py4j.Py4JException:方法socketTextStream不存在



我是Spark Streaming的新手。使用PyCharm中的PySpark,我无法通过socketTextStream初始化。

def start_streaming (self):
sp = SparkContext('local[2]', 'streamingTest')
stream = StreamingContext(sp, 1)
**items = stream.socketTextStream('localhost', '9009')**
print(items)
lines = items.flatMap(lambda line : line.split('n'))

我收到以下错误。有什么问题吗?

Traceback(上次调用):文件"/Users/egorkorneev/PycharmProjects/BasicStreaming/SparkConsumer.py",第75行,在dc.start_streaming()文件中"/Users/egorkorneev/PycharmProjects/BasicStreaming/SparkConsumer.py",第40行,在start_streaming项目中=stream.socketTextStream("本地主机","9009")文件"/Users/egorkorneev/rnd/spark-1.6.1-in-hadoop2.6/python/pyspark/streaming/context.py",第352行,在socketTextStream返回中DStream(self._jssc.socketTextStream(主机名,端口,jlevel),self,文件"/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site packages/py4j/java_gateway.py",第933行,在呼叫应答中,self.gateway_client,self.target_id,self.name)文件"/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site packages/py4j/protocol.py",第316行,get_return_value格式(target_id,".",name,value))py4j.protocol.Py4JError:调用时出错o19.socketTextStream。跟踪:py4j。Py4JException:方法socketTextStream([class java.lang.String,class org.apache.spark.storage.StorageLevel])在中不存在py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:335)在py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:344)在py4j。位于的Gateway.invoke(Gateway.java:252)py4j.commands.AbstractCommand.invokeMethod(AbstractCmd.java:133)在py4j.commands.CallCommand.execute(CallCommand.java:79)py4j。GatewayConnection.run(GatewayConnection.java:209)位于java.lang.Thread.run(线程.java:745)

Spark 1.6.1

端口号应该是一个整数值。

items=stream.socketTextStream("本地主机",9009)

相关内容

  • 没有找到相关文章

最新更新