pyspark在lambda内带有正则表达式的拆分字符串

Question

我正在尝试根据lambda函数中的正则表达式拆分字符串，字符串不会被拆分。我确定正则表达式正常。检查正则测试链接https://regex101.com/r/ryrio6/1

from pyspark.sql.functions import col,split
import re
r = re.compile(r"(?=sw+=)")
adsample = sc.textFile("hdfs://hostname/user/hdfs/sample/Log18Dec.txt")
splitted_sample = adsample.flatMap(lambda (x): ((v) for v in r.split(x)))
for m in splitted_sample.collect():
    print(m)

不确定我要在哪里出错。

文件中的示例行：

|RECEIVE|Low| eventId=139569 msg=W4N Alert :: Critical : Interface Utilization for GigabitEthernet0/1 90.0 % in=2442 out=0 categorySignificance=/Normal categoryBehavior=/Communicate/Query categoryDeviceGroup=/Application

正则应匹配键

之前的空间

输出

|RECEIVE|Low|
eventId=139569
msg=W4N Alert :: Critical : Interface Utilization for GigabitEthernet0/1 90.0 %
in=2442
out=0
categorySignificance=/Normal
categoryBehavior=/Communicate/Query
categoryDeviceGroup=/Application

Answer 1

from pyspark.sql.functions import col,split
import re
#r = re.compile(r"(?=sw+=)")
adsample = sc.textFile("hdfs://hostname/user/hdfs/sample/Log18Dec.txt")
splitted_sample = adsample.flatMap(lambda (x): ((v) for v in re.split('s+(?=w+=)',x)))
for m in splitted_sample.collect():
    print(m)