Python正则表达式跨多行查找所有

Question

在过去的一周里，我试图解决这个问题，但没有取得任何进展。非常感谢你们的帮助。

我有1000个文件，其中包含以下文本：

,,,,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,
Location:,,,ADDRESS_HERE_THAT I WANT
BUT IT CAN ALSO BE ACROSS,
MULTIPLE LINES, BUT NOT A SPECIFIC SET OF LINES,
AND IT ENDS AS ABRUPTLY,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,

但是一些文件也有这种方式

,,,,,,,,,,,,,,,,
Location:,,,ADDRESS,IS,IN,ONE,LINE,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,

我需要在Python中使用regex提取大写地址。

从技术上讲，它是一个CSV文件，由一个非常旧的系统导出。它实际上不能作为CSV使用，因此我选择提取字符串，假设它是纯文本文件。

我目前的代码是这样的，但我已经尝试了很多其他组合，但没有找到一个有效的解决方案。

location = re.findall(r'^Location:,,,(.*),,,,,,,,,,,,,n$|^Location:,,,(.*)[n.*]{1,2,3,4,5,6},,,,,,,,,,,,,', CSV, flags=re.DOTALL | re.MULTILINE)

我接近了吗？或者有更好的方法来解决这个问题吗？

我很感激在这里得到的任何帮助。

Answer 1

给定您提供的伪数据：

s = ''',,,,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,
Location:,,,ADDRESS_HERE_THAT I WANT
BUT IT CAN ALSO BE ACROSS,
MULTIPLE LINES, BUT NOT A SPECIFIC SET OF LINES,
AND IT ENDS AS ABRUPTLY,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,
Location:,,,ADDRESS,IS,IN,ONE,LINE,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,'''

您可以使用以下正则表达式：

matches = re.findall(r'Location:((?:[^,]*,){16})', s, flags=re.MULTILINE)

这就是比赛的样子：

>>> print('nn'.join(matches))
,,,ADDRESS_HERE_THAT I WANT
BUT IT CAN ALSO BE ACROSS,
MULTIPLE LINES, BUT NOT A SPECIFIC SET OF LINES,
AND IT ENDS AS ABRUPTLY,,,,,,,,,,
,,,ADDRESS,IS,IN,ONE,LINE,,,,,,,,,

接下来要做什么取决于原始文件中逗号的含义。例如，您可能希望用空格替换它们：

addrs = [match.replace(',', ' ').strip() for match in matches]

看起来像这样：

>>> print('nn'.join(addrs))
ADDRESS_HERE_THAT I WANT
BUT IT CAN ALSO BE ACROSS 
MULTIPLE LINES  BUT NOT A SPECIFIC SET OF LINES 
AND IT ENDS AS ABRUPTLY
ADDRESS IS IN ONE LINE

Answer 2

这里有一个想法：您可以使用简单的循环来检测和提取多行位置数据

# Test data
TEXT=""",,,,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,
Location:,,,ADDRESS_HERE_THAT I WANT
BUT IT CAN ALSO BE ACROSS,
MULTIPLE LINES, BUT NOT A SPECIFIC SET OF LINES,
AND IT ENDS AS ABRUPTLY,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,
Location:,,,ADDRESS,IS,IN,ONE,LINE,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,
"""
in_location = False
tmp_location = None
def extract_location(l):
global in_location
global tmp_location
if l.startswith("Location:"):
in_location = True
tmp_location = []
# special case
if l.endswith(',,,,,,,,,,,,,'):
print(l[13:-13])
in_location = False
else:
tmp_location.append(l[13:]) # Don't need 'Location:,,,'
else:
if in_location:
tmp_location.append(l)
if l.endswith(',,,,,,,,,,,,,'):
# The end
in_location = False
res =  " ".join(tmp_location)
print(res[0:-13])  # Remove trailing commas

def main():
for line in TEXT.split("n"):
extract_location(line)

if __name__ == "__main__":
main()

假设它被保存到一个名为concept.py，的文件中

$ python3 concept.py
DDRESS_HERE_THAT I WANT BUT IT CAN ALSO BE ACROSS, MULTIPLE LINES, BUT NOT A SPECIFIC SET OF LINES, AND IT ENDS AS ABRUPTLY
DDRESS,IS,IN,ONE,LINE