尝试抓取电子邮件地址



我试图抓取这个网站

[www.united-church.ca/search/locator/all?keyw=&mission_units_ucc_ministry_type_advanced=10&locll=][1]

我确实刮到了,但我无法刮到电子邮件地址你能帮我刮一下吗?我用的是报废的

# -*- coding: utf-8 -*-
import scrapy
from ..items import ChurchItem

class ChurchSpiderSpider(scrapy.Spider):
name = 'church_spider'
page_number = 1
start_urls = ['https://www.united-church.ca/search/locator/all?keyw=&mission_units_ucc_ministry_type_advanced=10&locll=']
def parse(self, response):
items = ChurchItem()
container = response.css(".icon-ministry")
for t in container:
church_name = t.css(".field-name-locator-ministry-title a::text").extract()
church_phone = t.css(".field-name-field-phone::text").extract()
church_address = t.css(".thoroughfare::text").extract()
church_email = t.css(".field-name-field-mu-email span::text").extract()
items["church_name"] = church_name
items["church_phone"] = church_phone
items["church_address"] = church_address
items["church_email"] = church_email
yield items
# next_page = 'https://www.united-church.ca/search/locator/all?keyw=&mission_units_ucc_ministry_type_advanced=10&locll=&page=' + str(ChurchSpiderSpider.page_number)
# if ChurchSpiderSpider.page_number <= 110:
#     ChurchSpiderSpider.page_number += 1
#     yield response.follow(next_page, callback=self.parse)

我找到了一点解决方案,但仍然不完整现在的输出就像

{'church_address': ['7763 Highway 21'],
'church_email': ['herbklaehn', ' [at] ', 'gmail.com'],
'church_name': ['Allenford United Church'],
'church_phone': ['519-35-6232']}

你能帮我把[at]替换成@并把它组合成一个字符串吗?

加入列表元素并替换,

email = ''.join(church_email).replace(" [at] ","@")

最新更新