MCPcopy Create free account
hub / github.com/Kr1s77/Python-crawler-tutorial-starts-from-zero / run

Method run

code_demo/Tieba.py:66–78  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

64 pass
65
66 def run(self):
67 # 1. 获取 url 列表
68 url_list = self.get_url_list()
69
70 for url in url_list:
71 # 2. 发送请求获取响应
72 content = self.get_content(url)
73 # 3. 从响应中提取数据
74 items = self.get_items(content, url_list.index(url) + 1)
75 # 4. 保存数据
76 self.save_items(items)
77
78 pass
79
80
81if __name__ == '__main__':

Callers 1

Tieba.pyFile · 0.80

Calls 4

get_url_listMethod · 0.95
get_contentMethod · 0.95
get_itemsMethod · 0.95
save_itemsMethod · 0.95

Tested by

no test coverage detected