Functions — github.com/DWJWendy/Weibo_Spider

CodeHub MCPcopy Create free account

hub / github.com/DWJWendy/Weibo_Spider / functions

Functions12 in github.com/DWJWendy/Weibo_Spider

⨍ Functions 12 ◇ Types & classes 2

↓ 4 callersFunctiongetData

# 封装一个用于get的函数，新浪微博这边get出来的内容编码都是-8，所以把utf-8写死在里边了，真实项目中建议根据内容实际编码来决定 :param url: 输入需要访问的url地址，返回text结果 :return:

program/Prelogin.py:21

↓ 1 callersFunctiondomain

program/main.py:20

↓ 1 callersMethodget_content

program/Spider.py:56

↓ 1 callersMethodget_page

program/Spider.py:41

↓ 1 callersMethodget_urls

program/Spider.py:28

↓ 1 callersFunctionlogin_weibo

program/Prelogin.py:50

↓ 1 callersFunctionmymain

program/main.py:32

↓ 1 callersFunctionpostData

# 封装一个用于post的函数，验证密码和用户名都是post的，所以这个postData在本demo中专门用于验证用户名和密码 :param url: :param data: :return:

program/Prelogin.py:34

↓ 1 callersMethodprocess_item

判断item的类型，并作相应的处理，再入数据库

program/Conn.py:20

program/Conn.py:14

program/Spider.py:18

Functionperform

program/main.py:28