MCPcopy Create free account

hub / github.com/aidenwang9867/Weibo-User-Depression-Detection-Dataset / types & classes

Types & classes16 in github.com/aidenwang9867/Weibo-User-Depression-Detection-Dataset

↓ 2 callersClassRelationshipItem
用户关系,只保留与关注的关系
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/items.py:44
↓ 1 callersClassCommentItem
微博评论信息
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/items.py:52
↓ 1 callersClassTweetItem
Tweet information
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/items.py:5
↓ 1 callersClassUserItem
User Information
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/items.py:23
↓ 1 callersClassWeibo
WU3D_crawler_preprocessing/Weibo_Spider/Spider1.0/user_spider.py:23
↓ 1 callersClassWeibo
WU3D_crawler_preprocessing/Weibo_Spider/Spider1.0/topic_spider.py:23
↓ 1 callersClassWeiboLogin
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/account/login.py:22
ClassCommentSpider
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/spiders/comment.py:18
ClassCookieMiddleware
每次请求都随机从账号池中选择一个账号去访问
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/middlewares.py:8
ClassFanSpider
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/spiders/fan.py:17
ClassFollowerSpider
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/spiders/follower.py:17
ClassIPProxyMiddleware
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/middlewares.py:50
ClassMongoDBPipeline
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/pipelines.py:8
ClassRedirectMiddleware
check account status HTTP Code = 302/418 -> cookie is expired or banned, and account status will change to 'error'
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/middlewares.py:27
ClassTweetSpider
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/spiders/tweet.py:18
ClassUserSpider
WU3D_crawler_preprocessing/Weibo_Spider/Spider2.0/weibospider/spiders/user.py:17