MCPcopy Create free account

hub / github.com/NanmiCoder/MediaCrawler / functions

Functions1,133 in github.com/NanmiCoder/MediaCrawler

Methodstart
Start the crawler Returns:
media_platform/tieba/core.py:62
Methodstart
(self)
media_platform/kuaishou/core.py:64
Methodstart
(self)
media_platform/xhs/core.py:65
Methodstart
(self)
media_platform/douyin/core.py:67
Functionstart_crawler
Start crawler task
api/routers/crawler.py:28
Functionstop_crawler
Stop crawler task
api/routers/crawler.py:41
Methodstore_comment
Store comment data to Excel Args: comment_item: Comment data dictionary
store/excel_store_base.py:259
Methodstore_comment
Zhihu comment CSV storage implementation Args: comment_item: comment item dict Returns:
store/zhihu/_store_impl.py:76
Methodstore_comment
comment JSON storage implementation Args: comment_item: Returns:
store/zhihu/_store_impl.py:158
Methodstore_comment
(self, comment_item: Dict)
store/zhihu/_store_impl.py:182
Methodstore_comment
Store comment to MongoDB Args: comment_item: Comment data
store/zhihu/_store_impl.py:220
Methodstore_comment
comment CSV storage implementation Args: comment_item: Returns:
store/bilibili/_store_impl.py:67
Methodstore_comment
comment JSON storage implementation Args: comment_item: Returns:
store/bilibili/_store_impl.py:230
Methodstore_comment
(self, comment_item: Dict)
store/bilibili/_store_impl.py:301
Methodstore_comment
Store comment to MongoDB Args: comment_item: Comment data
store/bilibili/_store_impl.py:353
Methodstore_comment
Weibo comment CSV storage implementation Args: comment_item: comment item dict Returns:
store/weibo/_store_impl.py:84
Methodstore_comment
comment JSON storage implementation Args: comment_item: Returns:
store/weibo/_store_impl.py:200
Methodstore_comment
(self, comment_item: Dict)
store/weibo/_store_impl.py:232
Methodstore_comment
Store comment to MongoDB Args: comment_item: Comment data
store/weibo/_store_impl.py:270
Methodstore_comment
tieba comment CSV storage implementation Args: comment_item: comment item dict Returns:
store/tieba/_store_impl.py:77
Methodstore_comment
tieba comment JSON storage implementation Args: comment_item: comment item dict Returns:
store/tieba/_store_impl.py:160
Methodstore_comment
(self, comment_item: Dict)
store/tieba/_store_impl.py:191
Methodstore_comment
Store comment to MongoDB Args: comment_item: Comment data
store/tieba/_store_impl.py:228
Methodstore_comment
Kuaishou comment CSV storage implementation Args: comment_item: comment item dict Returns:
store/kuaishou/_store_impl.py:76
Methodstore_comment
comment JSON storage implementation Args: comment_item: Returns:
store/kuaishou/_store_impl.py:155
Methodstore_comment
(self, comment_item: Dict)
store/kuaishou/_store_impl.py:178
Methodstore_comment
Store comment to MongoDB Args: comment_item: Comment data
store/kuaishou/_store_impl.py:213
Methodstore_comment
store comment data to csv file :param comment_item: :return:
store/xhs/_store_impl.py:55
Methodstore_comment
store comment data to json file :param comment_item: :return:
store/xhs/_store_impl.py:84
Methodstore_comment
(self, comment_item: Dict)
store/xhs/_store_impl.py:112
Methodstore_comment
Douyin comment CSV storage implementation Args: comment_item: comment item dict Returns:
store/douyin/_store_impl.py:64
Methodstore_comment
comment JSON storage implementation Args: comment_item: Returns:
store/douyin/_store_impl.py:161
Methodstore_comment
(self, comment_item: Dict)
store/douyin/_store_impl.py:204
Methodstore_comment
(self, comment_item: Dict)
base/base_crawler.py:93
Methodstore_comment
(self, comment_item)
tests/test_douyin_no_user_info.py:136
Methodstore_comment
(self, comment_item)
tests/test_kuaishou_no_user_info.py:108
Methodstore_contact
Store contact data to Excel (for platforms like Bilibili) Args: contact_item: Contact data dictionary
store/excel_store_base.py:299
Methodstore_contact
creator contact CSV storage implementation Args: contact_item: creator's contact item dict Returns:
store/bilibili/_store_impl.py:95
Methodstore_contact
(self, contact_item: Dict)
store/bilibili/_store_impl.py:181
Methodstore_contact
creator contact JSON storage implementation Args: contact_item: creator's contact item dict Returns:
store/bilibili/_store_impl.py:258
Methodstore_contact
(self, contact_item: Dict)
store/bilibili/_store_impl.py:313
Methodstore_content
Store content data to Excel Args: content_item: Content data dictionary
store/excel_store_base.py:237
Methodstore_content
Zhihu content CSV storage implementation Args: content_item: note item dict Returns:
store/zhihu/_store_impl.py:65
Methodstore_content
content JSON storage implementation Args: content_item: Returns:
store/zhihu/_store_impl.py:147
Methodstore_content
(self, content_item: Dict)
store/zhihu/_store_impl.py:179
Methodstore_content
Store content to MongoDB Args: content_item: Content data
store/zhihu/_store_impl.py:203
Methodstore_content
content CSV storage implementation Args: content_item: Returns:
store/bilibili/_store_impl.py:53
Methodstore_content
content JSON storage implementation Args: content_item: Returns:
store/bilibili/_store_impl.py:216
Methodstore_content
(self, content_item: Dict)
store/bilibili/_store_impl.py:295
Methodstore_content
Store video content to MongoDB Args: content_item: Video content data
store/bilibili/_store_impl.py:336
Methodstore_content
Weibo content CSV storage implementation Args: content_item: note item dict Returns:
store/weibo/_store_impl.py:73
Methodstore_content
content JSON storage implementation Args: content_item: Returns:
store/weibo/_store_impl.py:189
Methodstore_content
(self, content_item: Dict)
store/weibo/_store_impl.py:229
Methodstore_content
Store Weibo content to MongoDB Args: content_item: Weibo content data
store/weibo/_store_impl.py:253
Methodstore_content
tieba content CSV storage implementation Args: content_item: note item dict Returns:
store/tieba/_store_impl.py:66
Methodstore_content
tieba content JSON storage implementation Args: content_item: note item dict Returns:
store/tieba/_store_impl.py:149
Methodstore_content
(self, content_item: Dict)
store/tieba/_store_impl.py:188
Methodstore_content
Store post content to MongoDB Args: content_item: Post content data
store/tieba/_store_impl.py:211
Methodstore_content
Kuaishou content CSV storage implementation Args: content_item: note item dict Returns:
store/kuaishou/_store_impl.py:65
Methodstore_content
content JSON storage implementation Args: content_item: Returns:
store/kuaishou/_store_impl.py:144
Methodstore_content
(self, content_item: Dict)
store/kuaishou/_store_impl.py:175
Methodstore_content
Store video content to MongoDB Args: content_item: Video content data
store/kuaishou/_store_impl.py:196
Methodstore_content
store content data to csv file :param content_item: :return:
store/xhs/_store_impl.py:47
Methodstore_content
store content data to json file :param content_item: :return:
store/xhs/_store_impl.py:76
Methodstore_content
(self, content_item: Dict)
store/xhs/_store_impl.py:109
Methodstore_content
Douyin content CSV storage implementation Args: content_item: note item dict Returns:
store/douyin/_store_impl.py:50
Methodstore_content
content JSON storage implementation Args: content_item: Returns:
store/douyin/_store_impl.py:147
Methodstore_content
(self, content_item: Dict)
store/douyin/_store_impl.py:198
Methodstore_content
(self, content_item: Dict)
base/base_crawler.py:89
Methodstore_content
(self, content_item)
tests/test_douyin_no_user_info.py:133
Methodstore_content
(self, content_item)
tests/test_kuaishou_no_user_info.py:104
Methodstore_content
(self, content_item)
tests/test_weibo_no_user_info.py:99
Methodstore_creator
Store creator data to Excel Args: creator: Creator data dictionary
store/excel_store_base.py:279
Methodstore_creator
Creator profile is no longer persisted (teaching version: anti-harassment).
store/zhihu/_store_impl.py:87
Methodstore_creator
Creator profile is no longer persisted (teaching version: anti-harassment).
store/zhihu/_store_impl.py:169
Methodstore_creator
Creator profile is no longer persisted (teaching version: anti-harassment).
store/zhihu/_store_impl.py:185
Methodstore_creator
Creator profile is no longer persisted (teaching version: anti-harassment).
store/zhihu/_store_impl.py:237
Methodstore_creator
creator CSV storage implementation Args: creator: Returns:
store/bilibili/_store_impl.py:81
Methodstore_creator
(self, creator: Dict)
store/bilibili/_store_impl.py:177
Methodstore_creator
creator JSON storage implementation Args: creator: Returns:
store/bilibili/_store_impl.py:244
Methodstore_creator
(self, creator: Dict)
store/bilibili/_store_impl.py:307
Methodstore_creator
(self, creator_item: Dict)
store/bilibili/_store_impl.py:370
Methodstore_creator
Weibo creator CSV storage implementation 教学版:不采集/持久化创作者个人信息,空操作。 Args: creator: Returns:
store/weibo/_store_impl.py:95
Methodstore_creator
Weibo creator DB storage implementation 教学版:不采集/持久化创作者个人信息,空操作(WeiboCreator 表已删除)。 Args: creator: Return
store/weibo/_store_impl.py:171
Methodstore_creator
creator JSON storage implementation 教学版:不采集/持久化创作者个人信息,空操作。 Args: creator: Returns:
store/weibo/_store_impl.py:211
Methodstore_creator
(self, creator: Dict)
store/weibo/_store_impl.py:235
Methodstore_creator
Store creator information to MongoDB 教学版:不采集/持久化创作者个人信息,空操作。 Args: creator_item: Creator data
store/weibo/_store_impl.py:287
Methodstore_creator
tieba content CSV storage implementation Args: creator: creator dict Returns:
store/tieba/_store_impl.py:88
Methodstore_creator
(self, creator: Dict)
store/tieba/_store_impl.py:139
Methodstore_creator
tieba content JSON storage implementation Args: creator: creator dict Returns:
store/tieba/_store_impl.py:171
Methodstore_creator
(self, creator: Dict)
store/tieba/_store_impl.py:194
Methodstore_creator
(self, creator_item: Dict)
store/tieba/_store_impl.py:245
Methodstore_creator
(self, creator: Dict)
store/kuaishou/_store_impl.py:87
Methodstore_creator
(self, creator: Dict)
store/kuaishou/_store_impl.py:92
Methodstore_creator
(self, creator: Dict)
store/kuaishou/_store_impl.py:166
Methodstore_creator
(self, creator: Dict)
store/kuaishou/_store_impl.py:181
Methodstore_creator
(self, creator: Dict)
store/kuaishou/_store_impl.py:186
Methodstore_creator
(self, creator_item: Dict)
store/kuaishou/_store_impl.py:230
Methodstore_creator
(self, creator_item: Dict)
store/xhs/_store_impl.py:64
Methodstore_creator
(self, creator_item: Dict)
store/xhs/_store_impl.py:92
← previousnext →901–1,000 of 1,133, ranked by callers