create bilibili client :param httpx_proxy: httpx proxy :return: bilibili client

Create douyin client

Create index: keys=[("field", 1)]

Create ks client

Create tieba client with real browser User-Agent and complete headers Args: httpx_proxy: HTTP proxy ip_pool:

Create xhs client

Create Xiaohongshu client

Create zhihu client

Detect available browser paths in system Returns list of browser paths sorted by priority

extract zhihu answer content from html Args: html_content: Returns:

extract zhihu article content from html Args: html_content: Returns:

extract zhihu contents Args: json_data: zhihu json data Returns:

extract zhihu creator Args: user_url_token : zhihu creator url token html_content: zhihu creator html content

Extract Tieba creator information from creator homepage Args: html_content: HTML string of creator homepage Retu

Extract user information from HTML Args: html (str): HTML string Returns: Dict: User information dictionary

Extract follow count and fan count from selectors Args: selectors: List of selector objects Returns:

Extract IP location from HTML content Args: html_content: HTML string Returns: IP location string

Extract note details from HTML Args: html (str): HTML string Returns: Dict: Note details dictionary

Extract Tieba age from HTML content Example: "<span>吧龄:1.9年</span>" Returns: "1.9年" Args: html_content:

Extract post ID list from Tieba creator's homepage Args: html_content: HTML string of creator homepage Returns:

Extract verification code of 6 digits from the SMS.

extract zhihu zvideo content from html Args: html_content: Returns:

Filter Weibo search results, only keep data with card_type of 9 :param card_list: List of card items from search results :return: Filtere

Find available port

Find position to insert copyright declaration Args: lines: List of file content lines Returns: (insert line number, whe

Find all Python files Args: root_dir: Root directory exclude_patterns: Directory patterns to exclude Returns: L

Generate copyright declaration header Args: relative_path: File path relative to project root Returns: Formatted copyri

Generate wordcloud from comments data Only works when ENABLE_GET_WORDCLOUD and ENABLE_GET_COMMENTS are True

Get a_bogus parameter, currently does not support POST request type signature

Get a_bogus parameter through js Args: url: params: user_agent: Returns:

Get all answers by creator Args: url_token: Creator url token (in-memory only, not persisted) crawl_interval:

creator_url_list: get details for creator from creator URL list

Get all posts published by specified user, this method will continuously find all post information under a user Args: use

Get all posts published by a specified user, this method will continuously fetch all posts from a user Args: creator_id:

Get all posts published by the specified user, this method will continue to find all post information under a user Args:

Get answer information Args: question_id: answer_id: Returns:

Get article information Args: article_id: Returns:

获取帖子的所有评论，包括子评论 :param aweme_id: 帖子ID :param crawl_interval: 抓取间隔 :param is_fetch_sub_comments: 是否抓取子评论 :para

get note comments

get aweme images. please use get_aweme_media Args: aweme_item (Dict): 抖音作品详情

get aweme videos. please use get_aweme_media Args: aweme_item (Dict): 抖音作品详情

Get child comments under a root comment Args: root_comment_id: offset: limit: order_b

Get client

Get note comments with keyword filtering and quantity limitation Args: content_item: semaphore: Retu

get comment for video id :param video_id: :param semaphore: :return:

get comment for video id :param video_id: :param semaphore: :return:

Get note comments with keyword filtering and quantity limitation

Get all sub-comments under specified comments Args: content: Content detail object (question|article|video) c

Get all sub-comments of comments Args: note_id: comment_list: callback: Returns:

Get all sub-comments for specified comments (uses Playwright to access page, avoiding API detection) Args: comments: Comm

Get all second-level comments under specified first-level comments (V2 REST API) Args: comments: Comment list

Get all second-level comments under specified first-level comments, this method will continuously find all second-level comment information u

Get comments async task Args: note_detail: semaphore: Returns:

get creator all followings :param creator_info: :param crawl_interval: :param callback: :param max_count: Max

get creator all fans :param creator_info: :param crawl_interval: :param callback: :param max_count: Maximum n

get creator all followings :param creator_info: :param crawl_interval: :param callback: :param max_count: Max

Get creator's answers Args: url_token: offset: limit: Returns:

Get creator's articles Args: url_token: offset: limit: Returns:

get details for creator id :param creator_id: :param semaphore: :return:

get creator comments :param creator_id: Creator ID :param offset: Parameter required for sending request :return:

get creator fans :param creator_id: Creator ID :param pn: Start page number :param ps: Number of items per page

get creator followings :param creator_id: Creator ID :param pn: Start page number :param ps: Number of items per page

Get creator information Args: url_token: Returns:

get creator info :param creator_id: Creator ID

eg: https://www.kuaishou.com/profile/3x4jtnbfter525a Kuaishou user homepage

Get user profile brief information by parsing user homepage HTML The PC user homepage has window.__INITIAL_STATE__ variable, just par

Get user details by user ID Args: creator_id: Returns:

Get creator information by creator URL from current PC JSON API. Args: creator_url: Creator homepage URL Returns

Get creator's videos Args: url_token: offset: limit: Returns:

get videos for a creator :return:

Get creator's information and their notes and comments Returns:

Get creator's information and their notes and comments Returns:

Get creator's information and their notes and comments Returns:

Get creator's notes and retrieve their comment information.

Get creator's videos and retrieve their comment information.