launch browser and create browser context :param chromium: chromium browser :param playwright_proxy: playwright proxy

Launch browser and create browser context

Launch browser and create browser Args: chromium: playwright_proxy: user_agent: headl

Launch browser and create browser context

Launch browser and create browser context

Launch browser and create browser context

Load IP proxies Returns:

贴近真实微博评论结构的 mock comment_item(含嵌套 user 信息)。

贴近真实 m.weibo.cn 接口结构的 mock note_item(含嵌套 user 信息)。

贴近真实快手结构的 video_item：author 在顶层，photo 含内容字段。 author.headerUrl 与各禁用字段一样不应进入存储 dict。

Parse creator ID from Kuaishou creator homepage URL Supports the following formats: 1. Creator homepage: "https://www.kuaishou.com/profil

Parse creator information from Xiaohongshu creator homepage URL Supports the following formats: 1. Full URL: "https://www.xiaohongshu.com

Parse creator ID (sec_user_id) from Douyin creator homepage URL Supports the following formats: 1. Creator homepage: https://www.douyin.c

Parse video ID from Kuaishou video URL Supports the following formats: 1. Full video URL: "https://www.kuaishou.com/short-video/3x3zxz4mj

Send request to sign request parameters Need to get wbi_img_urls parameter from localStorage, value as follows: https://i0.hd

Print difference report

Make REST API V2 request (for comment endpoints) :param uri: API endpoint path :param data: request body :return: res

search weibo note with keywords :return:

Search bilibili video with keywords in a given time range. :param daily_limit: if True, strictly limit the number of notes per day an

KuaiShou web search api :param keyword: Search keyword :param page: Page number for pagination :param page_size: Numb

start crawler

Stop crawler process

Synchronize ORM model to database

Update cookies method provided by API client, typically called after successful login Args: browser_context: Browser cont

Update cookies from browser context :param browser_context: Browser context :param urls: Optional list of URLs to filter cook

Apply formatting to header row Args: sheet: Worksheet object row_num: Row number for headers (default: 1)

Build URL query string with encoding matching browser behavior (commas not encoded)

Build content string to be signed Args: uri: API path data: Request data method: Request method (GET or POST) Return

Clean up cache based on expiration time :return:

Connect to an existing browser that already has remote debugging enabled. User needs to enable remote debugging via chrome://inspect/

Connect to redis, return redis client, configure redis connection information as needed :return:

Encode data chunk

extract zhihu comment Args: page_content: comment with content object comment: zhihu comment Returns

Extract comment image list Args: comment_item (Dict): Douyin comment Returns: List[str]: Comment image list

Extract video cover URL Args: aweme_detail (Dict): Douyin content details Returns: str: Video cover URL

Extract music download URL Args: aweme_detail (Dict): Douyin video Returns: str: Music download URL

Extract note image list Args: aweme_detail (Dict): Douyin content details Returns: List[str]: Note image list

Extract video download URL Args: aweme_detail (Dict): Douyin video Returns: str: Video download URL

Get browser path

Inject anti-detection JavaScript scripts For Baidu Tieba's special detection mechanism

Ensure bare --init_db defaults to sqlite for backward compatibility.

Validate if proxy IP is valid :param proxy: :return:

Launch browser process

Simulate real user access path: 1. First visit Baidu homepage (https://www.baidu.com/) 2. Wait for page to load 3. Cl

Accept a Tieba creator homepage URL or a portrait id.

Accept a raw Tieba thread id or a /p/<id> URL.

修复 xhshow 库 build_payload_array 中 a3_hash 计算的 bug。 xhshow 原实现对所有请求使用 MD5(extract_api_path(content_string)) 计算 a3_hash, 其中 extract_api_pat

Sign request headers Args: url: Request URL with query parameters Returns:

Asynchronously read process output

Register cleanup handlers to ensure browser process cleanup on program exit

Reload proxy pool :return:

Python implementation of JavaScript unsigned right shift (>>>)

Start scheduled cleanup task :return:

Start scheduled cleanup task :return:

Convert 24-bit integer to 4 Base64 characters

Add anti-detection script

Converts an integer to a base36 string.

Start login zhihu

Start login bilibili

Start login weibo

Start login baidutieba

Start login xiaohongshu

Start login xiaohongshu

Start login douyin website The verification accuracy of the slider verification is not very good... If there are no special r

Broadcast message to all connections

Check if the current login status is successful and return True otherwise return False Returns:

Check if the current login status is successful and return True otherwise return False retry decorator will retry 20 times if

Check if the current login status is successful and return True otherwise return False retry decorator will retry 20 times if

Poll to check if login status is successful, return True if successful, otherwise return False Returns:

Check if the current login status is successful and return True otherwise return False retry decorator will retry 20 times if

Check if the current login status is successful and return True otherwise return False

Clear whitespace from image, mainly clearing slider whitespace

Close browser context Returns: