format proxy info for playwright and httpx

Get the value of a key from the cache. This is an abstract method. Subclasses must implement this method. :param key: The key

Get a_bogus parameter through playwright playwright version is deprecated Returns:

Get all articles by creator Args: url_token: Creator url token (in-memory only, not persisted) crawl_interval

Get all creator posts by creator username Args: user_name: Creator username crawl_interval: Crawl delay inter

Get all videos by creator Args: url_token: Creator url token (in-memory only, not persisted) crawl_interval:

Get browser info (name and version)

Get all configuration options

Get current cookies

Get crawler status

Get user's container ID, container information represents the real API request path fid_container_id: Container ID for user's Wei

get all videos for a creator :param creator_id: Creator ID :param pn: Page number :param ps: Number of videos per page

Get current date: '2023-12-02' :return:

Get current time: '2023-12-02 13:01:23' :return:

Get current time with hour: '2023-12-02-13' :return:

Get data statistics

Unix integer timestamp ==> date string :param unixtime: :return:

get fans for creator id :param creator_info: :param semaphore: :return:

Get file content or preview

get followings for creator id :param creator_info: :param semaphore: :return:

Get recent logs

Get note short URL Args: note_id: Note ID Returns:

Get list of supported platforms

KuaiDaili implementation Args: num: Returns:

:param num: :return:

:param num: :return:

* 获取zhihu sign value 对python暴漏的接口 * @param url 请求的路由参数 * @param cookies 请求的cookies，需要包含dc0这个key * @returns {*}

Unix integer timestamp ==> datetime string :param unixtime: :return:

Generate trace id for link tracing

Time string ==> Unix integer timestamp, precise to seconds :param time_str: :return:

Get all keys matching the pattern :param pattern: Matching pattern :return:

Launch browser using CDP mode (optional implementation) :param playwright: playwright instance :param playwright_proxy: playw

Get data file list

MediaCrawler 命令行入口

CRC32 variant, used for x9 field in x-s-common

Construct JiSu HTTP instance Returns:

POST request with header signing Args: uri: Request route data: Request body parameters Returns:

Return project root path

Receive SMS notification and send it to Redis. Args: sms: { "platform": "xhs", "from_numb

Sample Xiaohongshu comment data for testing

Sample Xiaohongshu creator data for testing

Sample Xiaohongshu note data for testing

Save Zhihu creator information Args: creator: Returns:

Save creator information to local 教学版：为防骚扰不再采集/持久化创作者个人信息（昵称/性别/头像/简介/IP/粉丝数等）， 此入口保留为空操作以兼容调用方。user_id 仅在调用方局部用于抓取该创作者的微博。 Args:

Save creator information to local Args: user_info: Returns:

Save Xiaohongshu creator Args: user_id: creator: Returns:

Return frontend page

Set the value of a key in the cache. This is an abstract method. Subclasses must implement this method. :param key: The key

Setup and teardown for each test

parse base64 encode qrcode image and show it

takes in a URI (uniform resource identifier), an optional data dictionary, and an optional ctime parameter. It returns a dictionary containing tw

Signal handler

Start the crawler Returns: