MCPcopy Create free account

hub / github.com/ZSAIm/VideoCrawlerEngine / functions

Functions584 in github.com/ZSAIm/VideoCrawlerEngine

↓ 71 callersMethodget
(self, k, default=None)
helper/conf/base.py:179
↓ 49 callersMethoditems
(self)
helper/conf/base.py:170
↓ 33 callersMethodappend
追加工作节点。
request/layer/flow.py:194
↓ 29 callersFunctionget_conf
(__name: str)
helper/conf/base.py:43
↓ 26 callersMethodget
返回指定版本的脚本。
app/script/manager.py:111
↓ 26 callersMethodgetdata
(self, key, default=None)
helper/payload/request.py:81
↓ 24 callersMethodapply
(self, value)
helper/ctxtools/mgr.py:58
↓ 20 callersMethodcontextmanager
创建一个上下文管理器。
helper/ctxtools/mgr.py:282
↓ 20 callersMethodupload
(self, **kwargs)
helper/payload/request.py:94
↓ 14 callersMethodkeys
(self)
helper/conf/base.py:173
↓ 12 callersMethodsubmit
( self, fn: Callable, context: Dict = None, args: tuple = (), kwargs:
helper/worker/pool.py:92
↓ 10 callersFunctioncat_a5g
(a5g, cat_str='-')
utils/common.py:117
↓ 9 callersMethod__lookup__
(self, item)
helper/ctxtools/mgr.py:352
↓ 9 callersMethodclose
(self)
helper/payload/request.py:110
↓ 9 callersMethodrun
(self, o, **options)
request/task.py:124
↓ 8 callersMethodget
(self, default=UNDEFINED)
helper/ctxtools/mgr.py:76
↓ 8 callersFunctionget_worker
( name: str )
helper/worker/__init__.py:12
↓ 8 callersFunctionreadable_file_size
(byte_size, precise=3)
utils/common.py:128
↓ 7 callersMethodreset
(self)
helper/ctxtools/mgr.py:65
↓ 6 callersFunctionformat_sum
(iterable, default=None)
app/taskflow/routers/helper/task.py:62
↓ 6 callersFunctionrun_context_from_dict
运行
helper/ctxtools/mgr.py:335
↓ 6 callersMethodshutdown
(self, wait=True)
helper/worker/pool.py:107
↓ 6 callersMethodstart_request
将请求交给工作线程池进行排队处理。 在转交工作线程处理之前将当前的上下文环境拷贝一份交给工作线程。 以保持上下文的连贯性。 Args; context: 该上下文管理器允许
helper/payload/request.py:165
↓ 6 callersMethodvalues
(self)
helper/conf/base.py:176
↓ 5 callersMethod_get_frame
(self)
request/helper/ffmpeg.py:81
↓ 5 callersMethodadd_stopper
停止器。
helper/payload/request.py:71
↓ 5 callersFunctionformat_mul
(_val, _ratio=1, default=None)
app/taskflow/routers/helper/task.py:57
↓ 5 callersFunctionget_client
(name)
helper/client/base.py:18
↓ 5 callersMethoditerdata
(self)
helper/payload/request.py:87
↓ 5 callersFunctionlist
( offset: int = 0, limit: int = 9999, active_key: str = None, )
app/taskflow/routers/helper/task.py:34
↓ 5 callersMethodrequest_get
(self, url, **kwargs)
repo/base.py:73
↓ 4 callersMethodapi_get
api json 请求。
repo/base.py:82
↓ 4 callersMethodend_request
(self)
request/task.py:91
↓ 4 callersFunctionget_ctx
( context: Union[_InvokeChain, T], default: Union[Undefined, Any] = UNDEFINED )
helper/ctxtools/mgr.py:437
↓ 4 callersFunctiongo_check
(o)
utils/common.py:85
↓ 4 callersFunctiongoto_search
迭代搜索。注意在交叉嵌套的情况下会出现无限迭代的问题。 但事实上payload通常不存在交叉嵌套的情况。
helper/payload/flow.py:40
↓ 4 callersFunctioninline_prop
(name: str)
helper/payload/request.py:36
↓ 4 callersMethodmktemp
(self, extension='')
request/helper/tempfile.py:35
↓ 4 callersMethodreport
(self, message)
helper/payload/request.py:132
↓ 4 callersMethodsetpoint
(self)
request/layer/flow.py:180
↓ 4 callersMethodstart
(self)
helper/payload/request.py:105
↓ 4 callersMethodtask_done
(self)
helper/payload/request.py:113
↓ 3 callersMethodactive
激活指定版本的脚本。
app/script/manager.py:129
↓ 3 callersFunctionconf_loader
(parser: ConfigParser, loaders: dict)
helper/conf/base.py:120
↓ 3 callersFunctioncopy_context_to_dict
helper/ctxtools/mgr.py:312
↓ 3 callersMethoddefault
()
helper/conf/script.py:42
↓ 3 callersFunctiondictify_payload
通过JSONEncoder简单处理JSON序列化对象问题。
helper/payload/resolve.py:98
↓ 3 callersFunctiondownload
下载请求 Args: uri: 下载uri headers: 指定下载请求头 multi_sources: 多下载源的添加方式。 [{'uri': 'http://xxx', 'headers': headers},
request/download.py:24
↓ 3 callersMethoddump
(self, value: list)
helper/conf/base.py:314
↓ 3 callersMethodexecute_script
(self)
request/layer/script.py:33
↓ 3 callersMethodfeed_data
异步喂数据。
request/helper/stream.py:45
↓ 3 callersMethodfind_by_name
(self, name: str)
request/layer/flow.py:256
↓ 3 callersFunctionget_ep
返回入口点。
helper/worker/entrypoint.py:89
↓ 3 callersFunctioninclude_exception_handler
异常处理器。
app/helper/middleware/exchandler.py:58
↓ 3 callersFunctionmanual_patch
单次补丁。
request/helper/stream.py:106
↓ 3 callersFunctionoption
( content, descriptions=None )
helper/payload/cond.py:116
↓ 3 callersFunctionoptional
( options: List[Any] )
helper/payload/cond.py:110
↓ 3 callersFunctionregister_worker
( name: str, max_concurrent: int, async_type: bool, independent: bool, ep: Entrypoint,
helper/worker/__init__.py:18
↓ 3 callersMethodrequest
处理URL资源。具体参数参考方法 requests.Session.request()。
repo/base.py:63
↓ 3 callersFunctionsplit_colon_keyword_dict
(s)
request/helper/ffmpeg.py:58
↓ 3 callersMethodsuccess
(self, message)
helper/payload/request.py:123
↓ 3 callersFunctionundictify_payload
( o: Any, idpls: Dict = None )
helper/payload/resolve.py:81
↓ 2 callersMethod__init__
(self, sep: str = ',', **kwargs)
helper/conf/base.py:307
↓ 2 callersFunction_encode
(o)
helper/payload/resolve.py:22
↓ 2 callersMethod_file_metadata
(metadata_str)
request/helper/ffmpeg.py:107
↓ 2 callersFunction_lookup_scope
(chain)
helper/ctxtools/mgr.py:415
↓ 2 callersMethod_request_agent
(self, method, params)
helper/client/base.py:117
↓ 2 callersMethod_responder
(self, resp: requests.Response)
helper/client/base.py:61
↓ 2 callersFunction_unwrap_serial_flows
打开串行层中的工作流。
request/layer/flow.py:199
↓ 2 callersFunction_worker
执行流程。
request/task.py:30
↓ 2 callersMethodbasename
(self)
request/helper/tempfile.py:15
↓ 2 callersFunctioncompile_script
编译指定脚本。
app/script/manager.py:157
↓ 2 callersMethodcomplete_length
(self)
request/helper/ffmpeg.py:228
↓ 2 callersFunctiondeepCopyJsonObject
(obj)
app/html/src/helper/utils.js:36
↓ 2 callersMethodend_request
结束请求。
helper/payload/request.py:188
↓ 2 callersMethoderror
(self, message)
helper/payload/request.py:119
↓ 2 callersMethoderror_handler
异常处理。
helper/payload/request.py:192
↓ 2 callersFunctiongen_linear_flow
生成payload的线性执行流程 Args: payload: rule:
helper/payload/request.py:420
↓ 2 callersFunctiongen_sign
(content: str, encoding='utf-8')
utils/common.py:124
↓ 2 callersFunctionget_pool
获取工作池。
helper/worker/pool.py:124
↓ 2 callersFunctionget_script
返回已经编译好的爬虫脚本对象。 :param script_name:脚本名称。若脚本名称带有版本号,那么将返回指定版本号的脚本,否则返回被激活的脚本。 version: 若None获取最新的版本。
app/script/manager.py:211
↓ 2 callersMethodget_subflow
根据payload生成当前流程的子流程。
app/taskflow/taskmgr.py:167
↓ 2 callersMethodgetdata
(self, name, default=None)
helper/payload/request.py:196
↓ 2 callersFunctioninclude_middleware
(app: FastAPI, middleware, middleware_type='http')
app/helper/middleware/__init__.py:5
↓ 2 callersMethodinfodata
(self)
helper/payload/request.py:203
↓ 2 callersFunctioniter_conf
()
helper/conf/base.py:47
↓ 2 callersMethodlive_room
直播间信息。
repo/bilibili.py:291
↓ 2 callersFunctionlookup_chain_object
查找链式对象。
helper/ctxtools/mgr.py:147
↓ 2 callersMethodobjectmappingcontext
创建一个对象方法映射上下文管理器。
helper/ctxtools/mgr.py:294
↓ 2 callersFunctionparse_payload
( payload: BasePayload )
helper/payload/resolve.py:19
↓ 2 callersMethodreload
(self)
helper/conf/base.py:182
↓ 2 callersMethodreset
(self)
helper/ctxtools/mgr.py:200
↓ 2 callersMethodreset
(self)
helper/ctxtools/mgr.py:253
↓ 2 callersFunctionrun_app
(name, *args, **kwargs)
start.py:7
↓ 2 callersFunctionscript_request
Args: url: 目标URL rule: 选择规则 prevent: 是否允许子脚本请求
request/script.py:92
↓ 2 callersFunctionsplit_name_version
返回分割的脚本名称,版本。
app/script/manager.py:324
↓ 2 callersMethodstop
(self)
request/layer/flow.py:163
↓ 2 callersMethodstop
(self)
app/taskflow/taskmgr.py:159
↓ 2 callersFunctionsupported_script
返回能处理该URL的脚本名称-版本。 :param url: 提供要处理的URL。 with_version: 返回名称是否带有版本号。
app/script/manager.py:236
↓ 2 callersFunctionundictify_args
(o)
helper/payload/resolve.py:49
next →1–100 of 584, ranked by callers