Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/ZSAIm/VideoCrawlerEngine
/ functions
Functions
584 in github.com/ZSAIm/VideoCrawlerEngine
⨍
Functions
584
◇
Types & classes
135
↳
Endpoints
20
↓ 71 callers
Method
get
(self, k, default=None)
helper/conf/base.py:179
↓ 49 callers
Method
items
(self)
helper/conf/base.py:170
↓ 33 callers
Method
append
追加工作节点。
request/layer/flow.py:194
↓ 29 callers
Function
get_conf
(__name: str)
helper/conf/base.py:43
↓ 26 callers
Method
get
返回指定版本的脚本。
app/script/manager.py:111
↓ 26 callers
Method
getdata
(self, key, default=None)
helper/payload/request.py:81
↓ 24 callers
Method
apply
(self, value)
helper/ctxtools/mgr.py:58
↓ 20 callers
Method
contextmanager
创建一个上下文管理器。
helper/ctxtools/mgr.py:282
↓ 20 callers
Method
upload
(self, **kwargs)
helper/payload/request.py:94
↓ 14 callers
Method
keys
(self)
helper/conf/base.py:173
↓ 12 callers
Method
submit
( self, fn: Callable, context: Dict = None, args: tuple = (), kwargs:
helper/worker/pool.py:92
↓ 10 callers
Function
cat_a5g
(a5g, cat_str='-')
utils/common.py:117
↓ 9 callers
Method
__lookup__
(self, item)
helper/ctxtools/mgr.py:352
↓ 9 callers
Method
close
(self)
helper/payload/request.py:110
↓ 9 callers
Method
run
(self, o, **options)
request/task.py:124
↓ 8 callers
Method
get
(self, default=UNDEFINED)
helper/ctxtools/mgr.py:76
↓ 8 callers
Function
get_worker
( name: str )
helper/worker/__init__.py:12
↓ 8 callers
Function
readable_file_size
(byte_size, precise=3)
utils/common.py:128
↓ 7 callers
Method
reset
(self)
helper/ctxtools/mgr.py:65
↓ 6 callers
Function
format_sum
(iterable, default=None)
app/taskflow/routers/helper/task.py:62
↓ 6 callers
Function
run_context_from_dict
运行
helper/ctxtools/mgr.py:335
↓ 6 callers
Method
shutdown
(self, wait=True)
helper/worker/pool.py:107
↓ 6 callers
Method
start_request
将请求交给工作线程池进行排队处理。 在转交工作线程处理之前将当前的上下文环境拷贝一份交给工作线程。 以保持上下文的连贯性。 Args; context: 该上下文管理器允许
helper/payload/request.py:165
↓ 6 callers
Method
values
(self)
helper/conf/base.py:176
↓ 5 callers
Method
_get_frame
(self)
request/helper/ffmpeg.py:81
↓ 5 callers
Method
add_stopper
停止器。
helper/payload/request.py:71
↓ 5 callers
Function
format_mul
(_val, _ratio=1, default=None)
app/taskflow/routers/helper/task.py:57
↓ 5 callers
Function
get_client
(name)
helper/client/base.py:18
↓ 5 callers
Method
iterdata
(self)
helper/payload/request.py:87
↓ 5 callers
Function
list
( offset: int = 0, limit: int = 9999, active_key: str = None, )
app/taskflow/routers/helper/task.py:34
↓ 5 callers
Method
request_get
(self, url, **kwargs)
repo/base.py:73
↓ 4 callers
Method
api_get
api json 请求。
repo/base.py:82
↓ 4 callers
Method
end_request
(self)
request/task.py:91
↓ 4 callers
Function
get_ctx
( context: Union[_InvokeChain, T], default: Union[Undefined, Any] = UNDEFINED )
helper/ctxtools/mgr.py:437
↓ 4 callers
Function
go_check
(o)
utils/common.py:85
↓ 4 callers
Function
goto_search
迭代搜索。注意在交叉嵌套的情况下会出现无限迭代的问题。 但事实上payload通常不存在交叉嵌套的情况。
helper/payload/flow.py:40
↓ 4 callers
Function
inline_prop
(name: str)
helper/payload/request.py:36
↓ 4 callers
Method
mktemp
(self, extension='')
request/helper/tempfile.py:35
↓ 4 callers
Method
report
(self, message)
helper/payload/request.py:132
↓ 4 callers
Method
setpoint
(self)
request/layer/flow.py:180
↓ 4 callers
Method
start
(self)
helper/payload/request.py:105
↓ 4 callers
Method
task_done
(self)
helper/payload/request.py:113
↓ 3 callers
Method
active
激活指定版本的脚本。
app/script/manager.py:129
↓ 3 callers
Function
conf_loader
(parser: ConfigParser, loaders: dict)
helper/conf/base.py:120
↓ 3 callers
Function
copy_context_to_dict
helper/ctxtools/mgr.py:312
↓ 3 callers
Method
default
()
helper/conf/script.py:42
↓ 3 callers
Function
dictify_payload
通过JSONEncoder简单处理JSON序列化对象问题。
helper/payload/resolve.py:98
↓ 3 callers
Function
download
下载请求 Args: uri: 下载uri headers: 指定下载请求头 multi_sources: 多下载源的添加方式。 [{'uri': 'http://xxx', 'headers': headers},
request/download.py:24
↓ 3 callers
Method
dump
(self, value: list)
helper/conf/base.py:314
↓ 3 callers
Method
execute_script
(self)
request/layer/script.py:33
↓ 3 callers
Method
feed_data
异步喂数据。
request/helper/stream.py:45
↓ 3 callers
Method
find_by_name
(self, name: str)
request/layer/flow.py:256
↓ 3 callers
Function
get_ep
返回入口点。
helper/worker/entrypoint.py:89
↓ 3 callers
Function
include_exception_handler
异常处理器。
app/helper/middleware/exchandler.py:58
↓ 3 callers
Function
manual_patch
单次补丁。
request/helper/stream.py:106
↓ 3 callers
Function
option
( content, descriptions=None )
helper/payload/cond.py:116
↓ 3 callers
Function
optional
( options: List[Any] )
helper/payload/cond.py:110
↓ 3 callers
Function
register_worker
( name: str, max_concurrent: int, async_type: bool, independent: bool, ep: Entrypoint,
helper/worker/__init__.py:18
↓ 3 callers
Method
request
处理URL资源。具体参数参考方法 requests.Session.request()。
repo/base.py:63
↓ 3 callers
Function
split_colon_keyword_dict
(s)
request/helper/ffmpeg.py:58
↓ 3 callers
Method
success
(self, message)
helper/payload/request.py:123
↓ 3 callers
Function
undictify_payload
( o: Any, idpls: Dict = None )
helper/payload/resolve.py:81
↓ 2 callers
Method
__init__
(self, sep: str = ',', **kwargs)
helper/conf/base.py:307
↓ 2 callers
Function
_encode
(o)
helper/payload/resolve.py:22
↓ 2 callers
Method
_file_metadata
(metadata_str)
request/helper/ffmpeg.py:107
↓ 2 callers
Function
_lookup_scope
(chain)
helper/ctxtools/mgr.py:415
↓ 2 callers
Method
_request_agent
(self, method, params)
helper/client/base.py:117
↓ 2 callers
Method
_responder
(self, resp: requests.Response)
helper/client/base.py:61
↓ 2 callers
Function
_unwrap_serial_flows
打开串行层中的工作流。
request/layer/flow.py:199
↓ 2 callers
Function
_worker
执行流程。
request/task.py:30
↓ 2 callers
Method
basename
(self)
request/helper/tempfile.py:15
↓ 2 callers
Function
compile_script
编译指定脚本。
app/script/manager.py:157
↓ 2 callers
Method
complete_length
(self)
request/helper/ffmpeg.py:228
↓ 2 callers
Function
deepCopyJsonObject
(obj)
app/html/src/helper/utils.js:36
↓ 2 callers
Method
end_request
结束请求。
helper/payload/request.py:188
↓ 2 callers
Method
error
(self, message)
helper/payload/request.py:119
↓ 2 callers
Method
error_handler
异常处理。
helper/payload/request.py:192
↓ 2 callers
Function
gen_linear_flow
生成payload的线性执行流程 Args: payload: rule:
helper/payload/request.py:420
↓ 2 callers
Function
gen_sign
(content: str, encoding='utf-8')
utils/common.py:124
↓ 2 callers
Function
get_pool
获取工作池。
helper/worker/pool.py:124
↓ 2 callers
Function
get_script
返回已经编译好的爬虫脚本对象。 :param script_name:脚本名称。若脚本名称带有版本号,那么将返回指定版本号的脚本,否则返回被激活的脚本。 version: 若None获取最新的版本。
app/script/manager.py:211
↓ 2 callers
Method
get_subflow
根据payload生成当前流程的子流程。
app/taskflow/taskmgr.py:167
↓ 2 callers
Method
getdata
(self, name, default=None)
helper/payload/request.py:196
↓ 2 callers
Function
include_middleware
(app: FastAPI, middleware, middleware_type='http')
app/helper/middleware/__init__.py:5
↓ 2 callers
Method
infodata
(self)
helper/payload/request.py:203
↓ 2 callers
Function
iter_conf
()
helper/conf/base.py:47
↓ 2 callers
Method
live_room
直播间信息。
repo/bilibili.py:291
↓ 2 callers
Function
lookup_chain_object
查找链式对象。
helper/ctxtools/mgr.py:147
↓ 2 callers
Method
objectmappingcontext
创建一个对象方法映射上下文管理器。
helper/ctxtools/mgr.py:294
↓ 2 callers
Function
parse_payload
( payload: BasePayload )
helper/payload/resolve.py:19
↓ 2 callers
Method
reload
(self)
helper/conf/base.py:182
↓ 2 callers
Method
reset
(self)
helper/ctxtools/mgr.py:200
↓ 2 callers
Method
reset
(self)
helper/ctxtools/mgr.py:253
↓ 2 callers
Function
run_app
(name, *args, **kwargs)
start.py:7
↓ 2 callers
Function
script_request
Args: url: 目标URL rule: 选择规则 prevent: 是否允许子脚本请求
request/script.py:92
↓ 2 callers
Function
split_name_version
返回分割的脚本名称,版本。
app/script/manager.py:324
↓ 2 callers
Method
stop
(self)
request/layer/flow.py:163
↓ 2 callers
Method
stop
(self)
app/taskflow/taskmgr.py:159
↓ 2 callers
Function
supported_script
返回能处理该URL的脚本名称-版本。 :param url: 提供要处理的URL。 with_version: 返回名称是否带有版本号。
app/script/manager.py:236
↓ 2 callers
Function
undictify_args
(o)
helper/payload/resolve.py:49
next →
1–100 of 584, ranked by callers