Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/OpenDCAI/DataFlow-MM
/ functions
Functions
991 in github.com/OpenDCAI/DataFlow-MM
⨍
Functions
991
◇
Types & classes
216
↓ 327 callers
Method
get
(self, name)
dataflow/utils/registry.py:107
↓ 188 callers
Method
step
(self)
dataflow/utils/storage.py:98
↓ 118 callers
Method
read
Read data from current file managed by storage. Args: output_type: Type that you want to read to, either "datafr
dataflow/utils/storage.py:153
↓ 101 callers
Function
get_logger
(level=logging.INFO)
dataflow/logger.py:14
↓ 80 callers
Method
write
Write data to current file managed by storage. data: Any, the data to write, it should be a dataframe, List[dict], etc.
dataflow/utils/storage.py:211
↓ 49 callers
Method
run
(self)
dataflow/statics/pipelines/gpu_pipelines/video_cotqa_pipeline.py:129
↓ 34 callers
Method
run
(self)
dataflow/statics/pipelines/api_pipelines/video_cotqa_api_pipeline.py:129
↓ 20 callers
Method
eval
( self, dataframe: pd.DataFrame, input_audio_key: str = "audio", input_conver
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:249
↓ 17 callers
Method
run
(self)
test/test_video_cotqa_generator.py:47
↓ 16 callers
Method
generate_from_input_messages
批量生成文本,支持对话历史格式,与 local_model_vlm_serving 接口对齐 :param conversations: 对话历史列表,每个元素是一个对话历史 格式:[[{"
dataflow/serving/api_vlm_serving_openai.py:869
↓ 15 callers
Function
check_column_exists
(clip, column, condition_name)
dataflow/operators/core_vision/filter/video_score_filter.py:42
↓ 15 callers
Method
keys
(self)
dataflow/utils/registry.py:153
↓ 13 callers
Method
build_prompt
Generate prompt using custom template.
dataflow/prompts/video.py:93
↓ 9 callers
Method
decode
(self, tokens)
dataflow/operators/core_vision/eval/image_text/model/simple_tokenizer.py:129
↓ 9 callers
Method
to_dict
(self)
dataflow/operators/core_vision/filter/video_scene_filter.py:105
↓ 8 callers
Method
close
(self)
dataflow/operators/core_audio/generaterow/audio_timestamp_chunk_row_generator.py:223
↓ 7 callers
Method
create
(cls, index, value, numbering_type=NUMBERING_TYPES[1], small_unit=False)
dataflow/operators/core_audio/refine/cn_tn.py:421
↓ 7 callers
Function
num2chn
(number_string, numbering_type=NUMBERING_TYPES[1], big=False, traditional=False, alt_zero=False, a
dataflow/operators/core_audio/refine/cn_tn.py:647
↓ 6 callers
Method
__init__
(self, embed_dim: int, # vision image_resolution: int,
dataflow/operators/core_vision/eval/image_text/model/model_longclip.py:244
↓ 5 callers
Method
__str__
(self)
dataflow/operators/core_audio/refine/cn_tn.py:397
↓ 5 callers
Function
_load_image
Load image from various formats (path, bytes, PIL Image). Args: image_data: Image in various formats Return
dataflow/utils/utils.py:27
↓ 5 callers
Method
cardinal2chntext
(self)
dataflow/operators/core_audio/refine/cn_tn.py:760
↓ 5 callers
Method
encode_image
(self, image)
dataflow/operators/core_vision/eval/image_text/model/model_longclip.py:353
↓ 5 callers
Method
generate_from_input
Generate data from input. input: List[str], the input of the generator
dataflow/core/LLMServing.py:9
↓ 5 callers
Function
generate_import_structure_from_type_checking
(source_file: str, base_path: str)
dataflow/utils/registry.py:17
↓ 5 callers
Method
read
(self, name: str)
test/test_vision_seg_refiner.py:9
↓ 4 callers
Method
_make_layer
(self, planes, blocks, stride=1)
dataflow/operators/core_vision/eval/image_text/model/model_longclip.py:129
↓ 4 callers
Function
_node_get
Gets attributes of a node which is polymorphic over return type. From https://github.com/pytorch/pytorch/pull/82628
dataflow/operators/core_vision/eval/image_text/model/longclip.py:79
↓ 4 callers
Function
_transform
(n_px)
dataflow/operators/core_vision/eval/image_text/model/longclip.py:35
↓ 4 callers
Function
chn2num
(chinese_string, numbering_type=NUMBERING_TYPES[1])
dataflow/operators/core_audio/refine/cn_tn.py:560
↓ 4 callers
Function
copy_files_recursively
Recursively copy all contents from source_path to destination_path. Prompts user if a file already exists in destination.
dataflow/cli_funcs/copy_funcs.py:54
↓ 4 callers
Method
encode_text
(self, text)
dataflow/operators/core_vision/eval/image_text/model/model_longclip.py:356
↓ 4 callers
Method
normalize_number
Convert string to float, handling commas.
dataflow/operators/core_vision/eval/general_text_answer_evaluator.py:55
↓ 4 callers
Function
normalize_whitespace
Collapse whitespace to single spaces and trim.
dataflow/operators/core_vision/refine/wiki_qa_refiner.py:8
↓ 4 callers
Function
pad_global_batch_stats
(sen_batch, stats_dict, device)
dataflow/utils/utils.py:386
↓ 4 callers
Function
patch_device
(module)
dataflow/operators/core_vision/eval/image_text/model/longclip.py:87
↓ 4 callers
Function
patch_float
(module)
dataflow/operators/core_vision/eval/image_text/model/longclip.py:111
↓ 4 callers
Method
run
(self, storage: DataFlowStorage, input_conversation_key: str = "conversation",
dataflow/operators/core_vision/generate/prompted_vqa_generator.py:39
↓ 4 callers
Method
run
( self, storage: DataFlowStorage, input_video_key: str = "video", output_key:
dataflow/statics/playground/video_ocr_filter_pipeline.py:43
↓ 4 callers
Function
time_to_frame
(time)
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:472
↓ 3 callers
Method
__init__
(self, date=None, chntext=None)
dataflow/operators/core_audio/refine/cn_tn.py:836
↓ 3 callers
Method
_convert_output
Convert dataframe to requested output type.
dataflow/utils/storage.py:145
↓ 3 callers
Method
_encode_image_to_base64
Read an image file and convert it to a base64-encoded string, returning the image data and MIME format. :param image_path: Path to t
dataflow/serving/api_vlm_serving_openai.py:61
↓ 3 callers
Method
_entail_prob
(self, premise: str, hypothesis: str)
dataflow/operators/core_vision/filter/image_cat_filter.py:105
↓ 3 callers
Function
_gather_all
Gather python objects across ranks into a list of length `world_size`.
dataflow/operators/core_vision/eval/video_aesthetic_evaluator.py:67
↓ 3 callers
Function
_gather_all
Gather python objects across ranks into a list of length `world_size`.
dataflow/operators/core_vision/eval/video_ocr_evaluator.py:58
↓ 3 callers
Function
_gather_all
Gather python objects across ranks into a list of length `world_size`.
dataflow/operators/core_vision/eval/video_luminance_evaluator.py:60
↓ 3 callers
Method
_init_loaders
(self)
dataflow/utils/registry.py:75
↓ 3 callers
Method
_load_image_for_gemini
Load image file, return PIL Image object (Gemini API can directly accept PIL Image)
dataflow/serving/api_image_gen_serving.py:371
↓ 3 callers
Method
_normalize
去掉_ . -等特殊字符,并转换为小写
dataflow/utils/registry.py:286
↓ 3 callers
Function
_process_text_chain
(chain: List[str])
dataflow/operators/core_text/refine/mcts_tree_refiner.py:11
↓ 3 callers
Function
_read_audio_local
(path: str, sr: Optional[int] = DEFAULT_SR)
dataflow/utils/audio.py:23
↓ 3 callers
Function
_read_audio_remote
(path: str, sr: Optional[int] = DEFAULT_SR)
dataflow/utils/audio.py:15
↓ 3 callers
Function
_remove_captions
Remove caption-related references and replace with video-related terms.
test/test_long_video_cotqa_generator.py:136
↓ 3 callers
Function
_remove_captions
Remove caption-related references and replace with video-related terms.
dataflow/statics/pipelines/api_pipelines/video_longvideo_cotqa_api_pipeline.py:131
↓ 3 callers
Function
_video_stem
(video_path: str)
dataflow/operators/core_vision/eval/video_aesthetic_evaluator.py:64
↓ 3 callers
Function
_video_stem
Get video filename without extension.
dataflow/operators/core_vision/eval/video_ocr_evaluator.py:54
↓ 3 callers
Function
_video_stem
(video_path: str)
dataflow/operators/core_vision/eval/video_luminance_evaluator.py:57
↓ 3 callers
Method
encode
(self, text)
dataflow/operators/core_vision/eval/image_text/model/simple_tokenizer.py:121
↓ 3 callers
Method
format_response
(self, response: dict)
dataflow/serving/api_llm_serving_request.py:33
↓ 3 callers
Method
get_dataflow_dir
()
dataflow/cli_funcs/paths.py:12
↓ 3 callers
Function
pad_local_batch_stats
(sen_batch, stats_dict, device)
dataflow/utils/utils.py:353
↓ 3 callers
Method
run
这里写一份通用的 run 文档也可以, 不写的话会被下面动态拷贝原 operator.run 的 __doc__。
dataflow/wrapper/batch_wrapper.py:13
↓ 3 callers
Method
write
(self, df: pd.DataFrame)
test/test_vision_seg_refiner.py:11
↓ 2 callers
Method
_build_gemini_prompt
Extract prompt text from user_input
dataflow/serving/api_image_gen_serving.py:363
↓ 2 callers
Method
_conversation_to_message
将格式1的数据转换为格式2。 支持多轮对话和多模态(图片、视频、音频),并验证token数量。
dataflow/io/whisper/whisper.py:55
↓ 2 callers
Method
_create_messages
Wrap content items into the standard OpenAI messages structure. :param content: List of content dicts (text/image elements).
dataflow/serving/api_vlm_serving_openai.py:183
↓ 2 callers
Method
_do_register
(self, name, obj)
dataflow/utils/registry.py:84
↓ 2 callers
Method
_encode_audio_to_base64_from_path
将音频文件编码为 base64 字符串 :param audio_path: 音频文件路径 :return: base64 编码的字符串
dataflow/serving/api_vlm_serving_openai.py:522
↓ 2 callers
Method
_encode_image_to_base64_from_path
将图像文件编码为 base64 字符串 :param image_path: 图像文件路径 :return: base64 编码的字符串
dataflow/serving/api_vlm_serving_openai.py:502
↓ 2 callers
Method
_encode_video_to_base64_from_path
将视频文件编码为 base64 字符串 :param video_path: 视频文件路径 :return: base64 编码的字符串
dataflow/serving/api_vlm_serving_openai.py:512
↓ 2 callers
Function
_ensure_dir
(path: str)
dataflow/operators/core_vision/filter/video_frame_filter.py:54
↓ 2 callers
Function
_first_path
Normalize a cell that may be str or [str] into a plain path string.
dataflow/operators/core_vision/eval/video_aesthetic_evaluator.py:56
↓ 2 callers
Function
_first_path
Normalize a cell that may be str or [str] into a plain path string.
dataflow/operators/core_vision/eval/video_ocr_evaluator.py:46
↓ 2 callers
Function
_first_path
Normalize a cell that may be str or [str] into a plain path string.
dataflow/operators/core_vision/eval/video_luminance_evaluator.py:49
↓ 2 callers
Method
_generate_single
Generate response for a single input with retry logic. Args: user_input: User input text system_prompt: Syste
dataflow/serving/lite_llm_serving.py:204
↓ 2 callers
Method
_get_all
(self)
dataflow/utils/registry.py:170
↓ 2 callers
Method
_get_cache_file_path
(self, step)
dataflow/utils/storage.py:88
↓ 2 callers
Function
_get_video_length_opencv
Get video frame count using OpenCV. method: - "header": use metadata header (fast, may be unreliable in some codecs) - "set"
dataflow/operators/core_vision/filter/video_info_filter.py:55
↓ 2 callers
Method
_guess_audio_format
给 Chat Completions 的 input_audio.format 用的格式字符串 常见:wav / mp3 / m4a / ogg / webm / flac / aac
dataflow/serving/api_vlm_serving_openai.py:532
↓ 2 callers
Method
_import_all
(self)
dataflow/utils/registry.py:228
↓ 2 callers
Function
_inject_luminance_into_dataframe
Write luminance stats back into df[video_clips_key]["clips"][clip_idx]: clip["luminance_mean"], clip["luminance_min"], clip["luminance_ma
dataflow/operators/core_vision/eval/video_luminance_evaluator.py:236
↓ 2 callers
Function
_inject_ocr_into_dataframe
Write OCR scores back into df[video_clips_key]["clips"][clip_idx]: clip["ocr_score"]
dataflow/operators/core_vision/eval/video_ocr_evaluator.py:317
↓ 2 callers
Function
_inject_ocr_into_dataframe_row_level
Write row-level OCR score back into df[output_key].
dataflow/operators/core_vision/eval/video_ocr_evaluator.py:337
↓ 2 callers
Function
_inject_row_level_luminance_into_dataframe
Write row-level stats back into df columns: - luminance_mean, luminance_min, luminance_max
dataflow/operators/core_vision/eval/video_luminance_evaluator.py:257
↓ 2 callers
Function
_inject_row_level_scores_into_dataframe
( df: pd.DataFrame, output_key: str, row_indices: List[int], scores: List[float], )
dataflow/operators/core_vision/eval/video_aesthetic_evaluator.py:312
↓ 2 callers
Function
_inject_scores_into_dataframe
Write scores back into df[video_clips_key]["clips"][clip_idx]["aesthetic_score"]. This function mutates a copied dataframe and returns it.
dataflow/operators/core_vision/eval/video_aesthetic_evaluator.py:293
↓ 2 callers
Method
_load_class_from_file
从指定文件中加载类。 :param file_path: 脚本文件的路径 :param class_name: 类的名字 :return: 类对象
dataflow/utils/registry.py:232
↓ 2 callers
Method
_load_local_file
Load data from local file based on file type.
dataflow/utils/storage.py:106
↓ 2 callers
Method
_pack_latents
(latents, batch_size, num_channels_latents, height, width)
dataflow/serving/utils/diffusers/flux_kontext_pipeline.py:570
↓ 2 callers
Function
_parse_base
基础解析逻辑(内部复用)
dataflow/statics/pipelines/gpu_pipelines/image_gcot_pipeline.py:29
↓ 2 callers
Function
_parse_base
基础解析逻辑(内部复用)
dataflow/statics/pipelines/api_pipelines/image_gcot_api_pipeline.py:32
↓ 2 callers
Method
_parse_openai_response
Parse OpenAI image generation/editing response, return (key, image)
dataflow/serving/api_image_gen_serving.py:136
↓ 2 callers
Method
_prepare_latent_image_ids
(batch_size, height, width, device, dtype)
dataflow/serving/utils/diffusers/flux_kontext_pipeline.py:555
↓ 2 callers
Method
_process_audio
(args)
dataflow/operators/core_audio/generaterow/audio_timestamp_chunk_row_generator.py:238
↓ 2 callers
Function
_process_single_clip_row
对单条 clip 元信息执行切割。 仅当 row_dict['filtered'] == False 时执行;否则直接跳过。 如果 'filtered' 字段不存在,默认为 False(不过滤)。 返回 (row_list, valid);valid=True 表示
dataflow/operators/core_vision/generate/video_clip_generator.py:42
↓ 2 callers
Function
_process_single_video
Process one video path: - detect scenes OR split by fixed interval - trim/split - build output dict with fps & scene entries
dataflow/operators/core_vision/filter/video_scene_filter.py:296
↓ 2 callers
Function
_read_audio_bytes
(data: bytes, sr: Optional[int] = DEFAULT_SR)
dataflow/utils/audio.py:26
↓ 2 callers
Method
_resolve_image_paths
Resolve image paths (supports single path or list of paths). If relative paths, resolve them relative to base_dir.
dataflow/operators/core_vision/generate/prompted_image_edit_generator.py:41
↓ 2 callers
Function
_safe_duration
Compute duration in seconds from num_frames and fps if both are valid.
dataflow/operators/core_vision/filter/video_info_filter.py:199
next →
1–100 of 991, ranked by callers