MCPcopy Create free account

hub / github.com/OpenDCAI/DataFlow-MM / functions

Functions991 in github.com/OpenDCAI/DataFlow-MM

↓ 1 callersFunctionis_api_serving
(serving)
dataflow/operators/core_vision/refine/visual_dependency_refiner.py:16
↓ 1 callersFunctionis_api_serving
(serving)
dataflow/operators/core_vision/generate/personalized_qa_generator.py:22
↓ 1 callersFunctionis_api_serving
(serving)
dataflow/operators/core_vision/generate/batch_vqa_generator.py:14
↓ 1 callersFunctionis_api_serving
(serving)
dataflow/operators/core_vision/generate/fix_prompted_vqa_generator.py:14
↓ 1 callersFunctionis_api_serving
(serving)
dataflow/operators/core_vision/generate/visual_reasoning_generator.py:15
↓ 1 callersFunctionis_api_serving
(serving)
dataflow/operators/core_vision/generate/vlm_bbox_generator.py:14
↓ 1 callersFunctionis_api_serving
(serving)
dataflow/operators/core_vision/generate/prompt_templated_vqa_generator.py:15
↓ 1 callersFunctionis_api_serving
判断 serving 是否为 API 类型
dataflow/operators/core_vision/generate/prompted_vqa_generator.py:11
↓ 1 callersMethodis_clear
(self, gray: np.ndarray)
dataflow/operators/core_vision/filter/image_aesthetic_filter.py:75
↓ 1 callersMethodis_complex_caption
(self, caption: str)
dataflow/operators/core_vision/filter/image_cat_filter.py:132
↓ 1 callersMethodis_complex_caption
(self, doc)
dataflow/operators/core_vision/filter/cat_filter.py:70
↓ 1 callersMethodis_consistent
(self, caption: str, question: str, answer: str)
dataflow/operators/core_vision/filter/image_consistency_filter.py:70
↓ 1 callersMethodis_consistent
(self, image_path: str, caption: str)
dataflow/operators/core_vision/filter/image_cat_filter.py:164
↓ 1 callersMethodis_consistent
(self, image_path: str, caption: str)
dataflow/operators/core_vision/filter/cat_filter.py:88
↓ 1 callersMethodis_not_ocr_only
(self, image_path: str, caption: str)
dataflow/operators/core_vision/filter/image_cat_filter.py:140
↓ 1 callersMethodis_not_ocr_only
(self, image_path: str, caption: str)
dataflow/operators/core_vision/filter/cat_filter.py:78
↓ 1 callersMethodis_safe
(self, image_path: str, *texts)
dataflow/operators/core_vision/filter/image_sensitive_filter.py:108
↓ 1 callersMethodis_safe_image
(self, image_path: str)
dataflow/operators/core_vision/filter/image_sensitive_filter.py:100
↓ 1 callersMethodis_safe_text
(self, text: str)
dataflow/operators/core_vision/filter/image_sensitive_filter.py:95
↓ 1 callersFunctionis_torch_cuda_available
Check if CUDA is available for PyTorch.
dataflow/cli_funcs/cli_env.py:8
↓ 1 callersMethodis_valid
(self, image_path: str, caption: str)
dataflow/operators/core_vision/filter/image_complexity_filter.py:91
↓ 1 callersMethodis_well_lit
(self, gray: np.ndarray)
dataflow/operators/core_vision/filter/image_aesthetic_filter.py:78
↓ 1 callersFunctionload_alignment_model
( device: str, model_path: str = "MahmoudAshraf/mms-300m-1130-forced-aligner", attn_implementation
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:594
↓ 1 callersMethodload_alignment_model
( self, model_path: str = "MahmoudAshraf/mms-300m-1130-forced-aligner", device: str =
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:360
↓ 1 callersMethodload_model
加载模型和相关的工具函数
dataflow/operators/core_audio/generate/audio_silero_voice_activity_detection_timestamps_generator.py:361
↓ 1 callersMethodload_model
(self, hf_model_name_or_path: str = None, hf_cache_dir: str = None,
dataflow/serving/local_model_llm_serving.py:43
↓ 1 callersMethodload_model
( self, hf_model_name_or_path, hf_cache_dir, hf_local_dir, sgl_tp_siz
dataflow/serving/local_model_llm_serving.py:195
↓ 1 callersMethodload_model
Load one or multiple diffusion pipelines and assign each to a separate GPU.
dataflow/serving/local_image_gen_serving.py:47
↓ 1 callersMethodload_model
(self, hf_model_name_or_path: str = None, hf_cache_dir: str = None,
dataflow/serving/local_model_vlm_serving.py:44
↓ 1 callersMethodload_model
( self, hf_model_name_or_path: str, hf_cache_dir: str, hf_local_dir: str,
dataflow/serving/local_model_vlm_serving.py:293
↓ 1 callersFunctionmain
()
test/test_qwenlv.py:9
↓ 1 callersFunctionmain
()
dataflow/cli.py:39
↓ 1 callersMethodmean_brightness
(self, img_gray: np.ndarray)
dataflow/operators/core_vision/filter/image_aesthetic_filter.py:63
↓ 1 callersFunctionmerge_repeats
(path, idx_to_token_map)
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:461
↓ 1 callersFunctionmerge_segments
(segments, threshold=0.00)
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:1120
↓ 1 callersFunctionmerge_video_captions
Merge captions from multiple clips into text format for LLM input. Args: dataframe: DataFrame containing clip information and ca
dataflow/operators/core_vision/generate/video_merged_caption_generator.py:40
↓ 1 callersMethodmin_arg
(self, n=100)
dataflow/operators/core_vision/generate/multimodal_math_generator.py:155
↓ 1 callersMethodmoney2chntext
(self)
dataflow/operators/core_audio/refine/cn_tn.py:901
↓ 1 callersMethodmonotonicity
(self, x_start, x_end, steps=50)
dataflow/operators/core_vision/generate/multimodal_math_generator.py:159
↓ 1 callersFunctionnon_max_suppression
非极大值抑制 NMS 算法,去除重叠过多的框
dataflow/operators/core_vision/generate/image_bbox_generator.py:77
↓ 1 callersFunctionnormalize_nsw
(raw_text)
dataflow/operators/core_audio/refine/cn_tn.py:928
↓ 1 callersFunctionnormalize_uroman
(text)
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:1043
↓ 1 callersMethodnot_extreme
(self, gray: np.ndarray)
dataflow/operators/core_vision/filter/image_aesthetic_filter.py:85
↓ 1 callersFunctionpad_vid_local_batch_stats
(sen_batch, stats_dict, device)
dataflow/utils/utils.py:370
↓ 1 callersFunctionpaint_text_box
(image_path, bbox, vis_path = None, rgb=(0, 255, 0), rect_thickness=2)
dataflow/operators/core_vision/generate/image_bbox_generator.py:42
↓ 1 callersFunctionparse_bbox_logic
解析模型生成的 BBox 文本 (x1, y1), (x2, y2)
dataflow/operators/core_vision/generate/vlm_bbox_generator.py:18
↓ 1 callersFunctionparse_reasoning
Parse reasoning text into structured format.
test/test_long_video_cotqa_generator.py:85
↓ 1 callersFunctionparse_reasoning
Parse reasoning text into structured format.
dataflow/statics/pipelines/api_pipelines/video_longvideo_cotqa_api_pipeline.py:80
↓ 1 callersFunctionparse_version_info
Parse a version string into a tuple. Args: version_str (str): The version string. Returns: tuple[int | str]: The version info
dataflow/version.py:4
↓ 1 callersFunctionparse_wiki_qa
(text: str)
dataflow/operators/core_vision/refine/wiki_qa_refiner.py:22
↓ 1 callersMethodpercentage2chntext
(self)
dataflow/operators/core_audio/refine/cn_tn.py:924
↓ 1 callersFunctionpostprocess_results
( text_starred: list, spans: list, stride: float, scores: np.ndarray, merge_threshold: flo
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:1126
↓ 1 callersMethodprepare_latents
( self, image: Optional[torch.Tensor], batch_size: int, num_channels_latents:
dataflow/serving/utils/diffusers/flux_kontext_pipeline.py:641
↓ 1 callersFunctionpreprocess_text
( text, romanize, language, split_size="word", star_frequency="segment" )
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:1082
↓ 1 callersFunctionprocess_video_cutting_from_list
消费 video_clips 列表;仅切割 filtered == False 的片段;返回成功 DataFrame 并写 CSV。 如果 filtered 列不存在,会自动添加并设为 False(不过滤)。
dataflow/operators/core_vision/generate/video_clip_generator.py:159
↓ 1 callersMethodread_media
解析单条消息中的音频信息
dataflow/io/qwen_audio/qwen_audio_2.py:17
↓ 1 callersMethodread_media
解析单条消息中的音频信息
dataflow/io/whisper/whisper.py:17
↓ 1 callersMethodread_media
解析单条消息中的多模态信息
dataflow/io/unifiedreward_qwen/unifiedreward.py:18
↓ 1 callersMethodread_media
解析单条消息中的多模态信息
dataflow/io/qwen_vl/qwen_vl_2_5.py:17
↓ 1 callersFunctionrefs_greedy_cos
Compute greedy matching based on cosine similarity. Args: - :param: `ref_embedding` (torch.Tensor): embeddings of
dataflow/utils/utils.py:184
↓ 1 callersFunctionremove_erhua
去除儿化音词中的儿: 他女儿在那边儿 -> 他女儿在那边
dataflow/operators/core_audio/refine/cn_tn.py:1020
↓ 1 callersFunctionremove_space
(text)
dataflow/operators/core_audio/refine/cn_tn.py:1047
↓ 1 callersFunctionretrieve_timesteps
r""" Calls the scheduler's `set_timesteps` method and retrieves timesteps from the scheduler after the call. Handles custom timesteps. Any kwa
dataflow/serving/utils/diffusers/flux_kontext_pipeline.py:114
↓ 1 callersMethodrun
Execute the complete long video cotqa pipeline. Args: storage: DataFlow storage object input_video_k
test/test_long_video_cotqa_generator.py:337
↓ 1 callersMethodrun
Execute the complete video processing pipeline. Args: storage: DataFlow storage object input_video_k
test/test_video_filter.py:204
↓ 1 callersMethodrun
(self, storage: DataFlowStorage, input_prompt_key: str = "prompt", output
dataflow/operators/core_text/generate/prompted_qa_generator.py:44
↓ 1 callersMethodrun
参数: - storage: DataFlowStorage - output_answer_key: 输出答案列名 - **input_keys: 模板字段名 -> DataFrame 列名 例如:descr
dataflow/operators/core_text/generate/prompt_templated_qa_generator.py:63
↓ 1 callersMethodrun
(self, storage: DataFlowStorage, input_list_key: str, input_image_key: str, output_key: str)
dataflow/operators/core_vision/refine/visual_dependency_refiner.py:104
↓ 1 callersMethodrun
Reads dataframe -> cleans text -> parses -> writes back -> returns output_key
dataflow/operators/core_vision/refine/wiki_qa_refiner.py:122
↓ 1 callersMethodrun
( self, storage: DataFlowStorage, video_clips_key: str = "video_clip", # 你 dataframe
dataflow/operators/core_vision/generate/video_clip_generator.py:274
↓ 1 callersMethodrun
( self, storage: DataFlowStorage, input_modal_key: str = "image", output_key:
dataflow/operators/core_vision/generate/personalized_qa_generator.py:114
↓ 1 callersMethodrun
(self, storage: DataFlowStorage, input_prompts_key: str, input_image_key: str, output_key: str)
dataflow/operators/core_vision/generate/batch_vqa_generator.py:61
↓ 1 callersMethodrun
(self, storage: DataFlowStorage, input_image_key: str = "image", input_v
dataflow/operators/core_vision/generate/fix_prompted_vqa_generator.py:46
↓ 1 callersMethodrun
( self, storage: DataFlowStorage, input_question_key: str, input_image_key:
dataflow/operators/core_vision/generate/visual_reasoning_generator.py:53
↓ 1 callersMethodrun
(self, storage: DataFlowStorage, input_image_key: str, input_kws_key: str, output_key: str)
dataflow/operators/core_vision/generate/vlm_bbox_generator.py:73
↓ 1 callersMethodrun
参数: - storage: DataFlowStorage - input_image_key / input_video_key: 存放图片/视频路径的列名(只允许其一存在) - output_answer_key: 输出答案列名
dataflow/operators/core_vision/generate/prompt_templated_vqa_generator.py:63
↓ 1 callersMethodrun
Main function to run the wrapper.
dataflow/core/Wrapper.py:10
↓ 1 callersMethodrun
Execute the complete video processing pipeline. Args: storage: DataFlow storage object input_video_k
dataflow/statics/pipelines/gpu_pipelines/video_clip_and_filter_pipeline.py:126
↓ 1 callersMethodrun
Execute the complete long video cotqa pipeline. Args: storage: DataFlow storage object input_video_k
dataflow/statics/pipelines/api_pipelines/video_longvideo_cotqa_api_pipeline.py:325
↓ 1 callersMethodrun
Execute the video scene clip generation pipeline. Args: storage: DataFlow storage object input_video
dataflow/statics/playground/video_scene_detect_pipeline.py:87
↓ 1 callersMethodrun
( self, storage: DataFlowStorage, input_video_key: str = "video", output_key:
dataflow/statics/playground/video_aesthetic_filter_pipeline.py:43
↓ 1 callersMethodrun
( self, storage: DataFlowStorage, input_video_key: str = "video", output_key:
dataflow/statics/playground/video_luminance_filter_pipeline.py:42
↓ 1 callersMethodsafe_read_gray
(self, image_path: str)
dataflow/operators/core_vision/filter/image_aesthetic_filter.py:53
↓ 1 callersMethodscore_text
(self, text: str)
dataflow/operators/core_vision/filter/image_sensitive_filter.py:77
↓ 1 callersMethodset_data
Set data to be written later.
dataflow/utils/storage.py:37
↓ 1 callersMethodset_file_name_prefix
Set the file name prefix for cache files.
dataflow/utils/storage.py:43
↓ 1 callersFunctionsplit_text
(text: str, split_size: str = "word")
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:1068
↓ 1 callersFunctionstring2symbols
(chinese_string, system)
dataflow/operators/core_audio/refine/cn_tn.py:573
↓ 1 callersFunctiontext_normalize
Given a text, normalize it by changing to lower case, removing punctuations, removing words that only contain digits and removing extra spaces
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:912
↓ 1 callersMethodvalidate_required_params
校验MyScaleDBStorage实例的关键参数有效性: - pipeline_id, input_task_id, output_task_id 必须非空,否则抛出异常。 - page_size, page_num 若未设置则赋默认值(page_
dataflow/utils/storage.py:297
↓ 1 callersMethodvariance_of_laplacian
(self, img_gray: np.ndarray)
dataflow/operators/core_vision/filter/image_aesthetic_filter.py:60
↓ 1 callersFunctionversion_and_check_for_updates
()
dataflow/cli.py:14
↓ 1 callersFunctionvid_greedy_cos
Compute greedy matching based on cosine similarity. Args: - :param: `ref_embedding` (torch.Tensor): embeddings of
dataflow/utils/utils.py:225
↓ 1 callersFunctionvp_normalize
(in_p, pad_x, pad_y, width, height)
dataflow/operators/core_vision/generate/image_bbox_generator.py:23
↓ 1 callersMethodwer
Calculate Word Error Rate.
dataflow/operators/core_vision/eval/general_text_answer_evaluator.py:64
↓ 1 callersFunctionwhitespace_clean
(text)
dataflow/operators/core_vision/eval/image_text/model/simple_tokenizer.py:56
↓ 1 callersMethodwrite
(self, image_data: Dict[str, List[Image.Image]])
dataflow/io/core_io/image_gen.py:26
Method__call__
(self, text)
dataflow/operators/core_audio/refine/cn_tn.py:1082
Method__call__
(self, image_data: Dict[str, List[Image.Image]])
dataflow/io/core_io/image_gen.py:51
Method__call__
r""" Function invoked when calling the pipeline for generation. Args: image (`torch.Tensor`, `PIL.Image.Image`, `np.ndarr
dataflow/serving/utils/diffusers/flux_kontext_pipeline.py:725
← previousnext →401–500 of 991, ranked by callers