Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/OpenDCAI/DataFlow-MM
/ functions
Functions
991 in github.com/OpenDCAI/DataFlow-MM
⨍
Functions
991
◇
Types & classes
216
↓ 1 callers
Method
compute_similarity
(self, image_path: str, text: str)
dataflow/operators/core_vision/eval/image_longclip_evaluator.py:91
↓ 1 callers
Function
compute_value
Compute the value. When current unit is larger than previous unit, current unit * all previous units will be used as all previous uni
dataflow/operators/core_audio/refine/cn_tn.py:616
↓ 1 callers
Method
compute_yes_prob
(self, image_path: str, text: str)
dataflow/operators/core_vision/eval/image_vqascore_evaluator.py:55
↓ 1 callers
Method
contrast
(self, img_gray: np.ndarray)
dataflow/operators/core_vision/filter/image_aesthetic_filter.py:66
↓ 1 callers
Function
convert_to_timestamps
( timestamp_unit, timestamps, hop_size_samples, sampling_rate )
dataflow/operators/core_audio/generaterow/audio_timestamp_chunk_row_generator.py:371
↓ 1 callers
Function
convert_weights
Convert applicable model parameters to fp16
dataflow/operators/core_vision/eval/image_text/model/model_longclip.py:488
↓ 1 callers
Function
correct_symbols
一百八 to 一百八十 一亿一千三百万 to 一亿 一千万 三百万
dataflow/operators/core_audio/refine/cn_tn.py:582
↓ 1 callers
Method
date2chntext
(self)
dataflow/operators/core_audio/refine/cn_tn.py:864
↓ 1 callers
Function
dedup_and_sort
(l)
dataflow/utils/utils.py:292
↓ 1 callers
Function
default_bpe
()
dataflow/operators/core_vision/eval/image_text/model/simple_tokenizer.py:11
↓ 1 callers
Method
derivative_sign
(self, x, eps=0.01)
dataflow/operators/core_vision/generate/multimodal_math_generator.py:153
↓ 1 callers
Method
detect_caps
(self, caption: str)
dataflow/operators/core_vision/filter/image_complexity_filter.py:74
↓ 1 callers
Method
encode_image
(self, image, device, num_images_per_prompt)
dataflow/serving/utils/diffusers/flux_kontext_pipeline.py:435
↓ 1 callers
Function
encode_text
(vid_caps, model, tokenizer, idf_dict, device)
dataflow/utils/utils.py:126
↓ 1 callers
Function
encode_video
(video_file, preprocess, model, batch_size, device)
dataflow/utils/utils.py:84
↓ 1 callers
Method
entailment_score
(self, caption: str, question: str, answer: str)
dataflow/operators/core_vision/filter/image_consistency_filter.py:59
↓ 1 callers
Method
extract_answer
Extract content between <answer> and </answer> tags.
dataflow/operators/core_vision/generate/video_cotqa_generator.py:93
↓ 1 callers
Function
extract_boxes_from_image
(image_path, min_area_ratio=0.01, max_area_ratio=0.8, min_aspect_ratio=0.1, max_aspect_ratio=5)
dataflow/operators/core_vision/generate/image_bbox_generator.py:113
↓ 1 callers
Method
extract_think
Extract content between <think> and </think> tags.
dataflow/operators/core_vision/generate/video_cotqa_generator.py:84
↓ 1 callers
Function
extract_video_clips_dataframe
Build clip metadata per row from prior pipeline columns. Source columns: - `input_video_key`: str or [str] - `video_info_key`: d
dataflow/operators/core_vision/filter/video_clip_filter.py:180
↓ 1 callers
Function
extract_video_frames_dataframe
Extract frames for each clip in the upstream dataframe. Args: input_video_key: where to read video path(s). video_info_key:
dataflow/operators/core_vision/filter/video_frame_filter.py:178
↓ 1 callers
Function
extract_video_info_dataframe
Extract video info for each row in a dataframe. Args: dataframe: Input dataframe (will not be mutated). backend: One of {"op
dataflow/operators/core_vision/filter/video_info_filter.py:257
↓ 1 callers
Function
extract_video_scenes_dataframe
Compute scene segments for each row. Args: dataframe: input dataframe that already contains video path column, an
dataflow/operators/core_vision/filter/video_scene_filter.py:396
↓ 1 callers
Method
extreme_pixel_ratios
(self, img_gray: np.ndarray)
dataflow/operators/core_vision/filter/image_aesthetic_filter.py:69
↓ 1 callers
Function
filter_dataset
对视频的每个clip应用过滤条件,添加过滤标记。 Args: clips: 视频片段列表,每个片段是一个字典,包含质量指标 strict_mode: 是否严格模式,True则缺失列时报错,False则跳过该过滤条件
dataflow/operators/core_vision/filter/video_score_filter.py:10
↓ 1 callers
Method
format_response
Format LiteLLM response to include reasoning content in a structured format. This method handles the standardized LiteLLM re
dataflow/serving/lite_llm_serving.py:133
↓ 1 callers
Method
forward
(self)
test/test_silero_vad_generator.py:33
↓ 1 callers
Method
forward
(self)
test/test_text_to_image_evaluation.py:37
↓ 1 callers
Method
forward
(self)
test/test_video_caption.py:30
↓ 1 callers
Method
forward
(self)
test/test_promptedvqa.py:38
↓ 1 callers
Method
forward
(self)
test/test_promptedvqa_sglang.py:33
↓ 1 callers
Method
forward
(self)
test/test_data_selection.py:90
↓ 1 callers
Method
forward
(self)
test/test_promptedvideoqa.py:41
↓ 1 callers
Method
forward
(self)
test/test_video_caption_api.py:33
↓ 1 callers
Method
forward
(self, image, text_long,text_short,rank)
dataflow/operators/core_vision/eval/image_text/model/model_longclip.py:442
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_filter_deduplicate.py:38
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/audio_voice_activity_detection_pipeline.py:39
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_eval_vqascore.py:41
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/context_vqa.py:41
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/text_to_image_generation_pipeline.py:42
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_filter_sensitive.py:36
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_visual_only_mcq_pipeline.py:145
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_eval_longclip.py:37
↓ 1 callers
Method
forward
一键跑完当前 pipeline 一个 step: 图片 → Caption
dataflow/statics/pipelines/gpu_pipelines/image2caption.py:46
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/vision_mct_reasoning_pipeline.py:67
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_filter_cat.py:47
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_gcot_pipeline.py:172
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/audio_aqa_pipeline.py:30
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_region_caption_pipeline.py:61
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_eval_clip.py:37
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_filter_complexity.py:36
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/audio_asr_pipeline.py:72
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_filter_clip.py:34
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_filter_consistency.py:38
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_editing_pipeline.py:42
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image_scale_caption_pipeline.py:187
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/gpu_pipelines/image2qa.py:40
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/cpu_pipelines/image_filter_diversity.py:39
↓ 1 callers
Method
forward
一键生成多模态数学题目数据集: 生成函数图像 + 对应问答对
dataflow/statics/pipelines/cpu_pipelines/multimodal_math.py:40
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/cpu_pipelines/image_filter_aesthetic.py:29
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/image_editing_api_pipeline.py:71
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/video_qa_api_pipeline.py:43
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/image_vqa.py:45
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/image_visual_only_mcq_api_pipeline.py:143
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/image_contextvqa.py:46
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/image_region_caption_api_pipeline.py:59
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/video_caption_api_pipeline.py:34
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/text_to_image_generation_api_pipeline.py:71
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/image_gcot_api_pipeline.py:171
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/vision_mct_reasoning_api_pipeline.py:64
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/image_scale_caption_api_pipeline.py:185
↓ 1 callers
Method
forward
(self)
dataflow/statics/pipelines/api_pipelines/image_caption.py:45
↓ 1 callers
Method
forward
(self)
dataflow/statics/playground/video_caption_pipeline.py:34
↓ 1 callers
Method
forward
(self)
dataflow/statics/playground/video_qa_pipeline.py:42
↓ 1 callers
Method
fraction2chntext
(self)
dataflow/operators/core_audio/refine/cn_tn.py:826
↓ 1 callers
Method
generate_complex_sample
(self, idx: int)
dataflow/operators/core_vision/generate/multimodal_math_generator.py:197
↓ 1 callers
Function
generate_emissions
( model, audio_waveform: torch.Tensor, window_length=30, context_length=2, batch_size=4, )
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:541
↓ 1 callers
Method
generate_from_input
(self, # TODO: 这里为了跑通,防止自己被误导就写成list[str]了,后面可以改成list of list of tokens
dataflow/serving/local_model_vlm_serving.py:109
↓ 1 callers
Method
generate_from_input_one_batch
Distribute inputs across pipelines and run in parallel, then save via image_io.
dataflow/serving/local_image_gen_serving.py:221
↓ 1 callers
Method
generate_from_input_one_batch
Process a batch of inputs, return dictionary in {key: [Image, ...]} format. user_inputs format is aligned with LocalImageGen
dataflow/serving/api_image_gen_serving.py:574
↓ 1 callers
Method
generate_sample
(self, idx: int)
dataflow/operators/core_vision/generate/multimodal_math_generator.py:121
↓ 1 callers
Method
get_alignments
( self, emissions: torch.Tensor, tokens: list, tokenizer, )
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:410
↓ 1 callers
Function
get_clickhouse_client
(db_config)
dataflow/utils/storage.py:253
↓ 1 callers
Method
get_dataflow_example_dir
()
dataflow/cli_funcs/paths.py:21
↓ 1 callers
Method
get_dataflow_pipelines_dir
()
dataflow/cli_funcs/paths.py:29
↓ 1 callers
Method
get_dataflow_playground_dir
()
dataflow/cli_funcs/paths.py:33
↓ 1 callers
Function
get_ffmpeg_acceleration
()
dataflow/operators/core_vision/generate/video_clip_generator.py:22
↓ 1 callers
Function
get_spans
(tokens, segments, blank)
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:478
↓ 1 callers
Method
get_speech_timestamps
This method is used for splitting long audios into speech chunks using silero VAD Parameters ---------- audio: torch
dataflow/operators/core_audio/generate/audio_silero_voice_activity_detection_timestamps_generator.py:382
↓ 1 callers
Method
get_type_of_operator
Classify the operator type by its path of registration. This is used to classify operators into different categories. :return
dataflow/utils/registry.py:185
↓ 1 callers
Function
get_uroman_tokens
(norm_transcripts: list[str], iso=None)
dataflow/operators/core_audio/eval/audio_ctc_forced_alignment_transcription_quality_evaluator.py:1050
↓ 1 callers
Function
get_value
(value_string, use_zeros=True)
dataflow/operators/core_audio/refine/cn_tn.py:651
↓ 1 callers
Method
has_action_verb
(self, caption: str)
dataflow/operators/core_vision/filter/image_cat_filter.py:136
↓ 1 callers
Method
has_action_verb
(self, doc)
dataflow/operators/core_vision/filter/cat_filter.py:74
↓ 1 callers
Method
has_contrast
(self, gray: np.ndarray)
dataflow/operators/core_vision/filter/image_aesthetic_filter.py:82
↓ 1 callers
Method
initialize_parameters
(self)
dataflow/operators/core_vision/eval/image_text/model/model_longclip.py:312
↓ 1 callers
Function
is_api_serving
(serving)
dataflow/operators/core_text/generate/prompted_qa_generator.py:14
↓ 1 callers
Function
is_api_serving
(serving)
dataflow/operators/core_text/generate/prompt_templated_qa_generator.py:15
↓ 1 callers
Function
is_api_serving
判断 serving 是否为 API 类型
dataflow/operators/core_audio/generate/prompted_aqa_generator.py:9
↓ 1 callers
Function
is_api_serving
(serving)
dataflow/operators/core_vision/refine/visual_grounding_refiner.py:14
← previous
next →
301–400 of 991, ranked by callers