MCPcopy Create free account

hub / github.com/Open-Bee/DataStudio / functions

Functions1,367 in github.com/Open-Bee/DataStudio

Methodloader_with_data
Create loader with test data.
tests/datasets/test_data_loader.py:134
Methodlogger
Create logger for testing.
tests/utils/test_logging.py:206
Methodlogger
Create logger for testing.
tests/utils/test_logging.py:247
Methodlogger
Create logger for testing.
tests/utils/test_logging.py:272
Methodmanager
Create checkpoint manager for testing.
tests/utils/test_checkpoint.py:49
Methodmanager
Create checkpoint manager for testing.
tests/utils/test_checkpoint.py:78
Methodmanager
Create checkpoint manager for testing.
tests/utils/test_checkpoint.py:101
Methodmanager
Create checkpoint manager for testing.
tests/utils/test_checkpoint.py:144
Methodmanager
Create checkpoint manager for testing.
tests/utils/test_checkpoint.py:166
Methodmanager
Create checkpoint manager for testing.
tests/utils/test_checkpoint.py:190
Methodmanager
Create checkpoint manager for testing.
tests/utils/test_checkpoint.py:303
Methodmanager
Create checkpoint manager for testing.
tests/utils/test_checkpoint.py:319
Methodmanager
Create checkpoint manager for testing.
tests/utils/test_checkpoint.py:350
Functionmock_image
Mock PIL Image for testing.
tests/conftest.py:165
Methodmock_lmdb
Mock lmdb module.
tests/utils/test_other_utils.py:422
Methodmock_loader
Create a mocked loader for testing.
tests/datasets/test_data_loader.py:77
Functionmock_logger
Mock logger for testing.
tests/conftest.py:139
Functionmock_model
Mock model for MLLM operators.
tests/conftest.py:151
Methodmock_model
Create mock model.
tests/operators/test_mllm.py:144
Methodmock_model
Create mock model.
tests/operators/test_mllm.py:243
Methodmock_model
Create mock model.
tests/operators/test_mllm.py:299
Functionmock_openai_reasoning_response
OpenAI API response with reasoning_content.
tests/models/test_openai_api.py:79
Functionmock_openai_response
Mock OpenAI API response.
tests/conftest.py:159
Functionmock_openai_success_response
Standard successful OpenAI API response.
tests/models/test_openai_api.py:73
Methodmock_pipeline
Create pipeline with mocked sub-pipeline.
tests/pipelines/test_pipeline.py:86
Functionmulti_stage_operations
Create multi-stage operations config.
tests/pipelines/test_pipeline.py:33
Methodmulti_turn_item
Create multi-turn DataItem for testing.
tests/operators/test_data_item.py:320
Methodmulti_turn_item
Create multi-turn DataItem.
tests/operators/test_result.py:271
Methodname
Operator name for records.
datastudio/operators/core/operator.py:36
Methodprocess
Process a single item (delegates to process_batch).
datastudio/operators/mllm/base.py:56
Methodprocess
Process by calling check() for each QA pair.
datastudio/operators/core/operator.py:96
Methodprocess
Process by calling rewrite() for each QA pair.
datastudio/operators/core/operator.py:133
Methodprocess
Check if any images have excluded extensions (item-level).
datastudio/operators/filters/image_ext.py:47
Methodprocess
Normalize prompt formatting in questions (modifies question).
datastudio/operators/rewriters/norm_prompt.py:189
Methodprocess
Remove redundant instruction patterns from multi-turn (item-level).
datastudio/operators/rewriters/norm_multi_turn_prompt.py:64
Methodprocess
Normalize image tags - move all to first question (item-level).
datastudio/operators/rewriters/norm_image_tag.py:58
Methodprocess
(self, item: DataItem)
tests/pipelines/test_sub_pipeline.py:91
Methodprocess
(self, item: DataItem)
tests/pipelines/test_sub_pipeline.py:104
Methodprocess
(self, item: DataItem)
tests/pipelines/test_sub_pipeline.py:119
Methodprocess
(self, item)
tests/pipelines/test_sub_pipeline.py:246
Methodprocess
(self, item)
tests/pipelines/test_sub_pipeline.py:353
Methodprocess
(self, item)
tests/pipelines/test_sub_pipeline.py:447
Methodprocess_batch
Process a batch of items. Default implementation calls process() for each item. Override for batch optimization (e.g., MLLM
datastudio/operators/core/operator.py:53
Methodprocess_batch
Process batch - returns keep result for each item.
datastudio/operators/rewriters/split.py:47
Methodprompt_text
Load and return the prompt text (lazy).
datastudio/operators/mllm/request.py:100
Functionpytest_configure
Configure pytest markers.
tests/conftest.py:270
Methodqa_count
Number of QA pairs.
datastudio/operators/core/data_item.py:68
Methodqa_pairs
Get all QA pairs (cached).
datastudio/operators/core/data_item.py:61
Methodqa_reject_rate
Calculate QA-level reject rate.
datastudio/utils/statistics.py:50
Functionreal_image
Create a real PIL Image for testing.
tests/models/test_base_api.py:43
Methodregistry
Create clean registry for testing.
tests/utils/test_registry.py:43
Methodregistry
Create registry with test module.
tests/utils/test_registry.py:160
Methodregistry_with_class
Create a registry with a simple test class registered.
tests/utils/test_registry.py:329
Methodregistry_with_modules
Create registry with registered modules.
tests/utils/test_registry.py:102
Methodregistry_with_modules
Create registry with registered modules.
tests/utils/test_registry.py:137
Methodreject_rate
Calculate reject rate (item level).
datastudio/utils/statistics.py:36
Methodreject_rate
(self)
datastudio/utils/statistics.py:89
Methodrequest_builder_cfg
Create request builder config.
tests/operators/test_mllm.py:151
Methodrequest_builder_cfg
Create request builder config.
tests/operators/test_mllm.py:250
Methodrequest_builder_cfg
Create request builder config.
tests/operators/test_mllm.py:306
Methodrequest_builder_cfg
Create request builder config.
tests/operators/test_mllm.py:337
Methodrewrite
Remove Reasoning: prefix from an answer.
datastudio/operators/rewriters/remove_reason.py:36
Methodrewrite
Not used - this rewriter modifies questions.
datastudio/operators/rewriters/norm_prompt.py:204
Methodrewrite
Not used - item-level rewriter.
datastudio/operators/rewriters/norm_multi_turn_prompt.py:89
Methodrewrite
Not used - this rewriter operates at item level.
datastudio/operators/rewriters/norm_image_tag.py:110
Methodrewrite
Normalize think tags in an answer.
datastudio/operators/rewriters/norm_think.py:51
Methodrewrite
Add empty think tags to a response missing them.
datastudio/operators/rewriters/add_nothink.py:35
Methodrewrite
(self, item, qa_idx)
tests/operators/test_operator.py:263
Methodrewrite_rate
Calculate rewrite rate.
datastudio/utils/statistics.py:43
Methodrewriter
Create rewriter instance.
tests/operators/test_rewriters.py:36
Methodrewriter
Create rewriter instance.
tests/operators/test_rewriters.py:109
Methodrewriter
Create rewriter instance.
tests/operators/test_rewriters.py:148
Methodrewriter
Create rewriter instance.
tests/operators/test_rewriters.py:185
Methodrewriter
Create rewriter instance.
tests/operators/test_rewriters.py:229
Methodrewriter
Create rewriter instance.
tests/operators/test_rewriters.py:257
Methodrewriter
Create rewriter instance.
tests/operators/test_rewriters.py:277
Methodrewriter
Create rewriter instance.
tests/operators/test_rewriters.py:321
Methodrewriter
Create rewriter instance.
tests/operators/test_rewriters.py:350
Methodrewriter_answer
Create MLLMRewriter instance with rewrite_type='answer'.
tests/operators/test_mllm.py:518
Methodrewriter_instance
Create MLLMRewriter instance.
tests/operators/test_mllm.py:261
Methodrewriter_question
Create MLLMRewriter instance with rewrite_type='question'.
tests/operators/test_mllm.py:532
Functionsample_config_dict
Sample configuration dictionary.
tests/conftest.py:224
Functionsample_conversation
Sample conversation data for testing.
tests/conftest.py:27
Functionsample_data_item
Sample data item dictionary without image.
tests/conftest.py:47
Functionsample_data_item_with_image
Sample data item with image.
tests/conftest.py:53
Functionsample_data_list
List of sample data items.
tests/conftest.py:63
Functionsample_multi_turn_conversation
Sample multi-turn conversation data.
tests/conftest.py:36
Functionsample_result
Create a sample Result for testing.
tests/conftest.py:243
Methodsave
Save data to JSON file. Args: data: List of data dictionaries. file_path: Output file path. indent: JSON
datastudio/datasets/formatters/json_formatter.py:39
Methodsave
Save data to file. Args: data: List of data dictionaries. file_path: Output file path. auto_denormalize:
datastudio/datasets/formatters/__init__.py:108
Methodsave
Save data to JSONL file. Args: data: List of data dictionaries. file_path: Output file path. ensure_ascii
datastudio/datasets/formatters/jsonl_formatter.py:56
Methodsave
Save configuration to YAML file. Args: config: StandardConfig to save. yaml_path: Output file path.
datastudio/datasets/config/config.py:159
Methodsave
(self, data, file_path, **kwargs)
tests/datasets/test_formatters.py:347
Methodsaver
Create a saver instance for testing.
tests/datasets/test_data_saver.py:70
Methodsaver
Create a saver instance for testing.
tests/datasets/test_data_saver.py:109
Methodsaver
Create a saver instance for testing.
tests/datasets/test_data_saver.py:392
Methodshutdown
Shutdown and release resources. Workers are ephemeral (created per generate() call), nothing to clean up.
datastudio/models/mp_openai_api.py:325
Methodside_effect
(*args, **kwargs)
tests/models/test_openai_api.py:362
Methodsimple_saver
Create SimpleSaver instance.
tests/datasets/test_saver_components.py:25
Methodsystem_prompt_text
Load and return the system prompt text (lazy).
datastudio/operators/mllm/request.py:107
← previousnext →401–500 of 1,367, ranked by callers