Factory function for default prompt templates.
()
| 23 | |
| 24 | |
| 25 | def get_default_prompt_templates() -> Dict[str, str]: |
| 26 | """Factory function for default prompt templates.""" |
| 27 | return { |
| 28 | EvaluationType.INSTRUCTION.value: """ |
| 29 | Evaluate if this video follows the instruction: '{instruction}'. |
| 30 | Use the following scoring criteria: |
| 31 | |
| 32 | - 0: The video does not follow the instruction at all. |
| 33 | - 1: The video includes the correct object but performs the wrong action, or vice versa. |
| 34 | - 2: The video follows the instruction and shows a tendency toward the intended goal. |
| 35 | - 3: The video follows the instruction precisely and successfully achieves the goal. |
| 36 | |
| 37 | Let's analyze step-by-step and conclude with 'Score: [score]'. |
| 38 | """.strip(), |
| 39 | |
| 40 | EvaluationType.PHYSICAL_LAWS.value: """ |
| 41 | Watch the video and determine if it shows any '{physical_laws}' |
| 42 | Let's think step-by-step and conclude with "Yes" or "No". |
| 43 | """.strip(), |
| 44 | |
| 45 | EvaluationType.COMMON_SENSE.value: """ |
| 46 | Does the video exhibit '{common_sense}'? |
| 47 | Let's think step-by-step and conclude with "Yes" or "No". |
| 48 | """.strip(), |
| 49 | } |
| 50 | |
| 51 | |
| 52 | def get_default_question_pool() -> Dict[str, Optional[List[str]]]: |
nothing calls this directly
no outgoing calls
no test coverage detected