MCPcopy Create free account

hub / github.com/Netflix-Skunkworks/oci-agent / functions

Functions115 in github.com/Netflix-Skunkworks/oci-agent

↓ 10 callersFunctionfmt
(v, w=10, d=4)
evals/baseline_vs_scaffolded/run.py:264
↓ 4 callersFunction_project_root
Walk up from this file until we find the directory with pyproject.toml.
evals/generate_synthetic_acic.py:41
↓ 4 callersFunctioncompute_stats
Point estimates + 95% CIs for bias / RMSE / coverage / width.
evals/smoketest/plot.py:46
↓ 3 callersFunction_next_iter_path
Return parent/iter_NN<suffix> with NN one greater than the highest existing.
oci_agent/agent.py:25
↓ 3 callersFunctionaggregate
(rows: list[dict])
evals/smoketest/judge.py:169
↓ 3 callersFunctiondiscover_treatments
(acic_dir: Path)
evals/smoketest/run.py:62
↓ 3 callersFunctionfmt_row
(label: str, s: dict)
evals/smoketest/judge.py:181
↓ 3 callersFunctionsample_responses
(treatment_dir: Path, k: int, rng: random.Random)
evals/smoketest/run.py:56
↓ 3 callersFunctionweighted_mean
(x, w)
oci_agent/backends/utils.py:180
↓ 2 callersMethod_call
(self, system: str, user_content: str)
oci_agent/actor.py:95
↓ 2 callersFunction_load_skill
Load a skill body (everything after the closing `---` of the frontmatter).
oci_agent/critic.py:13
↓ 2 callersFunction_oof_predict
(fold_models, folds, Z, predict_fn)
oci_agent/backends/econml_helpers.py:151
↓ 2 callersFunction_reproduce_drlearner_cv_folds
Reproduce the (train_idx, test_idx) splits a discrete-treatment DRLearner used at fit time, so that each row's nuisance prediction can be routed
oci_agent/backends/econml_helpers.py:116
↓ 2 callersFunctionannotate
Add covered / abs_error fields when the path produced a usable answer.
evals/baseline_vs_scaffolded/run.py:248
↓ 2 callersFunctionbuild_spec
First-iteration eval spec per plans/smoketest.md.
evals/smoketest/run.py:39
↓ 2 callersFunctiondraw_path
(ax, y: float, est: float | None, lo: float | None, hi: float | None, covers: bool | None, color
evals/baseline_vs_scaffolded/plot.py:85
↓ 2 callersMethodevaluate
( self, results: str | dict, plan_text: str | None = None, spec_text: str | No
oci_agent/critic.py:103
↓ 2 callersFunctionfmt_stats
(label: str, s: dict)
evals/baseline_vs_scaffolded/plot.py:71
↓ 2 callersFunctionone_call
()
evals/baseline_vs_scaffolded/run.py:201
↓ 2 callersFunctionparse_json_fence
Mirror oci_agent.critic._parse_critique's fence extractor.
evals/baseline_vs_scaffolded/run.py:165
↓ 2 callersFunctionpath_stats
Mean |error|, RMSE, coverage, mean interval width for one path.
evals/baseline_vs_scaffolded/plot.py:43
↓ 2 callersMethodpredict
(self, X)
oci_agent/backends/estimators.py:64
↓ 2 callersFunctionprint_three_tier_contrast
Partition by satisfaction (3 tiers) and print per-estimand rows.
evals/smoketest/judge.py:240
↓ 2 callersFunctionsetup_cov_rmse_axes
Coverage vs RMSE with reversed x-axis: higher x = lower RMSE = better. Caller passes a hint; we enforce a floor of 0.5 so cross-figure compar
evals/smoketest/plot.py:86
↓ 2 callersFunctionvalidate_baseline_payload
(data: dict)
evals/baseline_vs_scaffolded/run.py:177
↓ 2 callersFunctionweighted_var
(x, w)
oci_agent/backends/utils.py:184
↓ 1 callersFunction_append_serialization_cell
(nb, results_path: Path, spec: dict[str, Any])
oci_agent/nb_runner.py:121
↓ 1 callersFunction_build_system
()
oci_agent/critic.py:20
↓ 1 callersFunction_confirm_continue
Ask the user whether to revise and run the next iteration. Returns False on EOF / non-tty / negative answer so the loop stops cleanly when st
oci_agent/agent.py:133
↓ 1 callersFunction_evaluate_mode
(args: argparse.Namespace)
oci_agent/agent.py:80
↓ 1 callersFunction_execute_mode
(args: argparse.Namespace)
oci_agent/agent.py:56
↓ 1 callersFunction_find_config_cell
(nb)
oci_agent/nb_runner.py:114
↓ 1 callersFunction_inject_parameters_cell
(nb, spec: dict[str, Any])
oci_agent/nb_runner.py:106
↓ 1 callersFunction_load_spec
(path: Path)
oci_agent/agent.py:16
↓ 1 callersFunction_load_spec
(spec: dict[str, Any] | str | Path)
oci_agent/nb_runner.py:94
↓ 1 callersFunction_make_econml_treatment_design
(est, n, treatment_value)
oci_agent/backends/econml_helpers.py:225
↓ 1 callersFunction_normalize_satisfaction
Coerce `satisfaction` into {estimand: tier}. Accepts the per-estimand dict (new schema) or a single string / legacy `is_satisfactory` boolean
oci_agent/critic.py:170
↓ 1 callersFunction_parse_actor_response
(text: str)
oci_agent/actor.py:112
↓ 1 callersFunction_parse_critique
(text: str)
oci_agent/critic.py:140
↓ 1 callersFunction_revise_mode
(args: argparse.Namespace)
oci_agent/agent.py:185
↓ 1 callersMethod_split_data
(self, X, y, sample_weight)
oci_agent/backends/estimators.py:68
↓ 1 callersMethod_split_data
(self, X, y, sample_weight, stratify_arg)
oci_agent/backends/estimators.py:170
↓ 1 callersFunctionaggregate
(rows: list[dict], key: str)
evals/smoketest/eval.py:88
↓ 1 callersFunctionbuild_run_records
(run_dirs: list[Path], acic_dir: Path)
evals/smoketest/eval.py:49
↓ 1 callersFunctioncheck_python3_kernel_matches_current_interpreter
Check whether the 'python3' Jupyter kernelspec points to the current interpreter. This function does not modify the user's Jupyter environme
oci_agent/nb_runner.py:15
↓ 1 callersFunctioncompute_ground_truth
Compute true ATE/ATT/ATO from the raw zymu CSV. The ATO trimmed-row indices live in a sibling `keep_indices.json` written by the runner — the
evals/smoketest/eval.py:25
↓ 1 callersFunctioncompute_truth
(acic_dir: Path, treatment: int, response: int)
evals/baseline_vs_scaffolded/run.py:98
↓ 1 callersMethoddraft
(self, plan_text: str)
oci_agent/actor.py:60
↓ 1 callersMethodfit
(self, X, y, sample_weight=None)
oci_agent/backends/estimators.py:30
↓ 1 callersFunctiongenerate_covariates
58 ACIC-shaped covariates: a mix of continuous, binary, and count types. Real ACIC `x.csv` has a few object-dtype columns; we keep this all-numer
evals/generate_synthetic_acic.py:50
↓ 1 callersFunctiongenerate_zymu
Generate treatment + potential outcomes for one ACIC response replication. Confounding: propensity and outcome both depend on x_1..x_8 (continuou
evals/generate_synthetic_acic.py:71
↓ 1 callersFunctionget_or_compute_critique
Read cached critique.json from a run dir, or call the Critic to produce one.
evals/smoketest/judge.py:81
↓ 1 callersFunctionjudge_deterministic
Return (satisfaction_tier, diagnostic_flags) per writing-reports rules.
evals/smoketest/judge.py:58
↓ 1 callersFunctionjudge_llm
Annotate each row with `llm_satisfaction` (same value for all 3 estimands of a run). Calls the Critic concurrently when parallel > 1; cached criti
evals/smoketest/judge.py:115
↓ 1 callersFunctionjudge_one
(run_name: str, group: list[dict])
evals/smoketest/judge.py:128
↓ 1 callersFunctionload_config
(path: Path)
evals/smoketest/run.py:33
↓ 1 callersFunctionload_config
(path: Path)
evals/smoketest/judge.py:50
↓ 1 callersFunctionload_realized
Return the (x_1..x_58, z, y) view the analyst would see — no counterfactuals (y0/y1) and no ground-truth means (mu0/mu1).
evals/baseline_vs_scaffolded/run.py:68
↓ 1 callersFunctionload_records
(root: Path)
evals/baseline_vs_scaffolded/plot.py:38
↓ 1 callersFunctionmain
()
evals/generate_synthetic_acic.py:157
↓ 1 callersFunctionmain
()
evals/baseline_vs_scaffolded/run.py:417
↓ 1 callersFunctionmain
()
evals/baseline_vs_scaffolded/plot.py:99
↓ 1 callersFunctionmain
()
evals/smoketest/run.py:82
↓ 1 callersFunctionmain
()
evals/smoketest/eval.py:100
↓ 1 callersFunctionmain
()
evals/smoketest/plot.py:184
↓ 1 callersFunctionmain
()
evals/smoketest/judge.py:261
↓ 1 callersFunctionmain
()
oci_agent/agent.py:212
↓ 1 callersFunctionmake_benchmark_plot
Coverage vs RMSE — our ATT vs full ACIC 2016 competition (combined).
evals/smoketest/plot.py:102
↓ 1 callersFunctionmake_judge_plot
Coverage vs RMSE — ATE only, three judge tiers.
evals/smoketest/plot.py:142
↓ 1 callersFunctionparse_args
()
evals/baseline_vs_scaffolded/run.py:296
↓ 1 callersFunctionparse_treatments
Parse a `--treatments` argument like "1", "1,3,5", or "1-77".
evals/generate_synthetic_acic.py:129
↓ 1 callersMethodpredict_proba
(self, X)
oci_agent/backends/estimators.py:166
↓ 1 callersFunctionprint_aggregate
Aggregate summary for a multi-study run.
evals/baseline_vs_scaffolded/run.py:367
↓ 1 callersFunctionprint_confusion_matrix
Confusion matrix at the (run x estimand) level: rows = deterministic (ground truth), cols = LLM. Both judges now emit a per-estimand verdict,
evals/smoketest/judge.py:210
↓ 1 callersFunctionprint_table
(truth: dict, scaffolded: dict, baseline: dict)
evals/baseline_vs_scaffolded/run.py:263
↓ 1 callersMethodpropose
Programmatic validation against the writing-specs Validation rules.
oci_agent/actor.py:72
↓ 1 callersFunctionrender_plan
(template_path: Path, treatment: int, response: int, df: pd.DataFrame)
evals/baseline_vs_scaffolded/run.py:78
↓ 1 callersMethodrevise
(self, prev_spec_text: str, critic_report: str, critic_suggestions: list[str])
oci_agent/actor.py:63
↓ 1 callersFunctionrun_baseline
One messages.create call. One retry on parse failure. No tools.
evals/baseline_vs_scaffolded/run.py:190
↓ 1 callersFunctionrun_one
Execute one (spec, run_name) via subprocess. Returns (name, ok, last_stderr).
evals/smoketest/run.py:66
↓ 1 callersFunctionrun_one_study
Run a single (treatment, response) pair end-to-end. Writes `<out_dir>/t{treatment}_r{response}/{contrast.json, plan.md, scaffolded/, baseline/
evals/baseline_vs_scaffolded/run.py:319
↓ 1 callersFunctionrun_scaffolded
(treatment: int, response: int, plan_path: Path, out_dir: Path, args: argparse.Namespace)
evals/baseline_vs_scaffolded/run.py:111
↓ 1 callersFunctionsample_pair
(args: argparse.Namespace, rng: random.Random)
evals/baseline_vs_scaffolded/run.py:51
↓ 1 callersFunctiontrue_ate_for_treatment
Vary the constant treatment-effect component smoothly across treatments so the smoketest battery sees a non-trivial range of true ATEs (~1.0..5.0)
evals/generate_synthetic_acic.py:150
Method__init__
(self, model: str = "claude-sonnet-4-6")
oci_agent/actor.py:53
Method__init__
(self, model: str = "claude-sonnet-4-6")
oci_agent/critic.py:96
Method__init__
( self, base_estimator, validation_fraction=0.2, early_stopping_rounds=50,
oci_agent/backends/estimators.py:12
Method__init__
( self, base_estimator, validation_fraction=0.2, early_stopping_rounds=50,
oci_agent/backends/estimators.py:105
Function_draft_mode
(args: argparse.Namespace)
oci_agent/agent.py:39
Function_loop_mode
(args: argparse.Namespace)
oci_agent/agent.py:149
Function_predict
(model, Z_test)
oci_agent/backends/econml_helpers.py:214
Functionaipw_pseudo_outcome
Doubly-robust (AIPW) pseudo-outcome for the ATE per unit. Y_DR_i = m1(X_i) - m0(X_i) + (T_i / e_i) (Y_i - m1(X_i))
oci_agent/backends/econml_helpers.py:266
Functionaipw_summary
Estimate, standard error, and (1 - alpha) CI from DR pseudo-outcomes. When `centering` is supplied (array, same length as `pseudo`), the SE is
oci_agent/backends/econml_helpers.py:305
Functionatt_dr_pseudo_outcome
ATT influence-function-based pseudo-outcome. psi_ATT_i = (1 / pi) * [ T_i (Y_i - m0(X_i)) - (1 - T_i) (e_i / (1 - e_i
oci_agent/backends/econml_helpers.py:285
Functionatt_ipw_weights
Compute ATT inverse-propensity weights. Parameters ---------- propensity_scores : array-like Estimated Pr(T=1 | X). tre
oci_agent/backends/utils.py:305
Methodbest_iteration_
(self)
oci_agent/backends/estimators.py:91
Methodbest_iteration_
(self)
oci_agent/backends/estimators.py:195
Methodbest_score_
(self)
oci_agent/backends/estimators.py:96
Methodbest_score_
(self)
oci_agent/backends/estimators.py:200
Functionextract_avg_outcome_predictions
(est, T, X=None, W=None, treatment_value=1)
oci_agent/backends/econml_helpers.py:233
next →1–100 of 115, ranked by callers