MCPcopy Index your code

hub / github.com/Jiahong-Que-9527/SoloLakehouse / functions

Functions234 in github.com/Jiahong-Que-9527/SoloLakehouse

↓ 13 callersFunction_make_catalog
()
tests/test_collectors_ml_and_reports.py:18
↓ 12 callersFunctionget_storage_config
Resolve storage locations from environment variables. `DATA_BUCKET` is the entity-level setting. `BUCKET_NAME` remains supported for v2.5 com
storage_config.py:28
↓ 10 callersFunctionget_runtime_identity
Resolve product/runtime identity from environment variables. Defaults preserve the v2.5 SoloLakehouse local reference behavior.
runtime_identity.py:33
↓ 8 callersMethodget_catalog
(self)
dagster/resources.py:48
↓ 8 callersMethodjson
(self)
tests/test_collectors_ml_and_reports.py:80
↓ 8 callersFunctionscan_table
Scan an entire Iceberg table and return as a pandas DataFrame.
ingestion/iceberg_io.py:153
↓ 7 callersFunction_env
(env: Mapping[str, str], name: str, default: str)
runtime_identity.py:62
↓ 7 callersMethodwrite
Append *df* to the Bronze Iceberg table for *source* and return a logical path.
ingestion/bronze_writer.py:39
↓ 6 callersFunction_emit_metric
(step: str, started_at: float)
dagster/assets.py:32
↓ 6 callersFunction_env
(env: Mapping[str, str], name: str, default: str)
storage_config.py:110
↓ 6 callersFunction_env_url
(name: str, default: str)
scripts/health-server.py:208
↓ 6 callersFunction_make_model
(model_type: str, params: dict[str, Any])
ml/train_ecb_dax_model.py:23
↓ 6 callersMethodwrite_rejected
Append rejected records to the Bronze rejected Iceberg table.
ingestion/bronze_writer.py:55
↓ 5 callersFunction_make_catalog_mock
Return a mock Iceberg catalog that captures append calls.
tests/test_bronze_writer.py:10
↓ 5 callersFunctionget_data_bucket
Return the effective entity data bucket.
storage_config.py:57
↓ 5 callersMethodraise_for_status
(self)
tests/test_collectors_ml_and_reports.py:77
↓ 4 callersFunctioncheck_date_continuity
Raise if any gap between consecutive dates exceeds max_gap_days.
ingestion/quality/bronze_checks.py:55
↓ 4 callersFunctioncheck_no_future_dates
Raise if any date in date_col is later than datetime.date.today().
ingestion/quality/bronze_checks.py:41
↓ 4 callersFunctioncheck_no_nulls
Raise if any of the specified columns contain nulls.
ingestion/quality/bronze_checks.py:10
↓ 4 callersFunctioncheck_schema_version
Raise if df is missing any column from expected_columns.
ingestion/quality/bronze_checks.py:69
↓ 4 callersMethodcollect
(self)
ingestion/collectors/dax_collector.py:83
↓ 4 callersFunctionget_catalog
Create a HiveCatalog backed by Hive Metastore and MinIO (S3-compatible). All parameters fall back to environment variables so Docker and local-de
ingestion/iceberg_io.py:46
↓ 4 callersFunctionget_trino_user
Return the effective Trino user for this runtime identity.
runtime_identity.py:57
↓ 4 callersFunctionmake_dax_record
(**overrides)
tests/test_schemas.py:21
↓ 4 callersFunctionmake_ecb_record
(**overrides)
tests/test_schemas.py:12
↓ 4 callersFunctionrun_silver_quality_report
Return quality metrics dict and log it.
transformations/quality_report.py:13
↓ 3 callersMethod_already_ingested_today
Return True if Bronze already contains a row ingested today.
ingestion/collectors/ecb_collector.py:102
↓ 3 callersFunction_css_class
(value: str)
scripts/health-server.py:215
↓ 3 callersMethod_fetch_data
(self)
ingestion/collectors/ecb_collector.py:38
↓ 3 callersFunction_make_catalog
()
tests/test_transformation_runs.py:12
↓ 3 callersFunction_metadata_row_count
(result: dict[str, Any])
dagster/assets.py:37
↓ 3 callersFunctionbuild_gold_features
Build one feature row per ECB rate-change event.
transformations/silver_to_gold_features.py:22
↓ 3 callersFunctionexecute_trino_sql
Run a SQL statement via Trino REST API and poll until completion.
ingestion/trino_sql.py:22
↓ 3 callersFunctionload_health_server
()
tests/test_health_server.py:8
↓ 3 callersFunctionmake_gold_training_frame
(rows: int = 12)
tests/test_collectors_ml_and_reports.py:22
↓ 3 callersFunctionoverwrite_table
Replace all rows in an Iceberg table (Silver / Gold pattern).
ingestion/iceberg_io.py:135
↓ 3 callersFunctionrequired_databases
()
scripts/bootstrap-postgres.py:51
↓ 3 callersFunctionrequired_postgres_databases
(*, include_dagster: bool = False)
scripts/verify-setup.py:310
↓ 3 callersFunctionrun_dax_bronze_checks
Run DAX-specific bronze checks.
ingestion/quality/bronze_checks.py:90
↓ 3 callersFunctionrun_ecb_bronze_checks
Run ECB-specific bronze checks.
ingestion/quality/bronze_checks.py:76
↓ 3 callersFunctiontrain
Train a binary classifier with TimeSeriesSplit cross-validation.
ml/train_ecb_dax_model.py:38
↓ 2 callersFunction_base_dax_df
()
tests/test_quality_checks.py:29
↓ 2 callersFunction_base_ecb_df
()
tests/test_quality_checks.py:18
↓ 2 callersMethod_client
(self)
dagster/io_managers.py:33
↓ 2 callersFunction_downcast_ns_timestamps
Cast nanosecond-precision timestamp columns to microseconds. Iceberg v1/v2 only supports microsecond (us) timestamp precision. Python 3.11+ d
ingestion/iceberg_io.py:26
↓ 2 callersFunction_ensure_trailing_slash
(uri: str)
storage_config.py:124
↓ 2 callersFunction_env
(name: str, default: str)
scripts/health-server.py:200
↓ 2 callersMethod_fetch_data
(self)
ingestion/collectors/dax_collector.py:40
↓ 2 callersFunction_get_or_create_table
( catalog: "Catalog", namespace: str, table_name: str, schema: "Schema", partition_spec: "
ingestion/iceberg_io.py:95
↓ 2 callersMethod_parse_payload
(self, payload: dict[str, Any])
ingestion/collectors/ecb_collector.py:57
↓ 2 callersMethod_path_from_asset_key
(self, context: OutputContext | InputContext)
dagster/io_managers.py:42
↓ 2 callersFunction_postgres_tcp_endpoint
Host-side TCP endpoint for the published Postgres port (Compose maps PG_PORT).
scripts/bootstrap-postgres.py:18
↓ 2 callersFunction_replace_data_suffix
(bucket: str, suffix: str)
storage_config.py:104
↓ 2 callersMethod_validate_records
( self, raw_data: list[dict[str, Any]] )
ingestion/collectors/dax_collector.py:53
↓ 2 callersMethod_validate_records
( self, raw_data: list[dict[str, Any]] )
ingestion/collectors/ecb_collector.py:85
↓ 2 callersMethodas_dict
(self)
storage_config.py:24
↓ 2 callersMethodcollect
(self)
ingestion/collectors/ecb_collector.py:115
↓ 2 callersFunctionensure_namespace
Create namespace if it does not already exist (idempotent).
ingestion/iceberg_io.py:81
↓ 2 callersMethodfit
(self, x, y)
tests/test_collectors_ml_and_reports.py:300
↓ 2 callersFunctionload_dotenv_if_present
()
tests/integration/conftest.py:15
↓ 2 callersMethodto_dict
Serialize with model_dump and include underscore aliases.
ingestion/schema/ecb_schema.py:37
↓ 2 callersFunctiontransform_dax_bronze_to_silver
Transform DAX bronze rows into cleaned silver rows.
transformations/dax_bronze_to_silver.py:17
↓ 2 callersFunctiontransform_ecb_bronze_to_silver
Transform ECB bronze rows into cleaned silver rows.
transformations/ecb_bronze_to_silver.py:17
↓ 2 callersFunctionverify_tcp_password
(*, user: str, password: str)
scripts/bootstrap-postgres.py:60
↓ 1 callersMethod__init__
(self, *args, **kwargs)
tests/test_collectors_ml_and_reports.py:297
↓ 1 callersMethod_already_ingested_today
Return True if Bronze already contains a row ingested today.
ingestion/collectors/dax_collector.py:70
↓ 1 callersFunction_check_postgres_via_docker
(user: str)
scripts/verify-setup.py:130
↓ 1 callersFunction_compute_cumulative_return_pct
(returns_pct: pd.Series)
transformations/silver_to_gold_features.py:17
↓ 1 callersFunction_default_display_name
(product_id: str)
runtime_identity.py:76
↓ 1 callersFunction_default_trino_user
(product_id: str)
runtime_identity.py:83
↓ 1 callersFunction_dollar_quote_string
Return a PostgreSQL dollar-quoted literal safe for passwords with quotes or $.
scripts/bootstrap-postgres.py:25
↓ 1 callersFunction_gold_dataframe_from_iceberg
(catalog: "Catalog")
ml/evaluate.py:53
↓ 1 callersFunction_gold_dataframe_from_trino
(trino_url: str)
ml/evaluate.py:26
↓ 1 callersFunction_identity_summary
(identity: RuntimeIdentity)
scripts/health-server.py:193
↓ 1 callersFunction_load_dotenv
Load .env from the repo root if present (same logic as verify-demo.py).
scripts/init-iceberg-namespaces.py:25
↓ 1 callersFunction_minio_base_url
(endpoint: str)
scripts/verify-setup.py:42
↓ 1 callersFunction_postgres_list_databases_query
(*, include_dagster: bool)
scripts/verify-setup.py:304
↓ 1 callersMethod_serve_doc
(self, path: Path)
scripts/health-server.py:446
↓ 1 callersFunction_strip_optional_quotes
(value: str)
storage_config.py:118
↓ 1 callersFunction_strip_optional_quotes
(value: str)
runtime_identity.py:70
↓ 1 callersFunctionalign_role_password_via_docker
Apply ALTER USER using trusted in-container psql (avoids quoting issues).
scripts/bootstrap-postgres.py:77
↓ 1 callersFunctioncollect_statuses
()
scripts/health-server.py:93
↓ 1 callersFunctiondefault_audit_bucket
Return the default audit bucket for a data bucket.
storage_config.py:87
↓ 1 callersFunctiondefault_mlflow_artifact_bucket
Return the default MLflow artifact bucket for a data bucket.
storage_config.py:92
↓ 1 callersFunctiondefault_mlflow_artifact_root
Return the default MLflow artifact root URI for an artifact bucket.
storage_config.py:99
↓ 1 callersFunctiondefault_warehouse_uri
Return the default warehouse URI for a data bucket.
storage_config.py:82
↓ 1 callersFunctiondemo_readiness
(statuses: list[StatusTuple])
scripts/health-server.py:152
↓ 1 callersFunctionensure_databases_via_docker
(user: str)
scripts/bootstrap-postgres.py:149
↓ 1 callersFunctionensure_databases_via_tcp
(*, user: str, password: str)
scripts/bootstrap-postgres.py:198
↓ 1 callersFunctionexecute_count
(trino_url: str, sql: str)
scripts/verify-demo.py:37
↓ 1 callersFunctionget_audit_bucket
Return the effective entity audit bucket.
storage_config.py:67
↓ 1 callersFunctionget_mlflow_artifact_bucket
Return the effective MLflow artifact bucket.
storage_config.py:72
↓ 1 callersFunctionget_mlflow_artifact_root
Return the effective MLflow default artifact root URI.
storage_config.py:77
↓ 1 callersFunctionget_warehouse_uri
Return the effective Hive/Trino warehouse URI.
storage_config.py:62
↓ 1 callersFunctionload_dotenv_if_present
()
scripts/verify-setup.py:26
↓ 1 callersFunctionload_dotenv_if_present
()
scripts/bootstrap-postgres.py:35
↓ 1 callersFunctionload_dotenv_if_present
()
scripts/verify-demo.py:23
↓ 1 callersFunctionload_verify_setup_module
()
scripts/health-server.py:80
↓ 1 callersFunctionmain
()
scripts/init-iceberg-namespaces.py:44
↓ 1 callersFunctionmain
()
scripts/verify-setup.py:326
next →1–100 of 234, ranked by callers