Functions — github.com/devlace/datadevops

CodeHub MCPcopy Create free account

hub / github.com/devlace/datadevops / functions

Functions20 in github.com/devlace/datadevops

⨍ Functions 20 ◇ Types & classes 0

↓ 10 callersFunctionget_schema

src/ddo_transform/ddo_transform/transform.py:16

↓ 2 callersFunctiondownload_url

(url, filename)

databricks/notebooks/00_setup.py:137

↓ 1 callersFunction_inspect_df

(df: DataFrame)

src/ddo_transform/ddo_transform/transform.py:374

↓ 1 callersFunction_run_process_fact_parking

src/ddo_transform/ddo_transform/transform.py:354

↓ 1 callersFunctionget_schema

src/ddo_transform/ddo_transform/standardize.py:12

↓ 1 callersFunctionprocess_dim_location

Transform sensordata into dim_location

src/ddo_transform/ddo_transform/transform.py:162

↓ 1 callersFunctionprocess_dim_parking_bay

Transform incoming parkingbay_sdf data and existing dim_parking_bay into the latest version of records of dim_parking_bay data.

src/ddo_transform/ddo_transform/transform.py:88

↓ 1 callersFunctionprocess_dim_st_marker

Transform sensordata into dim_st_marker

src/ddo_transform/ddo_transform/transform.py:222

↓ 1 callersFunctionprocess_fact_parking

Transform sensordata into fact_parking

src/ddo_transform/ddo_transform/transform.py:277

↓ 1 callersFunctionstandardize_parking_bay

(parkingbay_sdf: DataFrame, load_id, loaded_on)

src/ddo_transform/ddo_transform/standardize.py:43

Function_run_process_dim_location

src/ddo_transform/ddo_transform/transform.py:334

Function_run_process_dim_parking_bay

src/ddo_transform/ddo_transform/transform.py:324

Function_run_process_dim_st_marker

src/ddo_transform/ddo_transform/transform.py:344

Functionsave_overwrite_unmanaged_table

When trying to read and overwrite the same table, you get this error: 'Cannot overwrite table dw.dim_parking_bay that is also being read from;'

src/ddo_transform/ddo_transform/util.py:8

Spark Session fixture

src/ddo_transform/tests/test_transform.py:16

Spark Session fixture

src/ddo_transform/tests/test_standardize.py:17

Functionstandardize_sensordata

(sensordata_sdf: DataFrame, load_id, loaded_on)

src/ddo_transform/ddo_transform/standardize.py:65

Functiontest_process_dim_parking_bay

Test data transform

src/ddo_transform/tests/test_transform.py:29

Functiontest_standardize_parking_bay

Test data transform

src/ddo_transform/tests/test_standardize.py:30

Functiontest_standardize_sensordata

Test data transform

src/ddo_transform/tests/test_standardize.py:45