Get the UUID namespace from environment variable.

Monitor memory and disk usage for GitHub Actions constraints.

Process all years for a specific layer type. Args: session (aiohttp.ClientSession): HTTP session for making requests

Process all years for a specific layer type. Args: layer_type: Type of layer to process (Markblokke, Marker, Smaabiotope

Validate the analysis results.

Calculates CO2 emissions from organogene jorde based on land characteristics. Args: h (float): Antal ha marken. i_omdrift (b

Check for potential PII data (like CPR numbers) and replace if found.

Monitor memory and disk usage.

Provide CHR formatting function to tests. Returns: Callable that formats CHR with leading zeros.

Commit generated schema files to GitHub. Args: commit_message: Custom commit message Returns: True

Create a GeoJSON Point geometry from coordinates. Args: latitude: Latitude coordinate longitude: Longitude c

Create a WKT POINT geometry string from coordinates. Args: latitude: Latitude coordinate longitude: Longitud

Create SOAP client with robust certificate-based authentication. Returns: Tuple of (client, username, password, certificate, private_key)

Provide CVR formatting function to tests. Returns: Callable that formats CVR with leading zeros.

Filter PII from raw CVR data while preserving business information. Args: raw_cvr_data: Raw CVR data from API Returns:

Filter PII from individual deltager (person) data. Args: deltager: Deltager data object Returns: Filtered deltager data

Find the most recent file matching a glob pattern.

Generate documentation for all tables and create overview. Args: tables: List of table names stage: Processi

Generate a UUID-based ID with a specific prefix.

* Get all PMTiles URLs for a specific year

Get agricultural fields dataset name for the configured year.

Run the complete silver processing pipeline. Args: bronze_data_path: Specific path to bronze data (optional) output_dir: Out

Execute pipeline stages based on --stage argument. Args: stage: The stage to run ("bronze", "silver", "all", etc.) stages_map: Or

Set up UUID generation functions in DuckDB connection. Args: conn: DuckDB connection object

Update the H3 resolution and corresponding validation parameters.

Check if memory usage is safe to continue (returns True if safe, False if emergency).

Create separate dissolved tables for each layer type using DuckDB-spatial. Creates separate dissolved geometries for: - inds

Draw a rounded box with centered text.

Fetch all data from a WFS service using pagination. This method orchestrates the fetching of all features from a WFS layer b

Find a column from a list of candidate names.

Get all available fvm_marker years from cloud storage. Returns: List of available years for fvm_marker datasets

Get path to latest silver data file.

Get the latest timestamped directory from a base storage path. This method dynamically discovers timestamped directories (format: YY

Get storage path for Stage 0 pre-filtered output with year suffix for isolation.

Get total number of features available from a specific layer. Args: session (aiohttp.ClientSession): HTTP session for ma

Load agricultural fields as BUILD side for spatial indexing.

Download parquet from R2 via wrangler and load into DuckDB table. Returns row count.

Log detailed performance metrics for each phase.

Create a StorageAccess with mocked filesystem.

Process raw data from multiple layers and combine into a single table. Args: raw_data (list): List of raw data dictionar

Read data from silver layer for gold processing.

Run svineflytning main.py with given args.

Run python main.py --help for a pipeline directory.

Transform ledger entries to aggregated CVR-level data.

Calculate NH3 emissions from cattle manure management. Formula: NH3 (kg) = antal_dyr × EF_nh3 Where: - antal_dyr: Numbe

Calculate NH3 emissions from synthetic fertilizer application to fields. Formula: NH3-N (kg) = N_applied × EF_nh3_n NH3 (kg)

Fetch company data for multiple CVR numbers efficiently using batch API calls. Uses Elasticsearch 'terms' query to fetch multiple co

Filter data by date range if start_date or end_date are provided.

Geocode an address using the Datavask API as fallback. Datavask API can handle unstructured address text and correct spelling errors

Get a specific input value for an animal type. Args: animal_type: Identifier for the animal type input_type:

Get list of years for which both pesticide and field data are available.

Get a CHR client lazily, creating it only when needed.

Get DuckDB connection with R2 configured (native TYPE r2 secret).

Get the cloud storage input paths for a specific pipeline step. This function intelligently determines whether to use pipeline dependencies

Execute a GraphQL query and return the response.

Download a parquet file and load into DuckDB table.

Log progress message with optional record count.

Main entry point for the pipeline. Returns: Exit code (0 for success, non-zero for errors)

Convert N2O mass to CO2 equivalent using IPCC AR5 GWP. Args: n2o_kg (float): Mass of N2O in kg config: Optional ConfigLoader

Return the ID of the nearest meteorological region (Euclidean in UTM).

Process files from the Bronze layer. Args: bronze_run_path: Path to the Bronze layer run directory specific_subfolder

Execute tasks in parallel using a thread pool with progress tracking.

Convenience function to save CVR numbers from a pipeline. Args: pipeline_name: Name of the pipeline cvr_numbers: List of CVR

Generate SQL for buffer operation in meters. Transforms to UTM, applies buffer, transforms back. Args: geometry_expr: SQL expre

Generate SQL for ST_Intersects with a metric buffer. Args: geom1_expr: SQL expression for first geometry geom2_expr: SQL exp

Check if a table exists.

Convert to dictionary for serialization.

Transform FVM DuckDB relation to structured field summaries. Args: rel: DuckDB relation with field boundary data

Validate that PII has been properly filtered from CVR data. Args: filtered_data: Filtered CVR data Returns: Validation

Fraction of time wind blows from the field direction toward the building. bearing_deg: compass bearing FROM the building TO the field center (0-3

Perform aggressive memory cleanup to free up resources.

Download an .rds file from GEUS Dataverse. Args: session: HTTP session for making requests url: Download URL

Draw an arrow between two points.

Fetch raw data from all configured layers and services. This is the main orchestration method that fetches data from all configured

Fetch all raw data from the WFS service. This method orchestrates the data retrieval workflow: 1. Establishes an HTTP sessio

Get an attribute value from an XML element. This method finds a child element with the specified tag and returns its text va

Get the latest path for a specific dataset.

Get the WFS layer name for a specific type and year. Args: layer_type (str): Type of layer ('Markblokke', 'Marker', 'Sma

Make an authenticated request to the CVR API with retry logic. Args: url: API endpoint URL payload: Request

Monitor and log memory usage for a specific operation.