Transform the PFAS DataFrame into DuckDB table with standardized schema. PFAS data has a different schema than pesticide data:

Validate geometries are within Denmark bounds (EPSG:25832). Args: table_name: Name of table to validate

Validate results after each disaggregation strategy runs. Tracks cumulative progress and ensures no data corruption. Args:

Add a herd to the high-volume herds list with specific processing constraints.

Apply CLI filtering for matrix job processing. This method modifies the year lists based on CLI parameters to enable process

Calculate CH4 emissions from pig enteric fermentation (IPCC Tier 1). Formula: CH4 (kg/year) = (antal_dyr × FE_per_dyr × MJ_per_FE ×

Calculate emissions from purchased cattle feed. Formula: CO2e (kg) = antal_dyr × TS_per_day × days × Σ(share × EF_per_kg_TS) / 1000

Calculate emissions from purchased pig feed. Formula: CO2e (kg) = antal_dyr × FE_per_animal × Σ(share × EF_per_FE) Where:

Calculate total manure emissions (CH4 + N2O) for pigs. Args: antal_dyr: Number of animals average_body_weight_kg: Average bo

Calculates N2O from nitratudvaskning and its CO2e value. Args: t (float): Typetal for nitratudvaskning h (float): Antal ha p

Clean up old PMTiles files, keeping only the most recent versions. Args: current_files: Dictionary mapping R2 keys to local file

Create a custom retry decorator with specific parameters. Args: max_attempts: Maximum number of retry attempts min_wait: Minimum

Creates the herd_sizes table from the nested BesStr list in besaetning details. Args: con: The DuckDB connection bes_details_raw:

Create output directory for a specific file or content type following the new structure. Args: run_dir: Run directory path (silve

Export table to parquet file.

Extract P-numbers and map them to CVR numbers using the CVR register.

Fetch raw climate grid data and return as JSON. For monthly data, the API will return monthly aggregated values when the dat

Check if a file exists in the Bronze layer. Args: run_dir: Base run directory (bronze/) source_path: Path of the file

Mock file exists check.

Filter PII from deltager relations while keeping business-relevant information. Args: deltager_relations: List of deltager relation

Generate H3 grid for Denmark - CACHED by resolution to avoid recomputation.

Generate metadata for a file. Args: file_path: Path to the file to generate metadata for file_id: Google Drive file I

Create a mock aiohttp session.

Create a mock aiohttp session.

Find CHR number column dynamically.

Get an authenticated Google Drive service. Args: credentials_path: Path to the service account credentials JSON file.

Fetch financial documents and reports for a specific CVR number. Args: cvr_number: 8-digit CVR number max_re

Extract the namespace from an XML root element. This method iterates through the XML elements to find and extract the first

Generate a summary of what PII was filtered from the data. Args: original_data: Original raw CVR data filtered_data: Filtere

Get row count for a table.

Get settings instance.

Get comprehensive schema information using DuckDB's native capabilities. Args: table_name: Name of the table to analyze

* Checks if a PageBuilderItem has actual data

List files matching pattern.

Load BMD data from cloud storage - CACHED to avoid reloading.

Load environmental layer data (year-independent). Returns: Dictionary mapping layer names to DuckDB table names

Mock implementation of load_herd_details. Fetches detailed information for a specific herd.

Log geometry bounds for debugging CRS issues. Args: conn: DuckDB connection table_name: Name of table geometry_col:

Convenience function to lookup cattle TS (dry matter) per day. Args: cattle_type: "malkekøer", "kvier", or "tyre_stude" bree

Monitor disk usage and log warnings if space is low.

Executes the bronze layer pipeline steps using Playwright only.

Run bronze processing for all configured DST tables. Returns: Optional[Dict[str, Any]]: Dictionary mapping table_id to t

Execute query with error handling and logging. Args: query: SQL query to execute description: Description of

Sanitize a SQL identifier by removing characters that aren't alphanumeric or underscores

Save cumulative kommune-level results to cloud storage with special 'total' year identifier.

Save cumulative H3 results to cloud storage with special 'total' year identifier.

Save data immediately to cloud storage without buffering - fixes parallel processing issues. This replaces the broken save_raw_data + finali

Save the transformed data to parquet with enhanced cloud storage export.

Search for addresses by text query. Args: query: Address search query limit: Maximum number of results to re

Select the primary address for the main company table. This function implements intelligent primary address selection that prioritizes:

Setup pipeline components.

Generate SQL to transform geometry to WGS84 for storage. Uses ``always_xy := true`` to emit (lon, lat) — what PostGIS/Supabase and our R

Upload a file to storage bucket using optimized streaming.

OPTIMIZED: Upload pre-serialized JSON string with streaming. Use this when you already have a JSON string and want maximum performan

Upload a PMTiles file to Cloudflare R2. Args: file_path: Local path to PMTiles file r2_key: R2 object key (path in bu

One-shot intersection observer — fires `true` once element enters viewport

Validate column names against conventions.

Validate that a field UUID follows proper UUID format. Args: field_uuid: The field UUID to validate Returns:

Verify field UUIDs are present in the final results table. field_uuid is now preserved throughout the pipeline from the source

Delegate to memory utils.

Aggressive resource cleanup for memory-constrained environment.

Apply Benjamini-Hochberg FDR correction to a list of results.

Build region_id → [freq for direction 0..350 step 10] lookup. Sums frequency across all stability classes per direction bin. Returns 36-eleme

Build request payload based on table ID and parameters - DEPRECATED

Check if numeric value is within tolerance of baseline.