Unified cloud data access optimized for maximum performance. Accepts bare ``bucket/key`` paths (canonical form) as well as ``r2://`` and ``s3

Manual configuration for data source business context

Context manager for timing async code blocks. Args: name: Name of the timer for logging Example: >>> async with

Client for accessing the Danish Address Web API (DAWA). Provides methods to: - Geocode addresses using adresseId from CVR - Search f

Client for accessing the Danish CVR register API. Provides methods to: - Fetch company data by CVR number - Fetch financial reports

DAWA API client with integrated geocoding cache. Provides the same interface as DAWAAPIClient but with automatic caching to avoid redund

Result of a transformation operation.

Configuration for individual pipeline scheduling. Attributes: frequency: How often the pipeline should run depends_on: List

Base configuration for field analysis stages.

Schema definition for a single column.

Centralized configuration for H3 spatial processing.

Wraps MetadataManager with automatic timing. Replaces the 30-40 lines of metadata boilerplate repeated in every pipeline: - start_time tracki

Shared base class for DuckDB-based data processing across all pipelines. This class consolidates common DuckDB operations that were previous

Local file system storage implementation.

Loads and integrates data from various sources for PMTiles generation.

The main pesticide disaggregation processor - this is where the magic happens! WHAT THIS CLASS DOES: ==================== This class

Cloud storage implementation.

Configuration for the DMI Bronze source. This class defines all configuration parameters needed for fetching climate data from the Danis

Storage manager wrapper that uses optimized cloud storage access for drive pipeline needs.

Test implementation of BaseSource for testing purposes.

Refactored H3 PFAS processor with modular architecture and cloud storage data loading.

Manager for file metadata.

Mock lxml Element for testing.

Raised when a dataset cannot be published safely.

Utility class for managing temporary files and directories.

Manages metadata creation and storage

A class to handle the silver layer transformations for arbejdstilsynet_inspections data. Transforms raw CSV data into cleaned and structured

Result of area validation check.

Configuration model for command-line interface options. This model validates and stores the configuration options provided via the comma

Utility class to verify coordinate order in geometry data.

Client for interacting with DMI's climate data API

Minimal transformer stub matching the current SilverProcessor contract.

Handles saving analysis results to cloud storage.

Custom exception for schema upload errors.

Uploads PMTiles to Cloudflare R2 using rclone.

Client for interacting with Danmarks Statistik API

Detects available years for different data sources in cloud storage.

Model for a Google Drive folder.

Handles data loading from cloud storage and local sources.

Configuration settings for BBR Buildings Pipeline.

Processor for the Silver layer.

Error during storage operations.

Bronze layer data processor for Danish water projects. This class handles the extraction of water project data from multiple Danish envi

Result of identifier validation.

Manages schema documentation generation and GitHub integration for any pipeline.

Processor for the Bronze layer.

Model for a Google Drive file.

Represents emissions from a specific category with data quality tracking. Includes both GHG emissions (CO2e) and environmental emissions (NH

Configuration for the FVM WFS Bronze source. This class defines all configuration parameters needed for fetching agricultural field data

Configuration for FVM WFS Silver data processing. This configuration defines parameters for transforming FVM WFS data from raw (bronze)

Raised when FVM WFS year discovery fails.

Error during file download operations.

Main PMTiles Generator Pipeline.

Extended processor for pipeline-specific operations. This class adds pipeline-specific functionality on top of the base SharedDuckDBProc

Context manager for stage logging within pipelines.

Configuration for address selection algorithm.

Loads agricultural data from cloud storage silver/gold layers for climate calculations. This loader provides convenient access to: - CHR

Google Cloud Storage backend for arbejdstilsynet_inspections files - OPTIMIZED VERSION.

Configuration for the DST Bronze source. This class defines all configuration parameters needed for fetching data from Danmarks Statisti

Local dataset export plus derived upload archive.

Enhanced primary address selection with multiple strategies.

Configuration class for testing BaseJobConfig.

Leverages DuckDB's native schema introspection capabilities.

Configuration for PMTiles Generator Gold Pipeline.

Context manager for pipeline logging that provides structured logging with automatic start/end messages and duration tracking.

Monitor runner resource usage during cloud storage operations.

Application settings loaded from environment variables.

Schema definition for a table.

Utility class for running tippecanoe commands.

Result of validation checks.

Result of a validation operation.

Short-circuit R2 discovery so export() operates on pre-seeded tables.

Configuration for agricultural pattern matching.

Bronze layer processor for BNBO status data. This class is responsible for fetching BNBO (Boringsnære Beskyttelsesområder) status data f

Manager for CVR number collection across pipelines. This class provides methods for: - Saving CVR numbers from individual pipelines

Handles coordinate system transformations and area calculations.

Silver layer processor for DMI monthly climate data using DuckDB-spatial. This class transforms raw DMI climate data from the bronze layer i

Transformer stub aligned with the current silver transformer contract.

Main orchestrator for farm climate impact calculations. Coordinates data loading, emission calculations across all categories, and inten

Generates field analysis PMTiles with integrated data sources.

Metadata for a file in the Bronze layer.

Error during Google Drive API operations.

Silver layer processor for Kemidata surface water pesticide data. Transforms raw CSV and station JSON from bronze into clean parquet wit

Configuration for Kemidata surface water silver processing. Attributes: dataset: Name of the dataset in storage bucket: stor

Handles the 5-stage optimized spatial join pipeline.

Build cloud storage paths consistently across all pipelines. Centralizes bucket name and medallion-layer path construction so pipelines never

Silver layer processor for pig movement data. This class transforms raw pig movement data from the bronze layer into structured, clean d

Result of area validation.

Configuration for BNBO (Boringsnære Beskyttelsesområder) status data source in the bronze layer. This class defines all the configuration pa

Metrics captured from a dataset for baseline comparison.