Substrate

Infrastructure for Human Knowledge & Progress

What Is It • Data • Quick Start • Docs • Contribute • Roadmap

---

🎯 What Is Substrate?

→ Watch Introduction Video • → Read Blog Post

---

A Shared Foundation for Human Progress

Think of substrate as the base layer—the common ground where we can all work together to understand problems and drive solutions forward. Instead of fragmented discussions and reinventing the wheel, Substrate gives us one place to:

• Document problems → What's actually broken, with evidence
• Track solutions → What works, what doesn't, with results
• Connect progress → Link people, organizations, and projects actually moving things forward
• Build on each other → Arguments and ideas that build on shared evidence
• Measure outcomes → Did it work? What actually changed?

The Purpose: Accelerate Human Progress

We can't solve problems we don't understand. We can't build on solutions we can't find. Substrate provides:

• 🎯 Shared understanding → One place to understand what's wrong and what works
• 🚀 Faster progress → Build on existing knowledge instead of starting over
• 📊 Evidence-based action → Ground decisions in authoritative data, not opinions
• 🔗 Connected knowledge → See how problems, solutions, people, and data interconnect
• 🌍 Collective intelligence → Human insight + AI analysis working together toward progress

An open-source framework connecting 17+ knowledge components:

graph TB
    subgraph "🌍 The Substrate"
        A[🧩 Problems]
        B[💡 Solutions]
        C[📊 Data Sources]
        D[🗣️ Arguments]
        E[📋 Claims]
        F[👥 People]
        G[🏢 Organizations]
        H[🚀 Projects]
        I[📈 Plans]
        J[🎯 Values]
        K[💭 Ideas]
    end

    L[👤 Human Contributors] --> A
    L --> B
    L --> D
    M[🤖 AI Analysis] --> A
    M --> B
    M --> D

    A -.connects to.-> B
    B -.connects to.-> C
    D -.connects to.-> C
    E -.connects to.-> C
    F -.connects to.-> G
    G -.connects to.-> H
    H -.connects to.-> B

    A --> N[🔍 Shared Understanding]
    B --> N
    C --> N
    D --> N

### 🏗️ **Structured Components** - **Problems** - Documented challenges with evidence - **Solutions** - Proven approaches with results - **Arguments** - Reasoning chains with quality scores - **Claims** - Assertions linked to evidence - **Plans** - Actionable strategies with metrics - **Ideas** - Frameworks and concepts - **People & Organizations** - Who's working on what - **Projects** - Active initiatives with outcomes

### 📊 **Authoritative Data** - **13 Data Sources** across 100+ years - **Library science methodology** (8 dimensions) - **Government agencies** + verified databases - **TypeScript automation** with Bun runtime - **Full documentation** for every dataset - **Free APIs** with excellent access - **Human wellbeing indicators** beyond GDP - **Real-time** to annual update frequencies

---

🚀 What's New

[!TIP] October 2025 - Massive Data Expansion!

We just added 8 authoritative data sources measuring human wellbeing beyond traditional economic metrics. Now track financial stress, health crises, social connection, worker agency, and environmental health.

📅 Latest Updates (Click to expand)

🔥 October 27, 2025 - Human Wellbeing Infrastructure

5 NEW US Wellbeing Data Sources:

Added	Source	What It Measures
🆕	DS-00004 FRED Economic Wellbeing	Debt stress, unemployment, inequality
🆕	DS-00005 CDC WONDER Mortality	Overdoses, suicides, deaths of despair
🆕	DS-00006 Census ACS Social	Living alone, commute times, isolation
🆕	DS-00007 BLS JOLTS Labor	Worker "permission to quit" index
🆕	DS-00008 EPA Air Quality	PM2.5, ozone, environmental health

Why This Matters:

"If we measure only GDP and unemployment, we will miss the slow-motion collapse of human thriving happening in plain sight."

These sources capture: - 💰 Leading indicators - Financial stress predicts recessions - 🎭 Behavioral truth - Actions reveal what surveys miss - 🏗️ Structural determinants - Air quality you can't "self-care" out of - 🚨 Crisis detection - County-level suffering visibility - 🆓 Worker agency - Quit rate = economic freedom measure

October 25, 2025 - Core Data Updates

• ✅ Pulitzer Prize, GDP, inflation data refreshed
• ✅ Knowledge Worker Salaries validation completed

October 16-18, 2025 - Infrastructure

• 🏗️ Library science methodology (8-dimension evaluation)
• ⚡ TypeScript automation with auto-discovery
• 📊 Central logging and health monitoring
• 📚 Complete documentation suite

---

📜 Previous Updates (Click to expand)

September 2024 - Community Growth

• ✅ Claims, Arguments, and Values frameworks
• ✅ 6+ community contributors
• ✅ 10+ merged pull requests
• ✅ TELOS integration

August 2024 - Framework Expansion

• ✅ Extended component types (Plans, Ideas, Models)
• ✅ Improved documentation structure
• ✅ Enhanced contribution guidelines

July 2024 - Foundation

• ✅ Single-repo structure with 17+ object types
• ✅ Core framework and documentation
• ✅ Public launch with initial datasets
• ✅ Community contribution framework

---

→ View Full Changelog

---

📊 Data & Evidence

[!NOTE] All data sources include complete library science cataloging with 8-dimension evaluation: Authority, Currency, Objectivity, Accuracy, Methodology, Coverage, Reliability, and Provenance.

[!IMPORTANT] We know data can be controversial. That's exactly why we: - 📊 Collect from multiple sources - Cross-reference data from different authoritative providers - 🔍 Provide complete transparency - Every source fully documented with provenance, methodology, and limitations - 📝 Full logging - All data pulls logged with timestamps, source versions, and processing steps - 🔓 Open source everything - TypeScript update scripts show exactly how data is fetched and transformed

You can verify, audit, and challenge our data. That's the point.

Core Datasets (Data/)

Dataset	Time Span	Data Points	Source	Status
🇺🇸 US GDP	1929-2025	96 years + 314 quarters	FRED/BEA	✅ Active
💵 US Inflation	1947-2025	945 months	FRED/BLS	✅ Active
🦠 Bay Area COVID Wastewater	2022-2025	161 weeks	CDPH	✅ Active
🏆 Pulitzer Prize Winners	1918-2024	249 winners	Wikidata	✅ Active
💼 Knowledge Worker Salaries	Global	Multi-region	Research	✅ Active

Wellbeing Data Sources (Data-Sources/) 🆕

🌍 Global Health & Development (Click to expand)

ID	Name	Coverage	Indicators	Update
DS-00001	WHO Global Health Observatory	194 countries	2,000+ health indicators	Quarterly
DS-00002	UN SDG Indicators	193 countries	231 SDG targets	Biannual
DS-00003	World Bank Open Data	Global	Development metrics	Varies

🇺🇸 US Human Wellbeing (October 2025)

Source	Key Indicators	Why It Matters	Update Freq
DS-00004 FRED Economic	• Debt service ratio • Credit card delinquency • Financial stress index • Underemployment (U-6) • Consumer sentiment • GINI inequality	💰 Economic Security Foundation Debt >12% = stress, >14% = crisis. Leading indicator of recession.	Weekly to Annual
DS-00005 CDC WONDER	• Drug overdose deaths • Opioid-specific deaths • Suicide rates • All-cause mortality	🚨 Crisis Detection Deaths of despair reveal community breakdown surveys miss. County-level visibility.	Annual (1-2yr lag)
DS-00006 Census ACS	• Living alone (isolation) • Commute times (time poverty) • No internet (digital divide) • Household demographics	🤝 Social Connection Structural isolation and time poverty constrain flourishing. Census tract granularity.	Annual
DS-00007 BLS JOLTS	• Quit rate (worker agency) • Job openings • Hire rate • Layoff/discharge rate	🆓 "Permission to Quit" People only quit when they have options. Measures economic freedom and dignity.	Monthly
DS-00008 EPA Air Quality	• PM2.5 (particulate matter) • Ozone (O3) • SO2, CO, NO2 • AQI exceedances	🌫️ Environmental Health You can't "self-care" out of breathing toxic air. Structural wellbeing constraint.	Real-time

Composite Wellbeing Indices

[!TIP] Combine multiple data sources to create powerful wellbeing metrics:

• 💸 Financial Stress Composite - Debt + delinquency + evictions + stress index
• 🚨 Crisis Alert Composite - Overdoses + suicides + long-term unemployment
• 🤝 Community Health Composite - Living alone + commute + digital divide (inverted)
• 🆓 Worker Agency Index - Quit rate + job openings / unemployment
• 🌫️ Environmental Health Index - PM2.5 + ozone (inverted)

→ Wellbeing Implementation Guide | → Data Directory

---

🤖 Human & AI Collaboration

Substrate provides the pieces. You and your AI create the connections.

### 👤 **Humans Contribute** - Document problems and solutions - Add authoritative data sources - Create arguments and claims - Link entities explicitly - Validate AI suggestions - Rate quality of evidence

### 🤖 **AI Analyzes** - Scan thousands of components - Suggest relationships automatically - Detect patterns across datasets - Score argument quality - Find contradictions - Generate knowledge graphs

Everything is designed for dual consumption: - ✅ Human-readable - Markdown and CSV anyone can open - ✅ Machine-parseable - Consistent formats AI can query - ✅ Fully documented - Complete methodology for every dataset - ✅ Linked with IDs - Unambiguous entity references

Use Cases

🔍 OSINT & Investigation

• Cross-reference public records, corporate filings, government data
• Link people → organizations → transactions → policies
• Surface connections invisible in isolated databases
• Build evidence chains from claims to verifiable records
• Pattern detection for fraud, corruption, illicit networks

📊 Research & Analysis

• Track claims against authoritative data sources
• Evaluate argument quality based on evidence backing
• Compare solutions across different implementations
• Measure progress toward stated goals with real metrics
• Cross-correlate economic, health, social, environmental data

🌐 Public Accountability

• Verify political claims against documented evidence
• Track campaign promises → policy outcomes → measured results
• Link donations → voting records → policy positions
• Monitor government spending against stated objectives
• Environmental justice analysis (who breathes toxic air?)

---

🚀 Quick Start

View the Data (No Installation Required)

All data