hub / github.com/microsoft/AI-Engineering-Coach

github.com/microsoft/AI-Engineering-Coach @main sqlite

2,021 symbols 6,027 edges 218 files 127 documented · 6%

README

AI Engineer Coach

Analyze your AI coding assistant usage across VS Code, GitHub Copilot for Xcode, Claude, Codex, OpenCode, and GitHub Copilot CLI.

Highlights

The extension is organized into three sections: Observe, Measure, and Improve.

Observe

Page	What it shows
Dashboard	Practice scores with week-over-week and month-over-month trends, skill finder summary, daily activity chart with per-harness breakdown, and top workspace stats
Timeline	Gantt-style session timeline with per-day drill-down, session overlap detection, and a searchable list view
Coding Moments	Screenshot gallery from AI coding sessions with story reels, workspace filtering, and progressive image loading

Measure

Page	What it shows
Output	Two tabs -- Code Output (generated code volume by language and workspace) and Token Usage (model usage table with per-model token breakdown) (Token Usage temporarily hidden)
Burndown	Monthly token budget progress with projection (temporarily disabled)
Patterns	7x24 activity heatmap and work-life balance signals

Improve

Page	What it shows
Anti-Patterns	Five practice score cards (Prompt Quality, Session Hygiene, Code Review, Tool Mastery, Context Management) with detailed findings, severity ratings, concrete actions, and example prompts
Skill Finder	AI-powered analysis of repeated prompts to discover custom skill opportunities, plus matching community skills and agents from the open-source catalog
Context Health	Overall context score, agentic readiness checklist, per-harness context provision breakdown, workspace context map (treemap colored by instruction quality), and AI-powered context file review
Rule Editor	Create, edit, and live-test detection rules as markdown with form-based or raw-source editing and AI-assisted drafting
Rule Playground	Interactive REPL for the rule DSL with field browser, function catalog, and metric list
Data Explorer	Browse request and session fields, view distributions, and run ad-hoc filters

Level Up

Page	What it shows
Learning Center	Personalized quizzes and code-comparison rounds generated from your actual usage
Achievements	XP-based progression with Bronze, Silver, Gold, and Diamond tiers
Agentic SDLC	Track how you use AI across the full software-development lifecycle
Share	Generate a shareable stat card and export Markdown/JSON summaries

Supported Harnesses

Harness	Default location
Local Agent	macOS: `~/Library/Application Support/Code/User/workspaceStorage/`

Linux: ~/.config/Code/User/workspaceStorage/

Windows: %APPDATA%\Code\User\workspaceStorage\ | | Local Agent (Insiders) | macOS: ~/Library/Application Support/Code - Insiders/User/workspaceStorage/

Linux: ~/.config/Code - Insiders/User/workspaceStorage/

Windows: %APPDATA%\Code - Insiders\User\workspaceStorage\ | | Local Agent (Server) | Linux/macOS remote host: ~/.vscode-server/data/User/workspaceStorage/ | | Local Agent (Server Insiders) | Linux/macOS remote host: ~/.vscode-server-insiders/data/User/workspaceStorage/ | | Xcode Copilot Chat | ~/.config/github-copilot/xcode/ (requires sqlite3) | | Claude | macOS/Linux: ~/.claude/projects/

Windows: %USERPROFILE%\.claude\projects\ | | Codex | macOS/Linux: ~/.codex/sessions/

Windows: %USERPROFILE%\.codex\sessions\ | | OpenCode | macOS/Linux: ~/.local/share/opencode/

Windows: %USERPROFILE%\.local\share\opencode\ | | GitHub Copilot CLI | ~/.copilot/session-state/ and ~/.copilot/history-session-state/ |

Chat

Type @aicoach in any VS Code chat panel for conversational access to all coaching data. Slash commands /summary, /improve, /compare, and /flow give quick access to common analyses. The participant orchestrates multiple backend tools automatically to answer complex questions.

Getting Started

Open the command palette (Cmd+Shift+P / Ctrl+Shift+P).
Run AI Engineer Coach: Open Dashboard.
Use the sidebar to navigate pages. Filter by workspace or harness at the bottom.
Run AI Engineer Coach: Reload Data to re-parse after new sessions.
Type @aicoach in VS Code chat for conversational coaching.

License

MIT

Disclaimer

This project is an open-source community effort by Microsoft employees. It is not an official Microsoft product and is not part of any Microsoft service or support offering. It is provided as-is with no warranties or guarantees.

Extension points exported contracts — how you extend this code

RequestBilling (Interface)

Per-request billing token attribution. * * `status` distinguishes: * - `complete` — both input and output tokens

src/core/analyzer-consumption.ts

ProgressMessage (Interface)

Update UI based on progress message

src/webview/app.ts

SummaryExportWriteResult (Interface)

(no doc)

src/summary-export-vscode.ts

CanvasHostOptions (Interface)

(no doc)

src/canvas/host.ts

SlashCommand (Interface)

(no doc)

src/chat/participant.ts

ToolDef (Interface)

(no doc)

src/mcp/tools.ts

GenOptions (Interface)

(no doc)

scripts/generate-synthetic-logs.ts

AckMessage (Interface)

Parent -> worker chunk acknowledgement (issue #106). Routed away from the request handler so * it never re-triggers a

src/core/parse-worker.ts

Core symbols most depended-on inside this repo

expect

called by 2451

src/core/dsl/parser.ts

html

called by 607

src/webview/shared.ts

filter

called by 351

src/core/analyzer-base.ts

get

called by 302

src/core/rule-trust.ts

evaluate

called by 288

src/core/dsl/interpreter.ts

render

called by 209

src/webview/render.ts

assert

called by 189

scripts/e2e-real-data.ts

add

called by 138

src/core/session-totals.ts

Shape

Function 1,386

Method 300

Interface 290

Class 44

Enum 1

Languages

TypeScript100%

Modules by API surface

src/webview/panel-request-service.ts49 symbols

src/core/analyzer.ts45 symbols

src/webview/shared.ts43 symbols

src/core/types/analytics-types.ts43 symbols

src/webview/page-antipatterns.ts42 symbols

src/core/dsl/interpreter.ts39 symbols

src/core/analyzer-consumption.ts39 symbols

src/core/parser-codex.ts36 symbols

src/webview/page-image-gallery.ts34 symbols

src/core/parser-vscode-request.ts34 symbols

src/core/rule-loader.ts31 symbols

src/core/parser-claude.ts31 symbols

Dependencies from manifests, versioned

@eslint/js10.0.1 · 1×

@playwright/test1.61.1 · 1×

@types/node26.0.1 · 1×

@types/vscode1.125.0 · 1×

@vitest/coverage-v84.1.9 · 1×

@vscode/vsce3.9.2 · 1×

chart.js4.5.1 · 1×

chartjs-chart-treemap3.1.0 · 1×

cspell10.0.1 · 1×

esbuild0.28.1 · 1×

eslint10.6.0 · 1×

eslint-plugin-import-x4.17.1 · 1×

Datastores touched

appDatabase · 1 repos

dbDatabase · 1 repos

For agents

$ claude mcp add AI-Engineering-Coach \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact