hub / github.com/cortexlabs/cortex

github.com/cortexlabs/cortex @v0.42.1 sqlite

repository ↗ · DeepWiki ↗ · release v0.42.1 ↗

3,162 symbols 12,189 edges 426 files 402 documented · 13%

README

Website • Slack • Docs

Production infrastructure for machine learning at scale

Deploy, manage, and scale machine learning models in production.

Serverless workloads

Realtime - respond to requests in real-time and autoscale based on in-flight request volumes.

Async - process requests asynchronously and autoscale based on request queue length.

Batch - run distributed and fault-tolerant batch processing jobs on-demand.

Automated cluster management

Autoscaling - elastically scale clusters with CPU and GPU instances.

Spot instances - run workloads on spot instances with automated on-demand backups.

Environments - create multiple clusters with different configurations.

CI/CD and observability integrations

Provisioning - provision clusters with declarative configuration or a Terraform provider.

Metrics - send metrics to any monitoring tool or use pre-built Grafana dashboards.

Logs - stream logs to any log management tool or use the pre-built CloudWatch integration.

Built for AWS

EKS - Cortex runs on top of EKS to scale workloads reliably and cost-effectively.

VPC - deploy clusters into a VPC on your AWS account to keep your data private.

IAM - integrate with IAM for authentication and authorization workflows.

Extension points exported contracts — how you extend this code

Client (Interface)

(no doc) [4 implementers]

pkg/autoscaler/client.go

Typed (Interface)

(no doc) [4 implementers]

pkg/lib/configreader/reader_test.go

Service (Interface)

Service provides an interface to the async-gateway business logic [2 implementers]

pkg/async-gateway/service.go

MessageHandler (Interface)

(no doc) [3 implementers]

pkg/dequeuer/message_handler.go

StatsReporter (Interface)

(no doc) [2 implementers]

pkg/activator/activator.go

Scaler (Interface)

(no doc) [3 implementers]

pkg/autoscaler/autoscaler.go

TestInterface (Interface)

(no doc) [2 implementers]

pkg/lib/strings/stringify_test.go

Storage (Interface)

Storage is an interface that abstracts cloud storage uploading [1 implementers]

pkg/async-gateway/storage.go

Core symbols most depended-on inside this repo

Wrap

called by 540

pkg/lib/errors/error.go

WithStack

called by 360

pkg/lib/errors/error.go

Equal

called by 311

pkg/lib/k8s/quantity.go

String

called by 245

pkg/types/async/status.go

New

called by 205

pkg/lib/sets/strset/strset.go

pkg/lib/sets/strset/threadsafe/strset.go

Error

called by 122

pkg/lib/errors/error.go

Shape

Function 2,147

Method 683

Struct 251

TypeAlias 32

Route 21

Class 15

Interface 12

FuncType 1

Languages

Go93%

Python7%

Modules by API surface

pkg/lib/files/files.go70 symbols

pkg/types/clusterconfig/cluster_config.go58 symbols

pkg/lib/aws/s3.go57 symbols

pkg/types/clusterconfig/errors.go53 symbols

pkg/lib/k8s/quantity.go53 symbols

pkg/lib/configreader/errors.go50 symbols

pkg/lib/sets/strset/threadsafe/strset.go39 symbols

pkg/types/userconfig/api.go37 symbols

pkg/lib/strings/stringify.go36 symbols

pkg/lib/configreader/reader.go36 symbols

pkg/lib/cast/interface.go35 symbols

pkg/lib/configreader/reader_test.go33 symbols

Dependencies from manifests, versioned

cloud.google.com/gov0.81.0 · 1×

github.com/Azure/go-ansitermv0.0.0-2021061722524 · 1×

github.com/Azure/go-autorestv14.2.0+incompatible · 1×

github.com/Azure/go-autorest/autorestv0.11.18 · 1×

github.com/Azure/go-autorest/autorest/adalv0.9.13 · 1×

github.com/Azure/go-autorest/autorest/datev0.3.0 · 1×

github.com/Azure/go-autorest/loggerv0.2.1 · 1×

github.com/Azure/go-autorest/tracingv0.6.0 · 1×

github.com/DataDog/datadog-gov4.8.0+incompatible · 1×

github.com/Microsoft/go-winiov0.5.0 · 1×

github.com/Nvveen/Gottyv0.0.0-2012060400481 · 1×

github.com/StackExchange/wmiv0.0.0-2021022419422 · 1×

For agents

$ claude mcp add cortex \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact