MCPcopy Index your code
hub / github.com/apache/spark-connect-rust

github.com/apache/spark-connect-rust @main

Chat with this repo
repository ↗ · DeepWiki ↗ · + Follow
719 symbols 3,058 edges 28 files 296 documented · 41% ● updated 42d ago★ 323 open issues
What it actually does AI analysis from the code graph — generated when you open this
loading…

Extension points exported contracts — how you extend this code

SparkDataType (Interface)
Represents basic methods for a [SparkDataType] [3 implementers]
crates/connect/src/types.rs
ToSchema (Interface)
A trait used to a create a DDL string or JSON string Primarily used for [StructType] and Strings [3 implementers]
crates/connect/src/readwriter.rs
ToFilterExpr (Interface)
Create a filter expression [2 implementers]
crates/connect/src/expressions.rs
ToLiteral (Interface)
Translate a rust value into a literal type
crates/connect/src/expressions.rs
ConfigOpts (Interface)
A trait used to convert to the expected Spark Options for readwriters This sets multiple options at once using a HashMa
crates/connect/src/readwriter.rs

Core symbols most depended-on inside this repo

invoke_func
called by 161
crates/connect/src/functions/mod.rs
collect
called by 139
crates/connect/src/dataframe.rs
col
called by 93
crates/connect/src/functions/mod.rs
create_dataframe
called by 76
crates/connect/src/session.rs
lit
called by 72
crates/connect/src/functions/mod.rs
select
called by 61
crates/connect/src/dataframe.rs
setup
called by 45
crates/connect/src/dataframe.rs
client
called by 45
crates/connect/src/session.rs

Shape

Method 407
Function 274
Class 29
Interface 5
Enum 4

Languages

Rust97%
Python3%

Modules by API surface

crates/connect/src/dataframe.rs143 symbols
crates/connect/src/functions/mod.rs126 symbols
crates/connect/src/plan.rs53 symbols
crates/connect/src/readwriter.rs51 symbols
crates/connect/src/streaming/mod.rs50 symbols
crates/connect/src/catalog.rs47 symbols
crates/connect/src/client/mod.rs42 symbols
crates/connect/src/column.rs40 symbols
crates/connect/src/session.rs38 symbols
dev/merge_connect_rust_pr.py21 symbols
crates/connect/src/window.rs19 symbols
crates/connect/src/types.rs19 symbols

For agents

$ claude mcp add spark-connect-rust \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact