hub / github.com/apache/spark-connect-rust

github.com/apache/spark-connect-rust @main

Chat with this repo

repository ↗ · DeepWiki ↗ · + Follow

719 symbols 3,058 edges 28 files 296 documented · 41% ● updated 3d ago★ 36

Browse by type

⨍ Functions 681◇ Types & classes 38

What it actually does AI analysis from the code graph — generated when you open this

loading…

Extension points exported contracts — how you extend this code

SparkDataType (Interface)

Represents basic methods for a [SparkDataType] [3 implementers]

crates/connect/src/types.rs

ToSchema (Interface)

A trait used to a create a DDL string or JSON string Primarily used for [StructType] and Strings [3 implementers]

crates/connect/src/readwriter.rs

ToFilterExpr (Interface)

Create a filter expression [2 implementers]

crates/connect/src/expressions.rs

ToLiteral (Interface)

Translate a rust value into a literal type

crates/connect/src/expressions.rs

ConfigOpts (Interface)

A trait used to convert to the expected Spark Options for readwriters This sets multiple options at once using a HashMa

crates/connect/src/readwriter.rs

browse all types & interfaces →

Core symbols most depended-on inside this repo

↓ 6 filescol

Returns a [Column] based on the given column name.

crates/connect/src/functions/mod.rs

↓ 4 fileslit

Creates a [Column] of [spark::expression::Literal] value.

crates/connect/src/functions/mod.rs

↓ 2 filesinvoke_func

crates/connect/src/functions/mod.rs

browse all functions →

Shape

Method 407

Function 274

Class 29

Interface 5

Enum 4

Languages

Rust97%

Python3%

Modules by API surface

crates/connect/src/dataframe.rs143 symbols

crates/connect/src/functions/mod.rs126 symbols

crates/connect/src/plan.rs53 symbols

crates/connect/src/readwriter.rs51 symbols

crates/connect/src/streaming/mod.rs50 symbols

crates/connect/src/catalog.rs47 symbols

crates/connect/src/client/mod.rs42 symbols

crates/connect/src/column.rs40 symbols

crates/connect/src/session.rs38 symbols

dev/merge_connect_rust_pr.py21 symbols

crates/connect/src/window.rs19 symbols

crates/connect/src/types.rs19 symbols

For agents

$ claude mcp add spark-connect-rust \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact

github.com/apache/spark-connect-rust @main

Extension points exported contracts — how you extend this code

Core symbols most depended-on inside this repo

Shape

Languages

Modules by API surface

For agents

Ask about this repo answers extend the page