Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/apache/spark-connect-rust
/ functions
Functions
681 in github.com/apache/spark-connect-rust
⨍
Functions
681
◇
Types & classes
38
Method
clear_tags
(&mut self)
crates/connect/src/client/mod.rs:339
Function
column
Returns a [Column] based on the given column name.
crates/connect/src/functions/mod.rs:102
Function
concat_ws
Concatenates multiple input string columns together into a single string column, using the given separator
crates/connect/src/functions/mod.rs:1254
Function
conv
Convert a number in a string column from one base to another.
crates/connect/src/functions/mod.rs:190
Function
convert_timezone
Converts the timestamp without time zone sourceTs from the sourceTz time zone to targetTz.
crates/connect/src/functions/mod.rs:287
Method
corr
(self, col1: impl AsRef<str>, col2: impl AsRef<str>)
crates/connect/src/plan.rs:170
Function
count_distinct
Returns a new Column for distinct count of col or cols
crates/connect/src/functions/mod.rs:949
Function
count_min_sketch
Returns a count-min sketch of a column with the given esp, confidence and seed.
crates/connect/src/functions/mod.rs:976
Method
cov
(self, col1: impl AsRef<str>, col2: impl AsRef<str>)
crates/connect/src/plan.rs:183
Method
create
(connection: &str)
crates/connect/src/client/builder.rs:163
Method
create_global_temp_view
Creates a global temporary view with this [DataFrame].
crates/connect/src/dataframe.rs:292
Method
create_or_replace
(self)
crates/connect/src/readwriter.rs:830
Method
create_temp_view
Creates a local temporary view with this [DataFrame]
crates/connect/src/dataframe.rs:307
Method
create_user_agent
(user_agent: Option<&str>)
crates/connect/src/client/builder.rs:78
Method
create_user_id
(user_id: Option<&str>)
crates/connect/src/client/builder.rs:89
Method
crosstab
(self, col1: &str, col2: &str)
crates/connect/src/plan.rs:195
Method
cube
Create a multi-dimensional cube for the current [DataFrame] using the specified columns, so we can run aggregations on them.
crates/connect/src/dataframe.rs:354
Method
current_row
Returns 0
crates/connect/src/window.rs:148
Method
ddl_parse
(&self)
crates/connect/src/client/mod.rs:615
Method
default
()
crates/connect/src/session.rs:54
Method
default
()
crates/connect/src/client/builder.rs:49
Function
desc_nulls_first
Returns a sort expression based on the descending order of the given column name, and null values appear before non-null values.
crates/connect/src/functions/mod.rs:1225
Function
desc_nulls_last
Returns a sort expression based on the descending order of the given column name, and null values appear after non-null values.
crates/connect/src/functions/mod.rs:1230
Method
describe
(self, cols: Option<I>)
crates/connect/src/plan.rs:207
Method
distinct
(self)
crates/connect/src/plan.rs:227
Method
div
(self, other: Self)
crates/connect/src/column.rs:470
Method
drop
(self, cols: I)
crates/connect/src/plan.rs:231
Method
drop_duplicates
( self, cols: Option<I>, within_watermark: bool, )
crates/connect/src/plan.rs:245
Method
drop_duplicates_within_waterwmark
Return a new [DataFrame] with duplicate rows removed, optionally only considering certain columns, within watermark. This only works with streaming [
crates/connect/src/dataframe.rs:428
Method
dropna
TODO! this should probably be an enum
crates/connect/src/plan.rs:279
Method
empty
Create an empty StructType
crates/connect/src/types.rs:95
Method
except_all
(self, other: LogicalPlanBuilder)
crates/connect/src/plan.rs:377
Method
exception
!TODO i don't really like the return values on this
crates/connect/src/streaming/mod.rs:497
Method
explain
(&self)
crates/connect/src/client/mod.rs:577
Method
explain
(&self, extended: Option<bool>)
crates/connect/src/streaming/mod.rs:466
Function
expr
Parses the expression string into the column that it represents
crates/connect/src/functions/mod.rs:159
Method
fill
Replace null values, alias for `df.na().fill()`.
crates/connect/src/dataframe.rs:1486
Method
fillna
(self, cols: Option<I>, values: T)
crates/connect/src/plan.rs:315
Function
first
Returns the first value in a group.
crates/connect/src/functions/mod.rs:994
Function
first_value
Returns the first value of col for a group of rows.
crates/connect/src/functions/mod.rs:1002
Function
format_string
Formats the arguments in printf-style and returns the result as a string column
crates/connect/src/functions/mod.rs:1275
Method
frame_boundary
(value: i64)
crates/connect/src/window.rs:85
Method
freq_items
Finding frequent items for columns, possibly with false positives.
crates/connect/src/dataframe.rs:558
Method
freq_items
(self, cols: I, support: Option<f64>)
crates/connect/src/plan.rs:479
Method
from
(error: std::io::Error)
crates/connect/src/errors.rs:115
Method
from
(value: StructType)
crates/connect/src/types.rs:116
Method
from
(value: VecExpression)
crates/connect/src/expressions.rs:51
Method
from
(rel_type: RelType)
crates/connect/src/plan.rs:830
Method
from
Used for creating columns from a [spark::Expression]
crates/connect/src/column.rs:376
Method
from
(spark_level: spark::StorageLevel)
crates/connect/src/storage.rs:37
Method
from
(config: Config)
crates/connect/src/client/config.rs:93
Method
from_config
Create a new Spark Session from a [Config] object
crates/connect/src/session.rs:75
Function
from_csv
Parses a column containing a CSV string to a row with the specific schema. Returns null in the case of an unparseable string
crates/connect/src/functions/mod.rs:864
Method
from_external_error
Wraps an external error in an `SparkError`.
crates/connect/src/errors.rs:109
Method
from_iter
(iter: I)
crates/connect/src/expressions.rs:39
Function
from_json
Parses a column containing a JSON string to a row with the specific schema. Returns null in the case of an unparseable string
crates/connect/src/functions/mod.rs:783
Method
from_str
(s: &str)
crates/connect/src/column.rs:62
Method
from_str_name
(value: &str)
crates/connect/src/types.rs:289
Method
from_string
(s: String)
crates/connect/src/column.rs:66
Function
from_unixtime
Converts the number of seconds from unix epoch (1970-01-01 00:00:00 UTC) to a string representing the timestamp of that moment in the current system t
crates/connect/src/functions/mod.rs:567
Method
get_function
Get the function with the specified name.
crates/connect/src/catalog.rs:244
Method
get_table
Get the table or view with the specified name.
crates/connect/src/catalog.rs:188
Method
get_tags
(&self)
crates/connect/src/client/mod.rs:335
Method
headers
(&self)
crates/connect/src/client/builder.rs:74
Method
hint
Specifies some hint on the current [DataFrame].
crates/connect/src/dataframe.rs:589
Method
hint
(self, name: &str, parameters: Option<I>)
crates/connect/src/plan.rs:498
Function
hll_sketch_agg
Returns the updatable binary representation of the Datasketches HllSketch configured with lgConfigK arg.
crates/connect/src/functions/mod.rs:1014
Function
hll_union
( col1: impl Into<Column>, col2: impl Into<Column>, allow_different_lg_config_k: Option<bool>, )
crates/connect/src/functions/mod.rs:1632
Function
hll_union_agg
Returns the updatable binary representation of the Datasketches HllSketch, generated by merging previously created Datasketches HllSketch instances vi
crates/connect/src/functions/mod.rs:1022
Method
host
(mut self, val: &str)
crates/connect/src/client/config.rs:51
Function
ilike
( str: impl Into<Column>, pattern: impl Into<Column>, escape_char: Option<Column>, )
crates/connect/src/functions/mod.rs:1287
Method
input_files
(&self)
crates/connect/src/client/mod.rs:603
Method
insert_into
Inserts the content of the [DataFrame] to the specified table. It requires that the schema of the [DataFrame] is the same as the schema of the target
crates/connect/src/readwriter.rs:729
Method
interrupt_all
Interrupt all operations of this session currently running on the connected server.
crates/connect/src/session.rs:234
Method
interrupt_operation
Interrupt an operation of this session with the given operationId.
crates/connect/src/session.rs:257
Method
interrupt_tag
Interrupt all operations of this session with the given operation tag.
crates/connect/src/session.rs:244
Method
intersect
(self, other: LogicalPlanBuilder)
crates/connect/src/plan.rs:425
Method
intersect_all
Return a new [DataFrame] containing rows in both this [DataFrame] and another [DataFrame] while preserving duplicates.
crates/connect/src/dataframe.rs:627
Method
intersect_all
(self, other: LogicalPlanBuilder)
crates/connect/src/plan.rs:435
Method
is_active
(&self)
crates/connect/src/streaming/mod.rs:440
Method
is_local
Returns `true` if the `collect()` and `take()` methods can be run locally (without any Spark executors).
crates/connect/src/dataframe.rs:646
Method
is_local
(&self)
crates/connect/src/client/mod.rs:590
Method
is_nan
(self)
crates/connect/src/column.rs:338
Method
is_not_null
A filter expression that evaluates to true is the expression is NOT null
crates/connect/src/column.rs:334
Method
is_null
A filter expression that evaluates to true is the expression is null
crates/connect/src/column.rs:329
Method
is_streaming
Returns `true` if this [DataFrame] contains one or more sources that continuously return data as it arrives.
crates/connect/src/dataframe.rs:658
Method
is_streaming
(&self)
crates/connect/src/client/mod.rs:597
Function
json_tuple
Creates a new row for a json column according to the given field names.
crates/connect/src/functions/mod.rs:770
Method
json_value
(&self)
crates/connect/src/types.rs:32
Function
lag
Returns the value that os offset rows before the current row, and default is there is less than offset rows before the current row
crates/connect/src/functions/mod.rs:1147
Function
last
Returns the last value in a group.
crates/connect/src/functions/mod.rs:1035
Function
last_value
Returns the last value of col for a group of rows.
crates/connect/src/functions/mod.rs:1043
Function
lead
Returns the value that os offset rows after the current row, and default is there is less than offset rows after the current row
crates/connect/src/functions/mod.rs:1162
Function
levenshtein
( left: impl Into<Column>, right: impl Into<Column>, threshold: Option<i32>, )
crates/connect/src/functions/mod.rs:1317
Function
like
( str: impl Into<Column>, pattern: impl Into<Column>, escape_char: Option<Column>, )
crates/connect/src/functions/mod.rs:1303
Method
limit
(self, limit: i32)
crates/connect/src/plan.rs:549
Method
list_databases
Returns a list of databases in this session
crates/connect/src/catalog.rs:125
Method
list_functions
Returns a list of functions registered in the specified database.
crates/connect/src/catalog.rs:202
Method
list_tables
Returns a list of tables/views in the specific database
crates/connect/src/catalog.rs:170
Method
local_relation
(batch: &RecordBatch)
crates/connect/src/plan.rs:157
← previous
next →
301–400 of 681, ranked by callers