MCPcopy Create free account

hub / github.com/apache/spark-connect-rust / functions

Functions681 in github.com/apache/spark-connect-rust

Methodclear_tags
(&mut self)
crates/connect/src/client/mod.rs:339
Functioncolumn
Returns a [Column] based on the given column name.
crates/connect/src/functions/mod.rs:102
Functionconcat_ws
Concatenates multiple input string columns together into a single string column, using the given separator
crates/connect/src/functions/mod.rs:1254
Functionconv
Convert a number in a string column from one base to another.
crates/connect/src/functions/mod.rs:190
Functionconvert_timezone
Converts the timestamp without time zone sourceTs from the sourceTz time zone to targetTz.
crates/connect/src/functions/mod.rs:287
Methodcorr
(self, col1: impl AsRef<str>, col2: impl AsRef<str>)
crates/connect/src/plan.rs:170
Functioncount_distinct
Returns a new Column for distinct count of col or cols
crates/connect/src/functions/mod.rs:949
Functioncount_min_sketch
Returns a count-min sketch of a column with the given esp, confidence and seed.
crates/connect/src/functions/mod.rs:976
Methodcov
(self, col1: impl AsRef<str>, col2: impl AsRef<str>)
crates/connect/src/plan.rs:183
Methodcreate
(connection: &str)
crates/connect/src/client/builder.rs:163
Methodcreate_global_temp_view
Creates a global temporary view with this [DataFrame].
crates/connect/src/dataframe.rs:292
Methodcreate_or_replace
(self)
crates/connect/src/readwriter.rs:830
Methodcreate_temp_view
Creates a local temporary view with this [DataFrame]
crates/connect/src/dataframe.rs:307
Methodcreate_user_agent
(user_agent: Option<&str>)
crates/connect/src/client/builder.rs:78
Methodcreate_user_id
(user_id: Option<&str>)
crates/connect/src/client/builder.rs:89
Methodcrosstab
(self, col1: &str, col2: &str)
crates/connect/src/plan.rs:195
Methodcube
Create a multi-dimensional cube for the current [DataFrame] using the specified columns, so we can run aggregations on them.
crates/connect/src/dataframe.rs:354
Methodcurrent_row
Returns 0
crates/connect/src/window.rs:148
Methodddl_parse
(&self)
crates/connect/src/client/mod.rs:615
Methoddefault
()
crates/connect/src/session.rs:54
Methoddefault
()
crates/connect/src/client/builder.rs:49
Functiondesc_nulls_first
Returns a sort expression based on the descending order of the given column name, and null values appear before non-null values.
crates/connect/src/functions/mod.rs:1225
Functiondesc_nulls_last
Returns a sort expression based on the descending order of the given column name, and null values appear after non-null values.
crates/connect/src/functions/mod.rs:1230
Methoddescribe
(self, cols: Option<I>)
crates/connect/src/plan.rs:207
Methoddistinct
(self)
crates/connect/src/plan.rs:227
Methoddiv
(self, other: Self)
crates/connect/src/column.rs:470
Methoddrop
(self, cols: I)
crates/connect/src/plan.rs:231
Methoddrop_duplicates
( self, cols: Option<I>, within_watermark: bool, )
crates/connect/src/plan.rs:245
Methoddrop_duplicates_within_waterwmark
Return a new [DataFrame] with duplicate rows removed, optionally only considering certain columns, within watermark. This only works with streaming [
crates/connect/src/dataframe.rs:428
Methoddropna
TODO! this should probably be an enum
crates/connect/src/plan.rs:279
Methodempty
Create an empty StructType
crates/connect/src/types.rs:95
Methodexcept_all
(self, other: LogicalPlanBuilder)
crates/connect/src/plan.rs:377
Methodexception
!TODO i don't really like the return values on this
crates/connect/src/streaming/mod.rs:497
Methodexplain
(&self)
crates/connect/src/client/mod.rs:577
Methodexplain
(&self, extended: Option<bool>)
crates/connect/src/streaming/mod.rs:466
Functionexpr
Parses the expression string into the column that it represents
crates/connect/src/functions/mod.rs:159
Methodfill
Replace null values, alias for `df.na().fill()`.
crates/connect/src/dataframe.rs:1486
Methodfillna
(self, cols: Option<I>, values: T)
crates/connect/src/plan.rs:315
Functionfirst
Returns the first value in a group.
crates/connect/src/functions/mod.rs:994
Functionfirst_value
Returns the first value of col for a group of rows.
crates/connect/src/functions/mod.rs:1002
Functionformat_string
Formats the arguments in printf-style and returns the result as a string column
crates/connect/src/functions/mod.rs:1275
Methodframe_boundary
(value: i64)
crates/connect/src/window.rs:85
Methodfreq_items
Finding frequent items for columns, possibly with false positives.
crates/connect/src/dataframe.rs:558
Methodfreq_items
(self, cols: I, support: Option<f64>)
crates/connect/src/plan.rs:479
Methodfrom
(error: std::io::Error)
crates/connect/src/errors.rs:115
Methodfrom
(value: StructType)
crates/connect/src/types.rs:116
Methodfrom
(value: VecExpression)
crates/connect/src/expressions.rs:51
Methodfrom
(rel_type: RelType)
crates/connect/src/plan.rs:830
Methodfrom
Used for creating columns from a [spark::Expression]
crates/connect/src/column.rs:376
Methodfrom
(spark_level: spark::StorageLevel)
crates/connect/src/storage.rs:37
Methodfrom
(config: Config)
crates/connect/src/client/config.rs:93
Methodfrom_config
Create a new Spark Session from a [Config] object
crates/connect/src/session.rs:75
Functionfrom_csv
Parses a column containing a CSV string to a row with the specific schema. Returns null in the case of an unparseable string
crates/connect/src/functions/mod.rs:864
Methodfrom_external_error
Wraps an external error in an `SparkError`.
crates/connect/src/errors.rs:109
Methodfrom_iter
(iter: I)
crates/connect/src/expressions.rs:39
Functionfrom_json
Parses a column containing a JSON string to a row with the specific schema. Returns null in the case of an unparseable string
crates/connect/src/functions/mod.rs:783
Methodfrom_str
(s: &str)
crates/connect/src/column.rs:62
Methodfrom_str_name
(value: &str)
crates/connect/src/types.rs:289
Methodfrom_string
(s: String)
crates/connect/src/column.rs:66
Functionfrom_unixtime
Converts the number of seconds from unix epoch (1970-01-01 00:00:00 UTC) to a string representing the timestamp of that moment in the current system t
crates/connect/src/functions/mod.rs:567
Methodget_function
Get the function with the specified name.
crates/connect/src/catalog.rs:244
Methodget_table
Get the table or view with the specified name.
crates/connect/src/catalog.rs:188
Methodget_tags
(&self)
crates/connect/src/client/mod.rs:335
Methodheaders
(&self)
crates/connect/src/client/builder.rs:74
Methodhint
Specifies some hint on the current [DataFrame].
crates/connect/src/dataframe.rs:589
Methodhint
(self, name: &str, parameters: Option<I>)
crates/connect/src/plan.rs:498
Functionhll_sketch_agg
Returns the updatable binary representation of the Datasketches HllSketch configured with lgConfigK arg.
crates/connect/src/functions/mod.rs:1014
Functionhll_union
( col1: impl Into<Column>, col2: impl Into<Column>, allow_different_lg_config_k: Option<bool>, )
crates/connect/src/functions/mod.rs:1632
Functionhll_union_agg
Returns the updatable binary representation of the Datasketches HllSketch, generated by merging previously created Datasketches HllSketch instances vi
crates/connect/src/functions/mod.rs:1022
Methodhost
(mut self, val: &str)
crates/connect/src/client/config.rs:51
Functionilike
( str: impl Into<Column>, pattern: impl Into<Column>, escape_char: Option<Column>, )
crates/connect/src/functions/mod.rs:1287
Methodinput_files
(&self)
crates/connect/src/client/mod.rs:603
Methodinsert_into
Inserts the content of the [DataFrame] to the specified table. It requires that the schema of the [DataFrame] is the same as the schema of the target
crates/connect/src/readwriter.rs:729
Methodinterrupt_all
Interrupt all operations of this session currently running on the connected server.
crates/connect/src/session.rs:234
Methodinterrupt_operation
Interrupt an operation of this session with the given operationId.
crates/connect/src/session.rs:257
Methodinterrupt_tag
Interrupt all operations of this session with the given operation tag.
crates/connect/src/session.rs:244
Methodintersect
(self, other: LogicalPlanBuilder)
crates/connect/src/plan.rs:425
Methodintersect_all
Return a new [DataFrame] containing rows in both this [DataFrame] and another [DataFrame] while preserving duplicates.
crates/connect/src/dataframe.rs:627
Methodintersect_all
(self, other: LogicalPlanBuilder)
crates/connect/src/plan.rs:435
Methodis_active
(&self)
crates/connect/src/streaming/mod.rs:440
Methodis_local
Returns `true` if the `collect()` and `take()` methods can be run locally (without any Spark executors).
crates/connect/src/dataframe.rs:646
Methodis_local
(&self)
crates/connect/src/client/mod.rs:590
Methodis_nan
(self)
crates/connect/src/column.rs:338
Methodis_not_null
A filter expression that evaluates to true is the expression is NOT null
crates/connect/src/column.rs:334
Methodis_null
A filter expression that evaluates to true is the expression is null
crates/connect/src/column.rs:329
Methodis_streaming
Returns `true` if this [DataFrame] contains one or more sources that continuously return data as it arrives.
crates/connect/src/dataframe.rs:658
Methodis_streaming
(&self)
crates/connect/src/client/mod.rs:597
Functionjson_tuple
Creates a new row for a json column according to the given field names.
crates/connect/src/functions/mod.rs:770
Methodjson_value
(&self)
crates/connect/src/types.rs:32
Functionlag
Returns the value that os offset rows before the current row, and default is there is less than offset rows before the current row
crates/connect/src/functions/mod.rs:1147
Functionlast
Returns the last value in a group.
crates/connect/src/functions/mod.rs:1035
Functionlast_value
Returns the last value of col for a group of rows.
crates/connect/src/functions/mod.rs:1043
Functionlead
Returns the value that os offset rows after the current row, and default is there is less than offset rows after the current row
crates/connect/src/functions/mod.rs:1162
Functionlevenshtein
( left: impl Into<Column>, right: impl Into<Column>, threshold: Option<i32>, )
crates/connect/src/functions/mod.rs:1317
Functionlike
( str: impl Into<Column>, pattern: impl Into<Column>, escape_char: Option<Column>, )
crates/connect/src/functions/mod.rs:1303
Methodlimit
(self, limit: i32)
crates/connect/src/plan.rs:549
Methodlist_databases
Returns a list of databases in this session
crates/connect/src/catalog.rs:125
Methodlist_functions
Returns a list of functions registered in the specified database.
crates/connect/src/catalog.rs:202
Methodlist_tables
Returns a list of tables/views in the specific database
crates/connect/src/catalog.rs:170
Methodlocal_relation
(batch: &RecordBatch)
crates/connect/src/plan.rs:157
← previousnext →301–400 of 681, ranked by callers