MCPcopy Create free account

hub / github.com/apache/spark-connect-rust / functions

Functions681 in github.com/apache/spark-connect-rust

Functionlocate
(substr: impl Into<Column>, str: impl Into<Column>, pos: Option<i32>)
crates/connect/src/functions/mod.rs:1328
Functionlog
Returns the first argument-based logarithm of the second argument.
crates/connect/src/functions/mod.rs:208
Functionmain
()
examples/src/databricks.rs:33
Functionmain
()
examples/src/sql.rs:25
Functionmain
()
examples/src/readstream.rs:25
Functionmain
()
examples/src/deltalake.rs:31
Functionmain
()
examples/src/writer.rs:28
Functionmain
()
examples/src/reader.rs:28
Functionmain
()
crates/connect/build.rs:20
Functionmake_dt_interval
Make DayTimeIntervalType duration from days, hours, mins and secs.
crates/connect/src/functions/mod.rs:347
Functionmake_interval
Make interval from years, months, weeks, days, hours, mins and secs.
crates/connect/src/functions/mod.rs:377
Functionmake_timestamp
Create timestamp from years, months, days, hours, mins, secs and timezone fields.
crates/connect/src/functions/mod.rs:429
Functionmake_timestamp_ltz
Create the current timestamp with local time zone from years, months, days, hours, mins, secs and timezone fields.
crates/connect/src/functions/mod.rs:463
Functionmake_timestamp_ntz
Create local date-time from years, months, days, hours, mins, secs fields.
crates/connect/src/functions/mod.rs:497
Functionmake_ym_interval
Make year-month interval from years, months.
crates/connect/src/functions/mod.rs:517
Functionmean
returns the average of the values in a group.
crates/connect/src/functions/mod.rs:1054
Methodmelt
Alias for [DataFrame::unpivot]
crates/connect/src/dataframe.rs:715
Methodmin
Computes the min value for each numeric column for each group.
crates/connect/src/group.rs:87
Functionmonths_between
Returns number of months between dates date1 and date2.
crates/connect/src/functions/mod.rs:538
Methodmul
(self, other: Self)
crates/connect/src/column.rs:462
Methodna
Returns a [DataFrameNaFunctions] for handling missing values.
crates/connect/src/dataframe.rs:729
Methodname
(&self)
crates/connect/src/streaming/mod.rs:340
Methodneg
(self)
crates/connect/src/column.rs:446
Functionnegate
Returns the negative value.
crates/connect/src/functions/mod.rs:221
Methodnew
create default DataFrame based on a spark session and initial logical plan
crates/connect/src/dataframe.rs:107
Methodnew
( partition_spec: Vec<spark::Expression>, order_spec: Vec<spark::expression::SortOrder>,
crates/connect/src/window.rs:39
Methodnew
(client: &SparkClient)
crates/connect/src/conf.rs:44
Methodnew
(spark_session: SparkSession)
crates/connect/src/catalog.rs:38
Methodnew
Create a new StructType from a vector of [StructField]
crates/connect/src/types.rs:100
Methodnew
( df: DataFrame, group_type: GroupType, grouping_cols: Vec<spark::Expression>,
crates/connect/src/group.rs:40
Methodnew
(connection: &str)
crates/connect/src/session.rs:65
Methodnew
Create a new DataFrameReader with a [SparkSession]
crates/connect/src/readwriter.rs:397
Methodnew
Create a new Logical Plan from an initial [spark::Relation]
crates/connect/src/plan.rs:55
Methodnew
()
crates/connect/src/client/config.rs:38
Methodnew
(headers: HashMap<String, String>)
crates/connect/src/client/middleware.rs:40
Methodnew
(stub: Arc<RwLock<SparkConnectServiceClient<T>>>, builder: ChannelBuilder)
crates/connect/src/client/mod.rs:105
Methodnew
()
crates/connect/src/client/builder.rs:60
Methodnew
(spark_session: SparkSession)
crates/connect/src/streaming/mod.rs:40
Methodnext_plan_id
()
crates/connect/src/plan.rs:50
Methodnot
(self)
crates/connect/src/column.rs:510
Functionnth_value
( col: impl Into<Column>, offset: impl Into<Column>, ignore_nulls: Option<bool>, )
crates/connect/src/functions/mod.rs:1175
Functionntile
Returns the ntile group id (from 1 to n inclusive) in an ordered window partition.
crates/connect/src/functions/mod.rs:1187
Methodoffset
Returns a new [DataFrame] by skiping the first n rows
crates/connect/src/dataframe.rs:736
Methodoffset
(self, num: i32)
crates/connect/src/plan.rs:558
Methodoptions
Set many input options based on an iterator of (key/value pairs) for the underlying data source
crates/connect/src/readwriter.rs:424
Methodoptions
Set many input options based on an iterator of (key/value pairs) for the underlying data source
crates/connect/src/streaming/mod.rs:68
Functionoptions_to_map
(cols: I)
crates/connect/src/functions/mod.rs:80
Methodorder_by
Returns a new [DataFrame] sorted by the specified column(s).
crates/connect/src/dataframe.rs:746
Functionoverlay
( src: impl Into<Column>, replace: impl Into<Column>, pos: impl Into<Column>, ignore_nulls: Op
crates/connect/src/functions/mod.rs:1475
Methodoverwrite
(self)
crates/connect/src/readwriter.rs:838
Methodoverwrite_partitions
(self)
crates/connect/src/readwriter.rs:842
Methodparse_connection_string
(connection: &str)
crates/connect/src/client/builder.rs:96
Methodparse_headers
(url: Url)
crates/connect/src/client/builder.rs:131
Functionparse_url
( url: impl Into<Column>, part_to_extract: impl Into<Column>, key: Option<impl Into<Column>>, )
crates/connect/src/functions/mod.rs:1358
Methodpartition_by
Partitions the output by the given columns on the file system
crates/connect/src/readwriter.rs:638
Functionpercentile
Returns the exact percentile(s) of numeric column expr at the given percentage(s) with value range in [0.0, 1.0].
crates/connect/src/functions/mod.rs:1064
Functionpercentile_approx
Returns the approximate percentile of the numeric column col which is the smallest value in the ordered col values (sorted from least to greatest) suc
crates/connect/src/functions/mod.rs:1079
Methodplan_cmd
Build the Spark [spark::Plan] for a [spark::command::CommandType]
crates/connect/src/plan.rs:82
Methodpoll_ready
(&mut self, cx: &mut Context<'_>)
crates/connect/src/client/middleware.rs:84
Functionposition
( substr: impl Into<Column>, str: impl Into<Column>, start: Option<impl Into<Column>>, )
crates/connect/src/functions/mod.rs:1372
Functionpow
Returns the value of the first argument raised to the power of the second argument.
crates/connect/src/functions/mod.rs:231
Functionprintf
(format: impl Into<Column>, cols: I)
crates/connect/src/functions/mod.rs:1383
Functionrand
Generates a random column with independent and identically distributed (i.i.d.) samples uniformly distributed in [0.0, 1.0).
crates/connect/src/functions/mod.rs:135
Functionrandn
Generates a column with independent and identically distributed (i.i.d.) samples from the standard normal distribution.
crates/connect/src/functions/mod.rs:140
Methodrecent_progress
(&self)
crates/connect/src/streaming/mod.rs:415
Methodrecover_partitions
Recovers all the partitions of the given table and updates the catalog.
crates/connect/src/catalog.rs:464
Methodrefresh_by_path
Invalidates and refreshes all the cached data (and the associated metadata) for any DataFrame that contains the given data source path.
crates/connect/src/catalog.rs:479
Methodrefresh_table
Invalidates and refreshes all the cached data (and the associated metadata) for any DataFrame that contains the given data source path.
crates/connect/src/catalog.rs:451
Functionregexp_extract
(str: impl Into<Column>, pattern: &str, idx: i32)
crates/connect/src/functions/mod.rs:1399
Functionregexp_extract_all
( str: impl Into<Column>, regexp: impl Into<Column>, idx: Option<impl Into<Column>>, )
crates/connect/src/functions/mod.rs:1403
Functionregexp_instr
( str: impl Into<Column>, regexp: impl Into<Column>, idx: Option<impl Into<Column>>, )
crates/connect/src/functions/mod.rs:1417
Methodrem
(self, other: Self)
crates/connect/src/column.rs:478
Methodremote
Validate a connect string for a remote Spark Session String must conform to the [Spark Documentation](https://github.com/apache/spark/blob/master/con
crates/connect/src/session.rs:85
Methodremove_tag
Remove a tag previously added to be assigned to all the operations started by this thread in this session.
crates/connect/src/session.rs:275
Methodremove_tag
(&mut self, tag: &str)
crates/connect/src/client/mod.rs:329
Methodrepartition
(self, num_partitions: u32, shuffle: Option<bool>)
crates/connect/src/plan.rs:580
Methodrepartition_by_range
Returns a new [DataFrame] partitioned by the given partitioning expressions.
crates/connect/src/dataframe.rs:850
Methodrepartition_by_range
( self, num_partitions: Option<i32>, cols: I, )
crates/connect/src/plan.rs:590
Methodrollup
Create a multi-dimensional rollup for the current DataFrame using the specified columns, and returns a [GroupedData] object
crates/connect/src/dataframe.rs:878
Functionround
Round the given value to scale decimal places using HALF_UP rounding mode if scale >= 0 or at integral part when scale < 0.
crates/connect/src/functions/mod.rs:238
Methodrun_id
(&self)
crates/connect/src/streaming/mod.rs:336
Methodsame_semantics
Returns True when the logical query plans inside both DataFrames are equal and therefore return the same results.
crates/connect/src/dataframe.rs:892
Methodsame_semantics
(&self)
crates/connect/src/client/mod.rs:622
Methodsample
( self, lower_bound: f64, upper_bound: f64, with_replacement: Option<bool>,
crates/connect/src/plan.rs:640
Methodsample_by
(self, col: T, fractions: I, seed: i64)
crates/connect/src/plan.rs:660
Methodschema
Schema of the stream in DDL format (e.g. `"name string, age int"`)
crates/connect/src/streaming/mod.rs:56
Functionschema_of_csv
Parses a CSV string and infers its schema in DDL format
crates/connect/src/functions/mod.rs:879
Functionschema_of_json
Parses a JSON string and infers its schema in DDL format
crates/connect/src/functions/mod.rs:798
Methodsemantic_hash
Returns a hash code of the logical query plan against this [DataFrame].
crates/connect/src/dataframe.rs:1004
Methodsemantic_hash
(&self)
crates/connect/src/client/mod.rs:628
Functionsentences
Splits a string into arrays of sentences, where each sentence is an array of words
crates/connect/src/functions/mod.rs:1494
Functionsequence
Generate a sequence of integers from start to stop, incrementing by step.
crates/connect/src/functions/mod.rs:842
Methodsession_id
(mut self, val: Uuid)
crates/connect/src/client/config.rs:66
Methodset_reattachable_execute
Change the reattachable execute value
crates/connect/src/client/mod.rs:133
Functionsort_array
Sorts the input array in ascending or descending order according to the natural ordering of the array elements.
crates/connect/src/functions/mod.rs:828
Methodsort_by
Sorts the output in each bucket by the given columns on the file system
crates/connect/src/readwriter.rs:629
Methodsort_within_partitions
Returns a new [DataFrame] with each partition sorted by the specified column(s).
crates/connect/src/dataframe.rs:1058
Methodspark_session
Returns Spark session that created this DataFrame.
crates/connect/src/dataframe.rs:1071
Functionsplit
Splits str around matches of the given pattern.
crates/connect/src/functions/mod.rs:1453
Methodstat
Returns a DataFrameStatFunctions for statistic functions.
crates/connect/src/dataframe.rs:1076
← previousnext →401–500 of 681, ranked by callers