Get the database with the specified name

A SQL ILIKE filter expression that evaluates the column based on a case insensitive match

Returns a best-effort snapshot of the files that compose this [DataFrame]

Return a new [DataFrame] containing rows only in both this [DataFrame] and another [DataFrame].

A SQL LIKE filter expression that evaluates the column based on a case sensitive match

Returns a list of catalogs in this session

Computes the max value for each numeric columns for each group.

Logical OR comparion.

Partitions the output by the given columns on the file system

Sets the storage level to persist the contents of the [DataFrame] across operations after the first time it is computed.

Randomly splits this [DataFrame] with the provided weights.

Returns a new [DataFrame] partitioned by the given partition number and shuffle option # Arguments `num_partitions`: the target number of partitions

Returns a new [DataFrame] replacing a value with another value.

A SQL RLIKE filter expression that evaluates the column based on a regex match

Returns a sampled subset of this [DataFrame]

Returns a stratified sample without replacement based on the fraction given on each stratum.

Project a set of SQL expressions and returns a new [DataFrame] This is a variant of `select` that accepts SQL Expressions # Example: ```rust async {

Sets the current default database in this session

Standardize the [SPARK-XXXXX] [MODULE] prefix Converts "[SPARK-XXX][mllib] Issue", "[MLLib] SPARK-XXX. Issue" or "SPARK XXX [MLLIB]: Issue" t

"Returns the sum of distinct values in the expression."

Computes specified statistics for numeric and string columns. Available statistics are: - count - mean - stddev - min - max - arbitrary approximate pe

Returns a new [DataFrame] based on a provided closure. # Example: ``` // the closure will capture this variable from the current scope let val = 100;

Removes the specified table from the in-memory cache.

Return a new [DataFrame] containing the union of rows in this and another [DataFrame].

Resets the configuration property for the given key.

The version of Spark on which this application is running.

Returns a new [DataFrame] by renaming multiple columns from a an iterator of containing a key/value pair with the key as the `existing` column name an

Returns a new [DataFrame] by updating an existing column with metadata.

Create a write configuration builder for v2 sources with [DataFrameWriterV2].

Returns a decrypted value of *input* using AES in *mode* with *padding

Returns a encrypted value of *input* using AES in *mode* with the specified *padding

Aggregate on the entire [DataFrame] without groups (shorthand for `df.group_by().agg()`)

Returns some value of col for a group of rows.

Returns a new Column for approximate distinct count of column col.

Calculates the approximate quantiles of numerical columns of a [DataFrame].

adds an item into a given array at a specified array index.

Concatenates the elements of column using the delimiter.

Returns a sort expression based on the ascending order of the given column name, and null values return before non-null values.

Returns a sort expression based on the ascending order of the given column name, and null values appear after non-null values.

Returns *null* if the input column is *true*; throws an exception with the provided error message otherwise

Computes bitwise not.

Marks a DataFrame as small enough for use in broadcast joins.

Round the given value to scale decimal places using HALF_EVEN rounding mode if scale >= 0 or at integral part when scale < 0.

Remove the leading and trailing *trim* characters from *str

Buckets the output by the given columns. If specified, the output is laid out on the file system similar to Hive’s bucketing scheme.

Removes all cached tables from the in-memory cache.