Functions — github.com/awslabs/amazon-redshift-utils

hub / github.com/awslabs/amazon-redshift-utils / functions

Functions735 in github.com/awslabs/amazon-redshift-utils

⨍ Functions 735◇ Types & classes 84 ↳ Endpoints 15

↓ 1 callersMethodget_database_name_out_of_ddl

(ddl)

src/UnloadCopyUtility/util/sql/ddl_generators.py:135

↓ 1 callersFunctionget_datashare_tables

Get all tables in the datashare database(s) using svv_redshift_tables

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:238

↓ 1 callersMethodget_default_config_key_values

(self)

src/UnloadCopyUtility/global_config.py:221

↓ 1 callersMethodget_default_config_parameter_updated_with_cli_args

(self, argv)

src/UnloadCopyUtility/global_config.py:260

↓ 1 callersMethodget_extract

getting the log location whether cloudwatch or s3 for cluster and checking whether the cluster is serverless or provisioned :

src/SimpleReplay/extract/extractor/extractor.py:45

↓ 1 callersMethodget_extract_from_s3

getting logs from s3 and passing it to get_s3_audit_logs() :param log_bucket: :param log_prefix: :param start_time:

src/SimpleReplay/extract/extractor/s3_extractor.py:21

↓ 1 callersMethodget_extract_locally

:param log_directory_path: :param start_time: :param end_time: :return:

src/SimpleReplay/extract/extractor/local_extractor.py:21

↓ 1 callersFunctionget_file_contents

(location, region_name)

src/WorkloadManagementScheduler/wlm_scheduler.py:83

↓ 1 callersFunctionget_foreign_keys

(schema_name, set_target_schema, table_name)

src/ColumnEncodingUtility/analyze-schema-compression.py:305

↓ 1 callersFunctionget_grants

(schema_name, table_name, current_user)

src/ColumnEncodingUtility/analyze-schema-compression.py:245

↓ 1 callersFunctionget_group_id

Get group ID from group name if exists

src/RedshiftIDCMigrationUtility/idc_add_users_groups_roles_psets.py:103

↓ 1 callersFunctionget_idc_role_grants

Get all roles granted to IDC roles using SVV_ROLE_GRANTS Returns a dictionary mapping IDC role names to lists of granted roles

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:326

↓ 1 callersFunctionget_idc_user_id

Get IDC user ID using AWS CLI get-user-id command with the correct syntax Uses email address as the identifier

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:493

↓ 1 callersFunctionget_identity

(adsrc)

src/ColumnEncodingUtility/analyze-schema-compression.py:233

↓ 1 callersFunctionget_identity_provider_namespace

Query SVV_IDENTITY_PROVIDERS to get the identity provider namespace for AWS IDC

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:909

↓ 1 callersMethodget_json_config_as_dict

(self, s3_url)

src/UnloadCopyUtility/util/s3_utils.py:17

↓ 1 callersMethodget_kms_encrypted_password_from_password_kms_txt

(self)

src/UnloadCopyUtility/tests/cloudformation/get_stack_parameters.py:36

↓ 1 callersFunctionget_local_database_permissions

Get IDC users with permissions on the local database and its tables using system tables Returns user_map and table_grants for local database

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:186

↓ 1 callersMethodget_output_variable

(self, output_variable_name)

src/UnloadCopyUtility/tests/cloudformation/run_stack.py:67

↓ 1 callersMethodget_parameters_for_log_extraction

:param config: from extract.yaml :return: extraction_name, start_time, end_time, log_location

src/SimpleReplay/extract/extractor/extractor.py:368

↓ 1 callersFunctionget_primary_key

(schema_name, set_target_schema, original_table, new_table)

src/ColumnEncodingUtility/analyze-schema-compression.py:336

↓ 1 callersFunctionget_raw_data

Reads and processes raw data from S3 @param report: Report, report object @param bucket: dict, S3 bucket location @param replay_path: str

src/SimpleReplay/replay_analysis.py:305

↓ 1 callersFunctionget_redshift_credentials

(config)

src/LakeFormationMigrationUtility/tests/performance_test/perf_unified_cleanup.py:7

↓ 1 callersFunctionget_redshift_credentials

Get Redshift credentials based on cluster type.

src/RedshiftIDCMigrationUtility/idc_redshift_unload_indatabase_groups_roles_users.py:73

↓ 1 callersMethodget_relation_regex_string

(self, quoted_schema=True, quoted_table=True)

src/UnloadCopyUtility/util/sql/ddl_generators.py:117

↓ 1 callersFunctionget_rs_conn

(db_host, db, db_user, db_pwd, schema_name, db_port=5439, query_group=None, query_slot_count=1,

src/AnalyzeVacuumUtility/lib/analyze_vacuum.py:90

↓ 1 callersMethodget_schema_ddl_SQL

(self, schema_name=None)

src/UnloadCopyUtility/util/sql/ddl_generators.py:64

↓ 1 callersFunctionget_secret

Retrieve a secret from AWS Secrets Manager

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:63

↓ 1 callersMethodget_sql_connections_replacements

(self, last_connections, log_items)

src/SimpleReplay/extract/extractor/extractor.py:167

↓ 1 callersMethodget_sql_without_block_comments

(input_sql_text)

src/UnloadCopyUtility/util/sql/sql_text_helpers.py:63

↓ 1 callersMethodget_stack_details_expiry_time

(self)

src/UnloadCopyUtility/tests/cloudformation/run_stack.py:36

↓ 1 callersMethodget_statement_to_retrieve_ddl_create_statement_text

(self)

src/UnloadCopyUtility/util/resources.py:27

↓ 1 callersMethodget_table_ddl_SQL

(self, table_name=None, schema_name=None)

src/UnloadCopyUtility/util/sql/ddl_generators.py:78

↓ 1 callersFunctionget_table_desc

(schema_name, table_name)

src/ColumnEncodingUtility/analyze-schema-compression.py:371

↓ 1 callersFunctionget_table_grants_for_roles

Get grants for specific roles on tables using SHOW GRANTS command Returns a dictionary mapping (db_name, schema_name, table_name) to a list o

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:364

↓ 1 callersMethodget_table_resource_from_merging_2_resources

(resource1, resource2)

src/UnloadCopyUtility/util/resources.py:376

↓ 1 callersMethodget_tagged_sql

(self, query_text, idx, transaction, connection)

src/SimpleReplay/replay.py:399

↓ 1 callersMethodget_task

(self, task_or_task_id)

src/UnloadCopyUtility/util/tasks.py:41

↓ 1 callersMethodget_user_auto_create

(self)

src/UnloadCopyUtility/util/redshift_cluster.py:116

↓ 1 callersFunctionget_user_id

Get user ID from username if exists

src/RedshiftIDCMigrationUtility/idc_add_users_groups_roles_psets.py:56

↓ 1 callersFunctionget_users_with_usage_permission

Query svv_database_privileges to get users with USAGE permission on the datashare database(s) Only include identity_provider_namespace: prefi

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:138

↓ 1 callersFunctionget_wlm_config

(ruleset, region_name)

src/WorkloadManagementScheduler/wlm_scheduler.py:95

↓ 1 callersFunctiongetiamcredentials

(dbhost=None,dbname=None, dbuser=None)

src/UnloadCopyUtility/util/redshift_cluster.py:21

↓ 1 callersFunctionglue_create_database

(name, description, region)

src/SimpleReplay/helper/aws_service.py:187

↓ 1 callersFunctionglue_get_database

(name, region)

src/SimpleReplay/helper/aws_service.py:182

↓ 1 callersFunctionglue_get_partition_indexes

(database, table, region)

src/SimpleReplay/helper/aws_service.py:170

↓ 1 callersFunctionglue_table_copy

CHeck if glue table exists in the new glue database, if not create the table structure along with the partitions @param orig_glue_db: @pa

src/SimpleReplay/external_object_replicator/glue_util.py:61

↓ 1 callersFunctionhash_query

(st)

src/SimpleReplay/api/utils.py:90

↓ 1 callersFunctionhist_gen

Generates a histogram for give table data @param x_data: pandas series, x axis data @param y_data: pandas series, y axis data @param titl

src/SimpleReplay/report_util.py:153

↓ 1 callersFunctioninit_logging

Initialize logging to stdio

src/SimpleReplay/helper/log.py:17

↓ 1 callersFunctioninitiate_connection

Initiate connection with Redshift cluster @param username: master username from replay.yaml @param cluster: cluster dictionary

src/SimpleReplay/replay_analysis.py:163

↓ 1 callersMethodinitiate_connection

(self, username)

src/SimpleReplay/replay.py:228

↓ 1 callersMethodis_bool

(value)

src/UnloadCopyUtility/global_config.py:178

↓ 1 callersMethodis_bool_list

(values_list)

src/UnloadCopyUtility/global_config.py:77

↓ 1 callersMethodis_boolean_config

(self, cli_argument)

src/UnloadCopyUtility/tests/cloudformation/run_stack.py:206

↓ 1 callersMethodis_parameter_being_processed_a_bool

(self)

src/UnloadCopyUtility/global_config.py:292

↓ 1 callersMethodis_region

(self, input_string)

src/UnloadCopyUtility/global_config.py:152

↓ 1 callersMethodis_region_name_list

(values_list)

src/UnloadCopyUtility/global_config.py:84

↓ 1 callersMethodis_stack_ready_for_teardown

(self)

src/UnloadCopyUtility/tests/cloudformation/run_stack.py:161

↓ 1 callersMethodis_value_in_list

(self, value)

src/UnloadCopyUtility/global_config.py:120

↓ 1 callersFunctioniter_batch

Generates each batch from the list of entries, evenly divided.

src/ManifestGenerator/manifestgen.py:69

↓ 1 callersFunctionlaunch_analysis_v2

Package install and server init

src/SimpleReplay/replay_analysis.py:32

↓ 1 callersFunctionlist_replays

Iterates through S3 and aggregates list of successful replays @param bucket_url: str, S3 bucket location

src/SimpleReplay/replay_analysis.py:446

↓ 1 callersFunctionlist_replays

Iterates through S3 and aggregates list of successful replays @param bucket_url: str, S3 bucket location

src/SimpleReplay/api/utils.py:34

↓ 1 callersFunctionlist_sql

List presigned urls for raw_data/ files in S3 for a given replay @param bucket_url: str, S3 bucket location @param replay: str, replay id

src/SimpleReplay/replay_analysis.py:513

↓ 1 callersFunctionload_config

Load configuration from config file (default: config.ini)

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:45

↓ 1 callersFunctionload_config

Load configuration from file

src/RedshiftIDCMigrationUtility/idc_redshift_unload_indatabase_groups_roles_users.py:13

↓ 1 callersFunctionload_config

Load a yaml config file from a local file or from s3

src/SimpleReplay/util.py:172

↓ 1 callersMethodload_driver

(self)

src/SimpleReplay/extract/extractor/extractor.py:300

↓ 1 callersFunctionlog_version

Read the VERSION file and log it

src/SimpleReplay/util.py:89

↓ 1 callersFunctionmain

()

src/LakeFormationMigrationUtility/rs_privs_to_lf.py:930

↓ 1 callersFunctionmain

()

src/AnalyzeVacuumUtility/analyze-vacuum-schema.py:106

↓ 1 callersFunctionmain

()

src/ManifestGenerator/manifestgen.py:84

↓ 1 callersFunctionmain

()

src/RedshiftIDCMigrationUtility/idc_redshift_unload_indatabase_groups_roles_users.py:187

↓ 1 callersFunctionmain

()

src/RedshiftIDCMigrationUtility/idc_add_users_groups_roles_psets.py:256

↓ 1 callersFunctionmain

(argv)

src/ColumnEncodingUtility/analyze-schema-compression.py:1123

↓ 1 callersFunctionmain

(args)

src/UnloadCopyUtility/redshift_unload_copy.py:168

↓ 1 callersFunctionmain

(input_args)

src/MultipleTableRestoreUtility/multitablerestore.py:155

↓ 1 callersFunctionmain

()

src/MetadataTransfer/userprivs.py:168

↓ 1 callersFunctionmain

()

src/MetadataTransfer/metadatacopy.py:188

↓ 1 callersFunctionmain

()

src/SimpleReplay/replay_analysis.py:547

↓ 1 callersFunctionmain

()

src/SimpleReplay/replay.py:1957

↓ 1 callersFunctionmain

()

src/SimpleReplay/extract.py:11

↓ 1 callersFunctionmain

(input_log, creds, rewrites, readonly)

src/SimpleReplay/PreviousVersion/ParseUserActivityLog.py:154

↓ 1 callersFunctionmain

()

src/SimpleReplay/external_object_replicator/external_object_replicator.py:23

↓ 1 callersFunctionmain

()

src/UnloadAutoPartitions/genunload.py:217

↓ 1 callersMethodmake_bool_config_parameter

(name, value, description)

src/UnloadCopyUtility/global_config.py:65

↓ 1 callersMethodmake_region_config_parameter

(name, value, description)

src/UnloadCopyUtility/global_config.py:69

↓ 1 callersMethodmake_value_list_config_parameter

(name, value, description, possible_values)

src/UnloadCopyUtility/global_config.py:73

↓ 1 callersMethodmark_task_as_failed

(self, task)

src/UnloadCopyUtility/util/tasks.py:95

↓ 1 callersMethodmark_task_as_succeeded

(self, task)

src/UnloadCopyUtility/util/tasks.py:90

↓ 1 callersMethodparse_arguments

(self, arguments)

src/UnloadCopyUtility/tests/cloudformation/run_stack.py:181

↓ 1 callersFunctionparse_connections

( workload_directory, time_interval_between_transactions, time_interval_between_queries, )

src/SimpleReplay/replay.py:617

↓ 1 callersFunctionparse_copy_replacements

(workload_directory)

src/SimpleReplay/replay.py:861

↓ 1 callersFunctionparse_error

(error, user, db, qtxt)

src/SimpleReplay/util.py:402

↓ 1 callersFunctionparse_filename

(filename)

src/SimpleReplay/replay.py:850

↓ 1 callersFunctionparse_transactions

(workload_directory)

src/SimpleReplay/replay.py:696

↓ 1 callersFunctionpdf_gen

This function formats the summary report using the content from report_content.yaml to populate the paragraphs, titles, and headers. The tables

src/SimpleReplay/report_gen.py:32

↓ 1 callersFunctionprint_stats

(stats)

src/SimpleReplay/replay.py:1940

↓ 1 callersMethodprint_supported_arguments

(self)

src/UnloadCopyUtility/tests/cloudformation/run_stack.py:226

← previous next →301–400 of 735, ranked by callers