MCPcopy Create free account

hub / github.com/awslabs/amazon-redshift-utils / functions

Functions735 in github.com/awslabs/amazon-redshift-utils

↓ 3 callersFunctionmatchesDuration
(item)
src/SimpleReplay/gui/src/components/ReplayAnalysis/TopQueryDeltas.js:37
↓ 3 callersFunctionmatchesDuration
(item)
src/SimpleReplay/gui/src/components/ReplayAnalysis/TopRunningQueries.js:60
↓ 3 callersFunctionmatchesDuration
(item)
src/SimpleReplay/gui/src/components/ReplayValidation/ErrorTable.js:81
↓ 3 callersFunctionmatchesThreshold
(item)
src/SimpleReplay/gui/src/components/ReplayAnalysis/TopQueryDeltas.js:57
↓ 3 callersFunctionobjconfig
(srccursor, tgtcursor, query, objtype, tgtdb, tgtconn)
src/MetadataTransfer/metadatacopy.py:92
↓ 3 callersMethodoffset_ms
(self, ref_time)
src/SimpleReplay/replay.py:189
↓ 3 callersFunctionparse_transaction
(transaction_dict)
src/SimpleReplay/replay.py:768
↓ 3 callersFunctionpercent
(num, den)
src/SimpleReplay/replay.py:928
↓ 3 callersFunctionread_csv_from_s3
(s3_client, bucket, file_key)
src/RedshiftIDCMigrationUtility/idc_add_users_groups_roles_psets.py:45
↓ 3 callersFunctionredshift_execute_query
Executes redshift query and gets response for query when finished
src/SimpleReplay/helper/aws_service.py:20
↓ 3 callersMethodrun_command_against_resource
(self, command, command_parameters=None)
src/UnloadCopyUtility/util/resources.py:320
↓ 3 callersMethodset_create_sql
(self, create_sql)
src/UnloadCopyUtility/util/resources.py:47
↓ 3 callersMethodset_port
(self, port)
src/UnloadCopyUtility/util/redshift_cluster.py:107
↓ 3 callersFunctionstyles
Specifies style guidelines for pdf report and column formatting @return: dict, style guidelines
src/SimpleReplay/report_util.py:191
↓ 3 callersFunctionsub_yaml_vars
@param report: Report object @param paragraph: str, report paragraph that is being edited @param replace_dict: dict, specific elements t
src/SimpleReplay/report_util.py:248
↓ 3 callersMethodtokenize_s3_path
(path)
src/UnloadCopyUtility/util/s3_utils.py:66
↓ 2 callersMethod__eq__
(self, other)
src/UnloadCopyUtility/util/resources.py:168
↓ 2 callersMethod_get_s3_audit_logs
Getting audit logs from S3 for the cluster from get_s3_logs and calling the pasrse_log() :param log_bucket: :param log_pre
src/SimpleReplay/extract/extractor/s3_extractor.py:73
↓ 2 callersMethod_read_cloudwatch_logs
(self, response, endpoint, start_time, end_time, region)
src/SimpleReplay/extract/extractor/cloudwatch_extractor.py:44
↓ 2 callersMethod_refresh_stack_details
(self, force=False)
src/UnloadCopyUtility/tests/cloudformation/run_stack.py:39
↓ 2 callersMethodadd_src_dest_tasks
(self,source,destination,global_config_values)
src/UnloadCopyUtility/redshift_unload_copy.py:102
↓ 2 callersFunctionanalysis_summary
Print presigned url for report of given replay @param bucket_url: str, S3 bucket location @param replay: str, replay id
src/SimpleReplay/replay_analysis.py:423
↓ 2 callersMethodawait_finishing_of_tests
(self)
src/UnloadCopyUtility/tests/cloudformation/run_stack.py:157
↓ 2 callersFunctioncheck_file_existence
(response, obj_type)
src/SimpleReplay/external_object_replicator/copy_util.py:42
↓ 2 callersFunctioncleanup
(conn)
src/AnalyzeVacuumUtility/lib/analyze_vacuum.py:68
↓ 2 callersFunctionclearFilter
()
src/SimpleReplay/gui/src/components/ReplayAnalysis/TopRunningQueries.js:64
↓ 2 callersFunctionclone_objects_to_s3
(target_dest, obj_type, source_location, objects_not_found)
src/SimpleReplay/external_object_replicator/copy_util.py:64
↓ 2 callersMethodclone_structure_from
Change DDL of self such that it has the same structure as other :param other: Resource implementation of same type a self :re
src/UnloadCopyUtility/util/resources.py:99
↓ 2 callersFunctionclose_conn
(conn)
src/ColumnEncodingUtility/analyze-schema-compression.py:126
↓ 2 callersMethodcopy
(self)
src/UnloadCopyUtility/util/tasks.py:114
↓ 2 callersMethodcount
(self, value)
src/UnloadCopyUtility/util/tasks.py:105
↓ 2 callersFunctioncreate_presigned_url
Creates a presigned url for a given object @param bucket_name: str, bucket name @param object_name: str, object name @return:
src/SimpleReplay/replay_analysis.py:397
↓ 2 callersMethoddelete_list_of_keys_from_bucket
This is a wrapper around delete_objects for the boto3 S3 client. This call only allows a maximum of 1000 keys otherwise an Exception
src/UnloadCopyUtility/util/s3_utils.py:34
↓ 2 callersMethodexecute_transaction
(self, transaction, connection)
src/SimpleReplay/replay.py:409
↓ 2 callersMethodexecute_update
(self, command, opt=options, timeout=set_timeout_stmt, database=None)
src/UnloadCopyUtility/util/redshift_cluster.py:273
↓ 2 callersFunctiongenerate_unified_cleanup_script
()
src/LakeFormationMigrationUtility/tests/integration_test/cleanup_script_generator.py:4
↓ 2 callersMethodget_conn_to_rs
(self, opt=options, timeout=set_timeout_stmt, database=None)
src/UnloadCopyUtility/util/redshift_cluster.py:227
↓ 2 callersMethodget_ddl_for_different_database
(ddl, new_database_name=None)
src/UnloadCopyUtility/util/sql/ddl_generators.py:146
↓ 2 callersMethodget_ddl_for_different_relation_where_relation_just_before_round_bracket
Get ddl but adapt it to create a relation with different name but same structure :param ddl: ddl from admin.v_generate_tbl_ddl view
src/UnloadCopyUtility/util/sql/ddl_generators.py:150
↓ 2 callersMethodget_element_from_cluster_endpoint
(self, element)
src/UnloadCopyUtility/util/redshift_cluster.py:213
↓ 2 callersMethodget_extract_from_cloudwatch
(self, start_time, end_time)
src/SimpleReplay/extract/extractor/cloudwatch_extractor.py:18
↓ 2 callersMethodget_filename
(self)
src/SimpleReplay/audit_logs_parsing.py:21
↓ 2 callersFunctionget_idc_group_id
Get IDC group ID using AWS CLI get-group-id command with caching
src/LakeFormationMigrationUtility/rs_privs_to_lf.py:277
↓ 2 callersMethodget_key_value_dict
(config_parameters_dict)
src/UnloadCopyUtility/global_config.py:254
↓ 2 callersFunctionget_log_formatter
Define the log format, with the option to prepend process and job/thread to each message
src/SimpleReplay/helper/log.py:51
↓ 2 callersMethodget_parameters_dict
(self)
src/UnloadCopyUtility/tests/cloudformation/get_stack_parameters.py:68
↓ 2 callersMethodget_parameters_from_stack_details
(self)
src/UnloadCopyUtility/tests/cloudformation/get_stack_parameters.py:22
↓ 2 callersMethodget_random_identifier
(*args, **kwargs)
src/UnloadCopyUtility/tests/redshift_unload_copy_cluster_tests.py:44
↓ 2 callersMethodget_redshift_client
(self)
src/UnloadCopyUtility/tests/cloudformation/get_stack_parameters.py:16
↓ 2 callersFunctionget_redshift_credentials
(config)
src/LakeFormationMigrationUtility/tests/performance_test/test_perf_redshift_to_lakeformation.py:10
↓ 2 callersMethodget_resource_from_dict
(cluster_dict, kms_region)
src/UnloadCopyUtility/util/resources.py:421
↓ 2 callersFunctionget_s3_folder_size
This function will calculate size of every folder inside the copy_replacement.csv @param copy_file_location: @return:
src/SimpleReplay/external_object_replicator/copy_util.py:27
↓ 2 callersFunctionget_secret
(secret_name, region_name)
src/SimpleReplay/util.py:287
↓ 2 callersMethodget_source_resource_from_config_helper
(config_helper, kms_region=None)
src/UnloadCopyUtility/util/resources.py:371
↓ 2 callersFunctionget_table_grants
Get grants for each table using SHOW GRANTS command Returns a dictionary mapping (db_name, schema_name, table_name) to a list of (grantee, pr
src/LakeFormationMigrationUtility/rs_privs_to_lf.py:425
↓ 2 callersMethodget_target_resource_from_config_helper
(config_helper, kms_region=None)
src/UnloadCopyUtility/util/resources.py:393
↓ 2 callersMethodget_user_creds_expiration
(self)
src/UnloadCopyUtility/util/redshift_cluster.py:128
↓ 2 callersMethodget_user_db_groups
(self)
src/UnloadCopyUtility/util/redshift_cluster.py:122
↓ 2 callersFunctionglue_create_table
(new_database, table_input, region)
src/SimpleReplay/helper/aws_service.py:177
↓ 2 callersFunctionglue_get_table
(database, table, region)
src/SimpleReplay/helper/aws_service.py:164
↓ 2 callersMethodhas_schema_in_ddl
(self)
src/UnloadCopyUtility/util/sql/ddl_generators.py:114
↓ 2 callersMethodhas_table_in_ddl
(self)
src/UnloadCopyUtility/util/sql/ddl_generators.py:110
↓ 2 callersFunctioninit_logging
Initialize logging to stdio
src/SimpleReplay/util.py:23
↓ 2 callersMethodis_a_parameter_key_being_processed
(self)
src/UnloadCopyUtility/global_config.py:295
↓ 2 callersFunctionis_duplicate
(first_query_text, second_query_text)
src/SimpleReplay/log_validation.py:67
↓ 2 callersFunctionis_valid_log
If query doesn't contain problem statements, saves it.
src/SimpleReplay/log_validation.py:12
↓ 2 callersFunctionjoin_finished_threads
(connection_threads, worker_stats, wait=False)
src/SimpleReplay/replay.py:969
↓ 2 callersFunctionload_configuration
(config_path='idc_config.ini')
src/RedshiftIDCMigrationUtility/idc_add_users_groups_roles_psets.py:12
↓ 2 callersFunctionload_file
load a file from s3 or local. decode if the file should be interpreted as text rather than binary
src/SimpleReplay/util.py:151
↓ 2 callersMethodmake_default_config_parameter
(name, value, description, possible_values)
src/UnloadCopyUtility/global_config.py:39
↓ 2 callersFunctionmatchesCategory
(item, categories)
src/SimpleReplay/gui/src/components/ReplayValidation/ErrorTable.js:60
↓ 2 callersFunctionmatchesDuration
(item)
src/SimpleReplay/gui/src/components/ReplayValidation/CopyDiff.js:30
↓ 2 callersFunctionmatchesQueryType
(item)
src/SimpleReplay/gui/src/components/ReplayAnalysis/TopQueryDeltas.js:50
↓ 2 callersFunctionmatchesQueryType
(item)
src/SimpleReplay/gui/src/components/ReplayAnalysis/TopRunningQueries.js:46
↓ 2 callersFunctionmatchesReplay
* FILTERING FUNCTIONS: all have the same structure * @param {Object} item individual entry in collection * @return {boolean} whether item ma
src/SimpleReplay/gui/src/components/ReplayAnalysis/TopRunningQueries.js:39
↓ 2 callersFunctionmatchesReplay
(item, replays)
src/SimpleReplay/gui/src/components/ReplayValidation/ErrorTable.js:67
↓ 2 callersFunctionmatchesUser
(item)
src/SimpleReplay/gui/src/components/ReplayAnalysis/TopQueryDeltas.js:43
↓ 2 callersFunctionmatchesUser
(item)
src/SimpleReplay/gui/src/components/ReplayAnalysis/TopRunningQueries.js:53
↓ 2 callersFunctionmatchesUser
(item)
src/SimpleReplay/gui/src/components/ReplayValidation/ErrorTable.js:74
↓ 2 callersFunctionparse_log
This function parses the different logs and send it to the respective function :param log_file: filname(either connectionlog, useractivitylo
src/SimpleReplay/extract/extractor/extract_parser.py:13
↓ 2 callersFunctionparse_s3_list_response
Parses the S3 list objects response into an iterator of entries.
src/ManifestGenerator/manifestgen.py:42
↓ 2 callersFunctionprepend_ids_to_logs
Update logging to prepend process_id and / or job_id to all emitted logs
src/SimpleReplay/util.py:82
↓ 2 callersFunctionprint_statements
(statements)
src/ColumnEncodingUtility/analyze-schema-compression.py:153
↓ 2 callersMethodprintmessage
(self, status)
src/MultipleTableRestoreUtility/multitablerestore.py:66
↓ 2 callersMethodprocess_parameter_without_value
(self)
src/UnloadCopyUtility/global_config.py:298
↓ 2 callersFunctionput_and_retry
Retry adding to the queue indefinitely until it succeeds. This should only raise an exception and retry if the queue limit is hit.
src/SimpleReplay/replay.py:1133
↓ 2 callersMethodquote_indent
(identifier_string)
src/UnloadCopyUtility/util/sql/sql_text_helpers.py:153
↓ 2 callersMethodquote_unindent
(identifier_string)
src/UnloadCopyUtility/util/sql/sql_text_helpers.py:164
↓ 2 callersFunctionredshift_get_cluster_credentials
( region, user, database_name, cluster_id, duration=900, auto_create=False )
src/SimpleReplay/util.py:472
↓ 2 callersMethodrun_command_against_resource
(self, command, command_parameters=None)
src/UnloadCopyUtility/util/resources.py:211
↓ 2 callersMethodset_user_auto_create
(self, user_auto_create)
src/UnloadCopyUtility/util/redshift_cluster.py:119
↓ 2 callersFunctionsize_of_data
Categorise bytes in GB,MB,TB @param bytes: @return:
src/SimpleReplay/external_object_replicator/copy_util.py:102
↓ 1 callersFunctionBuildQueryObjList
(sanitizedQueryObjList)
src/SimpleReplay/PreviousVersion/ParseUserActivityLog.py:73
↓ 1 callersFunctionParse_Auditlog
(input_log)
src/SimpleReplay/PreviousVersion/ParseUserActivityLog.py:19
↓ 1 callersFunctionParse_Regular_User_lines
(preparsed_lines)
src/SimpleReplay/PreviousVersion/ParseUserActivityLog.py:33
↓ 1 callersFunctionPreParse_Auditlog_Datetime_Lines
(loglines_input)
src/SimpleReplay/PreviousVersion/ParseUserActivityLog.py:55
↓ 1 callersFunctionPrint_Human_Readable
(queryObjList, creds, rewrites, readonly)
src/SimpleReplay/PreviousVersion/ParseUserActivityLog.py:107
↓ 1 callersFunctionRemove_Problem_Keywords
(reg_user_lines)
src/SimpleReplay/PreviousVersion/ParseUserActivityLog.py:38
↓ 1 callersMethod__init__
(self, start_time, end_time, text)
src/SimpleReplay/replay.py:175
↓ 1 callersMethod__str__
(self)
src/SimpleReplay/replay.py:181
← previousnext →101–200 of 735, ranked by callers