MCPcopy Create free account

hub / github.com/GoogleCloudPlatform/DataflowTemplates / functions

Functions23,218 in github.com/GoogleCloudPlatform/DataflowTemplates

⨍ Functions 23,218◇ Types & classes 3,671↳ Endpoints 7
↓ 49 callersMethodstruct
Returns a descriptor for a {@code STRUCT} type: an ordered collection of named and typed fields.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:286
↓ 49 callersMethodtables
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/sourceddl/SourceSchema.java:33
↓ 49 callersMethodupdate
Updates {@code rows} in the sink for the given {@code table}, routing by {@code shardId}. @param rows rows to update. The caller should group rows by
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/sink/DataWriter.java:51
↓ 48 callersMethodbuild
()
v1/src/main/java/com/google/cloud/teleport/templates/common/CsvConverters.java:189
↓ 48 callersMethodbuilder
()
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorSchema.java:30
↓ 48 callersMethoddiscoverTableSchema
Discover source schema. @return List of discovered schemas for all the passed sources. For single shard migration the returned list will contain
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/IoWrapper.java:54
↓ 48 callersMethodgroup
(boolean group)
v2/googlecloud-to-neo4j/src/test/java/com/google/cloud/teleport/v2/neo4j/utils/ModelUtilsTest.java:620
↓ 48 callersMethodnewBuilder
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/bigtablechangestreamstogcs/WriteChangeStreamMutationToGcsAvro.java:59
↓ 48 callersMethodprocess
(String fileString)
v1/src/main/java/com/google/cloud/teleport/util/ValueProcessor.java:22
↓ 48 callersMethodsetName
(String name)
plugins/core-plugin/src/main/java/com/google/cloud/teleport/plugin/model/ImageSpecMetadata.java:61
↓ 48 callersMethodstrings
()
v1/src/test/java/com/google/cloud/teleport/spanner/ImportFromAvroTest.java:537
↓ 48 callersMethodtrackNode
(String name, String executeAfter, String executeAfterName)
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/model/helpers/JobSpecIndex.java:41
↓ 48 callersMethodwithTimestampBound
(TimestampBound timestampBound)
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerIO.java:874
↓ 47 callersMethodaddKeyPart
(String table, String column, boolean desc)
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerSchema.java:100
↓ 47 callersMethodgetDMLStatement
(DMLGeneratorRequest dmlGeneratorRequest)
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/source/mysql/MySQLDMLGenerator.java:41
↓ 47 callersMethodgetLogicalShardId
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/shard/Shard.java:93
↓ 47 callersMethodgetSeconds
()
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/changestreams/estimator/BytesThroughputEstimator.java:57
↓ 47 callersMethodlaunchDataflowJob
Performs the following steps: Uploads session file to GCS. Creates Pubsub resources. Launches DataStreamToSpanner dataflow job. @param identifierSuff
v2/datastream-to-spanner/src/test/java/com/google/cloud/teleport/v2/templates/DataStreamToSpannerITBase.java:238
↓ 47 callersMethodpgInt8
()
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:174
↓ 47 callersMethodsetDatabaseName
(ValueProvider<String> value)
v1/src/main/java/com/google/cloud/teleport/templates/TextToSpanner.java:145
↓ 47 callersMethodsetMaxPartitionsHint
(Long value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/TableSplitSpecification.java:115
↓ 47 callersMethodwithUrl
Method to set the url for HEC event collector. @param url for HEC event collector @return {@link Builder}
v1/src/main/java/com/google/cloud/teleport/splunk/SplunkIO.java:142
↓ 46 callersMethodgetSourceColumnName
Retrieves the corresponding source column name given a Spanner table and Spanner column. @param namespace is currently not operational.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/schema/ISchemaMapper.java:64
↓ 46 callersMethodoptions
()
v2/elasticsearch-common/src/main/java/com/google/cloud/teleport/v2/elasticsearch/transforms/WriteToElasticsearch.java:103
↓ 46 callersMethodpgInt8
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:174
↓ 46 callersMethodquoteIdentifier
(String name, Dialect dialect)
v1/src/main/java/com/google/cloud/teleport/spanner/common/NameUtils.java:57
↓ 46 callersMethodrun
()
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/templates/GoogleCloudToNeo4j.java:244
↓ 46 callersMethodsetPassword
(String password)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/options/SourceDbToSpannerOptions.java:109
↓ 46 callersMethodwrite
Creates an uninitialized instance of {@link Write}. Before use, the {@link Write} must be configured with a {@link Write#withInstanceId} and {@link Wr
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerIO.java:514
↓ 45 callersMethodbuilder
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/GraphElementTable.java:151
↓ 45 callersMethodcolumns
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/sourceddl/SourceTable.java:34
↓ 45 callersMethodgetDatabaseClient
()
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/dbutils/SpannerDao.java:84
↓ 45 callersMethodgetSpannerTableName
Retrieves the corresponding Spanner table name given a source table name. @param namespace is currently not operational.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/schema/ISchemaMapper.java:49
↓ 45 callersMethodhasContent
Check if any of the artifacts has a specific content. @param content Content to search for
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/artifacts/matchers/ArtifactsSubject.java:88
↓ 45 callersMethodinputValue
(Object value)
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/reader/io/jdbc/rowmapper/JdbcSourceRowMapperTest.java:1086
↓ 45 callersMethodsanitize
(String identifier)
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/database/CypherPatterns.java:230
↓ 44 callersMethodbuild
()
v2/spanner-change-streams-to-sharded-file-sink/src/main/java/com/google/cloud/teleport/v2/templates/transforms/WriterGCS.java:106
↓ 44 callersMethodcolumns
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Table.java:54
↓ 44 callersMethodread
(self)
python/src/test/python/bigquery-anomaly-detection/pipeline_test.py:1323
↓ 44 callersMethodsetCardinality
(long value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceColumnIndexInfo.java:134
↓ 44 callersMethodtableName
Get the tableName metadata for the row. @return tableName
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/row/SourceRow.java:55
↓ 43 callersMethodbuilder
Builder for {@link SourceColumnIndexInfo}. @return builder.
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceColumnIndexInfo.java:106
↓ 43 callersMethodgetOriginalPayload
()
v2/datastream-common/src/main/java/com/google/cloud/teleport/v2/datastream/values/DmlInfo.java:46
↓ 43 callersMethodgetProjectId
()
v1/src/main/java/com/google/cloud/teleport/templates/TextToSpanner.java:118
↓ 43 callersMethodgetUsername
()
v2/dataplex/src/main/java/com/google/cloud/teleport/v2/options/DataplexJdbcIngestionOptions.java:93
↓ 43 callersMethodrun
Runs the pipeline with the supplied options. @param options The execution parameters to the pipeline. @return The result of the pipeline execution.
v2/datastream-to-spanner/src/main/java/com/google/cloud/teleport/v2/templates/DataStreamToSpanner.java:658
↓ 43 callersMethodsetIndexName
(String value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceColumnIndexInfo.java:138
↓ 43 callersMethodsetIsPrimary
(boolean value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceColumnIndexInfo.java:130
↓ 43 callersMethodsetIsUnique
(boolean value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceColumnIndexInfo.java:132
↓ 43 callersMethodsetOrdinalPosition
(long value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceColumnIndexInfo.java:136
↓ 43 callersMethodsetTimestamp
(long timestamp)
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/avro/AvroPubsubMessageRecord.java:67
↓ 43 callersMethodtoMicros
(Instant instant)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/source/postgres/reader/io/jdbc/rowmapper/provider/PostgreSQLJdbcValueMappings.java:57
↓ 42 callersMethodbuildDdlWithSingleNonPkCol
(String colName, Type colType)
v2/spanner-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/source/spanner/SpannerDMLGeneratorTest.java:537
↓ 42 callersMethodbuildMapperForSingleColTable
(SourceSchema schema)
v2/spanner-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/source/spanner/SpannerDMLGeneratorTest.java:573
↓ 42 callersMethodbuildSchemaWithSingleNonPkCol
(String colName, String colType)
v2/spanner-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/source/spanner/SpannerDMLGeneratorTest.java:547
↓ 42 callersMethodchildTables
The names of the tables that are children of this table in the generation hierarchy.
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorTable.java:72
↓ 42 callersMethodexecuteDdlStatements
Executes a list of DDL statements. <p>Note: Implementations may do instance creation and database creation here. @param statements The DDL statement
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/spanner/SpannerResourceManager.java:380
↓ 42 callersMethodgetCode
Returns the type code corresponding to this type.
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:443
↓ 42 callersMethodgetCurrentRowAsStruct
Returns the record at the current pointer as a {@link Struct}. It also updates the timestamp at which the record was read. <p>If {@link ChangeStreamR
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/changestreams/dao/ChangeStreamResultSet.java:104
↓ 42 callersMethodgetJavascriptTextTransformFunctionName
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java:258
↓ 42 callersMethodgetMod
()
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/changestream/TrimmedShardedDataChangeRecord.java:114
↓ 42 callersMethodgetPassword
Get Value provider for DB password. @return the password to be provided to {@link org.apache.beam.sdk.io.jdbc.JdbcIO JdbcIO}
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/auth/dbauth/DbAuth.java:39
↓ 42 callersMethodgetSourceTableName
Retrieves the corresponding Source table name given a spanner table name. @param namespace is currently not operational.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/schema/ISchemaMapper.java:42
↓ 42 callersMethodlaunchDataflowJob
Performs the following steps: Uploads session file to GCS. Creates Pubsub resources. Launches SourceDbToSpanner dataflow job for Jdbc Source. @param
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/templates/SourceDbToSpannerITBase.java:216
↓ 42 callersMethodparse
(SinkType sinkType, String sinkOptionsPath)
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/sink/SinkConfigParser.java:58
↓ 42 callersMethodreferencedTable
The table this foreign key references.
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorForeignKey.java:30
↓ 42 callersMethodrun
(TransactionContext transaction)
v1/src/test/java/com/google/cloud/teleport/templates/SpannerServerResource.java:143
↓ 42 callersMethodrunId
Returns the id associated with the particular run of the test class.
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/artifacts/ArtifactClient.java:54
↓ 42 callersMethodsetInputFileSpec
(String inputFileSpec)
v2/common/src/main/java/com/google/cloud/teleport/v2/transforms/AvroConverters.java:46
↓ 42 callersMethodtoString
()
v2/spanner-change-streams-to-sharded-file-sink/src/main/java/com/google/cloud/teleport/v2/templates/common/TrimmedShardedDataChangeRecord.java:149
↓ 42 callersMethodwithHost
(String host)
v1/src/main/java/com/google/cloud/teleport/splunk/SplunkEvent.java:83
↓ 42 callersMethodwithMessage
(String message)
v1/src/main/java/com/google/cloud/teleport/datadog/DatadogEvent.java:88
↓ 41 callersMethodaddDataSource
Adds a DataSource provider with a specific identifier. @param datasourceId The unique ID for this physical shard. @param provider The serializable fu
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/DataSourceProviderImpl.java:110
↓ 41 callersMethodaddSourceColumnNameToSourceColumnType
( String sourceColumnName, SourceColumnType sourceColumnType)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceTableSchema.java:107
↓ 41 callersMethodbuild
()
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerIO.java:1145
↓ 41 callersMethodconvert
(Struct row)
v1/src/main/java/com/google/cloud/teleport/spanner/SpannerRecordConverter.java:166
↓ 41 callersMethoddefaultExpression
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Column.java:78
↓ 41 callersMethodfloat32
Returns the descriptor for the {@code FLOAT32} type: a floating point type with the same value domain as a Java {code float}.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:110
↓ 41 callersMethodgenerateValue
Synthesise a value for the given column using {@code faker}. Caller is responsible for seeding the Faker instance. <p>The returned Java type matches
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/utils/DataGeneratorUtils.java:61
↓ 41 callersMethodgetDatabaseId
()
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerConfig.java:60
↓ 41 callersMethodgetErrorMessage
()
v2/common/src/main/java/com/google/cloud/teleport/v2/values/FailsafeElement.java:64
↓ 41 callersMethodnone
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/annotations/cassandra/CassandraType.java:36
↓ 41 callersMethodsetIsLast
(boolean value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:389
↓ 41 callersMethodsetQuery
(String query)
v2/google-ads-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/GoogleAdsToBigQuery.java:108
↓ 40 callersMethodbuilder
(String hostname, String username, String password, int port)
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/datastream/MySQLSource.java:58
↓ 40 callersMethodbuilder
(GcsResourceManager resourceManager, String gcsPathPrefix)
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/datastream/conditions/DlqEventsCountCheck.java:79
↓ 40 callersMethodbuilder
Creates a new Builder for the Cassandra SSL container wrapper. @param testId the test identifier. @return a new {@link Builder}.
v2/spanner-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/CassandraSslContainerWrapper.java:290
↓ 40 callersMethoddesc
(String name)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/IndexColumn.java:139
↓ 40 callersMethodexportMetricsToBigQuery
Exports the metrics of given dataflow job to BigQuery. @param launchInfo Job info of the job @param metrics metrics to export
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/LoadTestBase.java:141
↓ 40 callersMethodgetMetrics
Computes the metrics of the given job using dataflow and monitoring clients. @param launchInfo Job info of the job @param inputPcollection input pcol
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/LoadTestBase.java:281
↓ 40 callersMethodkind
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/GraphElementTable.java:51
↓ 40 callersMethodnewBuilder
()
v1/src/main/java/com/google/cloud/teleport/datadog/DatadogEvent.java:27
↓ 40 callersMethodof
Construct a JdbcIOWrapper from the configuration group. <p>This method performs schema discovery for all shards in the group. <p><b>Error Isolation:
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/iowrapper/JdbcIoWrapper.java:111
↓ 40 callersMethodpgArray
Returns a descriptor for an array of PG {@code elementType}.
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:262
↓ 40 callersMethodscale
The scale of the column (for numeric types).
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorColumn.java:53
↓ 40 callersMethodsetProjectId
(String projectId)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/options/SourceDbToSpannerOptions.java:174
↓ 40 callersMethodtoString
()
v2/gcs-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/common/ProcessingContext.java:85
↓ 40 callersMethodtrackEdge
(String name, String executeAfter, String executeAfterName)
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/model/helpers/JobSpecIndex.java:68
↓ 40 callersMethodwithQuery
(Statement statement)
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerIO.java:894
↓ 39 callersMethodbuilder
(String testId)
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/cloudsql/CloudMySQLResourceManager.java:40
← previousnext →401–500 of 23,218, ranked by callers