MCPcopy Create free account

hub / github.com/GoogleCloudPlatform/DataflowTemplates / functions

Functions23,218 in github.com/GoogleCloudPlatform/DataflowTemplates

↓ 7,365 callersMethodput
Register a mapping with a constant size estimate. @param typeName The JDBC type name (e.g., "VARCHAR"). @param extractor The extractor to get value f
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/rowmapper/JdbcMappings.java:51
↓ 2,942 callersMethodget
()
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/mysql/MySqlSchemaFetcher.java:48
↓ 2,692 callersMethodapply
(SQLException sqlException)
v2/datastream-common/src/main/java/com/google/cloud/teleport/v2/datastream/io/CdcJdbcIO.java:412
↓ 2,449 callersMethodto
()
plugins/core-plugin/src/test/java/com/google/cloud/teleport/plugin/sample/AtoBOk.java:37
↓ 2,338 callersMethodof
()
v1/src/main/java/com/google/cloud/teleport/spanner/FileShard.java:79
↓ 2,260 callersMethodadd
(self, item)
python/src/test/python/bigquery-anomaly-detection/pipeline_test.py:1315
↓ 2,036 callersMethodset
(IndexColumn indexColumn)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/IndexColumn.java:117
↓ 1,923 callersMethodaddParameter
(UdfParameter parameter)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Udf.java:262
↓ 1,865 callersMethodname
Returns the name/path of the artifact.
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/artifacts/Artifact.java:37
↓ 1,645 callersMethodget
Returns the estimated throughput for now.
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/changestreams/estimator/ThroughputEstimator.java:32
↓ 1,460 callersMethodof
(JsonNode node, Collection<Error> messages)
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/model/Json.java:80
↓ 1,342 callersMethodset
(IndexColumn indexColumn)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/IndexColumn.java:152
↓ 1,336 callersMethodformat
(PubSubUtils pubSub, JSONObject chg)
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/bigtablechangestreamstopubsub/schemautils/PubSubValueFormatter.java:25
↓ 1,334 callersMethodassertTrue
()
lt/observability/src/test/java/com/google/cloud/teleport/lt/rules/DetectMetricDeviationConditionCheck.java:106
↓ 1,298 callersMethodbuild
()
v1/src/test/java/com/google/cloud/teleport/spanner/ddl/RandomDdlGenerator.java:190
↓ 1,262 callersMethodbuild
()
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/reader/io/jdbc/rowmapper/JdbcSourceRowMapperTest.java:1096
↓ 1,081 callersMethodappend
(ILoggingEvent event)
structured-logging/src/main/java/com/google/cloud/teleport/v2/logging/JsonAppender.java:31
↓ 1,033 callersMethodcreate
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/source/cassandra/reader/io/cassandra/iowrapper/SSLOptionsProvider.java:54
↓ 1,031 callersMethodget
Supplies a value of type {@code T}. @return A value of type {@code T}. @throws Exception If an error occurs while supplying the value.
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/source/cassandra/CassandraTypeHandler.java:102
↓ 915 callersMethodcolumn
(String name)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Table.java:282
↓ 861 callersMethodof
(BigInteger start, BigInteger end)
v2/sourcedb-to-spanner/src/main/java/org/apache/beam/sdk/io/localcassandra/RingRange.java:64
↓ 802 callersMethodendColumn
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Column.java:403
↓ 790 callersMethodstring
Returns the descriptor for the {@code STRING} type: a variable-length Unicode character string.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:130
↓ 758 callersMethodof
(String name, Type type)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:373
↓ 757 callersMethodisEmpty
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/schema/Schema.java:250
↓ 730 callersMethodcolumn
(String name)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Table.java:304
↓ 712 callersMethodof
(DataSourceConfiguration dataSourceConfiguration)
v2/datastream-to-sql/src/main/java/com/google/cloud/teleport/v2/transforms/CreateDml.java:66
↓ 711 callersMethodgetValue
()
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/model/validation/DuplicateTextHeaderValidator.java:87
↓ 698 callersMethodoutput
(Iterable<MutationGroup> output)
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerIO.java:2167
↓ 698 callersMethodstream
(String tableName)
v1/src/test/java/com/google/cloud/teleport/spanner/ddl/RandomInsertMutationGenerator.java:56
↓ 682 callersMethodof
Creates a {@link PTransform} that will apply changes from the input {@link PCollection} into tables stored in the given {@code replicaDataset}. <p>It
v2/cdc-parent/cdc-change-applier/src/main/java/com/google/cloud/dataflow/cdc/applier/BigQueryChangeApplier.java:101
↓ 641 callersMethodof
( OriginalT originalPayload, CurrentT currentPayload)
v2/common/src/main/java/com/google/cloud/teleport/v2/values/FailsafeElement.java:44
↓ 639 callersMethodsize
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Column.java:45
↓ 624 callersMethodget
(DriverExecutionProfile profile, DriverOption driverOption)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/utils/CassandraDriverConfigLoader.java:177
↓ 618 callersMethodwrite
Executes a given write dmlGeneratorResponse against the data source then calls the transactionalCheck callback function (if not null). The transaction
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/dbutils/dao/source/IDao.java:32
↓ 616 callersMethodbuild
Builds and starts the {@link CassandraSslContainerWrapper}, including certificate generation. @return the initialized container wrapper.
v2/spanner-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/CassandraSslContainerWrapper.java:180
↓ 605 callersMethodendColumn
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Column.java:330
↓ 518 callersMethodmap
(Object input)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/avro/AvroJsonToCassandraMapConvertor.java:149
↓ 514 callersMethodcreateConfig
(LaunchInfo info)
v2/googlecloud-to-googlecloud/src/test/java/com/google/cloud/teleport/v2/templates/bigtablechangestreamstogcs/BigtableChangeStreamsToGcsIT.java:510
↓ 510 callersMethodnext
Adds one nanosecond to the given timestamp. If the timestamp given is {@link Timestamp#MAX_VALUE}, {@link Timestamp#MAX_VALUE} is returned. @param ti
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/changestreams/restriction/TimestampUtils.java:74
↓ 488 callersMethodpipelineOperator
()
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/TemplateTestBase.java:784
↓ 473 callersMethodbuild
()
v2/datastream-common/src/main/java/com/google/cloud/teleport/v2/datastream/io/CdcJdbcIO.java:569
↓ 454 callersMethodgetBytes
()
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/changestreams/estimator/BytesThroughputEstimator.java:61
↓ 451 callersMethodbuild
()
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorTable.java:109
↓ 434 callersMethodsetName
(String name)
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/SchemaConfig.java:120
↓ 432 callersMethodtype
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Udf.java:61
↓ 420 callersMethodint64
Returns the descriptor for the {@code INT64} type: an integral type with the same value domain as a Java {@code long}.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:102
↓ 405 callersMethodgetKey
()
v2/elasticsearch-common/src/main/java/com/google/cloud/teleport/v2/elasticsearch/utils/Dataset.java:27
↓ 402 callersMethodtype
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Column.java:36
↓ 372 callersMethodsize
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Column.java:43
↓ 363 callersMethodsetType
(MutationType type)
v2/bigtable-changestreams-to-hbase/src/test/java/com/google/cloud/bigtable/data/v2/models/ChangeStreamMutationBuilder.java:73
↓ 354 callersMethodint64
Returns the descriptor for the {@code INT64} type: an integral type with the same value domain as a Java {@code long}.
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:105
↓ 346 callersMethodapply
(Object recordValue, Schema fieldSchema)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/avro/AvroToValueMapper.java:73
↓ 343 callersMethodof
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/DLPTextToBigQueryStreaming.java:770
↓ 333 callersMethodsetColumnTypeName
(String value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:403
↓ 331 callersMethodnewBuilder
()
v1/src/main/java/com/google/cloud/teleport/splunk/SplunkEvent.java:29
↓ 323 callersMethodsetTableName
(ValueProvider<String> value)
v1/src/main/java/com/google/cloud/teleport/templates/TextToSpanner.java:151
↓ 320 callersMethodgetMessage
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/avro/AvroPubsubMessageRecord.java:47
↓ 307 callersMethodbuilder
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Ddl.java:281
↓ 305 callersMethodtoString
()
v2/datastream-to-spanner/src/main/java/com/google/cloud/teleport/v2/templates/source/mysql/MySqlChangeEventSequence.java:200
↓ 286 callersMethodasc
(String name)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/IndexColumn.java:134
↓ 276 callersMethodasc
(String name)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/IndexColumn.java:112
↓ 275 callersMethodcreateTable
(String name)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Ddl.java:304
↓ 268 callersMethodsetDataSourceId
(String value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/iowrapper/config/TableConfig.java:71
↓ 266 callersMethodsetMinRows
(Integer minRows)
it/jdbc/src/main/java/org/apache/beam/it/jdbc/conditions/JDBCRowsCheck.java:85
↓ 262 callersMethodsetTableIdentifier
(TableIdentifier tableIdentifier)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:430
↓ 256 callersMethodtoString
()
v1/src/test/java/com/google/cloud/teleport/spanner/spannerio/SpannerIOWriteTest.java:1690
↓ 252 callersMethodbuild
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/utils/FirestoreConverters.java:898
↓ 250 callersMethodbuilder
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/TableIdentifier.java:35
↓ 240 callersMethodgetGcsPath
(String artifactId, GcsResourceManager gcsResourceManager)
v2/gcs-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/SpannerToJdbcLTBase.java:215
↓ 238 callersMethodcreateTable
(String name)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Ddl.java:552
↓ 238 callersMethodinc
(Counter counter)
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/changestreams/ChangeStreamMetrics.java:223
↓ 234 callersMethodlaunchTemplate
Launch the template job with the given options. By default, it will setup the hooks to avoid jobs getting leaked.
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/TemplateTestBase.java:569
↓ 231 callersMethodclose
Releases sink-specific resources (Spanner accessor handles, test-owned pools, etc.). The default implementation is a no-op.
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/sink/DataWriter.java:68
↓ 231 callersMethodtoString
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/avro/AvroPubsubMessageRecord.java:93
↓ 227 callersMethodsetCoder
(Coder<T> coder)
v2/sourcedb-to-spanner/src/main/java/org/apache/beam/sdk/io/localcassandra/CassandraIO.java:498
↓ 225 callersMethodjson
Returns the descriptor for the {@code JSON} type.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:135
↓ 224 callersMethodbuilder
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Ddl.java:521
↓ 221 callersMethodsetColumnName
(String value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceColumnIndexInfo.java:128
↓ 219 callersMethodgetName
()
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:391
↓ 218 callersMethodendTable
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Table.java:291
↓ 216 callersMethodgetName
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:357
↓ 206 callersMethodexecute
()
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/actions/preload/PreloadAction.java:29
↓ 205 callersMethodsplit
Split a given range into 2 ranges via the {@link Range#boundary() boundary's} {@link Boundary#split(ProcessContext) split()}. The caller must ensure t
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:215
↓ 204 callersMethodbuildUpsertMutation
(Long key)
v1/src/test/java/com/google/cloud/teleport/spanner/spannerio/SpannerIOWriteTest.java:1659
↓ 204 callersMethodnewBuilder
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/utils/FirestoreConverters.java:901
↓ 197 callersMethodarray
Returns a descriptor for an array of {@code elementType}.
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:231
↓ 197 callersMethodparseTimestamp
(String timestamp)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/convertors/ChangeEventTypeConvertor.java:371
↓ 195 callersMethodstring
Returns the descriptor for the {@code STRING} type: a variable-length Unicode character string.
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:133
↓ 186 callersMethodgetInstanceId
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/options/SourceDbToSpannerOptions.java:148
↓ 180 callersMethodnewBuilder
()
v2/common/src/main/java/com/google/cloud/teleport/v2/transforms/WriteToGCSAvro.java:51
↓ 179 callersMethodtable
(String tableName)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Ddl.java:164
↓ 178 callersMethodmax
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Column.java:321
↓ 178 callersMethodsetColumnClass
(Class value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/PartitionColumn.java:83
↓ 177 callersMethodarray
Returns a descriptor for an array of {@code elementType}.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:223
↓ 176 callersMethodbuilder
()
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/reader/io/jdbc/rowmapper/JdbcSourceRowMapperTest.java:1042
↓ 176 callersMethodend
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/IndexColumn.java:235
↓ 175 callersMethodendTable
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Table.java:269
↓ 174 callersMethodvalue
()
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/models/PreparedStatementValueObject.java:25
↓ 173 callersMethodnewBuilder
()
it/datadog/src/main/java/com/google/cloud/teleport/it/datadog/DatadogLogEntry.java:27
next →1–100 of 23,218, ranked by callers