MCPcopy Create free account

hub / github.com/GoogleCloudPlatform/DataflowTemplates / functions

Functions23,218 in github.com/GoogleCloudPlatform/DataflowTemplates

⨍ Functions 23,218◇ Types & classes 3,671↳ Endpoints 7
↓ 65 callersMethodgetTimestamp
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/avro/AvroPubsubMessageRecord.java:63
↓ 65 callersMethodintValue
(String namespace, ByteString value)
v1/src/main/java/com/google/cloud/teleport/bigtable/BigtableToVectorEmbeddings.java:618
↓ 65 callersMethodisNullable
Whether the column is nullable.
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorColumn.java:33
↓ 64 callersMethodbuilder
Returns a new {@link Builder} for configuring a client.
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/storage/GcsResourceManager.java:126
↓ 64 callersMethodcreateRows
(String type, Object... values)
v2/spanner-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/SpannerToMySqlDataTypesIT.java:593
↓ 64 callersMethodcreateRows
(String type, Object... values)
v2/spanner-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/SpannerToMySqlDataTypesPGDialectIT.java:597
↓ 64 callersMethodfloat64
Returns the descriptor for the {@code FLOAT64} type: a floating point type with the same value domain as a Java {code double}.
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:121
↓ 64 callersMethodgetName
()
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/SchemaConfig.java:116
↓ 64 callersMethodnewBuilder
()
v2/spanner-change-streams-to-sharded-file-sink/src/main/java/com/google/cloud/teleport/v2/templates/transforms/WriterGCS.java:47
↓ 64 callersMethodnewBuilder
()
v2/file-format-conversion/src/main/java/com/google/cloud/teleport/v2/templates/FileFormatConversionFactory.java:58
↓ 63 callersMethodbuild
()
v2/kafka-to-bigquery/src/main/java/com/google/cloud/teleport/v2/transforms/StringMessageToTableRow.java:88
↓ 62 callersMethodequals
(@Nullable Object o)
v1/src/test/java/com/google/cloud/spanner/FakeBatchTransactionId.java:37
↓ 62 callersMethodgetMetadata
The connector execution metadata for this record.
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/changestreams/model/DataChangeRecord.java:209
↓ 62 callersMethodof
Parse Jdbc Url String and return an {@link JdbcUrl} object, or return null for unsupported formats. <p>Example of supported format: <ul> <li>"jdbc
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/transforms/JdbcUrl.java:64
↓ 62 callersMethodprimaryKeyColumns
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/sourceddl/SourceTable.java:36
↓ 62 callersMethodread
(Pipeline pipeline, ReadFromPubSubOptions options)
v2/common/src/main/java/com/google/cloud/teleport/v2/auto/blocks/ReadFromPubSub.java:43
↓ 62 callersMethodrun
Create the pipeline with the supplied options. @param options The execution parameters to the pipeline. @return The result of the pipeline execution.
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/templates/SourceDbToSpanner.java:97
↓ 62 callersMethodsetValue
(String value)
plugins/core-plugin/src/main/java/com/google/cloud/teleport/plugin/model/ImageSpecParameterEnumOption.java:41
↓ 61 callersMethodbuilder
()
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorColumn.java:60
↓ 61 callersMethodbuilder
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/spannerchangestreamstobigquery/BigQueryDynamicDestinations.java:198
↓ 61 callersMethodcleanupAll
Deletes all the files located under test-class-name/run-id.
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/artifacts/ArtifactClient.java:128
↓ 61 callersMethodgetSchema
Fetches the schema definition from the sink. @return The DataGeneratorSchema object. @throws IOException If an error occurs during fetching.
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/sink/SinkSchemaFetcher.java:37
↓ 61 callersMethodof
(DataSourceConfiguration config)
v2/datastream-to-sql/src/main/java/com/google/cloud/teleport/v2/utils/DatastreamToPostgresDML.java:39
↓ 61 callersMethodsetProjectId
(ValueProvider<String> value)
v1/src/main/java/com/google/cloud/teleport/templates/TextToSpanner.java:121
↓ 61 callersMethodsetSplitStagesCount
(Long value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/TableSplitSpecification.java:119
↓ 60 callersMethodcreateAvroSchema
(String columnName, Schema.Type type)
v1/src/test/java/com/google/cloud/teleport/spanner/AvroRecordConverterTest.java:1546
↓ 60 callersMethodgetDocumentId
()
v2/datastream-mongodb-to-firestore/src/main/java/com/google/cloud/teleport/v2/templates/datastream/MongoDbChangeEventContext.java:223
↓ 60 callersMethodgetResponseRow
()
v2/spanner-migrations-sdk/src/main/java/com/google/cloud/teleport/v2/spanner/utils/MigrationTransformationResponse.java:24
↓ 60 callersMethodgetSchema
Convert the Source Schema. @param mods Parameters like scale, precision are passed through mods. Refer to {@link com.google.cloud.teleport.v2.spa
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/typemapping/UnifiedTypeMapping.java:38
↓ 60 callersMethodgetTable
()
v2/common/src/main/java/com/google/cloud/teleport/v2/auto/options/ReadFromJdbcOptions.java:127
↓ 60 callersMethodoptions
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Udf.java:75
↓ 60 callersMethodsetId
(String value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/iowrapper/config/JdbcIOWrapperConfig.java:369
↓ 60 callersMethodsetUpSpannerITGcsResourceManager
()
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/TemplateTestBase.java:507
↓ 59 callersMethodbuild
()
v2/file-format-conversion/src/main/java/com/google/cloud/teleport/v2/templates/FileFormatConversionFactory.java:173
↓ 59 callersMethoddate
Returns the descriptor for the {@code DATE} type: a timezone independent date in the range [1678-01-01, 2262-01-01).
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:166
↓ 59 callersMethodrun
(CdcDataGeneratorOptions options)
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/CdcDataGenerator.java:84
↓ 59 callersMethodtoByteArray
Extracts the byte array from the given {@link ByteString} without copy. @param byteString A {@link ByteString} from which to extract the array. @retu
v1/src/main/java/com/google/cloud/teleport/bigtable/BigtableToAvro.java:228
↓ 59 callersMethodwithProjectId
Specifies the Cloud Spanner project.
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerIO.java:802
↓ 58 callersMethodassertThatArtifacts
Creates an {@link ArtifactsSubject} to assert information within a list of artifacts obtained from Cloud Storage. @param artifacts Artifacts in list
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/artifacts/matchers/ArtifactAsserts.java:38
↓ 58 callersMethodbool
Returns the descriptor for the {@code BOOL type}.
v1/src/main/java/com/google/cloud/teleport/spanner/common/Type.java:97
↓ 58 callersMethodgetColumnValueByType
Parses a column's value from a JSON object based on Spanner and source database column types. <p>This method determines the column type, extracts the
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/source/cassandra/CassandraTypeHandler.java:643
↓ 58 callersMethodsetInitialSplitHeight
(Long value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/TableSplitSpecification.java:123
↓ 58 callersMethodtableIdentifier
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:96
↓ 58 callersMethodwithEvent
(String event)
v1/src/main/java/com/google/cloud/teleport/splunk/SplunkEvent.java:113
↓ 57 callersMethodaddParameter
Set a custom parameter in the Dockerfile template. @param parameter name of parameter to set. @param value to use for the parameter. @return this {@l
plugins/core-plugin/src/main/java/com/google/cloud/teleport/plugin/DockerfileGenerator.java:463
↓ 57 callersMethodopen
(WritableByteChannel channel)
v2/dataplex/src/main/java/com/google/cloud/teleport/v2/io/AvroSinkWithJodaDatesConversion.java:73
↓ 57 callersMethodsetShard
(String shard)
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/changestream/TrimmedShardedDataChangeRecord.java:134
↓ 57 callersMethodtoString
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/shard/Shard.java:169
↓ 56 callersMethodcreateMutation
(String columnFamily, String columnName, ByteString value)
v1/src/test/java/com/google/cloud/teleport/bigtable/BeamRowToBigtableFnTest.java:311
↓ 56 callersMethodgetDataset
()
v2/googlecloud-to-elasticsearch/src/main/java/com/google/cloud/teleport/v2/elasticsearch/options/PubSubToElasticsearchOptions.java:48
↓ 56 callersMethodgetJavascriptTextTransformGcsPath
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/TextIOToBigQuery.java:247
↓ 56 callersMethodof
( OriginalT originalPayload, CurrentT currentPayload)
v1/src/main/java/com/google/cloud/teleport/values/FailsafeElement.java:44
↓ 56 callersMethodsetCommitTimestamp
(Timestamp commitTimestamp)
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/models/DMLGeneratorRequest.java:145
↓ 56 callersMethodtoBuilder
Generate a {@link Builder} from a given {@link Range}. @return builder.
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:80
↓ 56 callersMethodupdateQps
The QPS for updates.
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorTable.java:56
↓ 56 callersMethodwithProjectId
(String projectId)
v2/datastream-common/src/main/java/com/google/cloud/teleport/v2/cdc/merge/MergeConfiguration.java:86
↓ 55 callersMethodbuild
()
v2/pubsub-to-redis/src/main/java/com/google/cloud/teleport/v2/templates/io/RedisHashIO.java:161
↓ 55 callersMethodbuilder
( String testName, String projectId, CredentialsProvider credentialsProvider)
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/pubsub/PubsubResourceManager.java:142
↓ 55 callersMethodbuilder
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceSchema.java:32
↓ 55 callersMethodcreateTable
Creates a table on ClickHouse. @param tableName Name of the table to create. @return A boolean indicating whether the resource was created. @throws C
v2/googlecloud-to-clickhouse/src/test/java/org/apache/beam/it/clickhouse/ClickHouseResourceManager.java:165
↓ 55 callersMethodfields
(Object... fieldValues)
v2/dataplex/src/test/java/com/google/cloud/teleport/v2/templates/DataplexBigQueryToGcsTest.java:943
↓ 55 callersMethodgetMetadata
()
plugins/core-plugin/src/main/java/com/google/cloud/teleport/plugin/model/ImageSpec.java:37
↓ 55 callersMethodgetOptions
Returns the pipeline options as {@link PubSubProtoToBigQueryOptions}.
v2/pubsub-binary-to-bigquery/src/test/java/com/google/cloud/teleport/v2/templates/PubsubProtoToBigQueryTest.java:132
↓ 55 callersMethodisColumnEnabled
(ChangelogColumn column)
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/bigtablechangestreamstobigquery/model/BigQueryDestination.java:121
↓ 55 callersMethodnumeric
Returns the descriptor for the {@code NUMERIC} type.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:123
↓ 55 callersMethodof
Creates a {@link SerializableFunction} that uses a {@link Schema} to translate a {@link TableRow} into a {@link GenericRecord}. @param avroSchema sch
v2/common/src/main/java/com/google/cloud/teleport/v2/transforms/BigQueryConverters.java:660
↓ 54 callersMethodbuilder
(String testId, String projectId, Credentials credentials)
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/bigquery/BigQueryResourceManager.java:98
↓ 54 callersMethodgetId
Returns the ID of the document.
v2/mongodb-to-mongodb/src/main/java/com/google/cloud/teleport/v2/transforms/DocumentWithMetadata.java:90
↓ 54 callersMethodofJdbc
(JdbcSchemaReference jdbcSchemaReference)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceSchemaReference.java:50
↓ 54 callersMethodquery
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/View.java:40
↓ 53 callersMethodbuild
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/bigtablechangestreamstogcs/WriteChangeStreamMutationToGcsAvro.java:180
↓ 53 callersMethodequals
(Object o)
v2/kafka-to-gcs/src/main/java/com/google/cloud/teleport/v2/transforms/AvroDestination.java:39
↓ 53 callersMethodsecurity
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Udf.java:70
↓ 53 callersMethodsetSourceSchemaReference
(SourceSchemaReference value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceTableReference.java:62
↓ 52 callersMethodassertThatBigQueryRecords
Creates a {@link RecordsSubject} to assert information within a list of records. @param tableResult Records in BigQuery {@link TableResult} format to
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/bigquery/matchers/BigQueryAsserts.java:106
↓ 52 callersMethodsetErrorMessage
(String errorMessage)
v2/common/src/main/java/com/google/cloud/teleport/v2/values/FailsafeElement.java:68
↓ 51 callersMethodclear
(self)
python/src/test/python/bigquery-anomaly-detection/pipeline_test.py:1319
↓ 51 callersMethodcreate
( String name, Type type, int ordinalPosition, int pkOrdinalPosition)
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/spannerchangestreamstobigquery/model/TrackedSpannerColumn.java:29
↓ 51 callersMethodgetCommitTimestamp
(String spannerDatabaseName)
v2/googlecloud-to-googlecloud/src/test/java/com/google/cloud/teleport/v2/templates/spannerchangestreamstobigquery/FailsafeModJsonToTableRowTransformerTest.java:715
↓ 51 callersMethodgetDatabaseClient
()
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerAccessor.java:284
↓ 51 callersMethodgetValues
()
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/models/PreparedStatementGeneratedResponse.java:29
↓ 51 callersMethodof
( BigQueryDynamicDestinationsOptions bigQueryDynamicDestinationsOptions)
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/spannerchangestreamstobigquery/BigQueryDynamicDestinations.java:66
↓ 51 callersMethodparseDate
(String date)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/avro/AvroToValueMapper.java:497
↓ 51 callersMethodschema
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/sourceddl/SourceTable.java:31
↓ 51 callersMethodtoString
()
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/model/sources/TextSource.java:64
↓ 50 callersMethodbaseTableName
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/GraphElementTable.java:42
↓ 50 callersMethodgetMutation
()
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/models/SpannerMutationResponse.java:33
↓ 50 callersMethoditerateAll
()
it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/storage/GcsResourceManagerTest.java:508
↓ 50 callersMethodkeyColumns
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/GraphElementTable.java:55
↓ 50 callersMethodrun
Runs the pipeline with the supplied options. @param options The execution parameters to the pipeline. @return The result of the pipeline execution.
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/PubsubToAvro.java:184
↓ 50 callersMethodsetIndexType
(IndexType value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/schema/SourceColumnIndexInfo.java:140
↓ 50 callersMethodtoJson
Builds a JSON failure record for a row that could not be generated or written. @param tableName logical table the row belongs to @param operation the
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/utils/FailureRecord.java:52
↓ 49 callersMethoddialect
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Ddl.java:101
↓ 49 callersMethodfilter
(String filter)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Index.java:288
↓ 49 callersMethodfromJson
(String json)
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/bigtablechangestreamstopubsub/model/Mod.java:149
↓ 49 callersMethodgetDatabaseAdminClient
()
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerAccessor.java:292
↓ 49 callersMethodgetName
()
plugins/core-plugin/src/main/java/com/google/cloud/teleport/plugin/model/ImageSpecMetadata.java:57
↓ 49 callersMethodgetTable
()
v1/src/test/java/com/google/cloud/teleport/spanner/spannerio/SpannerReadIT.java:96
↓ 49 callersMethodgetTemplateAnnotation
()
plugins/core-plugin/src/main/java/com/google/cloud/teleport/plugin/model/TemplateDefinitions.java:90
↓ 49 callersMethodinterleaveInParent
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Table.java:39
← previousnext →301–400 of 23,218, ranked by callers