MCPcopy Create free account

hub / github.com/GoogleCloudPlatform/DataflowTemplates / functions

Functions23,218 in github.com/GoogleCloudPlatform/DataflowTemplates

⨍ Functions 23,218◇ Types & classes 3,671↳ Endpoints 7
↓ 173 callersMethodtoString
()
v2/spanner-common/src/test/java/com/google/cloud/teleport/v2/spanner/migrations/avro/AvroToValueMapperTest.java:295
↓ 171 callersMethodbuilder
()
v1/src/test/java/com/google/cloud/teleport/spanner/ddl/RandomDdlGenerator.java:143
↓ 171 callersMethodgetSchema
()
v2/common/src/main/java/com/google/cloud/teleport/v2/transforms/AvroConverters.java:58
↓ 171 callersMethodwithCoder
Specify the {@link Coder} used to serialize the entity in the {@link PCollection}.
v2/sourcedb-to-spanner/src/main/java/org/apache/beam/sdk/io/localcassandra/CassandraIO.java:269
↓ 170 callersMethoditerator
Returns an iterator over elements of type {@code T}. @return an Iterator.
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/source/cassandra/reader/io/cassandra/rowmapper/CassandraSourceRowMapperTest.java:578
↓ 170 callersMethodrun
(TransactionContext transaction)
v1/src/test/java/com/google/cloud/teleport/spanner/SpannerServerResource.java:192
↓ 163 callersMethodassertThatStructs
Creates a {@link RecordsSubject} to assert information within a list of records. @param structs Records in Spanner {@link Struct} format to use in th
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/spanner/matchers/SpannerAsserts.java:148
↓ 163 callersMethodequals
(Object o)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Ddl.java:778
↓ 161 callersMethodbuild
()
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/source/mysql/reader/io/jdbc/dialectadapter/mysql/MysqlDialectAdapterTest.java:1348
↓ 160 callersMethodparse
(String parameter, String functionSpecificName, Dialect dialect)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/UdfParameter.java:51
↓ 159 callersMethodtoString
Returns the string representation of the NULL_CLASS instance. @return the string "NULL_CLASS"
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/source/cassandra/CassandraTypeHandler.java:87
↓ 158 callersMethodend
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:91
↓ 156 callersMethodwithSchema
(Schema beamSchema)
v2/cdc-parent/cdc-change-applier/src/main/java/com/google/cloud/dataflow/cdc/applier/DecodeRows.java:40
↓ 155 callersMethodbuilder
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/PartitionColumn.java:67
↓ 154 callersMethodprimaryKey
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Table.java:239
↓ 153 callersMethodgetFields
()
v2/bigquery-to-parquet/src/main/java/com/google/cloud/teleport/v2/templates/BigQueryToParquet.java:187
↓ 150 callersMethodprimaryKey
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Table.java:261
↓ 147 callersMethoduploadArtifact
Uploads a local file to the service being used for storing artifacts. @param artifactName the name of the artifact. If this is supposed to go under a
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/artifacts/ArtifactClient.java:93
↓ 146 callersMethodcastToExpectedType
Casts the given column value to the expected type based on the Cassandra column type. <p>This method attempts to parse and cast the column value to a
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/source/cassandra/CassandraTypeHandler.java:675
↓ 145 callersMethodbuilder
()
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorTable.java:77
↓ 144 callersMethodgetConnection
(String connectionRequestKey)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/connection/IConnectionHelper.java:23
↓ 144 callersMethodgetDatabaseId
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/options/SourceDbToSpannerOptions.java:157
↓ 144 callersMethodschema
(String schemaName)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Ddl.java:215
↓ 144 callersMethodsetDdl
(Ddl ddl)
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/models/DMLGeneratorRequest.java:156
↓ 144 callersMethodsetSchemaMapper
(ISchemaMapper schemaMapper)
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/models/DMLGeneratorRequest.java:140
↓ 144 callersMethodsetSourceSchema
(SourceSchema sourceSchema)
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/models/DMLGeneratorRequest.java:161
↓ 143 callersMethodbuilder
(SpannerResourceManager resourceManager, String tableId)
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/spanner/conditions/SpannerRowsCheck.java:70
↓ 143 callersMethodput
Maintain mappings for a given type, as primitive as well as part of collections. @param cassandraType - name of the cassandra type, as discovered by
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/source/cassandra/reader/io/cassandra/mappings/CassandraMappings.java:70
↓ 142 callersMethodcreateArtifact
Creates a new artifact in whatever service is being used to store them. @param artifactName the name of the artifact. If this is supposed to go under
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/artifacts/ArtifactClient.java:72
↓ 142 callersMethodof
( Schema avroSchema, String outputTableSpec, String writeDisposition, String c
v2/kafka-to-bigquery/src/main/java/com/google/cloud/teleport/v2/transforms/BigQueryWriteUtils.java:119
↓ 142 callersMethodof
( Coder<OriginalT> originalPayloadCoder, Coder<CurrentT> currentPayloadCoder)
v2/common/src/main/java/com/google/cloud/teleport/v2/coders/FailsafeElementCoder.java:63
↓ 142 callersMethodsetMaxRows
(Integer maxRows)
it/jdbc/src/main/java/org/apache/beam/it/jdbc/conditions/JDBCRowsCheck.java:87
↓ 142 callersMethodsetStart
(@Nullable T start)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:408
↓ 141 callersMethodcreateTopic
Creates a topic with the given name on Pub/Sub. @param topicName Topic name to create. The underlying implementation may not use the topic name d
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/pubsub/PubsubResourceManager.java:165
↓ 141 callersMethodgetField
()
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerSchema.java:150
↓ 140 callersMethodcreate
Creates {@link BoundarySplitter BoundarySplitter&lt;T&gt;} for pass class {@code c} such that {@code T.getClass == c}. @param c Class for the type of
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/BoundarySplitterFactory.java:101
↓ 138 callersMethodmax
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Column.java:391
↓ 138 callersMethodsetEnd
(@Nullable T end)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:413
↓ 137 callersMethodequals
(Object o)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Ddl.java:332
↓ 136 callersMethodbuild
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Ddl.java:320
↓ 134 callersMethodbuild
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Ddl.java:739
↓ 133 callersMethodtimestamp
Returns the descriptor for the {@code TIMESTAMP} type: a nano precision timestamp in the range [0000-01-01 00:00:00, 9999-12-31 23:59:59.999999999 UTC
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:153
↓ 132 callersMethodbuilder
(String testId)
v2/googlecloud-to-clickhouse/src/test/java/org/apache/beam/it/clickhouse/ClickHouseResourceManager.java:122
↓ 132 callersMethodof
(long numRows, int pipelineTimeout, String runner, int valueSizeBytes)
it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/bigtable/BigTableIOLT.java:219
↓ 132 callersMethodof
()
v1/src/main/java/com/google/cloud/teleport/templates/common/FirestoreNestedValueProvider.java:33
↓ 131 callersMethodbuild
()
v2/gcs-spanner-dv/src/main/java/com/google/cloud/teleport/v2/dto/Column.java:40
↓ 131 callersMethodrecord
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/row/SourceRow.java:85
↓ 131 callersMethodtoString
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Udf.java:152
↓ 130 callersMethodbuild
()
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/utilities/ShardedMySQLResourceManager.java:77
↓ 129 callersMethodisEmpty
()
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/models/DMLGeneratorResponse.java:29
↓ 126 callersMethodcolumns
()
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorTable.java:32
↓ 126 callersMethodsetBoundarySplitter
( BoundarySplitter<T> boundarySplitter)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:424
↓ 125 callersMethodbool
Returns the descriptor for the {@code BOOL type}.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:94
↓ 124 callersMethodtoString
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/ddl/Index.java:158
↓ 121 callersMethodgetType
()
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:386
↓ 121 callersMethodsetColName
(String colName)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:393
↓ 121 callersMethodtables
Map of table name to table definition.
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorSchema.java:28
↓ 120 callersMethoddelete
Deletes {@code rows} from the sink for the given {@code table}, routing by {@code shardId}. @param rows rows to delete. The caller should group rows
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/sink/DataWriter.java:62
↓ 119 callersMethodbuild
()
v2/common/src/main/java/com/google/cloud/teleport/v2/transforms/CsvConverters.java:606
↓ 119 callersMethodgetBqColumnName
()
v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/templates/bigtablechangestreamstobigquery/model/ChangelogColumn.java:82
↓ 119 callersMethodreadTableRecords
Reads all the rows in a table. This method requires {@link SpannerResourceManager#executeDdlStatement(String)} to be called for the target table befor
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/spanner/SpannerResourceManager.java:603
↓ 118 callersMethodbuild
()
it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/cloudsql/CloudSqlResourceManagerTest.java:93
↓ 118 callersMethodbuildMutationGroup
(Mutation m, Mutation... other)
v1/src/test/java/com/google/cloud/teleport/spanner/spannerio/SpannerIOWriteTest.java:1655
↓ 117 callersMethodgetName
()
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/actions/HttpAction.java:36
↓ 117 callersMethodnext
()
v1/src/test/java/com/google/cloud/teleport/spanner/ddl/RandomInsertMutationGenerator.java:210
↓ 116 callersMethodparse
( JSONArray json, OptionsParams options, JobSpecIndex jobIndex, boolean indexAllProperties)
v2/googlecloud-to-neo4j/src/main/java/com/google/cloud/teleport/v2/neo4j/model/helpers/TargetMapper.java:93
↓ 116 callersMethodreadTable
Reads all rows from the specified table in the current keyspace. @param table the name of the table to read from. @return an {@link Iterable} of {@li
v2/spanner-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/CassandraSslContainerWrapper.java:137
↓ 116 callersMethodsetColClass
(Class value)
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:398
↓ 115 callersMethodwithSpannerConfig
Specifies the Cloud Spanner configuration.
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerIO.java:797
↓ 114 callersMethodequals
(Object object)
v2/datastream-common/src/main/java/com/google/cloud/teleport/v2/cdc/merge/MergeInfo.java:123
↓ 113 callersMethodcreate
()
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerConfig.java:97
↓ 113 callersMethodprettyPrint
(Appendable appendable)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Ddl.java:231
↓ 112 callersMethodgetDatabaseName
()
v1/src/main/java/com/google/cloud/teleport/templates/TextToSpanner.java:141
↓ 112 callersMethoduploadDataStreamFile
Helper function for constructing a ConditionCheck whose check() method uploads a given file to GCS with path similar to DataStream generated file path
v2/datastream-to-spanner/src/test/java/com/google/cloud/teleport/v2/templates/DataStreamToSpannerITBase.java:186
↓ 111 callersMethodlogicalType
The logical type of the column for data generation.
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorColumn.java:30
↓ 111 callersMethodsetFields
(String fields)
v2/bigquery-to-parquet/src/main/java/com/google/cloud/teleport/v2/templates/BigQueryToParquet.java:194
↓ 110 callersMethodgetRowCount
Retrieves the total row count of a specified table in Cassandra. <p>This method executes a `SELECT COUNT( )` query on the given table and returns the
v2/spanner-to-sourcedb/src/test/java/com/google/cloud/teleport/v2/templates/SpannerToCassandraSourceDbIT.java:619
↓ 109 callersMethodmappedValue
(Object value)
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/reader/io/jdbc/rowmapper/JdbcSourceRowMapperTest.java:1091
↓ 109 callersMethodstart
()
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/Range.java:86
↓ 108 callersMethodderbyColumnType
(String value)
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/reader/io/jdbc/rowmapper/JdbcSourceRowMapperTest.java:1072
↓ 108 callersMethodfrom
()
plugins/core-plugin/src/test/java/com/google/cloud/teleport/plugin/sample/AtoBOk.java:45
↓ 108 callersMethodrunSQLUpdate
(@NonNull String sql)
it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/cloudsql/CloudSqlResourceManagerTest.java:72
↓ 108 callersMethodsourceColumnType
(String value)
v2/sourcedb-to-spanner/src/test/java/com/google/cloud/teleport/v2/reader/io/jdbc/rowmapper/JdbcSourceRowMapperTest.java:1077
↓ 108 callersMethodtable
(String tableName)
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Ddl.java:151
↓ 107 callersMethodequals
(ShadowTableRecord other)
v2/spanner-to-sourcedb/src/main/java/com/google/cloud/teleport/v2/templates/utils/ShadowTableRecord.java:41
↓ 107 callersMethodgetSplitPoint
Get Split point for start and end. @param start star of the boundary. @param end end of the boundary. @param partitionColumn column being split. @par
v2/sourcedb-to-spanner/src/main/java/com/google/cloud/teleport/v2/reader/io/jdbc/uniformsplitter/range/BoundarySplitter.java:54
↓ 107 callersMethodrunQuery
Runs the specified query. @param query the query to execute
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/spanner/SpannerResourceManager.java:562
↓ 107 callersMethodsetCell
( String colFamily, String colQualifier, String value, long atTimestamp)
v2/bigtable-changestreams-to-hbase/src/test/java/com/google/cloud/bigtable/data/v2/models/ChangeStreamMutationBuilder.java:49
↓ 106 callersMethodcreateSubscription
Creates a subscription at the specific topic, with a given name. @param topicName Topic Name reference to add the subscription. @param subscriptionNa
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/pubsub/PubsubResourceManager.java:197
↓ 106 callersMethodnotNull
()
v1/src/main/java/com/google/cloud/teleport/spanner/ddl/Column.java:50
↓ 106 callersMethodsize
The size/length of the column (e.g., for strings or bytes).
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorColumn.java:45
↓ 104 callersMethodforeignKeys
Foreign keys defined on this table.
v2/cdc-data-generator/src/main/java/com/google/cloud/teleport/v2/templates/model/DataGeneratorTable.java:42
↓ 103 callersMethodfloat64
Returns the descriptor for the {@code FLOAT64} type: a floating point type with the same value domain as a Java {code double}.
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/type/Type.java:118
↓ 103 callersMethodof
()
it/google-cloud-platform/src/main/java/org/apache/beam/it/gcp/cloudsql/CloudSqlContainer.java:39
↓ 103 callersMethodparse
(SpannerException exception)
v2/spanner-common/src/main/java/com/google/cloud/teleport/v2/spanner/migrations/exceptions/SpannerExceptionParser.java:52
↓ 103 callersMethodwithInstanceId
Specifies the Cloud Spanner instance.
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/SpannerIO.java:813
↓ 102 callersMethodbuild
()
v2/googlecloud-to-neo4j/src/test/java/com/google/cloud/teleport/v2/neo4j/utils/ModelUtilsTest.java:625
↓ 102 callersMethoditerator
()
v1/src/main/java/com/google/cloud/teleport/spanner/spannerio/MutationGroup.java:53
↓ 102 callersMethodmatches
(Statement argument)
v1/src/test/java/com/google/cloud/teleport/spanner/spannerio/SpannerIOWriteTest.java:234
↓ 102 callersMethodprint
(Struct struct)
v1/src/main/java/com/google/cloud/teleport/templates/common/SpannerConverters.java:524
← previousnext →101–200 of 23,218, ranked by callers