Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Index your code
hub
/
github.com/dataArtisans/flink-dataflow
/ functions
Functions
813 in github.com/dataArtisans/flink-dataflow
⨍
Functions
813
◇
Types & classes
169
↓ 246 callers
Method
of
Builds a union coder with the given list of element coders. This list corresponds to a mapping of union tag to Coder. Union tags start at 0.
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/UnionCoder.java:47
↓ 92 callers
Method
apply
(int[] accumulator)
runner/src/test/java/com/dataartisans/flink/dataflow/streaming/StateSerializationTest.java:83
↓ 83 callers
Method
getValue
()
examples/src/main/java/com/dataartisans/flink/dataflow/examples/streaming/AutoComplete.java:262
↓ 69 callers
Method
add
(AI value)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/CombineFnAggregatorWrapper.java:46
↓ 60 callers
Method
element
()
runner/src/test/java/com/dataartisans/flink/dataflow/streaming/GroupAlsoByWindowTest.java:478
↓ 53 callers
Method
makeWindowedValue
(WindowingStrategy strategy, T output, Instant timestamp, Collection<? extends BoundedWindow> w
runner/src/test/java/com/dataartisans/flink/dataflow/streaming/GroupAlsoByWindowTest.java:466
↓ 45 callers
Method
getKey
(WindowedValue<KV<K, V>> value)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/FlinkGroupByKeyWrapper.java:52
↓ 43 callers
Method
getOutput
()
examples/src/main/java/com/dataartisans/flink/dataflow/examples/WordCount.java:90
↓ 42 callers
Method
apply
( PCollection<CompletionCandidate> input)
examples/src/main/java/com/dataartisans/flink/dataflow/examples/streaming/AutoComplete.java:118
↓ 39 callers
Method
output
(OUT output)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/FlinkDoFnFunction.java:171
↓ 35 callers
Method
getInput
()
examples/src/main/java/com/dataartisans/flink/dataflow/examples/WordCount.java:85
↓ 35 callers
Method
processElement
(ProcessContext c)
runner/src/test/java/com/dataartisans/flink/dataflow/streaming/GroupByNullKeyTest.java:99
↓ 25 callers
Method
run
(Pipeline pipeline)
runner/src/main/java/com/dataartisans/flink/dataflow/FlinkPipelineRunner.java:101
↓ 23 callers
Method
apply
(PCollection<KV<String, KV<URI, Double>>> wordToUriAndTfIdf)
examples/src/main/java/com/dataartisans/flink/dataflow/examples/TFIDF.java:417
↓ 22 callers
Method
getTimestamp
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointReader.java:56
↓ 20 callers
Method
named
Returns a ConsoleIO.Write PTransform with the given step name.
runner/src/main/java/com/dataartisans/flink/dataflow/io/ConsoleIO.java:46
↓ 20 callers
Method
state
(StateNamespace namespace, StateTag<? super K, StateT> address)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:130
↓ 19 callers
Method
encode
( RawUnionValue union, OutputStream outStream, Context context)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/UnionCoder.java:71
↓ 19 callers
Method
isEmpty
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:660
↓ 17 callers
Method
getBuffer
Get the underlying byte array.
runner/src/main/java/com/dataartisans/flink/dataflow/translation/types/InspectableByteArrayOutputStream.java:31
↓ 16 callers
Method
equals
(Object o)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/types/CoderTypeSerializer.java:134
↓ 16 callers
Method
of
Creates a new unbounded source from a Flink source. @param flinkSource The Flink source function @param <T> The type that the source function produces
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/io/UnboundedFlinkSource.java:75
↓ 15 callers
Method
createForBatch
Creates and returns a new test pipeline for batch execution. <p> Use {@link com.google.cloud.dataflow.sdk.testing.DataflowAssert} to add tests, then
runner/src/test/java/com/dataartisans/flink/dataflow/FlinkTestPipeline.java:35
↓ 15 callers
Method
getName
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/CombineFnAggregatorWrapper.java:82
↓ 15 callers
Method
read
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/DataInputViewWrapper.java:44
↓ 14 callers
Method
create
Returns a ConsoleIO.Write PTransform with a default step name.
runner/src/main/java/com/dataartisans/flink/dataflow/io/ConsoleIO.java:39
↓ 13 callers
Method
getInputDataSet
(PValue value)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkBatchTranslationContext.java:69
↓ 13 callers
Method
next
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/FlinkKeyedListAggregationFunction.java:59
↓ 12 callers
Method
create
Creates and returns a new test pipeline for streaming or batch execution. <p> Use {@link com.google.cloud.dataflow.sdk.testing.DataflowAssert} to add
runner/src/test/java/com/dataartisans/flink/dataflow/FlinkTestPipeline.java:60
↓ 11 callers
Method
getExecutionEnvironment
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkBatchTranslationContext.java:61
↓ 11 callers
Method
hasNext
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/FlinkKeyedListAggregationFunction.java:54
↓ 11 callers
Method
iterator
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/FlinkKeyedListAggregationFunction.java:49
↓ 11 callers
Method
setOutputDataSet
(PValue value, DataSet<?> set)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkBatchTranslationContext.java:74
↓ 10 callers
Method
as
(Class<T> kls)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/FlinkGroupAlsoByWindowWrapper.java:449
↓ 10 callers
Method
getPipelineOptions
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkBatchTranslationContext.java:65
↓ 10 callers
Method
getTypeInfo
(PInput output)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkBatchTranslationContext.java:99
↓ 9 callers
Method
decode
(InputStream inStream, Context context)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/UnionCoder.java:90
↓ 8 callers
Method
setOutputDataStream
(PValue value, DataStream<?> set)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkStreamingTranslationContext.java:64
↓ 8 callers
Method
validate
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointWriter.java:122
↓ 7 callers
Method
close
()
runner/src/test/java/com/dataartisans/flink/dataflow/streaming/UnboundedSourceITCase.java:179
↓ 7 callers
Method
flatMap
(String s, Collector<WindowedValue<String>> collector)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkStreamingTransformTranslators.java:177
↓ 7 callers
Method
getInputDataStream
(PValue value)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkStreamingTranslationContext.java:59
↓ 7 callers
Method
getParallelism
()
runner/src/main/java/com/dataartisans/flink/dataflow/FlinkPipelineOptions.java:69
↓ 7 callers
Method
processWatermark
(Watermark mark)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/FlinkGroupAlsoByWindowWrapper.java:268
↓ 7 callers
Method
setData
(ByteString data)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointWriter.java:87
↓ 7 callers
Method
setParallelism
(Integer value)
runner/src/main/java/com/dataartisans/flink/dataflow/FlinkPipelineOptions.java:72
↓ 7 callers
Method
writeInt
(int number)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointWriter.java:101
↓ 6 callers
Method
createForStreaming
Creates and returns a new test pipeline for streaming execution. <p> Use {@link com.google.cloud.dataflow.sdk.testing.DataflowAssert} to add tests, t
runner/src/test/java/com/dataartisans/flink/dataflow/FlinkTestPipeline.java:47
↓ 6 callers
Method
encodeKey
(StateNamespace namespace, StateTag<? super K, ?> address)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:260
↓ 6 callers
Method
getInt
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointReader.java:46
↓ 6 callers
Method
getWindowSize
()
examples/src/main/java/com/dataartisans/flink/dataflow/examples/streaming/WindowedWordCount.java:84
↓ 6 callers
Method
setRunner
(Class<? extends PipelineRunner<?>> kls)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/FlinkGroupAlsoByWindowWrapper.java:464
↓ 6 callers
Method
toString
()
examples/src/main/java/com/dataartisans/flink/dataflow/examples/streaming/AutoComplete.java:296
↓ 5 callers
Method
apply
(PCollection<?> input)
runner/src/main/java/com/dataartisans/flink/dataflow/io/ConsoleIO.java:73
↓ 5 callers
Method
createAccumulator
(K key, CombineWithContext.Context c)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:441
↓ 5 callers
Method
createTestingOperatorAndState
(WindowingStrategy strategy, long initialTime)
runner/src/test/java/com/dataartisans/flink/dataflow/streaming/GroupAlsoByWindowTest.java:383
↓ 5 callers
Method
getData
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointReader.java:42
↓ 5 callers
Method
getFilesToStage
List of local files to make available to workers. <p> Jars are placed on the worker's classpath. <p> The default value is the list of jars from the ma
runner/src/main/java/com/dataartisans/flink/dataflow/FlinkPipelineOptions.java:41
↓ 5 callers
Method
getHostname
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/io/UnboundedSocketSource.java:70
↓ 5 callers
Method
getPort
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/io/UnboundedSocketSource.java:74
↓ 5 callers
Method
getSource
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/SourceInputSplit.java:48
↓ 5 callers
Method
mergeAccumulators
(K key, Iterable<AccumT> accumulators, CombineWithContext.Context c)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:451
↓ 5 callers
Method
restoreState
(StateCheckpointReader checkpointReader, ClassLoader loader)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:154
↓ 5 callers
Method
serialize
(StateType type, StateCheckpointWriter output)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateType.java:40
↓ 5 callers
Method
serializeObject
(T object, CoderTypeSerializer<T> objectSerializer)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointWriter.java:80
↓ 5 callers
Method
setExecutionRetryDelay
(Long delay)
runner/src/main/java/com/dataartisans/flink/dataflow/FlinkPipelineOptions.java:90
↓ 5 callers
Method
setNumberOfExecutionRetries
(Integer retries)
runner/src/main/java/com/dataartisans/flink/dataflow/FlinkPipelineOptions.java:85
↓ 5 callers
Method
setTag
(ByteString stateKey)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointWriter.java:66
↓ 5 callers
Method
toString
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/types/CoderTypeInformation.java:104
↓ 5 callers
Method
toString
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:412
↓ 4 callers
Method
add
(T input)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:655
↓ 4 callers
Method
addInput
(K key, AccumT accumulator, InputT value, CombineWithContext.Context c)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:446
↓ 4 callers
Method
addValue
(AI value)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/CombineFnAggregatorWrapper.java:77
↓ 4 callers
Method
advance
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/io/UnboundedSocketSource.java:173
↓ 4 callers
Method
apply
(PCollection<String> lines)
examples/src/main/java/com/dataartisans/flink/dataflow/examples/WordCount.java:56
↓ 4 callers
Method
create
Creates an DataStream where elements are grouped in windows based on the specified windowing strategy. This method assumes that <b>elements are alread
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/FlinkGroupAlsoByWindowWrapper.java:118
↓ 4 callers
Method
equals
(Object other)
examples/src/main/java/com/dataartisans/flink/dataflow/examples/streaming/AutoComplete.java:281
↓ 4 callers
Method
formatNodeName
(TransformTreeNode node)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkStreamingPipelineTranslator.java:144
↓ 4 callers
Method
formatNodeName
(TransformTreeNode node)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkBatchPipelineTranslator.java:151
↓ 4 callers
Method
genSpaces
(int n)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkStreamingPipelineTranslator.java:136
↓ 4 callers
Method
genSpaces
(int n)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkBatchPipelineTranslator.java:143
↓ 4 callers
Method
makeWindowedValue
( T output, Instant timestamp, Collection<? extends BoundedWindow> windows, PaneInfo pane)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/FlinkAbstractParDoWrapper.java:204
↓ 4 callers
Method
remove
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/FlinkKeyedListAggregationFunction.java:70
↓ 4 callers
Method
setCheckpointingInterval
(Long interval)
runner/src/main/java/com/dataartisans/flink/dataflow/FlinkPipelineOptions.java:78
↓ 4 callers
Method
setTimestamp
(Instant timestamp)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointWriter.java:95
↓ 4 callers
Method
sideOutput
(TupleTag<T> tag, T output)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/FlinkDoFnFunction.java:182
↓ 4 callers
Method
startBundle
(Context c)
runner/src/test/java/com/dataartisans/flink/dataflow/WordCountJoin3ITCase.java:115
↓ 4 callers
Method
validate
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointReader.java:84
↓ 3 callers
Method
checkTimestamp
(WindowedValue<IN> ref, Instant timestamp)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/FlinkAbstractParDoWrapper.java:193
↓ 3 callers
Method
createForTesting
(PipelineOptions options, CoderRegistry registry, WindowingStrategy<KV<K,
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/FlinkGroupAlsoByWindowWrapper.java:190
↓ 3 callers
Method
deserialize
(DataInputView dataInputView)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/types/CoderTypeSerializer.java:109
↓ 3 callers
Method
deserializeObject
(CoderTypeSerializer<T> objectSerializer)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/StateCheckpointReader.java:66
↓ 3 callers
Method
extractOutput
(K key, AccumT accumulator, CombineWithContext.Context c)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/state/FlinkStateInternals.java:456
↓ 3 callers
Method
getFlinkMaster
The url of the Flink JobManager on which to execute pipelines. This can either be the the address of a cluster JobManager, in the form "host:port" or
runner/src/main/java/com/dataartisans/flink/dataflow/FlinkPipelineOptions.java:63
↓ 3 callers
Method
getIndexForEncoding
(RawUnionValue union)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/functions/UnionCoder.java:58
↓ 3 callers
Method
getTranslator
(PTransform<?, ?> transform)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkBatchTransformTranslators.java:139
↓ 3 callers
Method
getTranslator
(PTransform<?, ?> transform)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/FlinkStreamingTransformTranslators.java:83
↓ 3 callers
Method
hashCode
()
runner/src/main/java/com/dataartisans/flink/dataflow/translation/types/CoderTypeSerializer.java:148
↓ 3 callers
Method
open
(String uId)
runner/src/test/java/com/dataartisans/flink/dataflow/WriteSinkITCase.java:129
↓ 3 callers
Method
processElement
(StreamRecord<WindowedValue<KV<K, VIN>>> element)
runner/src/main/java/com/dataartisans/flink/dataflow/translation/wrappers/streaming/FlinkGroupAlsoByWindowWrapper.java:260
next →
1–100 of 813, ranked by callers