MCPcopy Create free account

hub / github.com/cloudera/flume / functions

Functions4,174 in github.com/cloudera/flume

↓ 30 callersMethodrecursive
This method creates a recursive pattern match relation. This will traverse through any number of nodes to check if the child pattern matches.
flume-core/src/main/java/com/cloudera/flume/conf/PatternMatch.java:297
↓ 30 callersMethodupdateEventProcessingStats
This method should be called from sources which wish to track event statistics.
flume-core/src/main/java/com/cloudera/flume/core/EventSource.java:152
↓ 29 callersMethodcheckAcks
This contacts the master to find if any of the pending acks are completed,
flume-core/src/main/java/com/cloudera/flume/agent/WALAckManager.java:106
↓ 29 callersMethodcreateTestableConfiguration
Resets the singleton configuration to empty and returns it. Should be used for testing only - this is used to isolate different test configurations.
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:119
↓ 29 callersMethodescapeString
Replace all substrings of form %{tagname} with get(tagname).toString() and all shorthand substrings of form %x with a special value. Any unrecognized
flume-core/src/main/java/com/cloudera/flume/core/Event.java:303
↓ 29 callersMethodheartbeatChecks
All the core functionality of a heartbeat accessible without having to be in the heartbeat thread.
flume-core/src/main/java/com/cloudera/flume/agent/LivenessManager.java:181
↓ 29 callersMethodnext
()
flume-core/src/main/java/com/cloudera/flume/handlers/debug/MemorySinkSource.java:67
↓ 27 callersMethodcreate
(final String path, final byte[] data, final List<ACL> acls, final CreateMode mode)
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:411
↓ 27 callersMethodgetBody
()
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:76
↓ 27 callersMethodgetNodes
()
flume-core/src/main/java/com/cloudera/distributed/Group.java:48
↓ 27 callersMethodgetPending
This method returns a copy of the current outstanding and completed ackIds This method is currently only used in tests.
flume-core/src/main/java/com/cloudera/flume/master/MasterAckManager.java:62
↓ 27 callersMethodtoText
Serializes event as text to supplied writer.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportEvent.java:349
↓ 26 callersMethodgetCommand
()
flume-core/src/main/java/com/cloudera/flume/master/Command.java:45
↓ 25 callersMethodchild
This method creates a child relation where 'this' is the parent, and the specified pattern child is a child. This matches if any of the parent node's
flume-core/src/main/java/com/cloudera/flume/conf/PatternMatch.java:280
↓ 25 callersMethodsetInt
(Event e, String attr, int i)
flume-core/src/main/java/com/cloudera/flume/core/Attributes.java:96
↓ 25 callersMethodupdateAll
Similar to refreshAll, except it only incrementally refreshes configurations that change due to state changes. This is only really necessary for trans
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:146
↓ 24 callersMethodclear
Removes all registered reportables from the ReportManager.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportManager.java:113
↓ 24 callersMethoddumbfilecopy
Copies a file.
flume-core/src/main/java/com/cloudera/util/FileUtil.java:119
↓ 24 callersMethodgetMessage
Translate antlr internal exceptions to sane flume data flow configuration specific messages.
flume-core/src/main/java/com/cloudera/flume/conf/RuntimeRecognitionException.java:52
↓ 24 callersMethodnoChildren
Returns an empty immutable map of children reports.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportUtil.java:63
↓ 24 callersMethodopen
()
flume-core/src/main/java/com/cloudera/flume/core/CompositeSink.java:49
↓ 24 callersMethodtoJSONObject
Convert a flume report in to a jettison JSONObject.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportUtil.java:39
↓ 24 callersMethodtoString
()
flume-core/src/main/java/com/cloudera/util/Pair.java:67
↓ 23 callersMethodcleanupLocalWriteDir
Cleanup the temp dir after the test is run.
flume-core/src/test/java/com/cloudera/util/FlumeTestHarness.java:107
↓ 23 callersMethodclear
()
flume-core/src/main/java/com/cloudera/util/Cache.java:95
↓ 23 callersMethodgetFile
()
flume-core/src/main/java/com/cloudera/flume/handlers/log4j/SeqfileAppender.java:71
↓ 23 callersMethodgetLivenessManager
()
flume-core/src/main/java/com/cloudera/flume/agent/FlumeNode.java:758
↓ 23 callersMethodserve
Start listening for client requests.
flume-core/src/main/java/com/cloudera/flume/master/RPCServer.java:33
↓ 23 callersMethodsetupLocalWriteDir
This sets the log dir in the FlumeConfiguration and then instantiates a mock master and node that use that configuration
flume-core/src/test/java/com/cloudera/util/FlumeTestHarness.java:56
↓ 22 callersMethodappend
(Event e)
flume-core/src/main/java/com/cloudera/flume/core/BackOffFailOverSink.java:96
↓ 22 callersMethodgetConfigManForFlow
Only for testing
flume-core/src/main/java/com/cloudera/flume/master/flows/FlowConfigManager.java:78
↓ 22 callersMethodgetDriver
@return the driver responsible for opening/appending/closing
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNode.java:378
↓ 22 callersMethodgetFails
()
flume-core/src/main/java/com/cloudera/flume/core/BackOffFailOverSink.java:270
↓ 22 callersMethodshutdown
()
flume-core/src/test/java/com/cloudera/flume/master/TestZKBackedConfigStore.java:316
↓ 22 callersMethodstart
()
flume-core/src/main/java/com/cloudera/flume/core/connector/DirectDriver.java:234
↓ 21 callersMethodaddLogicalNode
(String physNode, String logicNode)
flume-core/src/main/java/com/cloudera/flume/master/ConfigManager.java:289
↓ 21 callersMethodgenFiles
(File tmpdir, String prefix, int files, int lines)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestTailDirSource.java:100
↓ 21 callersMethodgetArgs
()
flume-core/src/main/java/com/cloudera/flume/util/FlumeShell.java:204
↓ 21 callersMethodgetEventMaxSizeBytes
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:964
↓ 21 callersMethodgetReport
Generate a simplified report. This only gathers a limited number of metrics about the particular sink, and does not hierarchically gather information
flume-core/src/main/java/com/cloudera/flume/core/EventSink.java:71
↓ 21 callersMethodgetTimestamp
()
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:84
↓ 21 callersMethodparse
(String s)
flume-core/src/main/java/com/cloudera/flume/conf/FlumeBuilder.java:122
↓ 21 callersMethodremoveLogicalNode
This removes the logical node data flow configuration from both the flow table and the phys-logical mapping
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:103
↓ 21 callersMethodtoString
()
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/TimeTrigger.java:78
↓ 21 callersMethodwaitForAtLeastState
Block until driver state to reaches at least the specified state where HELLO < OPENING < ACTIVE < CLOSING < IDLE < ERROR or to millis ms has elapsed.
flume-core/src/main/java/com/cloudera/flume/core/Driver.java:92
↓ 20 callersMethodget
(T val)
flume-core/src/main/java/com/cloudera/util/Histogram.java:72
↓ 20 callersMethodgetConfig
(String host)
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:40
↓ 20 callersMethodgetNodeStatuses
()
flume-core/src/main/java/com/cloudera/flume/util/AdminRPC.java:41
↓ 20 callersMethodgetPriority
()
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:80
↓ 20 callersMethodgetStatus
()
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNode.java:370
↓ 20 callersMethodtoString
Returns event in string form: host [ priority date ] {attr1:val1} {attr2:val2} {metric1:val1} {metric2:val2} body
flume-core/src/main/java/com/cloudera/flume/reporter/ReportEvent.java:298
↓ 19 callersMethoddumpMatches
(Map<String, CommonTree> matches)
flume-core/src/test/java/com/cloudera/flume/conf/TestPatternMatch.java:56
↓ 19 callersMethodgetFlattenedReport
Get a recursively flattened metrics report. If the reportable is null this returns null.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportUtil.java:87
↓ 19 callersMethodgetLogicalNode
(String physNode)
flume-core/src/main/java/com/cloudera/flume/master/ConfigManager.java:276
↓ 18 callersMethodclose
()
flume-core/src/main/java/com/cloudera/flume/core/CompositeSink.java:54
↓ 18 callersMethodgetAttrs
Ideally this would be package private, but instead this method should return a ReadOnly Map. This can be done by wrapping a map m with Collections.unm
flume-core/src/main/java/com/cloudera/flume/core/Event.java:96
↓ 18 callersMethodgetFlowId
returns the flow id of a particular logicalNode
flume-core/src/main/java/com/cloudera/flume/master/flows/FlowConfigManager.java:67
↓ 18 callersMethodreset
Reset the trigger condition.
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/RollTrigger.java:50
↓ 18 callersMethodsynthInMem
This is about 300MB in memory
flume-microbenchmarks/src/test/java/com/cloudera/flume/FlumeBenchmarkHarness.java:175
↓ 18 callersMethodtoString
()
flume-core/src/main/java/com/cloudera/flume/agent/AvroMasterRPC.java:201
↓ 17 callersMethodclose
()
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/ThriftEventSource.java:161
↓ 17 callersMethodgetCommand
()
flume-core/src/main/java/com/cloudera/flume/util/FlumeShell.java:200
↓ 17 callersMethodgetConfig
(String host)
flume-core/src/main/java/com/cloudera/flume/master/ConfigManager.java:71
↓ 17 callersMethodgetPendingAckTags
()
flume-core/src/main/java/com/cloudera/flume/agent/WALAckManager.java:214
↓ 17 callersMethodgetWritingTags
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:199
↓ 17 callersMethodopen
Send open event after open
flume-core/src/main/java/com/cloudera/flume/handlers/endtoend/AckChecksumInjector.java:114
↓ 17 callersMethodsetSink
This is only for testing
flume-core/src/main/java/com/cloudera/flume/conf/SinkFactoryImpl.java:344
↓ 17 callersMethodstart
()
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:42
↓ 17 callersMethodstop
()
flume-core/src/main/java/com/cloudera/flume/core/connector/DirectDriver.java:247
↓ 16 callersMethodappend
Calculate the crc based on the body of the message and xor it into the checksum.
flume-core/src/main/java/com/cloudera/flume/handlers/endtoend/AckChecksumInjector.java:133
↓ 16 callersMethodbuild
(Context context, String... argv)
flume-core/src/test/java/com/cloudera/flume/handlers/rolling/TestRollSink.java:293
↓ 16 callersMethodcharAt
(int arg0)
flume-core/src/main/java/com/cloudera/flume/handlers/text/CustomDelimCursor.java:77
↓ 16 callersMethodgetChannel
()
flume-core/src/main/java/com/cloudera/util/InputStreamPipe.java:60
↓ 16 callersMethodgetLoggedTags
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:203
↓ 16 callersMethodgetSendingTags
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:207
↓ 16 callersMethodgetSentTags
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:211
↓ 16 callersMethodgetTimestamp
Returns unix time stamp in millis
flume-core/src/main/java/com/cloudera/flume/core/EventImpl.java:127
↓ 16 callersMethodsubmit
(Command cmd)
flume-core/src/main/java/com/cloudera/flume/master/CommandManager.java:166
↓ 15 callersMethodclose
Send close event before close
flume-core/src/main/java/com/cloudera/flume/handlers/endtoend/AckChecksumInjector.java:123
↓ 15 callersMethoddoDecoBenchmark
This takes a single decorator, and then applies all of the datasets through the decorator. Each source is bufferzied -- the given number of messages a
flume-microbenchmarks/src/test/java/com/cloudera/flume/FlumeBenchmarkHarness.java:134
↓ 15 callersMethodinit
Reads the standard configuration and initializes client and optionally server accordingly.
flume-core/src/main/java/com/cloudera/flume/master/ZooKeeperConfigStore.java:106
↓ 15 callersMethodjoin
This causes the driver to block until it is "done".
flume-core/src/main/java/com/cloudera/flume/core/Driver.java:63
↓ 15 callersMethodmakeDirs
Make a directory and its parents, returning true if and only if the dir exists. Does not guarantee that we can write to that directory!
flume-core/src/main/java/com/cloudera/util/FileUtil.java:133
↓ 15 callersMethodopen
()
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/ThriftEventSource.java:131
↓ 15 callersMethodpoll
()
flume-core/src/main/java/com/cloudera/flume/core/PollingSource.java:53
↓ 15 callersMethodreadInt
(Event e, String attr)
flume-core/src/main/java/com/cloudera/flume/core/Attributes.java:52
↓ 15 callersMethodsetSinkFactory
(SinkFactory snkFact)
flume-core/src/main/java/com/cloudera/flume/conf/FlumeBuilder.java:106
↓ 14 callersMethodacknowledge
(String group)
flume-core/src/main/java/com/cloudera/flume/agent/MasterRPC.java:57
↓ 14 callersMethodcannedData
Create a memory based source of count events. Each event has s with count appended as its body.
flume-core/src/main/java/com/cloudera/flume/handlers/debug/MemorySinkSource.java:82
↓ 14 callersMethodcheckLogicalNodes
Checks against the master to get new physical nodes or to learn about decommissioned logical nodes Invariant: There is always at least logical per ph
flume-core/src/main/java/com/cloudera/flume/agent/LivenessManager.java:119
↓ 14 callersMethodgetMetrics
Get reportable data from the thrift event source. @Override
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/ThriftEventSource.java:92
↓ 14 callersMethodinit
Establishes a connection with a ZooKeeper service.
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:135
↓ 14 callersMethodparseLine
This takes a single string and parses it into a Command.
flume-core/src/main/java/com/cloudera/flume/shell/CommandBuilder.java:94
↓ 13 callersMethodattempt
Calls doTry on a Retryable until either it succeeds or the backoff policy fails.
flume-core/src/main/java/com/cloudera/util/RetryHarness.java:56
↓ 13 callersMethodbuild
This is required for backwards compatibility and will eventually become deprecated
flume-core/src/main/java/com/cloudera/flume/conf/SinkFactory.java:76
↓ 13 callersMethodcheck
This the core check method that updates information from the previous poll and fires events based on changes.
flume-core/src/main/java/com/cloudera/util/dirwatcher/DirWatcher.java:128
↓ 13 callersMethodcreateIOException
A convenient method to create an {@link IOException}.
flume-core/src/main/java/com/cloudera/util/MultipleIOException.java:59
↓ 13 callersMethodcurl
Grab a url's contents. This assumes that grabbed pages are small @param urlString @return @throws IOException
flume-core/src/main/java/com/cloudera/util/HttpServerTestUtils.java:43
↓ 13 callersMethodgetFormat
()
flume-core/src/main/java/com/cloudera/flume/handlers/debug/TextFileSink.java:145
↓ 13 callersMethodgetLogicalNode
Gets an unmodifiable list of all of the logical nodes associated with the specified physical node
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:83
← previousnext →101–200 of 4,174, ranked by callers