Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/cloudera/flume
/ functions
Functions
4,174 in github.com/cloudera/flume
⨍
Functions
4,174
◇
Types & classes
671
↓ 30 callers
Method
recursive
This method creates a recursive pattern match relation. This will traverse through any number of nodes to check if the child pattern matches.
flume-core/src/main/java/com/cloudera/flume/conf/PatternMatch.java:297
↓ 30 callers
Method
updateEventProcessingStats
This method should be called from sources which wish to track event statistics.
flume-core/src/main/java/com/cloudera/flume/core/EventSource.java:152
↓ 29 callers
Method
checkAcks
This contacts the master to find if any of the pending acks are completed,
flume-core/src/main/java/com/cloudera/flume/agent/WALAckManager.java:106
↓ 29 callers
Method
createTestableConfiguration
Resets the singleton configuration to empty and returns it. Should be used for testing only - this is used to isolate different test configurations.
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:119
↓ 29 callers
Method
escapeString
Replace all substrings of form %{tagname} with get(tagname).toString() and all shorthand substrings of form %x with a special value. Any unrecognized
flume-core/src/main/java/com/cloudera/flume/core/Event.java:303
↓ 29 callers
Method
heartbeatChecks
All the core functionality of a heartbeat accessible without having to be in the heartbeat thread.
flume-core/src/main/java/com/cloudera/flume/agent/LivenessManager.java:181
↓ 29 callers
Method
next
()
flume-core/src/main/java/com/cloudera/flume/handlers/debug/MemorySinkSource.java:67
↓ 27 callers
Method
create
(final String path, final byte[] data, final List<ACL> acls, final CreateMode mode)
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:411
↓ 27 callers
Method
getBody
()
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:76
↓ 27 callers
Method
getNodes
()
flume-core/src/main/java/com/cloudera/distributed/Group.java:48
↓ 27 callers
Method
getPending
This method returns a copy of the current outstanding and completed ackIds This method is currently only used in tests.
flume-core/src/main/java/com/cloudera/flume/master/MasterAckManager.java:62
↓ 27 callers
Method
toText
Serializes event as text to supplied writer.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportEvent.java:349
↓ 26 callers
Method
getCommand
()
flume-core/src/main/java/com/cloudera/flume/master/Command.java:45
↓ 25 callers
Method
child
This method creates a child relation where 'this' is the parent, and the specified pattern child is a child. This matches if any of the parent node's
flume-core/src/main/java/com/cloudera/flume/conf/PatternMatch.java:280
↓ 25 callers
Method
setInt
(Event e, String attr, int i)
flume-core/src/main/java/com/cloudera/flume/core/Attributes.java:96
↓ 25 callers
Method
updateAll
Similar to refreshAll, except it only incrementally refreshes configurations that change due to state changes. This is only really necessary for trans
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:146
↓ 24 callers
Method
clear
Removes all registered reportables from the ReportManager.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportManager.java:113
↓ 24 callers
Method
dumbfilecopy
Copies a file.
flume-core/src/main/java/com/cloudera/util/FileUtil.java:119
↓ 24 callers
Method
getMessage
Translate antlr internal exceptions to sane flume data flow configuration specific messages.
flume-core/src/main/java/com/cloudera/flume/conf/RuntimeRecognitionException.java:52
↓ 24 callers
Method
noChildren
Returns an empty immutable map of children reports.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportUtil.java:63
↓ 24 callers
Method
open
()
flume-core/src/main/java/com/cloudera/flume/core/CompositeSink.java:49
↓ 24 callers
Method
toJSONObject
Convert a flume report in to a jettison JSONObject.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportUtil.java:39
↓ 24 callers
Method
toString
()
flume-core/src/main/java/com/cloudera/util/Pair.java:67
↓ 23 callers
Method
cleanupLocalWriteDir
Cleanup the temp dir after the test is run.
flume-core/src/test/java/com/cloudera/util/FlumeTestHarness.java:107
↓ 23 callers
Method
clear
()
flume-core/src/main/java/com/cloudera/util/Cache.java:95
↓ 23 callers
Method
getFile
()
flume-core/src/main/java/com/cloudera/flume/handlers/log4j/SeqfileAppender.java:71
↓ 23 callers
Method
getLivenessManager
()
flume-core/src/main/java/com/cloudera/flume/agent/FlumeNode.java:758
↓ 23 callers
Method
serve
Start listening for client requests.
flume-core/src/main/java/com/cloudera/flume/master/RPCServer.java:33
↓ 23 callers
Method
setupLocalWriteDir
This sets the log dir in the FlumeConfiguration and then instantiates a mock master and node that use that configuration
flume-core/src/test/java/com/cloudera/util/FlumeTestHarness.java:56
↓ 22 callers
Method
append
(Event e)
flume-core/src/main/java/com/cloudera/flume/core/BackOffFailOverSink.java:96
↓ 22 callers
Method
getConfigManForFlow
Only for testing
flume-core/src/main/java/com/cloudera/flume/master/flows/FlowConfigManager.java:78
↓ 22 callers
Method
getDriver
@return the driver responsible for opening/appending/closing
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNode.java:378
↓ 22 callers
Method
getFails
()
flume-core/src/main/java/com/cloudera/flume/core/BackOffFailOverSink.java:270
↓ 22 callers
Method
shutdown
()
flume-core/src/test/java/com/cloudera/flume/master/TestZKBackedConfigStore.java:316
↓ 22 callers
Method
start
()
flume-core/src/main/java/com/cloudera/flume/core/connector/DirectDriver.java:234
↓ 21 callers
Method
addLogicalNode
(String physNode, String logicNode)
flume-core/src/main/java/com/cloudera/flume/master/ConfigManager.java:289
↓ 21 callers
Method
genFiles
(File tmpdir, String prefix, int files, int lines)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestTailDirSource.java:100
↓ 21 callers
Method
getArgs
()
flume-core/src/main/java/com/cloudera/flume/util/FlumeShell.java:204
↓ 21 callers
Method
getEventMaxSizeBytes
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:964
↓ 21 callers
Method
getReport
Generate a simplified report. This only gathers a limited number of metrics about the particular sink, and does not hierarchically gather information
flume-core/src/main/java/com/cloudera/flume/core/EventSink.java:71
↓ 21 callers
Method
getTimestamp
()
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:84
↓ 21 callers
Method
parse
(String s)
flume-core/src/main/java/com/cloudera/flume/conf/FlumeBuilder.java:122
↓ 21 callers
Method
removeLogicalNode
This removes the logical node data flow configuration from both the flow table and the phys-logical mapping
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:103
↓ 21 callers
Method
toString
()
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/TimeTrigger.java:78
↓ 21 callers
Method
waitForAtLeastState
Block until driver state to reaches at least the specified state where HELLO < OPENING < ACTIVE < CLOSING < IDLE < ERROR or to millis ms has elapsed.
flume-core/src/main/java/com/cloudera/flume/core/Driver.java:92
↓ 20 callers
Method
get
(T val)
flume-core/src/main/java/com/cloudera/util/Histogram.java:72
↓ 20 callers
Method
getConfig
(String host)
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:40
↓ 20 callers
Method
getNodeStatuses
()
flume-core/src/main/java/com/cloudera/flume/util/AdminRPC.java:41
↓ 20 callers
Method
getPriority
()
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:80
↓ 20 callers
Method
getStatus
()
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNode.java:370
↓ 20 callers
Method
toString
Returns event in string form: host [ priority date ] {attr1:val1} {attr2:val2} {metric1:val1} {metric2:val2} body
flume-core/src/main/java/com/cloudera/flume/reporter/ReportEvent.java:298
↓ 19 callers
Method
dumpMatches
(Map<String, CommonTree> matches)
flume-core/src/test/java/com/cloudera/flume/conf/TestPatternMatch.java:56
↓ 19 callers
Method
getFlattenedReport
Get a recursively flattened metrics report. If the reportable is null this returns null.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportUtil.java:87
↓ 19 callers
Method
getLogicalNode
(String physNode)
flume-core/src/main/java/com/cloudera/flume/master/ConfigManager.java:276
↓ 18 callers
Method
close
()
flume-core/src/main/java/com/cloudera/flume/core/CompositeSink.java:54
↓ 18 callers
Method
getAttrs
Ideally this would be package private, but instead this method should return a ReadOnly Map. This can be done by wrapping a map m with Collections.unm
flume-core/src/main/java/com/cloudera/flume/core/Event.java:96
↓ 18 callers
Method
getFlowId
returns the flow id of a particular logicalNode
flume-core/src/main/java/com/cloudera/flume/master/flows/FlowConfigManager.java:67
↓ 18 callers
Method
reset
Reset the trigger condition.
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/RollTrigger.java:50
↓ 18 callers
Method
synthInMem
This is about 300MB in memory
flume-microbenchmarks/src/test/java/com/cloudera/flume/FlumeBenchmarkHarness.java:175
↓ 18 callers
Method
toString
()
flume-core/src/main/java/com/cloudera/flume/agent/AvroMasterRPC.java:201
↓ 17 callers
Method
close
()
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/ThriftEventSource.java:161
↓ 17 callers
Method
getCommand
()
flume-core/src/main/java/com/cloudera/flume/util/FlumeShell.java:200
↓ 17 callers
Method
getConfig
(String host)
flume-core/src/main/java/com/cloudera/flume/master/ConfigManager.java:71
↓ 17 callers
Method
getPendingAckTags
()
flume-core/src/main/java/com/cloudera/flume/agent/WALAckManager.java:214
↓ 17 callers
Method
getWritingTags
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:199
↓ 17 callers
Method
open
Send open event after open
flume-core/src/main/java/com/cloudera/flume/handlers/endtoend/AckChecksumInjector.java:114
↓ 17 callers
Method
setSink
This is only for testing
flume-core/src/main/java/com/cloudera/flume/conf/SinkFactoryImpl.java:344
↓ 17 callers
Method
start
()
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:42
↓ 17 callers
Method
stop
()
flume-core/src/main/java/com/cloudera/flume/core/connector/DirectDriver.java:247
↓ 16 callers
Method
append
Calculate the crc based on the body of the message and xor it into the checksum.
flume-core/src/main/java/com/cloudera/flume/handlers/endtoend/AckChecksumInjector.java:133
↓ 16 callers
Method
build
(Context context, String... argv)
flume-core/src/test/java/com/cloudera/flume/handlers/rolling/TestRollSink.java:293
↓ 16 callers
Method
charAt
(int arg0)
flume-core/src/main/java/com/cloudera/flume/handlers/text/CustomDelimCursor.java:77
↓ 16 callers
Method
getChannel
()
flume-core/src/main/java/com/cloudera/util/InputStreamPipe.java:60
↓ 16 callers
Method
getLoggedTags
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:203
↓ 16 callers
Method
getSendingTags
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:207
↓ 16 callers
Method
getSentTags
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:211
↓ 16 callers
Method
getTimestamp
Returns unix time stamp in millis
flume-core/src/main/java/com/cloudera/flume/core/EventImpl.java:127
↓ 16 callers
Method
submit
(Command cmd)
flume-core/src/main/java/com/cloudera/flume/master/CommandManager.java:166
↓ 15 callers
Method
close
Send close event before close
flume-core/src/main/java/com/cloudera/flume/handlers/endtoend/AckChecksumInjector.java:123
↓ 15 callers
Method
doDecoBenchmark
This takes a single decorator, and then applies all of the datasets through the decorator. Each source is bufferzied -- the given number of messages a
flume-microbenchmarks/src/test/java/com/cloudera/flume/FlumeBenchmarkHarness.java:134
↓ 15 callers
Method
init
Reads the standard configuration and initializes client and optionally server accordingly.
flume-core/src/main/java/com/cloudera/flume/master/ZooKeeperConfigStore.java:106
↓ 15 callers
Method
join
This causes the driver to block until it is "done".
flume-core/src/main/java/com/cloudera/flume/core/Driver.java:63
↓ 15 callers
Method
makeDirs
Make a directory and its parents, returning true if and only if the dir exists. Does not guarantee that we can write to that directory!
flume-core/src/main/java/com/cloudera/util/FileUtil.java:133
↓ 15 callers
Method
open
()
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/ThriftEventSource.java:131
↓ 15 callers
Method
poll
()
flume-core/src/main/java/com/cloudera/flume/core/PollingSource.java:53
↓ 15 callers
Method
readInt
(Event e, String attr)
flume-core/src/main/java/com/cloudera/flume/core/Attributes.java:52
↓ 15 callers
Method
setSinkFactory
(SinkFactory snkFact)
flume-core/src/main/java/com/cloudera/flume/conf/FlumeBuilder.java:106
↓ 14 callers
Method
acknowledge
(String group)
flume-core/src/main/java/com/cloudera/flume/agent/MasterRPC.java:57
↓ 14 callers
Method
cannedData
Create a memory based source of count events. Each event has s with count appended as its body.
flume-core/src/main/java/com/cloudera/flume/handlers/debug/MemorySinkSource.java:82
↓ 14 callers
Method
checkLogicalNodes
Checks against the master to get new physical nodes or to learn about decommissioned logical nodes Invariant: There is always at least logical per ph
flume-core/src/main/java/com/cloudera/flume/agent/LivenessManager.java:119
↓ 14 callers
Method
getMetrics
Get reportable data from the thrift event source. @Override
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/ThriftEventSource.java:92
↓ 14 callers
Method
init
Establishes a connection with a ZooKeeper service.
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:135
↓ 14 callers
Method
parseLine
This takes a single string and parses it into a Command.
flume-core/src/main/java/com/cloudera/flume/shell/CommandBuilder.java:94
↓ 13 callers
Method
attempt
Calls doTry on a Retryable until either it succeeds or the backoff policy fails.
flume-core/src/main/java/com/cloudera/util/RetryHarness.java:56
↓ 13 callers
Method
build
This is required for backwards compatibility and will eventually become deprecated
flume-core/src/main/java/com/cloudera/flume/conf/SinkFactory.java:76
↓ 13 callers
Method
check
This the core check method that updates information from the previous poll and fires events based on changes.
flume-core/src/main/java/com/cloudera/util/dirwatcher/DirWatcher.java:128
↓ 13 callers
Method
createIOException
A convenient method to create an {@link IOException}.
flume-core/src/main/java/com/cloudera/util/MultipleIOException.java:59
↓ 13 callers
Method
curl
Grab a url's contents. This assumes that grabbed pages are small @param urlString @return @throws IOException
flume-core/src/main/java/com/cloudera/util/HttpServerTestUtils.java:43
↓ 13 callers
Method
getFormat
()
flume-core/src/main/java/com/cloudera/flume/handlers/debug/TextFileSink.java:145
↓ 13 callers
Method
getLogicalNode
Gets an unmodifiable list of all of the logical nodes associated with the specified physical node
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:83
← previous
next →
101–200 of 4,174, ranked by callers