Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/cloudera/flume
/ functions
Functions
4,174 in github.com/cloudera/flume
⨍
Functions
4,174
◇
Types & classes
671
↓ 13 callers
Method
shutdown
()
flume-core/src/main/java/com/cloudera/flume/master/ZooKeeperConfigStore.java:655
↓ 13 callers
Method
unmapLogicalNode
This removes the mapping from a physical node to the logical node, but leaves the logicalNode data flow configuration.
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:109
↓ 12 callers
Method
add
Registers a reportable object. If a Reportable with the same name is already registered, it will be replaced.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportManager.java:61
↓ 12 callers
Method
append
Writes the message to an HDFS file whose path is substituted with tags drawn from the supplied event
flume-core/src/main/java/com/cloudera/flume/handlers/hive/HiveNotifyingDfsSink.java:176
↓ 12 callers
Method
build
This is required for backwards compatibility and will eventually become deprecated
flume-core/src/main/java/com/cloudera/flume/conf/SinkFactory.java:49
↓ 12 callers
Method
buildSimpleArg
All of factories expect all string arguments. Numbers are expected to be in decimal format. If it is of type KWARG, it returns null TODO (jon) move
flume-core/src/main/java/com/cloudera/flume/conf/FlumeBuilder.java:341
↓ 12 callers
Method
close
This is a synchronous close operation for the logical node.
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNode.java:385
↓ 12 callers
Method
disconnect
()
flume-core/src/main/java/com/cloudera/flume/util/FlumeShell.java:224
↓ 12 callers
Method
getAgentAckQueuer
()
flume-core/src/main/java/com/cloudera/flume/agent/WALAckManager.java:99
↓ 12 callers
Method
getDefaultFlowName
Returns the default flow name for logical nodes.
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:1012
↓ 12 callers
Method
getHost
Host name of the machine that generated this event. TODO (jon) consider wrapping this. Chose string because it doesn't assume ipv4 or ipv6, etc. May
flume-core/src/main/java/com/cloudera/flume/core/Event.java:72
↓ 12 callers
Method
getLogicalNodeMap
Gets the full physical to logical nodes mapping
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:119
↓ 12 callers
Method
getNanos
()
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:88
↓ 12 callers
Method
getNodes
()
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNodeManager.java:60
↓ 12 callers
Method
getResult
()
flume-core/src/main/java/com/cloudera/util/ResultRetryable.java:26
↓ 12 callers
Method
getSink
()
flume-core/src/main/java/com/cloudera/flume/core/Driver.java:37
↓ 12 callers
Method
isWindowsOS
()
flume-core/src/main/java/com/cloudera/util/OSUtils.java:30
↓ 12 callers
Method
join
()
flume-core/src/main/java/com/cloudera/flume/core/connector/DirectDriver.java:259
↓ 12 callers
Method
next
()
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/ThriftEventSource.java:202
↓ 12 callers
Method
reset
Reset backoff state. Call this after successful attempts.
flume-core/src/main/java/com/cloudera/util/BackoffPolicy.java:58
↓ 12 callers
Method
setConfig
(String host, String flowid, String source, String sink)
flume-core/src/main/java/com/cloudera/flume/master/flows/FlowConfigManager.java:277
↓ 12 callers
Method
shutdown
Shutdown all the various servers.
flume-core/src/main/java/com/cloudera/flume/master/FlumeMaster.java:322
↓ 11 callers
Method
appendData
(File f, int start, int count)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestTailSourceCursor.java:74
↓ 11 callers
Method
close
Closes the WAL manager for reads and writes
flume-core/src/main/java/com/cloudera/flume/agent/diskfailover/DiskFailoverManager.java:80
↓ 11 callers
Method
contains
Rhetorically asks, does the current set contain the specified subset with high probability? This essentially does a 'and' and then verifies if the re
flume-core/src/main/java/com/cloudera/util/bloom/BloomSet.java:162
↓ 11 callers
Method
createDataFile
(int count)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestMultiLineCursor.java:111
↓ 11 callers
Method
createDataFile
(int count)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestTailSourceCursor.java:62
↓ 11 callers
Method
genArg
(CommonTree t)
flume-core/src/main/java/com/cloudera/flume/conf/FlumeSpecGen.java:38
↓ 11 callers
Method
getMetrics
()
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/RollSink.java:373
↓ 11 callers
Method
isSuccess
(long cmdid)
flume-core/src/main/java/com/cloudera/flume/master/CommandManager.java:179
↓ 11 callers
Method
rotate
()
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/RollSink.java:266
↓ 11 callers
Method
setBuilder
(OutputFormatBuilder builder)
flume-core/src/main/java/com/cloudera/flume/handlers/text/output/OutputFormat.java:47
↓ 11 callers
Method
sink
Matches if the current as node is a sink or deco of kind kind.
flume-core/src/main/java/com/cloudera/flume/conf/FlumePatterns.java:68
↓ 11 callers
Method
spawn
(Context ctx, String name, FlumeConfigData fcd)
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNodeManager.java:90
↓ 11 callers
Method
submit
(Command command)
flume-core/src/main/java/com/cloudera/flume/util/AdminRPC.java:39
↓ 11 callers
Method
xdr_string
Puts a string into the buffer by first writing the size of the string as an int, followed by the bytes of the string, padded if necessary to a multipl
flume-core/src/main/java/com/cloudera/flume/reporter/ganglia/GangliaSink.java:263
↓ 10 callers
Method
appendData
(File f, int start, int count)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestMultiLineCursor.java:123
↓ 10 callers
Method
changeState
Change the state of a file after it has been successfully processed. The generally move linearly from WRITING -> LOGGED -> SENDING -> SENT -> E2EACKED
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:613
↓ 10 callers
Method
checkConfig
Takes a FlumeConfigData and attempts load/config the node. True if successful, false if failed
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNode.java:264
↓ 10 callers
Method
close
{@inheritDoc}
flume-core/src/main/java/com/cloudera/flume/handlers/avro/AvroEventSource.java:155
↓ 10 callers
Method
dumpLog
()
flume-core/src/main/java/com/cloudera/flume/master/MasterAckManager.java:66
↓ 10 callers
Method
getBody
Returns reference to mutable body of event. NOTE: the contents of the returned byte array should not be modified.
flume-core/src/main/java/com/cloudera/flume/core/EventImpl.java:112
↓ 10 callers
Method
getLastDelta
()
flume-core/src/main/java/com/cloudera/util/Benchmark.java:148
↓ 10 callers
Method
getMasterServerId
For distributed ZK, we need to know which server we are.
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:486
↓ 10 callers
Method
getNodeStatuses
Returns a copy of the hashmap containing the mapping from node names to their status object.
flume-core/src/main/java/com/cloudera/flume/master/StatusManager.java:201
↓ 10 callers
Method
getOpenPath
()
flume-core/src/main/java/com/cloudera/util/PathManager.java:187
↓ 10 callers
Method
getPriority
the priority - user specified priority
flume-core/src/main/java/com/cloudera/flume/core/Event.java:54
↓ 10 callers
Method
getState
Get the current state of the driver. (HELLO, OPENING, ACTIVE, CLOSING, IDLE, ERROR)
flume-core/src/main/java/com/cloudera/flume/core/Driver.java:109
↓ 10 callers
Method
open
()
flume-core/src/main/java/com/cloudera/flume/handlers/batch/BatchingDecorator.java:199
↓ 10 callers
Method
open
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:166
↓ 10 callers
Method
open
Open the WAL manager to enable reads and writes.
flume-core/src/main/java/com/cloudera/flume/agent/durability/WALManager.java:78
↓ 10 callers
Method
replaceChildren
This does an inplace child replacement. This replaces the current dst nodes children with the src nodes children.
flume-core/src/main/java/com/cloudera/flume/conf/PatternMatch.java:313
↓ 10 callers
Method
setLong
(Event e, String attr, long l)
flume-core/src/main/java/com/cloudera/flume/core/Attributes.java:101
↓ 10 callers
Method
toString
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeBuilder.java:406
↓ 10 callers
Method
toString
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfigData.java:121
↓ 9 callers
Method
addHandler
Add a handler callback object.
flume-core/src/main/java/com/cloudera/util/dirwatcher/DirWatcher.java:173
↓ 9 callers
Method
addInt
Adds an int to the bloom filter.
flume-core/src/main/java/com/cloudera/util/bloom/BloomSet.java:103
↓ 9 callers
Method
append
(final Event e)
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/RollSink.java:179
↓ 9 callers
Method
attempt
()
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:87
↓ 9 callers
Method
attemptToAddAttribute
(Put p, Entry<String, byte[]> a)
plugins/flume-plugin-hbasesink/src/main/java/com/cloudera/flume/hbase/Attr2HBaseEventSink.java:260
↓ 9 callers
Method
build
(String... args)
flume-core/src/test/java/com/cloudera/flume/handlers/text/output/TestOutputFormatFactory.java:352
↓ 9 callers
Method
close
()
flume-core/src/main/java/com/cloudera/flume/handlers/batch/BatchingDecorator.java:224
↓ 9 callers
Method
createConfigStore
Helper function to parse the configuration to decide which kind of config store to start
flume-core/src/main/java/com/cloudera/flume/master/FlumeMaster.java:217
↓ 9 callers
Method
createLegacyHtmlReport
This is a temporary method present while I convert old reports into new ones.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportEvent.java:378
↓ 9 callers
Method
createSink
Update to make object arguments instead of string arguments.
flume-core/src/main/java/com/cloudera/flume/conf/SinkFactory.java:93
↓ 9 callers
Method
createSource
(Context ctx, String name, Object... args)
flume-core/src/main/java/com/cloudera/flume/conf/SourceFactory.java:46
↓ 9 callers
Method
defaultHandleException
Takes default action for ZK exceptions. If CONNECTIONLOSS, try and reconnect followed by abort. Otherwise, abort and signal failure.
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:107
↓ 9 callers
Method
findHostIndex
Returns the index of the hostname/ip in the list that is the machine running the process. @param hosts @return the index of the array that is localho
flume-core/src/main/java/com/cloudera/util/NetUtils.java:82
↓ 9 callers
Method
getAgentLogsDir
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:490
↓ 9 callers
Method
getBinFor
This returns the closest bin for the object. If the object is the bin it should be an exact hit, but if it is a value traverse to find closest subsequ
flume-core/src/main/java/com/cloudera/util/consistenthash/ConsistentHash.java:102
↓ 9 callers
Method
getBytesWritten
()
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/TStatsTransport.java:78
↓ 9 callers
Method
getClosedPath
()
flume-core/src/main/java/com/cloudera/util/PathManager.java:191
↓ 9 callers
Method
getConfigs
()
flume-core/src/main/java/com/cloudera/flume/util/AdminRPC.java:44
↓ 9 callers
Method
getData
(final String path, final boolean watch, final Stat stat)
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:369
↓ 9 callers
Method
getFailChainSinkSpec
This uses the instance's state to generate a spec
flume-core/src/main/java/com/cloudera/flume/master/availability/FailoverChainManager.java:86
↓ 9 callers
Method
getFlowID
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfigData.java:93
↓ 9 callers
Method
getNanos
Get the current nanos. This is mostly used as a tie breaker if unixtime doesn't have enough resolution -- subsequent class will be "slightly" after ea
flume-core/src/test/java/com/cloudera/flume/util/MockClock.java:59
↓ 9 callers
Method
getPort
()
flume-core/src/test/java/com/cloudera/flume/reporter/ganglia/TestGangliaSink.java:229
↓ 9 callers
Method
getType
(String attr)
flume-core/src/main/java/com/cloudera/flume/core/Attributes.java:219
↓ 9 callers
Method
getZK
Returns the underlying ZooKeeper object. Use only for methods that are not captured by this class. Note that the returned ZooKeeper could be closed b
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:267
↓ 9 callers
Method
isEmpty
Returns true if there dfo has no logged entries. This is useful for completeness checking. (wait for after this is true before closing).
flume-core/src/main/java/com/cloudera/flume/agent/diskfailover/DiskFailoverManager.java:135
↓ 9 callers
Method
nanos
()
flume-core/src/main/java/com/cloudera/util/Clock.java:79
↓ 9 callers
Method
newTag
Our sinks often rotate and each version needs a separate unique tag/name. This method updates state and creates the next name.
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/Tagger.java:39
↓ 9 callers
Method
setupColl
(long port, String name, String acc)
flume-core/src/test/java/com/cloudera/flume/agent/diskfailover/TestDiskFailoverBehavior.java:80
↓ 9 callers
Method
setupSinkFactory
Adds a few simple sinks with known names
flume-core/src/test/java/com/cloudera/flume/reporter/ReportTestUtils.java:33
↓ 9 callers
Method
source
Matches if current ast node is a source of kind kind.
flume-core/src/main/java/com/cloudera/flume/conf/FlumePatterns.java:40
↓ 9 callers
Method
start
Starts the exec thread (don't do this in a constructor)
flume-core/src/main/java/com/cloudera/flume/master/CommandManager.java:147
↓ 9 callers
Method
toJson
Serializes event as JSON string
flume-core/src/main/java/com/cloudera/flume/reporter/ReportEvent.java:209
↓ 9 callers
Method
unmapAllLogicalNodes
Unmaps all logical nodes in a single operation.
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:151
↓ 9 callers
Method
xdr_int
Puts an integer into the buffer as 4 bytes, big-endian. Not thread safe
flume-core/src/main/java/com/cloudera/flume/reporter/ganglia/GangliaSink.java:289
↓ 8 callers
Method
checkFile
(File f)
flume-core/src/test/java/com/cloudera/flume/handlers/text/output/TestOutputFormatFactory.java:127
↓ 8 callers
Method
close
()
flume-core/src/main/java/com/cloudera/flume/handlers/debug/MemorySinkSource.java:55
↓ 8 callers
Method
close
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALDeco.java:207
↓ 8 callers
Method
createAttr
(String key, byte[] val)
plugins/flume-plugin-hbasesink/src/test/java/com/cloudera/flume/hbase/TestAttr2HBaseSink.java:294
↓ 8 callers
Method
deco
Matches if the current ast node is a deco (not a sink) of kind kind.
flume-core/src/main/java/com/cloudera/flume/conf/FlumePatterns.java:54
↓ 8 callers
Method
forcedRotate
Right now this is exposed for testing purposes. Eventually rotate() may be redefined to be used with a global scheduler to reduce the number of thread
flume-core/src/main/java/com/cloudera/flume/reporter/history/ScheduledHistoryReporter.java:98
↓ 8 callers
Method
genArgs
(List<String> args, String pre, String delim, String post)
flume-core/src/main/java/com/cloudera/flume/conf/FlumeSpecGen.java:74
↓ 8 callers
Method
get
(String attr)
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:171
↓ 8 callers
Method
getAndInit
Returns the singleton ZooKeeperService, initializing it if it has not been initialized already.
flume-core/src/main/java/com/cloudera/flume/master/ZooKeeperService.java:123
↓ 8 callers
Method
getCollectorHost
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:597
← previous
next →
201–300 of 4,174, ranked by callers