MCPcopy Create free account

hub / github.com/cloudera/flume / functions

Functions4,174 in github.com/cloudera/flume

↓ 13 callersMethodshutdown
()
flume-core/src/main/java/com/cloudera/flume/master/ZooKeeperConfigStore.java:655
↓ 13 callersMethodunmapLogicalNode
This removes the mapping from a physical node to the logical node, but leaves the logicalNode data flow configuration.
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:109
↓ 12 callersMethodadd
Registers a reportable object. If a Reportable with the same name is already registered, it will be replaced.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportManager.java:61
↓ 12 callersMethodappend
Writes the message to an HDFS file whose path is substituted with tags drawn from the supplied event
flume-core/src/main/java/com/cloudera/flume/handlers/hive/HiveNotifyingDfsSink.java:176
↓ 12 callersMethodbuild
This is required for backwards compatibility and will eventually become deprecated
flume-core/src/main/java/com/cloudera/flume/conf/SinkFactory.java:49
↓ 12 callersMethodbuildSimpleArg
All of factories expect all string arguments. Numbers are expected to be in decimal format. If it is of type KWARG, it returns null TODO (jon) move
flume-core/src/main/java/com/cloudera/flume/conf/FlumeBuilder.java:341
↓ 12 callersMethodclose
This is a synchronous close operation for the logical node.
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNode.java:385
↓ 12 callersMethoddisconnect
()
flume-core/src/main/java/com/cloudera/flume/util/FlumeShell.java:224
↓ 12 callersMethodgetAgentAckQueuer
()
flume-core/src/main/java/com/cloudera/flume/agent/WALAckManager.java:99
↓ 12 callersMethodgetDefaultFlowName
Returns the default flow name for logical nodes.
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:1012
↓ 12 callersMethodgetHost
Host name of the machine that generated this event. TODO (jon) consider wrapping this. Chose string because it doesn't assume ipv4 or ipv6, etc. May
flume-core/src/main/java/com/cloudera/flume/core/Event.java:72
↓ 12 callersMethodgetLogicalNodeMap
Gets the full physical to logical nodes mapping
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:119
↓ 12 callersMethodgetNanos
()
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:88
↓ 12 callersMethodgetNodes
()
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNodeManager.java:60
↓ 12 callersMethodgetResult
()
flume-core/src/main/java/com/cloudera/util/ResultRetryable.java:26
↓ 12 callersMethodgetSink
()
flume-core/src/main/java/com/cloudera/flume/core/Driver.java:37
↓ 12 callersMethodisWindowsOS
()
flume-core/src/main/java/com/cloudera/util/OSUtils.java:30
↓ 12 callersMethodjoin
()
flume-core/src/main/java/com/cloudera/flume/core/connector/DirectDriver.java:259
↓ 12 callersMethodnext
()
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/ThriftEventSource.java:202
↓ 12 callersMethodreset
Reset backoff state. Call this after successful attempts.
flume-core/src/main/java/com/cloudera/util/BackoffPolicy.java:58
↓ 12 callersMethodsetConfig
(String host, String flowid, String source, String sink)
flume-core/src/main/java/com/cloudera/flume/master/flows/FlowConfigManager.java:277
↓ 12 callersMethodshutdown
Shutdown all the various servers.
flume-core/src/main/java/com/cloudera/flume/master/FlumeMaster.java:322
↓ 11 callersMethodappendData
(File f, int start, int count)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestTailSourceCursor.java:74
↓ 11 callersMethodclose
Closes the WAL manager for reads and writes
flume-core/src/main/java/com/cloudera/flume/agent/diskfailover/DiskFailoverManager.java:80
↓ 11 callersMethodcontains
Rhetorically asks, does the current set contain the specified subset with high probability? This essentially does a 'and' and then verifies if the re
flume-core/src/main/java/com/cloudera/util/bloom/BloomSet.java:162
↓ 11 callersMethodcreateDataFile
(int count)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestMultiLineCursor.java:111
↓ 11 callersMethodcreateDataFile
(int count)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestTailSourceCursor.java:62
↓ 11 callersMethodgenArg
(CommonTree t)
flume-core/src/main/java/com/cloudera/flume/conf/FlumeSpecGen.java:38
↓ 11 callersMethodgetMetrics
()
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/RollSink.java:373
↓ 11 callersMethodisSuccess
(long cmdid)
flume-core/src/main/java/com/cloudera/flume/master/CommandManager.java:179
↓ 11 callersMethodrotate
()
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/RollSink.java:266
↓ 11 callersMethodsetBuilder
(OutputFormatBuilder builder)
flume-core/src/main/java/com/cloudera/flume/handlers/text/output/OutputFormat.java:47
↓ 11 callersMethodsink
Matches if the current as node is a sink or deco of kind kind.
flume-core/src/main/java/com/cloudera/flume/conf/FlumePatterns.java:68
↓ 11 callersMethodspawn
(Context ctx, String name, FlumeConfigData fcd)
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNodeManager.java:90
↓ 11 callersMethodsubmit
(Command command)
flume-core/src/main/java/com/cloudera/flume/util/AdminRPC.java:39
↓ 11 callersMethodxdr_string
Puts a string into the buffer by first writing the size of the string as an int, followed by the bytes of the string, padded if necessary to a multipl
flume-core/src/main/java/com/cloudera/flume/reporter/ganglia/GangliaSink.java:263
↓ 10 callersMethodappendData
(File f, int start, int count)
flume-core/src/test/java/com/cloudera/flume/handlers/text/TestMultiLineCursor.java:123
↓ 10 callersMethodchangeState
Change the state of a file after it has been successfully processed. The generally move linearly from WRITING -> LOGGED -> SENDING -> SENT -> E2EACKED
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:613
↓ 10 callersMethodcheckConfig
Takes a FlumeConfigData and attempts load/config the node. True if successful, false if failed
flume-core/src/main/java/com/cloudera/flume/agent/LogicalNode.java:264
↓ 10 callersMethodclose
{@inheritDoc}
flume-core/src/main/java/com/cloudera/flume/handlers/avro/AvroEventSource.java:155
↓ 10 callersMethoddumpLog
()
flume-core/src/main/java/com/cloudera/flume/master/MasterAckManager.java:66
↓ 10 callersMethodgetBody
Returns reference to mutable body of event. NOTE: the contents of the returned byte array should not be modified.
flume-core/src/main/java/com/cloudera/flume/core/EventImpl.java:112
↓ 10 callersMethodgetLastDelta
()
flume-core/src/main/java/com/cloudera/util/Benchmark.java:148
↓ 10 callersMethodgetMasterServerId
For distributed ZK, we need to know which server we are.
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:486
↓ 10 callersMethodgetNodeStatuses
Returns a copy of the hashmap containing the mapping from node names to their status object.
flume-core/src/main/java/com/cloudera/flume/master/StatusManager.java:201
↓ 10 callersMethodgetOpenPath
()
flume-core/src/main/java/com/cloudera/util/PathManager.java:187
↓ 10 callersMethodgetPriority
the priority - user specified priority
flume-core/src/main/java/com/cloudera/flume/core/Event.java:54
↓ 10 callersMethodgetState
Get the current state of the driver. (HELLO, OPENING, ACTIVE, CLOSING, IDLE, ERROR)
flume-core/src/main/java/com/cloudera/flume/core/Driver.java:109
↓ 10 callersMethodopen
()
flume-core/src/main/java/com/cloudera/flume/handlers/batch/BatchingDecorator.java:199
↓ 10 callersMethodopen
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALManager.java:166
↓ 10 callersMethodopen
Open the WAL manager to enable reads and writes.
flume-core/src/main/java/com/cloudera/flume/agent/durability/WALManager.java:78
↓ 10 callersMethodreplaceChildren
This does an inplace child replacement. This replaces the current dst nodes children with the src nodes children.
flume-core/src/main/java/com/cloudera/flume/conf/PatternMatch.java:313
↓ 10 callersMethodsetLong
(Event e, String attr, long l)
flume-core/src/main/java/com/cloudera/flume/core/Attributes.java:101
↓ 10 callersMethodtoString
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeBuilder.java:406
↓ 10 callersMethodtoString
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfigData.java:121
↓ 9 callersMethodaddHandler
Add a handler callback object.
flume-core/src/main/java/com/cloudera/util/dirwatcher/DirWatcher.java:173
↓ 9 callersMethodaddInt
Adds an int to the bloom filter.
flume-core/src/main/java/com/cloudera/util/bloom/BloomSet.java:103
↓ 9 callersMethodappend
(final Event e)
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/RollSink.java:179
↓ 9 callersMethodattempt
()
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:87
↓ 9 callersMethodattemptToAddAttribute
(Put p, Entry<String, byte[]> a)
plugins/flume-plugin-hbasesink/src/main/java/com/cloudera/flume/hbase/Attr2HBaseEventSink.java:260
↓ 9 callersMethodbuild
(String... args)
flume-core/src/test/java/com/cloudera/flume/handlers/text/output/TestOutputFormatFactory.java:352
↓ 9 callersMethodclose
()
flume-core/src/main/java/com/cloudera/flume/handlers/batch/BatchingDecorator.java:224
↓ 9 callersMethodcreateConfigStore
Helper function to parse the configuration to decide which kind of config store to start
flume-core/src/main/java/com/cloudera/flume/master/FlumeMaster.java:217
↓ 9 callersMethodcreateLegacyHtmlReport
This is a temporary method present while I convert old reports into new ones.
flume-core/src/main/java/com/cloudera/flume/reporter/ReportEvent.java:378
↓ 9 callersMethodcreateSink
Update to make object arguments instead of string arguments.
flume-core/src/main/java/com/cloudera/flume/conf/SinkFactory.java:93
↓ 9 callersMethodcreateSource
(Context ctx, String name, Object... args)
flume-core/src/main/java/com/cloudera/flume/conf/SourceFactory.java:46
↓ 9 callersMethoddefaultHandleException
Takes default action for ZK exceptions. If CONNECTIONLOSS, try and reconnect followed by abort. Otherwise, abort and signal failure.
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:107
↓ 9 callersMethodfindHostIndex
Returns the index of the hostname/ip in the list that is the machine running the process. @param hosts @return the index of the array that is localho
flume-core/src/main/java/com/cloudera/util/NetUtils.java:82
↓ 9 callersMethodgetAgentLogsDir
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:490
↓ 9 callersMethodgetBinFor
This returns the closest bin for the object. If the object is the bin it should be an exact hit, but if it is a value traverse to find closest subsequ
flume-core/src/main/java/com/cloudera/util/consistenthash/ConsistentHash.java:102
↓ 9 callersMethodgetBytesWritten
()
flume-core/src/main/java/com/cloudera/flume/handlers/thrift/TStatsTransport.java:78
↓ 9 callersMethodgetClosedPath
()
flume-core/src/main/java/com/cloudera/util/PathManager.java:191
↓ 9 callersMethodgetConfigs
()
flume-core/src/main/java/com/cloudera/flume/util/AdminRPC.java:44
↓ 9 callersMethodgetData
(final String path, final boolean watch, final Stat stat)
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:369
↓ 9 callersMethodgetFailChainSinkSpec
This uses the instance's state to generate a spec
flume-core/src/main/java/com/cloudera/flume/master/availability/FailoverChainManager.java:86
↓ 9 callersMethodgetFlowID
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfigData.java:93
↓ 9 callersMethodgetNanos
Get the current nanos. This is mostly used as a tie breaker if unixtime doesn't have enough resolution -- subsequent class will be "slightly" after ea
flume-core/src/test/java/com/cloudera/flume/util/MockClock.java:59
↓ 9 callersMethodgetPort
()
flume-core/src/test/java/com/cloudera/flume/reporter/ganglia/TestGangliaSink.java:229
↓ 9 callersMethodgetType
(String attr)
flume-core/src/main/java/com/cloudera/flume/core/Attributes.java:219
↓ 9 callersMethodgetZK
Returns the underlying ZooKeeper object. Use only for methods that are not captured by this class. Note that the returned ZooKeeper could be closed b
flume-core/src/main/java/com/cloudera/flume/master/ZKClient.java:267
↓ 9 callersMethodisEmpty
Returns true if there dfo has no logged entries. This is useful for completeness checking. (wait for after this is true before closing).
flume-core/src/main/java/com/cloudera/flume/agent/diskfailover/DiskFailoverManager.java:135
↓ 9 callersMethodnanos
()
flume-core/src/main/java/com/cloudera/util/Clock.java:79
↓ 9 callersMethodnewTag
Our sinks often rotate and each version needs a separate unique tag/name. This method updates state and creates the next name.
flume-core/src/main/java/com/cloudera/flume/handlers/rolling/Tagger.java:39
↓ 9 callersMethodsetupColl
(long port, String name, String acc)
flume-core/src/test/java/com/cloudera/flume/agent/diskfailover/TestDiskFailoverBehavior.java:80
↓ 9 callersMethodsetupSinkFactory
Adds a few simple sinks with known names
flume-core/src/test/java/com/cloudera/flume/reporter/ReportTestUtils.java:33
↓ 9 callersMethodsource
Matches if current ast node is a source of kind kind.
flume-core/src/main/java/com/cloudera/flume/conf/FlumePatterns.java:40
↓ 9 callersMethodstart
Starts the exec thread (don't do this in a constructor)
flume-core/src/main/java/com/cloudera/flume/master/CommandManager.java:147
↓ 9 callersMethodtoJson
Serializes event as JSON string
flume-core/src/main/java/com/cloudera/flume/reporter/ReportEvent.java:209
↓ 9 callersMethodunmapAllLogicalNodes
Unmaps all logical nodes in a single operation.
flume-core/src/main/java/com/cloudera/flume/master/ConfigurationManager.java:151
↓ 9 callersMethodxdr_int
Puts an integer into the buffer as 4 bytes, big-endian. Not thread safe
flume-core/src/main/java/com/cloudera/flume/reporter/ganglia/GangliaSink.java:289
↓ 8 callersMethodcheckFile
(File f)
flume-core/src/test/java/com/cloudera/flume/handlers/text/output/TestOutputFormatFactory.java:127
↓ 8 callersMethodclose
()
flume-core/src/main/java/com/cloudera/flume/handlers/debug/MemorySinkSource.java:55
↓ 8 callersMethodclose
()
flume-core/src/main/java/com/cloudera/flume/agent/durability/NaiveFileWALDeco.java:207
↓ 8 callersMethodcreateAttr
(String key, byte[] val)
plugins/flume-plugin-hbasesink/src/test/java/com/cloudera/flume/hbase/TestAttr2HBaseSink.java:294
↓ 8 callersMethoddeco
Matches if the current ast node is a deco (not a sink) of kind kind.
flume-core/src/main/java/com/cloudera/flume/conf/FlumePatterns.java:54
↓ 8 callersMethodforcedRotate
Right now this is exposed for testing purposes. Eventually rotate() may be redefined to be used with a global scheduler to reduce the number of thread
flume-core/src/main/java/com/cloudera/flume/reporter/history/ScheduledHistoryReporter.java:98
↓ 8 callersMethodgenArgs
(List<String> args, String pre, String delim, String post)
flume-core/src/main/java/com/cloudera/flume/conf/FlumeSpecGen.java:74
↓ 8 callersMethodget
(String attr)
flume-core/src/main/java/com/cloudera/flume/handlers/hdfs/WriteableEvent.java:171
↓ 8 callersMethodgetAndInit
Returns the singleton ZooKeeperService, initializing it if it has not been initialized already.
flume-core/src/main/java/com/cloudera/flume/master/ZooKeeperService.java:123
↓ 8 callersMethodgetCollectorHost
()
flume-core/src/main/java/com/cloudera/flume/conf/FlumeConfiguration.java:597
← previousnext →201–300 of 4,174, ranked by callers