Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/dianping/wormhole
/ functions
Functions
874 in github.com/dianping/wormhole
⨍
Functions
874
◇
Types & classes
186
↓ 4 callers
Method
getTrimmed
(String s)
src/main/java/com/dp/nebula/wormhole/plugins/reader/salesforcereader/SOQLInfo.java:142
↓ 4 callers
Method
prepare
(IParam param, ISourceCounter counter)
src/main/java/com/dp/nebula/wormhole/common/interfaces/ITransmissionPeriphery.java:6
↓ 4 callers
Method
pull
Pull one line from {@link IStorage}, used by {@link IWriter}. @return one {@link ILine} of record.
src/main/java/com/dp/nebula/wormhole/engine/storage/IStorage.java:66
↓ 4 callers
Method
push
Push one line into {@link IStorage}, used by {@link IReader} @param line One line of record, see {@link ILine} @return true for OK, false for
src/main/java/com/dp/nebula/wormhole/engine/storage/IStorage.java:42
↓ 4 callers
Method
replaceNullString
(String string)
src/main/java/com/dp/nebula/wormhole/plugins/reader/sftpreader/SftpReader.java:264
↓ 4 callers
Method
setByteLimit
(int byteLimit)
src/main/java/com/dp/nebula/wormhole/engine/storage/StorageConf.java:42
↓ 4 callers
Method
setId
(String id)
src/main/java/com/dp/nebula/wormhole/engine/storage/StorageConf.java:18
↓ 4 callers
Method
setIp
(String ip)
src/main/java/com/dp/nebula/wormhole/plugins/common/PCInfo.java:16
↓ 4 callers
Method
setLineLimit
(int lineLimit)
src/main/java/com/dp/nebula/wormhole/engine/storage/StorageConf.java:34
↓ 4 callers
Method
setPath
(String path)
src/main/java/com/dp/nebula/wormhole/plugins/common/PCInfo.java:48
↓ 4 callers
Method
setPeriod
(int period)
src/main/java/com/dp/nebula/wormhole/engine/storage/StorageConf.java:58
↓ 4 callers
Method
setPwd
(String pwd)
src/main/java/com/dp/nebula/wormhole/plugins/common/PCInfo.java:40
↓ 4 callers
Method
setStorageClassName
(String storageClassName)
src/main/java/com/dp/nebula/wormhole/engine/storage/StorageConf.java:26
↓ 4 callers
Method
setUser
(String user)
src/main/java/com/dp/nebula/wormhole/plugins/common/PCInfo.java:32
↓ 4 callers
Method
setWaitTime
(int waitTime)
src/main/java/com/dp/nebula/wormhole/engine/storage/StorageConf.java:66
↓ 4 callers
Method
shutdown
()
src/test/java/com/dp/nebula/wormhole/plugins/reader/hivereader/HiveReaderTest.java:148
↓ 3 callers
Method
addColumn
(byte[] family, byte[] qualifier, byte[] value)
src/main/java/com/dp/nebula/wormhole/plugins/common/HBaseClient.java:87
↓ 3 callers
Method
authenticate
(String username, String password, ServerSession session)
src/test/java/com/dp/nebula/wormhole/plugins/reader/sftpreader/MyPasswordAuthenticator.java:11
↓ 3 callers
Method
closeAll
()
src/main/java/com/dp/nebula/wormhole/plugins/writer/hdfswriter/HdfsWriterPeriphery.java:278
↓ 3 callers
Method
commit
()
src/main/java/com/dp/nebula/wormhole/common/interfaces/IWriter.java:7
↓ 3 callers
Method
createReaderThread
(IReader reader)
src/test/java/com/dp/nebula/wormhole/engine/core/ReaderThreadTest.java:60
↓ 3 callers
Method
createWriterThread
(IWriter writer)
src/test/java/com/dp/nebula/wormhole/engine/core/WriterThreadTest.java:60
↓ 3 callers
Method
dbPreCheck
(String preSql,Connection conn)
src/main/java/com/dp/nebula/wormhole/plugins/common/DBUtils.java:23
↓ 3 callers
Method
deleteFilesOnHdfs
(String dir, String prefix, String suffix)
src/main/java/com/dp/nebula/wormhole/plugins/writer/hdfswriter/HdfsWriterPeriphery.java:307
↓ 3 callers
Method
fromStatus
(int status)
src/main/java/com/dp/nebula/wormhole/common/JobStatus.java:55
↓ 3 callers
Method
genKey
generate key to get {@link DataSource} NOTE: Client must make sure all connections to the same database should share the same value a suggestion: use
src/main/java/com/dp/nebula/wormhole/plugins/common/DBSource.java:244
↓ 3 callers
Method
getCompletedMonitorInfo
()
src/main/java/com/dp/nebula/wormhole/engine/monitor/MonitorManager.java:73
↓ 3 callers
Method
getCompressionSuffixMap
()
src/main/java/com/dp/nebula/wormhole/plugins/common/DFSUtils.java:62
↓ 3 callers
Method
getConf
()
src/main/java/com/dp/nebula/wormhole/plugins/common/SFTPUtils.java:26
↓ 3 callers
Method
getFailedInfo
()
src/main/java/com/dp/nebula/wormhole/engine/monitor/MonitorManager.java:138
↓ 3 callers
Method
getFieldName
()
src/main/java/com/dp/nebula/wormhole/plugins/reader/salesforcereader/SOQLInfo.java:68
↓ 3 callers
Method
getResourcePath
(String[] paths)
src/test/java/com/dp/nebula/wormhole/engine/common/TestUtils.java:11
↓ 3 callers
Method
getStatus
Decide whether the reader or writer thread is executed successfully if there is NO thread failed, it returns true; even if some of the thread is runni
src/main/java/com/dp/nebula/wormhole/engine/core/AbstractPluginManager.java:70
↓ 3 callers
Method
getStorageMonitorCriteriaMap
()
src/main/java/com/dp/nebula/wormhole/engine/monitor/RealtimeMonitorInfo.java:52
↓ 3 callers
Method
getString
()
src/main/java/com/dp/nebula/wormhole/engine/monitor/WormHoleJobInfo.java:78
↓ 3 callers
Method
getWriterConfs
Get writer plugin's configuration. The return value is a list, this is designed to suit multiple data destination. @return a list of {@link JobPlu
src/main/java/com/dp/nebula/wormhole/common/config/JobConf.java:43
↓ 3 callers
Method
info
Get info of line number in {@link IStorage} space. @return Information of line number.
src/main/java/com/dp/nebula/wormhole/engine/storage/RAMStorage.java:228
↓ 3 callers
Method
init
(IParam jobParams)
src/main/java/com/dp/nebula/wormhole/plugins/reader/sftpreader/SftpDirSplitter.java:44
↓ 3 callers
Method
isSuccess
()
src/main/java/com/dp/nebula/wormhole/engine/core/ReaderManager.java:167
↓ 3 callers
Method
loadJobConf
@param filename job configuration name @return a job configure instance with the specified job configuration file
src/main/java/com/dp/nebula/wormhole/common/utils/ParseXMLUtil.java:37
↓ 3 callers
Method
loadPluginConf
Parse plugin configure file. @return a map mapping plugin name to plugin params
src/main/java/com/dp/nebula/wormhole/common/utils/ParseXMLUtil.java:110
↓ 3 callers
Method
read
(ILineSender lineSender)
src/main/java/com/dp/nebula/wormhole/common/interfaces/IReader.java:5
↓ 3 callers
Method
rollbackAll
()
src/main/java/com/dp/nebula/wormhole/engine/core/WriterManager.java:259
↓ 3 callers
Method
setCipherKeyFromFilePath
@param keyFilename @throws IOException
src/main/java/com/dp/nebula/wormhole/plugins/reader/salesforcereader/EncryptionUtil.java:220
↓ 3 callers
Method
setSourceLines
(long lines)
src/main/java/com/dp/nebula/wormhole/common/interfaces/ISourceCounter.java:5
↓ 3 callers
Method
setStartEndRange
(byte[] startKey, byte[] endKey)
src/main/java/com/dp/nebula/wormhole/plugins/reader/hbasereader/HBaseProxy.java:69
↓ 3 callers
Method
setText
(boolean isText)
src/main/java/com/dp/nebula/wormhole/plugins/common/MetaData.java:140
↓ 3 callers
Method
split
()
src/main/java/com/dp/nebula/wormhole/plugins/reader/sftpreader/SftpDirSplitter.java:50
↓ 3 callers
Method
splitColumns
@param der column list from job configure @return comma split column string, can be empty string
src/main/java/com/dp/nebula/wormhole/plugins/writer/mysqlwriter/MysqlWriter.java:342
↓ 3 callers
Method
transform
(ILine line)
src/main/java/com/dp/nebula/wormhole/common/interfaces/ITransformer.java:5
↓ 3 callers
Method
write
(ILineReceiver lineReceiver)
src/main/java/com/dp/nebula/wormhole/common/interfaces/IWriter.java:5
↓ 2 callers
Method
addStorageMonitorCriteria
(String name, Statistics smc)
src/main/java/com/dp/nebula/wormhole/engine/monitor/RealtimeMonitorInfo.java:40
↓ 2 callers
Method
build
()
src/main/java/com/dp/nebula/wormhole/plugins/reader/hivereader/HiveJdbcClient.java:133
↓ 2 callers
Method
bulkInsertToMongo
(DBCollection coll, List<DBObject> dbObjectList)
src/main/java/com/dp/nebula/wormhole/plugins/writer/mongowriter/MongoWriter.java:84
↓ 2 callers
Method
bytesToText
Convert bytes to text @param bytes @return text for the input bytes
src/main/java/com/dp/nebula/wormhole/plugins/reader/salesforcereader/EncryptionUtil.java:62
↓ 2 callers
Method
changeChar
(String str)
src/main/java/com/dp/nebula/wormhole/common/DefaultParam.java:184
↓ 2 callers
Method
clearPutBuffer
()
src/main/java/com/dp/nebula/wormhole/plugins/common/HBaseClient.java:196
↓ 2 callers
Method
closeAll
()
src/main/java/com/dp/nebula/wormhole/plugins/writer/sftpwriter/SftpWriterPeriphery.java:110
↓ 2 callers
Method
closeAll
()
src/main/java/com/dp/nebula/wormhole/plugins/writer/sftpwriter/SftpWriter.java:163
↓ 2 callers
Method
createCipher
Create the cipher object for encryption or decryption. We create a DES cipher with PKCS#5 padding @return Cipher @throws NoSuchAlgorithmException @th
src/main/java/com/dp/nebula/wormhole/plugins/reader/salesforcereader/EncryptionUtil.java:111
↓ 2 callers
Method
createThreadPool
create thread pool to run reader/writer threads @param concurrency @return ExecutorService
src/main/java/com/dp/nebula/wormhole/engine/core/AbstractPluginManager.java:56
↓ 2 callers
Method
decryptString
Decrypt a string using whatever is the default encryption technique for the system. @param cipherText @return The decrypted string @throws NoSuchPadd
src/main/java/com/dp/nebula/wormhole/plugins/reader/salesforcereader/EncryptionUtil.java:166
↓ 2 callers
Method
deleteTableByMode
(int mode)
src/main/java/com/dp/nebula/wormhole/plugins/writer/hbasewriter/HBaseWriterPeriphery.java:73
↓ 2 callers
Method
describeSObject
(String entity)
src/main/java/com/dp/nebula/wormhole/plugins/reader/salesforcereader/SalesforceReader.java:253
↓ 2 callers
Method
doPost
(IParam param, ITargetCounter counter)
src/main/java/com/dp/nebula/wormhole/common/interfaces/ITransmissionPeriphery.java:8
↓ 2 callers
Method
extract
()
src/main/java/com/dp/nebula/wormhole/engine/storage/SingleQueue.java:81
↓ 2 callers
Method
extract
Extract one line of record from the space which contains current data. @return line A line of data.
src/main/java/com/dp/nebula/wormhole/engine/storage/DoubleQueue.java:160
↓ 2 callers
Method
flush
Flush data in buffer (if exists) to {@link Storage}.
src/main/java/com/dp/nebula/wormhole/common/BufferedLineExchanger.java:120
↓ 2 callers
Method
flush
()
src/main/java/com/dp/nebula/wormhole/plugins/common/DBResultSetSender.java:87
↓ 2 callers
Method
fromUnixTime
(long unixTime)
src/main/java/com/dp/nebula/wormhole/transform/utils/FieldTransformUtils.java:12
↓ 2 callers
Method
generateJobConfXml
()
src/main/java/com/dp/nebula/wormhole/common/utils/JobConfGenDriver.java:85
↓ 2 callers
Method
generateKey
Create a DES key and return a string version of the raw bits. @param seed @return A key for encryption @throws NoSuchAlgorithmException
src/main/java/com/dp/nebula/wormhole/plugins/reader/salesforcereader/EncryptionUtil.java:197
↓ 2 callers
Method
getAllKeys
()
src/main/java/com/dp/nebula/wormhole/common/utils/ClassNode.java:78
↓ 2 callers
Method
getAllMembers
()
src/main/java/com/dp/nebula/wormhole/common/utils/ClassNode.java:30
↓ 2 callers
Method
getBufferedLineExchangerInstance
()
src/test/java/com/dp/nebula/wormhole/plugins/reader/hivereader/HiveReaderTest.java:38
↓ 2 callers
Method
getConcurrency
get number of reader/writer threads running concurrently it's determined by parameter concurrency set in job.xml the valid value is between 1 to MAX_T
src/main/java/com/dp/nebula/wormhole/engine/core/AbstractPluginManager.java:39
↓ 2 callers
Method
getConnection
(IParam param)
src/main/java/com/dp/nebula/wormhole/plugins/reader/sqlserverreader/SqlserverReaderPeriphery.java:46
↓ 2 callers
Method
getCryptoKey
Create a key for encryption and decryption @return Key @throws NoSuchAlgorithmException @throws InvalidKeySpecException @throws InvalidKeyException
src/main/java/com/dp/nebula/wormhole/plugins/reader/salesforcereader/EncryptionUtil.java:85
↓ 2 callers
Method
getErrorCode
()
src/main/java/com/dp/nebula/wormhole/engine/core/WriterManager.java:232
↓ 2 callers
Method
getFailedLinesThreshold
(String writerID)
src/main/java/com/dp/nebula/wormhole/engine/core/WriterManager.java:73
↓ 2 callers
Method
getId
Get job id. @return job id.
src/main/java/com/dp/nebula/wormhole/common/config/JobConf.java:87
↓ 2 callers
Method
getInstance
(ILineSender lineSender, IParam param, String readerClassName, String readerPath, IPluginMonitor monitor)
src/main/java/com/dp/nebula/wormhole/engine/core/ReaderThread.java:24
↓ 2 callers
Method
getInstance
(ILineReceiver lineReceiver, IParam param, String writerClassName, String writerPath, IPluginMonitor pm)
src/main/java/com/dp/nebula/wormhole/engine/core/WriterThread.java:24
↓ 2 callers
Method
getLineSpeed
Get average line speed @param lines Line amount @param seconds Costed time. @return Average line speed.
src/main/java/com/dp/nebula/wormhole/engine/storage/Statistics.java:194
↓ 2 callers
Method
getPath
(String[] paths)
src/test/java/com/dp/nebula/wormhole/engine/utils/ReflectionUtilTest.java:55
↓ 2 callers
Method
getPluginDirAsList
(String pluginsDirName)
src/main/java/com/dp/nebula/wormhole/common/utils/JobConfGenDriver.java:47
↓ 2 callers
Method
getPluginName
()
src/main/java/com/dp/nebula/wormhole/common/AbstractPlugin.java:37
↓ 2 callers
Method
getPut
()
src/main/java/com/dp/nebula/wormhole/plugins/common/HBaseClient.java:184
↓ 2 callers
Method
getReadSuccessLines
()
src/main/java/com/dp/nebula/wormhole/engine/monitor/RealtimeMonitorInfo.java:24
↓ 2 callers
Method
getReaderConf
Get reader plugin's configuration. @return a {@link JobPluginConf}.
src/main/java/com/dp/nebula/wormhole/common/config/JobConf.java:20
↓ 2 callers
Method
getSpeed
(long byteNum, double seconds)
src/main/java/com/dp/nebula/wormhole/engine/storage/Statistics.java:165
↓ 2 callers
Method
getStorageMap
()
src/main/java/com/dp/nebula/wormhole/engine/storage/StorageManager.java:28
↓ 2 callers
Method
getSuccessLines
()
src/main/java/com/dp/nebula/wormhole/common/interfaces/IPluginMonitor.java:5
↓ 2 callers
Method
incByteTx
(long i)
src/main/java/com/dp/nebula/wormhole/engine/storage/Statistics.java:104
↓ 2 callers
Method
incLineRRefused
(long lineRRefused)
src/main/java/com/dp/nebula/wormhole/engine/storage/Statistics.java:113
↓ 2 callers
Method
incLineTRefused
(long lineTRefused)
src/main/java/com/dp/nebula/wormhole/engine/storage/Statistics.java:121
↓ 2 callers
Method
incLineTx
(long i)
src/main/java/com/dp/nebula/wormhole/engine/storage/Statistics.java:86
↓ 2 callers
Method
init
(IParam jobParams)
src/main/java/com/dp/nebula/wormhole/common/interfaces/ISplitter.java:7
↓ 2 callers
Method
initialize
()
src/main/java/com/dp/nebula/wormhole/plugins/reader/hivereader/HiveJdbcClient.java:30
↓ 2 callers
Method
insert
(ILine line)
src/main/java/com/dp/nebula/wormhole/engine/storage/SingleQueue.java:63
← previous
next →
101–200 of 874, ranked by callers