Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/alibaba/DataX
/ functions
Functions
5,539 in github.com/alibaba/DataX
⨍
Functions
5,539
◇
Types & classes
1,122
↓ 3 callers
Method
wait4Submit
(final Future<Boolean> future)
gdbwriter/src/main/java/com/alibaba/datax/plugin/writer/gdbwriter/GdbWriter.java:209
↓ 2 callers
Function
_afterpoint
Symbols after a decimal point, -1 if the string lacks the decimal point. >>> _afterpoint("123.45") 2 >>> _afterpoint("1001") -1 >
otsstreamreader/tools/tabulate.py:409
↓ 2 callers
Function
_bool
A wrapper around standard bool() which doesn't throw on NumPy arrays
otsstreamreader/tools/tabulate.py:638
↓ 2 callers
Function
_isconvertible
(conv, string)
otsstreamreader/tools/tabulate.py:340
↓ 2 callers
Function
_isnumber
>>> _isnumber("123.45") True >>> _isnumber("123") True >>> _isnumber("spam") False
otsstreamreader/tools/tabulate.py:348
↓ 2 callers
Function
_pad_row
(cells, padding)
otsstreamreader/tools/tabulate.py:1114
↓ 2 callers
Function
_pprint_file
(fobject, headers, tablefmt, sep, floatfmt, file)
otsstreamreader/tools/tabulate.py:1230
↓ 2 callers
Method
addAuth
(Request request, String username, String password)
tsdbwriter/src/main/java/com/alibaba/datax/plugin/writer/util/HttpUtils.java:73
↓ 2 callers
Method
addAuth
(Request request, String username, String password)
tsdbreader/src/main/java/com/alibaba/datax/plugin/reader/tsdbreader/util/HttpUtils.java:72
↓ 2 callers
Method
addBatchRecords
(final List<Record> records)
obhbasewriter/src/main/java/com/alibaba/datax/plugin/writer/obhbasewriter/task/ObHBaseWriteTask.java:289
↓ 2 callers
Method
addColumn
(ColumnType columnType, ValueType type, String name)
gdbreader/src/main/java/com/alibaba/datax/plugin/reader/gdbreader/mapping/MappingRule.java:37
↓ 2 callers
Method
addCommonHeader
()
selectdbwriter/src/main/java/com/alibaba/datax/plugin/writer/selectdbwriter/HttpPutBuilder.java:40
↓ 2 callers
Method
addCount
(long count)
common/src/main/java/com/alibaba/datax/common/statistics/PerfRecord.java:114
↓ 2 callers
Method
addPart
(Odps odps, Table table, String partition)
odpswriter/src/main/java/com/alibaba/datax/plugin/writer/odpswriter/util/OdpsUtil.java:196
↓ 2 callers
Method
addRecordsToWriteQueue
@param records @return 返回一个新的Cache用于存储接下来的数据
oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/task/ConcurrentTableWriterTask.java:274
↓ 2 callers
Method
addSecretKeyPath
按照configuration要求格式的path 比如: a.b.c a.b[2].c @param path
common/src/main/java/com/alibaba/datax/common/util/Configuration.java:715
↓ 2 callers
Method
addSize
(long size)
common/src/main/java/com/alibaba/datax/common/statistics/PerfRecord.java:118
↓ 2 callers
Method
addSourceFileByType
(String filePath)
hdfsreader/src/main/java/com/alibaba/datax/plugin/reader/hdfsreader/DFSUtil.java:221
↓ 2 callers
Method
addTaskDetails
(int taskId, String detail)
common/src/main/java/com/alibaba/datax/common/statistics/PerfTrace.java:100
↓ 2 callers
Method
adjustChannelNumber
()
core/src/main/java/com/alibaba/datax/core/job/JobContainer.java:416
↓ 2 callers
Method
appedSuffixTo
(String currentObject)
osswriter/src/main/java/com/alibaba/datax/plugin/writer/osswriter/OssWriter.java:1110
↓ 2 callers
Method
appendCommit
()
plugin-unstructured-storage-util/src/main/java/com/alibaba/datax/plugin/unstructuredstorage/writer/SqlWriter.java:63
↓ 2 callers
Method
asBigDecimal
()
common/src/main/java/com/alibaba/datax/common/element/StringColumn.java:81
↓ 2 callers
Method
asBigInteger
()
common/src/main/java/com/alibaba/datax/common/element/LongColumn.java:61
↓ 2 callers
Method
asLong
()
common/src/main/java/com/alibaba/datax/common/element/BoolColumn.java:45
↓ 2 callers
Method
asSqlParserException
(DataBaseType dataBaseType, Exception e,String querySql)
plugin-rdbms-util/src/main/java/com/alibaba/datax/plugin/rdbms/util/RdbmsException.java:124
↓ 2 callers
Method
assertLabels
(Configuration config)
gdbreader/src/main/java/com/alibaba/datax/plugin/reader/gdbreader/util/ConfigHelper.java:46
↓ 2 callers
Method
asyncExecuteWithRetry
在外部线程执行并且重试。每次执行需要在timeoutMs内执行完,不然视为失败。 执行异步操作的线程池从外部传入,线程池的共享粒度由外部控制。比如,HttpClientUtil共享一个线程池。 <p/> 限制条件:仅仅能够在阻塞的时候interrupt线程 @param callable
common/src/main/java/com/alibaba/datax/common/util/RetryUtil.java:68
↓ 2 callers
Method
baseAuth
(String user, String password)
selectdbwriter/src/main/java/com/alibaba/datax/plugin/writer/selectdbwriter/HttpPutBuilder.java:45
↓ 2 callers
Method
batchCommitRecords
(final List<Tuple2<Record, GdbElement>> records)
gdbwriter/src/main/java/com/alibaba/datax/plugin/writer/gdbwriter/GdbWriter.java:221
↓ 2 callers
Method
batchPut
(final Record record, final String dps)
tsdbwriter/src/main/java/com/alibaba/datax/plugin/writer/tsdbwriter/TSDBWriter.java:319
↓ 2 callers
Method
beginTx
()
gdbwriter/src/main/java/com/alibaba/datax/plugin/writer/gdbwriter/model/AbstractGdbGraph.java:100
↓ 2 callers
Method
bigIntegerToString
(BigInteger baseValue, BigInteger bValue, BigInteger multi, int lenOfString)
otsreader/src/main/java/com/alibaba/datax/plugin/reader/otsreader/utils/RangeSplit.java:19
↓ 2 callers
Method
bind
设置pluginConfigs,方便后面插件来获取 @param pluginConfigs
core/src/main/java/com/alibaba/datax/core/util/container/LoadUtil.java:59
↓ 2 callers
Method
build
()
hbase094xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase094xreader/HbaseColumnCell.java:118
↓ 2 callers
Method
build3DesKey
根据字符串生成密钥字节数组 @param keyStr 密钥字符串 @return key 符合DESede标准的24byte数组
core/src/main/java/com/alibaba/datax/core/util/SecretUtil.java:249
↓ 2 callers
Method
buildFilePath
(String path, String fileName, String suffix)
plugin-unstructured-storage-util/src/main/java/com/alibaba/datax/plugin/unstructuredstorage/writer/UnstructuredStorageWriterUtil.java:146
↓ 2 callers
Method
buildFilePath
()
txtfilewriter/src/main/java/com/alibaba/datax/plugin/writer/txtfilewriter/TxtFileWriter.java:312
↓ 2 callers
Method
buildFilePath
()
hdfswriter/src/main/java/com/alibaba/datax/plugin/writer/hdfswriter/HdfsWriter.java:273
↓ 2 callers
Method
buildKey
构建key 构建数据为空时当做脏数据处理
ocswriter/src/main/java/com/alibaba/datax/plugin/writer/ocswriter/OcsWriter.java:242
↓ 2 callers
Method
buildOneRecord
(RecordSender recordSender, List<String> columns)
streamreader/src/main/java/com/alibaba/datax/plugin/reader/streamreader/StreamReader.java:309
↓ 2 callers
Method
buildPut
(Put put, Record record)
obhbasewriter/src/main/java/com/alibaba/datax/plugin/writer/obhbasewriter/task/PutTask.java:199
↓ 2 callers
Method
buildQuerySql
(List<String> columnNames, String table, String where)
hbase20xsqlreader/src/main/java/com/alibaba/datax/plugin/reader/hbase20xsqlreader/HBase20SQLReaderHelper.java:246
↓ 2 callers
Method
buildQuerySql
(boolean weakRead, String column, String table, String where)
oceanbasev10reader/src/main/java/com/alibaba/datax/plugin/reader/oceanbasev10reader/util/ObReaderUtils.java:841
↓ 2 callers
Method
buildTransformerInfo
(ComplexTransformer complexTransformer, boolean isNative, ClassLoader classLoader)
core/src/main/java/com/alibaba/datax/core/transport/transformer/TransformerRegistry.java:167
↓ 2 callers
Method
buildValue
构建value 如果有二进制字段当做脏数据处理 如果col为null,当做脏数据处理
ocswriter/src/main/java/com/alibaba/datax/plugin/writer/ocswriter/OcsWriter.java:205
↓ 2 callers
Method
buildWriteSql
@param tableName @param columnHolders @param conn @param writeMode @return
oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/util/ObWriterUtils.java:243
↓ 2 callers
Method
byte2hex
(byte[] b)
common/src/main/java/com/alibaba/datax/common/util/DESCipher.java:206
↓ 2 callers
Method
calcValueHolder
(String columnType)
plugin-rdbms-util/src/main/java/com/alibaba/datax/plugin/rdbms/writer/CommonRdbmsWriter.java:580
↓ 2 callers
Method
calculate
计算 Partition Id @param record @return Long
oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/part/IObPartCalculator.java:18
↓ 2 callers
Method
call
()
otsreader/src/main/java/com/alibaba/datax/plugin/reader/otsreader/callable/GetRangeCallable.java:20
↓ 2 callers
Method
canClose
()
oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/ext/OBDataSourceV10.java:179
↓ 2 callers
Method
canSplitSingleFile
(Configuration jobConfig)
ossreader/src/main/java/com/alibaba/datax/plugin/reader/ossreader/util/OssSplitUtil.java:61
↓ 2 callers
Method
cancelAll
()
oceanbasev10reader/src/main/java/com/alibaba/datax/plugin/reader/oceanbasev10reader/util/ExecutorTemplate.java:184
↓ 2 callers
Method
charToByte
(char c)
doriswriter/src/main/java/com/alibaba/datax/plugin/writer/doriswriter/DelimiterParser.java:51
↓ 2 callers
Method
charToByte
(char c)
selectdbwriter/src/main/java/com/alibaba/datax/plugin/writer/selectdbwriter/DelimiterParser.java:51
↓ 2 callers
Method
charToByte
(char c)
starrockswriter/src/main/java/com/starrocks/connector/datax/plugin/writer/starrockswriter/row/StarRocksDelimiterParser.java:51
↓ 2 callers
Method
check
Fast check the future @param f
oceanbasev10reader/src/main/java/com/alibaba/datax/plugin/reader/oceanbasev10reader/util/ExecutorTemplate.java:217
↓ 2 callers
Method
checkAndGetPrimaryKey
( List<PrimaryKeyColumn> pk, List<PrimaryKeySchema> pkSchema, String jsonK
otsreader/src/main/java/com/alibaba/datax/plugin/reader/otsreader/utils/ParamChecker.java:256
↓ 2 callers
Method
checkColumnByMode
(List<OTSColumn> columns , OTSMode mode)
otsreader/src/main/java/com/alibaba/datax/plugin/reader/otsreader/utils/ParamChecker.java:157
↓ 2 callers
Method
checkFileNameIfRepeatedThrowException
校验文件名是否有重复的,如果有重复的文件名则抛出异常 @param fileNameList
plugin-unstructured-storage-util/src/main/java/com/alibaba/datax/plugin/unstructuredstorage/writer/binaryFileUtil/BinaryFileWriterUtil.java:80
↓ 2 callers
Method
checkFinish
()
obhbasewriter/src/main/java/com/alibaba/datax/plugin/writer/obhbasewriter/task/ObHBaseWriteTask.java:256
↓ 2 callers
Method
checkFinish
()
oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/task/ConcurrentTableWriterTask.java:411
↓ 2 callers
Method
checkHbaseTable
(Admin admin, TableName hTableName)
hbase11xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase11xreader/Hbase11xHelper.java:146
↓ 2 callers
Method
checkHbaseTable
(HBaseAdmin admin, HTable hTable)
hbase094xwriter/src/main/java/com/alibaba/datax/plugin/writer/hbase094xwriter/Hbase094xHelper.java:146
↓ 2 callers
Method
checkIfBInA
(List<String> aList, List<String> bList, boolean caseSensitive)
common/src/main/java/com/alibaba/datax/common/util/ListUtil.java:65
↓ 2 callers
Method
checkIfBetweenRange
(int value, int left, int right)
common/src/main/java/com/alibaba/datax/common/util/RangeSplitUtil.java:95
↓ 2 callers
Method
checkIfHasSameValue
(List<String> listA, List<String> listB)
common/src/main/java/com/alibaba/datax/common/util/ListUtil.java:141
↓ 2 callers
Method
checkIfValueSame
(List<Boolean> aList)
common/src/main/java/com/alibaba/datax/common/util/ListUtil.java:111
↓ 2 callers
Method
checkMemStore
()
oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/task/ConcurrentTableWriterTask.java:291
↓ 2 callers
Method
checkMemstore
()
oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/task/InsertTask.java:204
↓ 2 callers
Method
checkName
(String functionName, boolean isNative)
core/src/main/java/com/alibaba/datax/core/transport/transformer/TransformerRegistry.java:149
↓ 2 callers
Method
checkNecessaryConfig
(Configuration originalConfig, String writeMode)
adswriter/src/main/java/com/alibaba/datax/plugin/writer/adswriter/util/AdsUtil.java:26
↓ 2 callers
Method
checkProcessorRunningStatus
(List<RecordProcessor> processors)
otsstreamreader/src/main/java/com/alibaba/datax/plugin/reader/otsstreamreader/internal/OTSStreamReaderSlaveProxy.java:253
↓ 2 callers
Method
checkRecordLimit
(Communication communication)
core/src/main/java/com/alibaba/datax/core/util/ErrorRecordChecker.java:48
↓ 2 callers
Method
checkSplitDsl
(final boolean firstAdd, final int requestLength, final int attachLength, final int appendLength, fi
gdbwriter/src/main/java/com/alibaba/datax/plugin/writer/gdbwriter/model/ScriptGdbGraph.java:142
↓ 2 callers
Method
checkSplitPk
检测splitPk的配置是否正确。 configuration为null, 是precheck的逻辑,不需要回写PK_TYPE到configuration中
plugin-rdbms-util/src/main/java/com/alibaba/datax/plugin/rdbms/reader/util/SingleTableSplitUtil.java:176
↓ 2 callers
Method
checkTable
检查表 @param conn @param namespace @param tableName @param isThinClient @throws DataXException
hbase11xsqlwriter/src/main/java/com/alibaba/datax/plugin/writer/hbase11xsqlwriter/HbaseSQLHelper.java:265
↓ 2 callers
Method
checkTableExists
(SyncClientInterface ots, String tableName, boolean isTimeseriesTable)
otsstreamreader/src/main/java/com/alibaba/datax/plugin/reader/otsstreamreader/internal/utils/OTSHelper.java:106
↓ 2 callers
Method
checkTableStoreSDKVersion
()
otsreader/src/main/java/com/alibaba/datax/plugin/reader/otsreader/utils/Common.java:120
↓ 2 callers
Method
chooseJdbcUrlWithoutRetry
(final DataBaseType dataBaseType, final List<String> jdbcUrls, final St
plugin-rdbms-util/src/main/java/com/alibaba/datax/plugin/rdbms/util/DBUtil.java:84
↓ 2 callers
Method
clearBatch
Clear batch is always recreate a new {@link ObDirectLoadBucket}
oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/directPath/DirectPathPreparedStatement.java:116
↓ 2 callers
Method
clearParameters
Clear the holder parameters. @throws SQLException
oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/directPath/DirectPathPreparedStatement.java:127
↓ 2 callers
Method
close
关闭函数,释放资源
otsreader/src/main/java/com/alibaba/datax/plugin/reader/otsreader/IOtsReaderSlaveProxy.java:18
↓ 2 callers
Method
closeAdmin
(Admin admin)
hbase11xsqlwriter/src/main/java/com/alibaba/datax/plugin/writer/hbase11xsqlwriter/HbaseSQLHelper.java:314
↓ 2 callers
Method
closeAdmin
(Admin admin)
hbase11xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase11xreader/Hbase11xHelper.java:112
↓ 2 callers
Method
closeAdmin
(HBaseAdmin admin)
hbase094xwriter/src/main/java/com/alibaba/datax/plugin/writer/hbase094xwriter/Hbase094xHelper.java:127
↓ 2 callers
Method
closeJestClient
关闭JestClient客户端
elasticsearchwriter/src/main/java/com/alibaba/datax/plugin/writer/elasticsearchwriter/ElasticSearchClient.java:303
↓ 2 callers
Method
closeRegionLocator
(RegionLocator regionLocator)
hbase11xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase11xreader/Hbase11xHelper.java:136
↓ 2 callers
Method
closeTable
(Table table)
hbase11xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase11xreader/Hbase11xHelper.java:121
↓ 2 callers
Method
closeTable
(HTable table)
hbase094xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase094xreader/Hbase094xHelper.java:103
↓ 2 callers
Method
closeTable
(Table table)
hbase11xwriter/src/main/java/com/alibaba/datax/plugin/writer/hbase11xwriter/Hbase11xHelper.java:175
↓ 2 callers
Method
columnName
(String columnName)
obhbasereader/src/main/java/com/alibaba/datax/plugin/reader/obhbasereader/HbaseColumnCell.java:105
↓ 2 callers
Method
columnName
(String columnName)
hbase11xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase11xreader/HbaseColumnCell.java:103
↓ 2 callers
Method
columnName
(String columnName)
hbase094xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase094xreader/HbaseColumnCell.java:103
↓ 2 callers
Method
columnToColumnValue
(Column c)
otswriter/src/main/java/com/alibaba/datax/plugin/writer/otswriter/utils/ColumnConversion.java:42
↓ 2 callers
Method
columnToPrimaryKeyValue
(Column c, PrimaryKeySchema col)
otswriter/src/main/java/com/alibaba/datax/plugin/writer/otswriter/utils/ColumnConversion.java:21
↓ 2 callers
Method
columnValue
(String columnValue)
obhbasereader/src/main/java/com/alibaba/datax/plugin/reader/obhbasereader/HbaseColumnCell.java:110
↓ 2 callers
Method
columnValue
(String columnValue)
hbase11xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase11xreader/HbaseColumnCell.java:108
↓ 2 callers
Method
columnValue
(String columnValue)
hbase094xreader/src/main/java/com/alibaba/datax/plugin/reader/hbase094xreader/HbaseColumnCell.java:108
← previous
next →
801–900 of 5,539, ranked by callers