Functions — github.com/daoqidelv/filespilt-demo

hub / github.com/daoqidelv/filespilt-demo / functions

Functions239 in github.com/daoqidelv/filespilt-demo

⨍ Functions 239◇ Types & classes 34

↓ 10 callersMethodgetLineSize

()

src/main/java/com/daoqidlv/filespilt/mutil/FileLine.java:26

↓ 8 callersMethodgetSubFileSizeLimit

()

src/main/java/com/daoqidlv/filespilt/Master.java:95

↓ 7 callersMethodgenFullFileName

(String fileDir, String fileName)

src/main/java/com/daoqidlv/filespilt/Util.java:43

↓ 6 callersMethodgenSubFileFullName

生成子文件的名称 @param subFileNo —— 子文件编号 @return 子文件名称

src/main/java/com/daoqidlv/filespilt/FileSpiltter.java:99

↓ 5 callersMethodgetLineSize

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileLine.java:31

↓ 5 callersMethodgetToReadSize

()

src/main/java/com/daoqidlv/filespilt/mutil/FileReadTask.java:232

↓ 4 callersMethodcloseFileInputStream

()

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_fos.java:126

↓ 4 callersMethodgetEndFilePointer

()

src/main/java/com/daoqidlv/filespilt/mutil/FileReadTask.java:265

↓ 4 callersMethodgetFileSpiltter

()

src/main/java/com/daoqidlv/filespilt/Master.java:103

↓ 4 callersMethodgetLineContent

()

src/main/java/com/daoqidlv/filespilt/mutil/FileLine.java:34

↓ 3 callersMethodgetFileDir

()

src/main/java/com/daoqidlv/filespilt/single/normal/FileWriteTask.java:88

↓ 3 callersMethodgetFileName

()

src/main/java/com/daoqidlv/filespilt/single/normal/FileWriteTask.java:98

↓ 3 callersMethodisDone

()

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask.java:169

↓ 3 callersMethodopenFileInputStream

()

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_fos.java:112

↓ 3 callersMethodopenWriteByteBuffer

()

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_nio.java:102

↓ 3 callersMethodopenWriteByteBuffer

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask_writeLine_nio.java:102

↓ 3 callersMethodproduceEventToDisruptor

(int lineSize, byte[] lineContent)

src/main/java/com/daoqidlv/filespilt/disruptor/FileReadTask.java:115

↓ 2 callersMethodcloseWriteByteBuffer

()

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_nio.java:120

↓ 2 callersMethodcloseWriteByteBuffer

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask_writeLine_nio.java:120

↓ 2 callersMethodgenSubFileName

生成子文件的名称 @return 子文件名称

src/main/java/com/daoqidlv/filespilt/FileSpiltter.java:80

↓ 2 callersMethodgetLineContent

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileLine.java:39

↓ 2 callersMethodinitFileReadTask

依据原始文件大小及读文件任务数，完成FileReadTask的初始化 @return List<FileReadTask> FileReadTask任务列表

src/main/java/com/daoqidlv/filespilt/mutil/TaskAllocater.java:57

↓ 2 callersMethodisDone

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask.java:175

↓ 2 callersMethodsetLineContent

(byte[] lineContent)

src/main/java/com/daoqidlv/filespilt/disruptor/FileLine.java:43

↓ 2 callersMethodsetLineSize

(int lineSize)

src/main/java/com/daoqidlv/filespilt/disruptor/FileLine.java:35

↓ 2 callersMethodspiltFileLine

从字节缓存中拆分出每一行对应的字节数据，并放入队列 @param inputBuffer 目标字节缓存 @param index 进行拆分的起始字节位置 @param totalSpiltedSize 总共需要进行拆分的字节数 @return index 拆分处理后，最新的待处理字节的起始位置 @t

src/main/java/com/daoqidlv/filespilt/mutil/FileReadTask.java:134

↓ 2 callersMethodtoString

()

src/main/java/com/daoqidlv/filespilt/mutil/FileLine.java:42

↓ 2 callersMethodwriteSubFile

集中一次写入整个子文件

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask.java:96

↓ 2 callersMethodwriteSubFile

集中一次写入整个子文件

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeAll_fos.java:99

↓ 2 callersMethodwriteSubFile

集中一次写入整个子文件

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask.java:97

↓ 1 callersMethodaddConsumerQueue

(BlockingQueue<FileLine> consumerQueue)

src/main/java/com/daoqidlv/filespilt/disruptor/FileLineEventHandler.java:37

↓ 1 callersMethodclone

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileLine.java:47

↓ 1 callersMethodexcute

业务逻辑执行

src/main/java/com/daoqidlv/filespilt/Master.java:77

↓ 1 callersMethodgetBeginFilePointer

()

src/main/java/com/daoqidlv/filespilt/mutil/FileReadTask.java:224

↓ 1 callersMethodgetFileDir

()

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkFileWriteTask.java:87

↓ 1 callersMethodgetFileName

()

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkFileWriteTask.java:97

↓ 1 callersMethodgetFileSize

()

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkFileWriteTask.java:117

↓ 1 callersMethodgetFileSize

()

src/main/java/com/daoqidlv/filespilt/single/normal/FileWriteTask.java:118

↓ 1 callersMethodgetFileWritenSize

()

src/main/java/com/daoqidlv/filespilt/single/normal/FileWriteTask.java:128

↓ 1 callersMethodgetMasterInstance

工厂方法，根据masterType产生master示例 @param masterType master类型 NORMAL —— 返回NormalPoolMaster，使用普通线程池 ThreadPoolExcutor FORKJOIN —— 返回使用ForkJoinPoll PRODU

src/main/java/com/daoqidlv/filespilt/Master.java:46

↓ 1 callersMethodgetQueue

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask.java:183

↓ 1 callersMethodgetReadedSize

()

src/main/java/com/daoqidlv/filespilt/mutil/FileReadTask.java:249

↓ 1 callersMethodgetReadedSize

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileReadTask.java:247

↓ 1 callersMethodgetTaskSeq

()

src/main/java/com/daoqidlv/filespilt/mutil/FileReadTask.java:216

↓ 1 callersMethodgetTotalReadedSize

(List<Future> fileReadFutureList)

src/main/java/com/daoqidlv/filespilt/mutil/MutilThreadReadMaster.java:114

↓ 1 callersMethodgetTotalReadedSize

(List<Future> fileReadFutureList)

src/main/java/com/daoqidlv/filespilt/disruptor/DisruptorMaster.java:251

↓ 1 callersMethodgetTotalWritenSize

(List<Future> fileWriteFutureList)

src/main/java/com/daoqidlv/filespilt/mutil/MutilThreadReadMaster.java:142

↓ 1 callersMethodgetTotalWritenSize

(List<Future> fileWriteFutureList)

src/main/java/com/daoqidlv/filespilt/disruptor/DisruptorMaster.java:279

↓ 1 callersMethodgetWritenSize

()

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask.java:161

↓ 1 callersMethodgetWritenSize

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask.java:167

↓ 1 callersMethodinit

其他初始化操作

src/main/java/com/daoqidlv/filespilt/Master.java:70

↓ 1 callersMethodinitFileReadTask

依据原始文件大小及读文件任务数，完成FileReadTask的初始化 @return List<FileReadTask> FileReadTask任务列表

src/main/java/com/daoqidlv/filespilt/disruptor/DisruptorMaster.java:180

↓ 1 callersMethodinitFileWriteTask

依据指定的readTaskNum初始化文件写入任务列表。 @return List<FileWriteTask> —— 文件写入任务列表

src/main/java/com/daoqidlv/filespilt/mutil/TaskAllocater.java:129

↓ 1 callersMethodinitFileWriteTask

依据指定的readTaskNum初始化文件写入任务列表。 @return List<FileWriteTask> —— 文件写入任务列表

src/main/java/com/daoqidlv/filespilt/disruptor/DisruptorMaster.java:159

↓ 1 callersMethodisNull

判断是否存在null或者空字符串 @param params @return

src/main/java/com/daoqidlv/filespilt/Util.java:13

↓ 1 callersMethodreviseEndFilePointer

修正任务的结束文件指针位置，加上第一个换行符/回车符的偏移量，确保‘完整行’需求 @param endFilePointer @param orginFile @return revisedEndFilePointer —— 修正后的endFilePointer TODO 此方案需要提前给定最大行

src/main/java/com/daoqidlv/filespilt/mutil/TaskAllocater.java:103

↓ 1 callersMethodreviseEndFilePointer

src/main/java/com/daoqidlv/filespilt/disruptor/DisruptorMaster.java:228

↓ 1 callersMethodsetDone

(boolean isDone)

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask.java:173

↓ 1 callersMethodsetDone

(boolean isDone)

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask.java:179

↓ 1 callersMethodspilt

(String lineContent)

src/main/java/com/daoqidlv/filespilt/FileSpiltter.java:56

↓ 1 callersMethodspiltFileLine

src/main/java/com/daoqidlv/filespilt/disruptor/FileReadTask.java:141

↓ 1 callersMethodspiltForFork

(String lineContent)

src/main/java/com/daoqidlv/filespilt/FileSpiltter.java:113

↓ 1 callersMethodswitchSubFile

()

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_fos.java:102

↓ 1 callersMethodswitchSubFile

()

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_nio.java:133

↓ 1 callersMethodswitchSubFile

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask_writeLine_nio.java:133

↓ 1 callersMethodwriteSubFile

(FileLine fileLine)

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_fos.java:137

↓ 1 callersMethodwriteSubFile

(FileLine fileLine)

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_nio.java:139

↓ 1 callersMethodwriteSubFile

(FileLine fileLine)

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask_writeLine_nio.java:139

MethodDisruptorMaster

(String fileDir, String fileName, int subFileSizeLimit, int readTaskNum, int writeTaskNum, int queueSize, int

src/main/java/com/daoqidlv/filespilt/disruptor/DisruptorMaster.java:52

MethodFileLine

(int lineSize, byte[] lineContent)

src/main/java/com/daoqidlv/filespilt/mutil/FileLine.java:21

MethodFileLine

(int lineSize, byte[] lineContent)

src/main/java/com/daoqidlv/filespilt/disruptor/FileLine.java:21

MethodFileLineEventHandler

(List<BlockingQueue<FileLine>> consumerQueues)

src/main/java/com/daoqidlv/filespilt/disruptor/FileLineEventHandler.java:19

MethodFileReadTask

(int taskSeq, int beginFilePointer, int endFilePointer, String orignFileFullName, BlockingQueue<FileLine> queu

src/main/java/com/daoqidlv/filespilt/mutil/FileReadTask.java:56

MethodFileReadTask

(int taskSeq, int beginFilePointer, int endFilePointer, String orignFileFullName, Disruptor<FileLine> disrupto

src/main/java/com/daoqidlv/filespilt/disruptor/FileReadTask.java:55

MethodFileSpiltter

(int subFileSizeLimit, String fileDir, String fileNameTemplate)

src/main/java/com/daoqidlv/filespilt/FileSpiltter.java:48

MethodFileWriteTask

(int taskSeq, FileSpiltter fileSpiltter, BlockingQueue<FileLine> queue)

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask.java:135

MethodFileWriteTask

(String fileDir, String fileName, List<String> fileContent, int fileSize)

src/main/java/com/daoqidlv/filespilt/single/normal/FileWriteTask.java:44

MethodFileWriteTask

(int taskSeq, FileSpiltter fileSpiltter, BlockingQueue<FileLine> queue)

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask.java:141

MethodFileWriteTask_writeAll_fos

(int taskSeq, FileSpiltter fileSpiltter, BlockingQueue<FileLine> queue)

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeAll_fos.java:134

MethodFileWriteTask_writeLine_fos

(int taskSeq, FileSpiltter fileSpiltter, BlockingQueue<FileLine> queue)

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_fos.java:159

MethodFileWriteTask_writeLine_nio

(int taskSeq, FileSpiltter fileSpiltter, BlockingQueue<FileLine> queue)

src/main/java/com/daoqidlv/filespilt/mutil/FileWriteTask_writeLine_nio.java:150

MethodFileWriteTask_writeLine_nio

(int taskSeq, FileSpiltter fileSpiltter, BlockingQueue<FileLine> queue)

src/main/java/com/daoqidlv/filespilt/disruptor/FileWriteTask_writeLine_nio.java:150

MethodForkFileReadTask

(String fullFileName, FileSpiltter fileSpiltter)

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkFileReadTask.java:34

MethodForkFileWriteTask

(String fileDir, String fileName, List<String> fileContent, int fileSize)

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkFileWriteTask.java:41

MethodForkJoinPoolMaster

(String fileDir, String fileName, int subFileSizeLimit)

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkJoinPoolMaster.java:25

MethodMaster

(String fileDir, String fileName, int subFileSizeLimit)

src/main/java/com/daoqidlv/filespilt/Master.java:30

MethodMutilThreadReadMaster

(String fileDir, String fileName, int subFileSizeLimit, int readTaskNum, int writeTaskNum, int queueSize)

src/main/java/com/daoqidlv/filespilt/mutil/MutilThreadReadMaster.java:42

MethodNormalPoolMaster

(String fileDir, String fileName, int subFileSizeLimit)

src/main/java/com/daoqidlv/filespilt/single/normal/NormalPoolMaster.java:37

MethodTaskAllocater

(String orignFileFullName, int readTaskNum, int writeTaskNum, int maxLineSize, FileSpiltter fileSpiltter, Bloc

src/main/java/com/daoqidlv/filespilt/mutil/TaskAllocater.java:44

MethodWriteFileTask

(String fileName, int offset, int size)

src/test/java/com/daoqidlv/filespilt/GenBigFile.java:31

Methodcompute

使用fork/join模式完成文件读/写的并行操作。 @return true —— 操作成功 false —— 操作失败

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkFileReadTask.java:44

Methodcompute

()

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkFileWriteTask.java:49

Methodexcute

()

src/main/java/com/daoqidlv/filespilt/mutil/MutilThreadReadMaster.java:60

Methodexcute

()

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkJoinPoolMaster.java:30

Methodexcute

()

src/main/java/com/daoqidlv/filespilt/single/normal/NormalPoolMaster.java:43

Methodexcute

()

src/main/java/com/daoqidlv/filespilt/disruptor/DisruptorMaster.java:87

MethodgetBeginFilePointer

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileReadTask.java:222

MethodgetConsumerQueues

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileLineEventHandler.java:29

MethodgetEndFilePointer

()

src/main/java/com/daoqidlv/filespilt/disruptor/FileReadTask.java:263

MethodgetFileContent

()

src/main/java/com/daoqidlv/filespilt/single/forkjoin/ForkFileWriteTask.java:107

next →1–100 of 239, ranked by callers