This function appends the byte to the output character data buffer @param data current byte read

Get next byte from stream. Also maintains the current line count. Will throw a StreamFinishedPseudoException when the stream has run out of bytes. @

Execute a time-critical operation op within time timeout. Causes the query to fail completely if the operation times out. @param op a Function that re

Helper method to check if the buffer we are accessing has a minimum reference count and has not been deallocated @param b working drill buffer

Number of lines read since the start of this split. @return

Get next byte from stream. Do no maintain any line count Will throw a StreamFinishedPseudoException when the stream has run out of bytes. @return ne

Skip forward the number of line delimiters. If you are in the middle of a line, a value of 1 will skip to the start of the next record. @param lines

Read more data into the buffer. Will also manage split end conditions. @throws IOException

Clean up needs to be performed before closing writer. Partially written data will be removed.

Shortcut that lets the output know that we are closing ending a field with no data. @return true if engine should continue processing record. false i

The number of valid records to be parsed before the process is stopped. A negative value indicates there's no limit (defaults to -1). @return the numb

Helper method to get the most recent characters consumed since the last record started. May get an incomplete string since we don't support stream rew

Parses the next record from the input. Will skip the line if its a comment, this is required when the file contains headers @throws IOException

{@inheritDoc}

Given an invalid header, rewrite it to replace illegal characters with valid ones. The header won't be what the user specified, but it will be a valid

Helper function to skip white spaces occurring at the current input stream. @throws IOException

Starting point for the reader. Sets up the input interface. @throws IOException

Start processing a new field within a record. @param index index within the record

Add the provided data but drop any whitespace. @param data

Will be called at the end of every schema write Flush data to IPFS @throws IOException

Cleanup state once we are finished processing all the records. This would internally close the input stream we are reading from.

{@inheritDoc}

End processing a field within a record. @return true if engine should continue processing record. false if rest of record can be skipped.

This method is responsible to implement logic for extracting header from text file Currently it is assumed to be first line if headerExtractionEnabled

commit written data and wrap up in a new IPFS object @throws IOException

Does any final cleanup that is required for closing a batch. Example might include closing the last field.

Completes the processing of a given record. Also completes the processing of the last field being read.

Returns the field delimiter character. Defaults to ',' @return the field delimiter character