Initialize the dataset, which wraps the pymudoc documents. Args: bits (bytes): the bytes of the pdf

Initialize the dataset, which wraps the pymudoc documents. Args: bits (bytes): the bytes of the photo which will be converted to

Initialize the dataset with multiple files (PDFs and images). Args: file_bytes_list (list[bytes]): list of file bytes (PDF or ima

s3 reader client. Args: bucket (str): bucket name ak (str): access key sk (str): secret key e

s3 reader client. Args: bucket (str): bucket name ak (str): access key sk (str): secret key e

Initialized with parent_dir. Args: parent_dir (str, optional): the parent directory that may be used within methods. Defaults to

Initialized with parent_dir. Args: parent_dir (str, optional): the parent directory that may be used within methods. Defaults to

s3 writer client. Args: default_prefix_without_bucket: prefix that not contains bucket bucket (str): bucket name

Initialized with multiple s3 configs. Args: default_prefix (str): the default prefix of the relative path. for example, {some_buc

Yield the page data.

Yield the page doc object.

Yield the page object.

Yield the page object.

The length of the dataset.

The page number of the pdf.

The length of the dataset.

The length of the dataset.

Replace \u0002 and \u0003, as these characters become garbled when extracted using pymupdf. In fact, they were originally quotation marks. Drawbac

Background thread: continuously process request queue

Background thread: continuously process request queue

Apply callable method which. Args: proc (Callable): invoke proc as follows: proc(pipeline_result, *args, **kwargs

Apply callable method which. Args: proc (Callable): invoke proc as follows: proc(inference_result, *args, **kwarg

Synchronous batch inference

Synchronous batch inference

classify the dataset Returns: SupportedPdfParseMethod: _description_

classify the dataset Returns: SupportedPdfParseMethod: _description_

classify the dataset Returns: SupportedPdfParseMethod: _description_

classify the dataset Returns: SupportedPdfParseMethod: _description_

Clear all inputs and outputs

clone this dataset

clone this dataset

clone this dataset

clone this dataset

The pdf bits used to create this dataset.

The pdf bits used to create this dataset.

The pdf bits used to create this dataset.

Decode the base64 string and decompress the json object

Draw line sort. Args: file_path (str): The file location of line sort result file

Draw model inference result. Args: file_path (str): the output file path

draw rectangle. Args: rect_coords (list[float]): four elements array contain the top-left and bottom-right coordinates, [x0, y0,

Dump model inference result to file. Args: writer (DataWriter): writer handle file_path (str): the location of target

Dump model inference result to file. Args: writer (DataWriter): writer handle file_path (str): the location of target

Dump the file Args: file_path (str): the file path

Dump the file Args: file_path (str): the file path

Dump the file Args: file_path (str): the file path

Extract formulas from image or PDF

Extract tables from image or PDF

Get information about each file in the dataset. Returns: list[dict]: List of file information dictionaries containing: