Function _get_index_path

tensorflow_datasets/core/writer.py:100–113

Returns path to the index file of the records stored at the given path. E.g: Say the path to a shard of records (of a particular split) are stored at `your/path/to/records/foo.riegeli-00001-of-00005`, it is transformed into `your/path/to/records/foo.riegeli-00001-of-00005_index.json`. Args

(path: str)

def _get_index_path(path: str) -> epath.PathLike:
  """Returns path to the index file of the records stored at the given path.

  E.g: Say the path to a shard of records (of a particular split) are stored at
  `your/path/to/records/foo.riegeli-00001-of-00005`, it is transformed into
  `your/path/to/records/foo.riegeli-00001-of-00005_index.json`.

  Args:
    path: Path to the record file.

  Returns:
    Path of the index file of a shard of records stored at given path.
  """
  return path + _INDEX_PATH_SUFFIX


def _get_shard_specs(