Function cache

python/paddle/reader/decorator.py:75–112

Cache the reader data into memory. Be careful that this method may take long time to process, and consume lots of memory. :code:`reader()` would only call once. Args: reader (generator): a reader object which yields data each time. Returns: gen

(reader: _Reader[_T])

def cache(reader: _Reader[_T]) -> _Reader[_T]:
    """
    Cache the reader data into memory.

    Be careful that this method may take long time to process,
    and consume lots of memory. :code:`reader()` would only
    call once.

    Args:
        reader (generator): a reader object which yields
            data each time.

    Returns:
        generator: a decorated reader object which yields data from cached memory.

    Examples:
        .. code-block:: pycon

            >>> import paddle

            >>> def reader():
            ...     for i in range(3):
            ...         yield i
            >>> # All data is cached into memory
            >>> cached_reader = paddle.base.io.cache(reader)

            >>> for i in cached_reader():
            ...     print(i)
            0
            1
            2
    """
    all_data = tuple(reader())

    def __impl__() -> Generator[_T, None, None]:
        yield from all_data

    return __impl__


# A temporary solution like builtin map function.