MCPcopy
hub / github.com/mosaicml/composer / ensure_data_spec

Function ensure_data_spec

composer/core/data_spec.py:321–336  ·  view source on GitHub ↗

Ensures that the ``dataloader`` is a :class:`.DataSpec`. Args: dataloader (DataSpec | Iterable | dict): A DataSpec, DataLoader, or dict of DataSpec kwargs. Returns: DataSpec: A DataSpec

(dataloader: Union[DataSpec, Iterable, dict])

Source from the content-addressed store, hash-verified

319
320
321def ensure_data_spec(dataloader: Union[DataSpec, Iterable, dict]) -> DataSpec:
322 """Ensures that the ``dataloader`` is a :class:`.DataSpec`.
323
324 Args:
325 dataloader (DataSpec | Iterable | dict): A DataSpec, DataLoader, or dict of DataSpec kwargs.
326
327 Returns:
328 DataSpec: A DataSpec
329 """
330 if isinstance(dataloader, dict):
331 # treat as kwargs for DataSpec
332 dataloader = DataSpec(**dataloader)
333 if not isinstance(dataloader, DataSpec):
334 dataloader = DataSpec(dataloader)
335
336 return dataloader

Callers 3

__init__Method · 0.90
__init__Method · 0.90
fitMethod · 0.90

Calls 1

DataSpecClass · 0.85

Tested by

no test coverage detected