MCPcopy Index your code
hub / github.com/PrathamLearnsToCode/paper2code / get_dataloaders

Function get_dataloaders

skills/paper2code/worked/ddpm/src/data.py:58–111  ·  view source on GitHub ↗

Create CIFAR-10 train and test dataloaders. §4 — CIFAR-10 unconditional generation at 32×32 §4 — "batch size 128" [FROM_OFFICIAL_CODE — paper does not state batch size] Args: data_dir: Root directory for dataset download/cache batch_size: Batch size for training

(
    data_dir: str = "./data",
    batch_size: int = 128,
    num_workers: int = 4,
    image_size: int = 32,
)

Source from the content-addressed store, hash-verified

56
57
58def get_dataloaders(
59 data_dir: str = "./data",
60 batch_size: int = 128,
61 num_workers: int = 4,
62 image_size: int = 32,
63) -> Tuple[DataLoader, DataLoader]:
64 """Create CIFAR-10 train and test dataloaders.
65
66 §4 — CIFAR-10 unconditional generation at 32×32
67 §4 — "batch size 128" [FROM_OFFICIAL_CODE — paper does not state batch size]
68
69 Args:
70 data_dir: Root directory for dataset download/cache
71 batch_size: Batch size for training
72 num_workers: Number of data loading workers
73 image_size: Image resolution (32 for CIFAR-10)
74
75 Returns:
76 (train_loader, test_loader)
77 """
78 train_transform, test_transform = get_cifar10_transforms(image_size)
79
80 train_dataset = datasets.CIFAR10(
81 root=data_dir,
82 train=True,
83 download=True,
84 transform=train_transform,
85 )
86
87 test_dataset = datasets.CIFAR10(
88 root=data_dir,
89 train=False,
90 download=True,
91 transform=test_transform,
92 )
93
94 train_loader = DataLoader(
95 train_dataset,
96 batch_size=batch_size,
97 shuffle=True,
98 num_workers=num_workers,
99 pin_memory=True,
100 drop_last=True, # [ASSUMPTION] drop incomplete last batch for stable training
101 )
102
103 test_loader = DataLoader(
104 test_dataset,
105 batch_size=batch_size,
106 shuffle=False,
107 num_workers=num_workers,
108 pin_memory=True,
109 )
110
111 return train_loader, test_loader

Callers 1

trainFunction · 0.90

Calls 1

get_cifar10_transformsFunction · 0.85

Tested by

no test coverage detected