MCPcopy Create free account
hub / github.com/apache/arrow / counting_generator

Function counting_generator

python/pyarrow/tests/test_dataset.py:4366–4373  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

4364 keep_going = True
4365
4366 def counting_generator():
4367 nonlocal batches_read
4368 while batches_read < end:
4369 if not keep_going:
4370 return
4371 time.sleep(0.01)
4372 batches_read += 1
4373 yield batch
4374
4375 scanner = ds.Scanner.from_batches(
4376 counting_generator(), schema=schema, use_threads=True)

Callers 1

Calls

no outgoing calls

Tested by

no test coverage detected