MCPcopy Create free account
hub / github.com/apache/arrow / counting_generator

Function counting_generator

python/pyarrow/tests/test_dataset.py:4363–4370  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

4361 keep_going = True
4362
4363 def counting_generator():
4364 nonlocal batches_read
4365 while batches_read < end:
4366 if not keep_going:
4367 return
4368 time.sleep(0.01)
4369 batches_read += 1
4370 yield batch
4371
4372 scanner = ds.Scanner.from_batches(
4373 counting_generator(), schema=schema, use_threads=True)

Callers 1

Calls

no outgoing calls

Tested by

no test coverage detected