MCPcopy Create free account
hub / github.com/apache/arrow / counting_generator

Function counting_generator

python/pyarrow/tests/test_dataset.py:4370–4377  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

4368 keep_going = True
4369
4370 def counting_generator():
4371 nonlocal batches_read
4372 while batches_read < end:
4373 if not keep_going:
4374 return
4375 time.sleep(0.01)
4376 batches_read += 1
4377 yield batch
4378
4379 scanner = ds.Scanner.from_batches(
4380 counting_generator(), schema=schema, use_threads=True)

Callers 1

Calls

no outgoing calls

Tested by

no test coverage detected