Function chunks

codegeex/mindspore/src/preprocess.py:32–35 · view source on GitHub ↗

yield n sized chunks from list

(lst, n)

Source from the content-addressed store, hash-verified

30
31
32	def chunks(lst, n):
33	"""yield n sized chunks from list"""
34	for i in range(0, len(lst), n):
35	yield lst[i: i + n]
36
37
38	def package_file(it, n):

tokenize_openwebtextFunction · 0.85

tokenize_wikiFunction · 0.85

tokenize_lambadaFunction · 0.85

no outgoing calls

no test coverage detected