MCPcopy Create free account
hub / github.com/apache/arrow / check_chunked_overflow

Function check_chunked_overflow

python/pyarrow/feather.py:106–119  ·  view source on GitHub ↗
(name, col)

Source from the content-addressed store, hash-verified

104
105
106def check_chunked_overflow(name, col):
107 if col.num_chunks == 1:
108 return
109
110 if col.type in (ext.binary(), ext.string()):
111 raise ValueError(f"Column '{name}' exceeds 2GB maximum capacity of "
112 "a Feather binary column. This restriction may be "
113 "lifted in the future")
114 else:
115 # TODO(wesm): Not sure when else this might be reached
116 raise ValueError(
117 f"Column '{name}' of type {col.type} was chunked on conversion to Arrow "
118 "and cannot be currently written to Feather format"
119 )
120
121
122_FEATHER_SUPPORTED_CODECS = {'lz4', 'zstd', 'uncompressed'}

Callers 1

write_featherFunction · 0.85

Calls 1

stringMethod · 0.45

Tested by

no test coverage detected