MCPcopy Create free account
hub / github.com/apache/arrow / check_chunked_overflow

Function check_chunked_overflow

python/pyarrow/feather.py:96–109  ·  view source on GitHub ↗
(name, col)

Source from the content-addressed store, hash-verified

94
95
96def check_chunked_overflow(name, col):
97 if col.num_chunks == 1:
98 return
99
100 if col.type in (ext.binary(), ext.string()):
101 raise ValueError(f"Column '{name}' exceeds 2GB maximum capacity of "
102 "a Feather binary column. This restriction may be "
103 "lifted in the future")
104 else:
105 # TODO(wesm): Not sure when else this might be reached
106 raise ValueError(
107 f"Column '{name}' of type {col.type} was chunked on conversion to Arrow "
108 "and cannot be currently written to Feather format"
109 )
110
111
112_FEATHER_SUPPORTED_CODECS = {'lz4', 'zstd', 'uncompressed'}

Callers 1

write_featherFunction · 0.85

Calls 1

stringMethod · 0.45

Tested by

no test coverage detected