MCPcopy Create free account
hub / github.com/apache/arrow / check_chunked_overflow

Function check_chunked_overflow

python/pyarrow/feather.py:97–110  ·  view source on GitHub ↗
(name, col)

Source from the content-addressed store, hash-verified

95
96
97def check_chunked_overflow(name, col):
98 if col.num_chunks == 1:
99 return
100
101 if col.type in (ext.binary(), ext.string()):
102 raise ValueError(f"Column '{name}' exceeds 2GB maximum capacity of "
103 "a Feather binary column. This restriction may be "
104 "lifted in the future")
105 else:
106 # TODO(wesm): Not sure when else this might be reached
107 raise ValueError(
108 f"Column '{name}' of type {col.type} was chunked on conversion to Arrow "
109 "and cannot be currently written to Feather format"
110 )
111
112
113_FEATHER_SUPPORTED_CODECS = {'lz4', 'zstd', 'uncompressed'}

Callers 1

write_featherFunction · 0.85

Calls 1

stringMethod · 0.45

Tested by

no test coverage detected