MCPcopy Create free account
hub / github.com/apache/arrow / ReconstructChunksWithoutNulls

Function ReconstructChunksWithoutNulls

cpp/src/parquet/arrow/reader_internal.cc:355–364  ·  view source on GitHub ↗

Drop the validity buffer from each chunk. Used when reading a non-nullable field.

Source from the content-addressed store, hash-verified

353///
354/// Used when reading a non-nullable field.
355void ReconstructChunksWithoutNulls(::arrow::ArrayVector* chunks) {
356 for (size_t i = 0; i < chunks->size(); i++) {
357 if ((*chunks)[i]->data()->buffers[0]) {
358 std::shared_ptr<::arrow::ArrayData> data = (*chunks)[i]->data();
359 data->null_count = 0;
360 data->buffers[0] = nullptr;
361 (*chunks)[i] = MakeArray(data);
362 }
363 }
364}
365
366template <typename ArrowType, typename ParquetType>
367void AttachStatistics(::arrow::ArrayData* data,

Callers 3

TransferDictionaryFunction · 0.85
TransferBinaryFunction · 0.85
TransferDecimalFunction · 0.85

Calls 3

MakeArrayFunction · 0.50
sizeMethod · 0.45
dataMethod · 0.45

Tested by

no test coverage detected