MCPcopy Create free account
hub / github.com/apache/arrow / ReconstructChunksWithoutNulls

Function ReconstructChunksWithoutNulls

cpp/src/parquet/arrow/reader_internal.cc:356–365  ·  view source on GitHub ↗

Drop the validity buffer from each chunk. Used when reading a non-nullable field.

Source from the content-addressed store, hash-verified

354///
355/// Used when reading a non-nullable field.
356void ReconstructChunksWithoutNulls(::arrow::ArrayVector* chunks) {
357 for (size_t i = 0; i < chunks->size(); i++) {
358 if ((*chunks)[i]->data()->buffers[0]) {
359 std::shared_ptr<::arrow::ArrayData> data = (*chunks)[i]->data();
360 data->null_count = 0;
361 data->buffers[0] = nullptr;
362 (*chunks)[i] = MakeArray(data);
363 }
364 }
365}
366
367template <typename ArrowType, typename ParquetType>
368void AttachStatistics(::arrow::ArrayData* data,

Callers 4

TransferDictionaryFunction · 0.85
TransferBinaryFunction · 0.85
TransferDecimalFunction · 0.85
TransferFlbaTimestampFunction · 0.85

Calls 3

MakeArrayFunction · 0.50
sizeMethod · 0.45
dataMethod · 0.45

Tested by

no test coverage detected