Function
_sanitize_table
(table, new_schema, flavor)
Source from the content-addressed store, hash-verified
| 743 | |
| 744 | |
| 745 | def _sanitize_table(table, new_schema, flavor): |
| 746 | # TODO: This will not handle prohibited characters in nested field names |
| 747 | if 'spark' in flavor: |
| 748 | column_data = [table[i] for i in range(table.num_columns)] |
| 749 | return pa.Table.from_arrays(column_data, schema=new_schema) |
| 750 | else: |
| 751 | return table |
| 752 | |
| 753 | |
| 754 | _parquet_writer_arg_docs = """version : {"1.0", "2.4", "2.6"}, default "2.6" |
Tested by
no test coverage detected