MCPcopy Create free account
hub / github.com/google-research/language / process_table

Function process_table

language/xsp/data_preprocessing/schema_utils.py:164–180  ·  view source on GitHub ↗

Processes a schema table into a DatabaseTable object.

(table_name, columns, tokenizer, aligned_schema_entities)

Source from the content-addressed store, hash-verified

162
163
164def process_table(table_name, columns, tokenizer, aligned_schema_entities):
165 """Processes a schema table into a DatabaseTable object."""
166 table_obj = DatabaseTable()
167 table_obj.original_table_name = table_name
168
169 table_obj.matches_to_utterance = table_obj.original_table_name.lower(
170 ).replace('_', ' ') in aligned_schema_entities
171
172 # Name wordpieces. Remove underscores then tokenize.
173 table_obj.table_name_wordpieces.extend(
174 get_wordpieces(table_name.replace('_', ' '), tokenizer)[0])
175
176 table_obj.table_columns.extend(
177 process_columns(columns, tokenizer, table_obj.original_table_name,
178 aligned_schema_entities))
179
180 return table_obj
181
182
183def process_tables(schema, tokenizer, aligned_schema_entities):

Callers 1

process_tablesFunction · 0.70

Calls 4

get_wordpiecesFunction · 0.90
DatabaseTableClass · 0.85
process_columnsFunction · 0.85
replaceMethod · 0.80

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…