MCPcopy Create free account
hub / github.com/BIT-DataLab/LakeBench / query_online

Function query_online

join&union/Frt12/online_process/all_schema_com5.py:202–260  ·  view source on GitHub ↗
(query_folder_path, query_label_folder_path, fnames, can_label_second_column, can_entity_list,
can_all_att, one_att_freq, two_att_freq, top_k)

Source from the content-addressed store, hash-verified

200
201
202def query_online(query_folder_path, query_label_folder_path, fnames, can_label_second_column, can_entity_list,
203can_all_att, one_att_freq, two_att_freq, top_k):
204 all_query_result = []
205 query_csv_files = os.listdir(query_folder_path)
206 join = []
207 for filename in tqdm(query_csv_files):
208 query_label_path = os.path.join(query_label_folder_path, filename)
209
210 query_label_df = pd.read_csv(query_label_path, low_memory=False, lineterminator='\n')
211
212 query_path = os.path.join(query_folder_path, filename)
213
214 query_df = pd.read_csv(query_path, low_memory=False, lineterminator='\n')
215
216 query_attribute = read_att(query_path)
217
218
219 query_label_second_column = read_sencond_column(query_label_df)
220
221 query_entity = read_first_column(query_label_df)
222
223
224 result, join_dict = all_schema(fnames, can_label_second_column, query_label_second_column, can_entity_list, query_entity,
225 query_attribute, can_all_att, one_att_freq, two_att_freq, top_k)
226
227 count = 0
228 for item in result:
229 mid = []
230 mid_list = join_dict[count]
231 count += 1
232 mid.append(filename)
233 mid.append(item)
234 mid.append(mid_list[0])
235 mid.append(mid_list[1])
236 join.append(mid)
237 # join.append(join_dict)
238 # print(join_dict)
239
240 return join
241
242
243
244
245 # for value in result.values():
246 # join_list1 = []
247 # join_list1.append(filename)
248 # join_list1.append(value)
249
250 # # join.append(filename)
251 # index = -1
252 # if value in my_list:
253 # index = my_list.index(fnames)
254 # can_att = can_all_att[index]
255 # max_att1, max_att2 = can_pairs(query_attribute, can_att)
256 # join_list1.append(max_att1)
257 # join_list1.append(max_att2)
258 # join.append(join_list1)
259

Callers

nothing calls this directly

Calls 4

read_attFunction · 0.70
read_sencond_columnFunction · 0.70
read_first_columnFunction · 0.70
all_schemaFunction · 0.70

Tested by

no test coverage detected