MCPcopy Create free account

hub / github.com/clovaai/webvicob / functions

Functions83 in github.com/clovaai/webvicob

⨍ Functions 83◇ Types & classes 3
↓ 13 callersFunctionencode
(string_data)
webvicob/lmdb_maker.py:79
↓ 6 callersFunctionadd_style
(driver, style)
webvicob/wikipedia/wikipedia.py:661
↓ 6 callersFunctiondraw_rectangle
(image, boxes, max_hw=None)
webvicob/wikipedia/wikipedia.py:604
↓ 6 callersMethodget
(self, key)
webvicob/lmdb_maker.py:29
↓ 5 callersMethodput
(self, key, value)
webvicob/lmdb_maker.py:54
↓ 4 callersFunctionadd_inline_style
(driver, selector, key, value, important=False)
webvicob/wikipedia/wikipedia.py:668
↓ 3 callersFunctiondecode
(string_data)
webvicob/lmdb_maker.py:83
↓ 2 callersFunction_checkcontinue
계속해서 박스를 줄여 나갈지 말 지 결정
webvicob/shrinkbox.py:99
↓ 2 callersFunction_get_points_value
Return list of values of cordinates in linepoints
webvicob/shrinkbox.py:84
↓ 2 callersFunction_linspace2d
두 2D 점 사이의 등간격 점 좌표들을 반환 sampling 수는 point1과 point2의 거리로 계산
webvicob/shrinkbox.py:71
↓ 2 callersFunctionbbox2quad
x1y1x2y2 to quad
webvicob/wikipedia/wikipedia.py:1187
↓ 2 callersFunctionget_enclosing_bbox
(bbox_coords_list)
webvicob/wikipedia/wikipedia.py:1148
↓ 2 callersFunctionget_glyph_ratio
(font_path, char)
webvicob/wikipedia/wikipedia.py:976
↓ 2 callersFunctionget_jsonl_paths
(original_data_path, target_lang)
webvicob/wikipedia/wikipedia.py:271
↓ 2 callersMethodget_num_data
(self)
webvicob/lmdb_maker.py:51
↓ 2 callersFunctionhtml_generator
(workspace, target_lang, shm_name, chunk_idx, total_chunk, html_section_chunker)
webvicob/wikipedia/wikipedia.py:224
↓ 2 callersFunctionis_intersect
(bbox_coords1: List, bbox_coords2: List)
webvicob/wikipedia/wikipedia.py:1166
↓ 2 callersMethodput_annots
(self, annots, idx)
webvicob/lmdb_maker.py:67
↓ 2 callersMethodput_html
(self, html, idx)
webvicob/lmdb_maker.py:61
↓ 2 callersMethodput_img
(self, img_buffer, idx)
webvicob/lmdb_maker.py:64
↓ 2 callersMethodput_raw_html
(self, raw_html, idx)
webvicob/lmdb_maker.py:58
↓ 2 callersFunctionstretch_box
x 방향으로 box y 크기만큼 bbox_coords 를 늘려줌
webvicob/wikipedia/wikipedia.py:1178
↓ 1 callersFunction_add_boxes
(soup, elem)
webvicob/wikipedia/wikipedia.py:627
↓ 1 callersFunction_distance
l2 distance
webvicob/shrinkbox.py:104
↓ 1 callersFunction_unitlinenormal
Apply -90deg rotation of vec(pnt1, pnt2) and normalize Args: pnt1 (NDArray[float32]): 시계방향 기준 pnt2 다음 point (1, 2) pnt2 (NDArray[f
webvicob/shrinkbox.py:89
↓ 1 callersFunctionadd_boxes
(html)
webvicob/wikipedia/wikipedia.py:626
↓ 1 callersFunctioncapture
(driver, capture_width, capture_height_limit)
webvicob/wikipedia/wikipedia.py:464
↓ 1 callersFunctionchange_paragraph_fonts
(driver, js_font_paths)
webvicob/wikipedia/wikipedia.py:718
↓ 1 callersFunctioncreate_annotation
(image, boxes, font2path, shrink_heuristic, lang)
webvicob/wikipedia/wikipedia.py:899
↓ 1 callersFunctionexecute_js
(driver, remove_background, unroll_contents, change_para_font, js_font_paths)
webvicob/wikipedia/wikipedia.py:436
↓ 1 callersMethodextract_section_indexes
(self, html, sections)
webvicob/wikipedia/chunker.py:82
↓ 1 callersMethodextract_sections
(self, sections, cur_depth=0)
webvicob/wikipedia/chunker.py:72
↓ 1 callersMethodextract_title_tag
(self, html: str)
webvicob/wikipedia/chunker.py:48
↓ 1 callersFunctionfinal_line_structuring
(nested_annots, lines)
webvicob/wikipedia/wikipedia.py:1094
↓ 1 callersMethodget_annots
(self, idx)
webvicob/lmdb_maker.py:46
↓ 1 callersFunctionget_boxes
(driver)
webvicob/wikipedia/wikipedia.py:828
↓ 1 callersFunctionget_driver
Get google chrome driver. # for chromium options # https://peter.sh/experiments/chromium-command-line-switches/ # https://chromium.g
webvicob/wikipedia/wikipedia.py:300
↓ 1 callersFunctionget_font_paths
(font_dir_path, debug)
webvicob/wikipedia/wikipedia.py:195
↓ 1 callersMethodget_img
(self, idx)
webvicob/lmdb_maker.py:40
↓ 1 callersFunctionget_version_str
(target_lang, num_train, chunk_idx)
webvicob/wikipedia/wikipedia.py:1129
↓ 1 callersFunctionhuman_format
(num)
webvicob/wikipedia/wikipedia.py:1138
↓ 1 callersFunctionline_grouping
(cl_boxes)
webvicob/wikipedia/wikipedia.py:1034
↓ 1 callersFunctionload_html
(driver, html, tmp_path, unlink=True)
webvicob/wikipedia/wikipedia.py:456
↓ 1 callersFunctionmain
( workspace="./", target_lang="ja", num_train=-1, num_val=0, num_test=0, debug=False,
webvicob/wikipedia/wikipedia.py:48
↓ 1 callersFunctionmake_para_polys
(boxes)
webvicob/wikipedia/wikipedia.py:1003
↓ 1 callersMethodmerge_into_chunks
(self, sections, html_front, html_back)
webvicob/wikipedia/chunker.py:104
↓ 1 callersFunctionmodify_html
(html)
webvicob/wikipedia/wikipedia.py:431
↓ 1 callersFunctionmp_job
(inp)
webvicob/wikipedia/wikipedia.py:341
↓ 1 callersMethodput_num_data
(self, num_data)
webvicob/lmdb_maker.py:70
↓ 1 callersFunctionquad2bbox
quad to x1y1x2y2
webvicob/wikipedia/wikipedia.py:1201
↓ 1 callersMethodread_jsonl
(self, idx)
webvicob/wikipedia/wikipedia.py:292
↓ 1 callersFunctionremove_background_image
(driver)
webvicob/wikipedia/wikipedia.py:790
↓ 1 callersFunctionremove_border_bottom
(driver)
webvicob/wikipedia/wikipedia.py:768
↓ 1 callersFunctionremove_element
(driver, selector)
webvicob/wikipedia/wikipedia.py:709
↓ 1 callersFunctionremove_flexbox
(driver)
webvicob/wikipedia/wikipedia.py:817
↓ 1 callersFunctionremove_float
(driver)
webvicob/wikipedia/wikipedia.py:808
↓ 1 callersFunctionremove_position
(driver)
webvicob/wikipedia/wikipedia.py:799
↓ 1 callersFunctionremove_pseudo_element
(driver)
webvicob/wikipedia/wikipedia.py:777
↓ 1 callersFunctionreplace_html
(html, target_lang)
webvicob/wikipedia/wikipedia.py:243
↓ 1 callersFunctionresize_to_final_width
(jpeg, annots, final_width, capture_width)
webvicob/wikipedia/wikipedia.py:402
↓ 1 callersFunctionshrink_height
(image, boxes, font2path, shrink_heuristic)
webvicob/wikipedia/wikipedia.py:927
↓ 1 callersFunctionshrinkbox
Perform shrink_box Args: gray: grayscaled image quad: quadrangle (4, 2) use_otsu (bool): OTSU threshold를 사용할 지 말지.
webvicob/shrinkbox.py:10
↓ 1 callersFunctionupdate_invisible_element_priority
(driver)
webvicob/wikipedia/wikipedia.py:678
↓ 1 callersFunctionvisualize
(img, annots, save=False, idx=0, max_hw=1600)
webvicob/wikipedia/wikipedia.py:495
↓ 1 callersFunctionvisualize_char
(image, annots, max_hw=None)
webvicob/wikipedia/wikipedia.py:523
↓ 1 callersFunctionvisualize_images
(image, annots, max_hw=None)
webvicob/wikipedia/wikipedia.py:535
↓ 1 callersFunctionvisualize_latex
(image, annots, max_hw=None)
webvicob/wikipedia/wikipedia.py:594
↓ 1 callersFunctionvisualize_line
(image, annots, max_hw=None)
webvicob/wikipedia/wikipedia.py:574
↓ 1 callersFunctionvisualize_paras
(image, annots, max_hw=None)
webvicob/wikipedia/wikipedia.py:544
↓ 1 callersFunctionvisualize_tables
(image, annots, max_hw=None)
webvicob/wikipedia/wikipedia.py:565
↓ 1 callersFunctionvisualize_words_wo_latex
(image, annots, max_hw=None)
webvicob/wikipedia/wikipedia.py:583
↓ 1 callersFunctionword_grouping
(intermediate_lines, lang)
webvicob/wikipedia/wikipedia.py:1054
↓ 1 callersMethodwrap_up
(self)
webvicob/lmdb_maker.py:73
Method__call__
(self, html: str)
webvicob/wikipedia/chunker.py:28
Method__init__
(self, lmdb_path: Path, readonly=False, verbose=True)
webvicob/lmdb_maker.py:19
Method__init__
( self, min_section_tokens: int = 100, min_section_chars: int = None, append_t
webvicob/wikipedia/chunker.py:15
Method__init__
(self, jsonl_file_path)
webvicob/wikipedia/wikipedia.py:282
Function_regex_srcset_handler
(m)
webvicob/wikipedia/wikipedia.py:253
Methodextract_children_tag_names
(self, html: str, parent_name: str = None)
webvicob/wikipedia/chunker.py:59
Methodget_html
(self, idx)
webvicob/lmdb_maker.py:37
Methodget_raw_html
(self, idx)
webvicob/lmdb_maker.py:34
Functionget_total_size
(workspace, target_lang, chunk_idx, total_chunk)
webvicob/wikipedia/wikipedia.py:210
Functiontest_basic
()
tests/test_basic.py:9