Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/YoongiKim/AutoCrawler
/ functions
Functions
26 in github.com/YoongiKim/AutoCrawler
⨍
Functions
26
◇
Types & classes
3
↓ 4 callers
Method
remove_duplicates
(_list)
collect_links.py:88
↓ 3 callers
Method
get_scroll
(self)
collect_links.py:63
↓ 3 callers
Method
highlight
(self, element)
collect_links.py:83
↓ 2 callers
Method
base64_to_object
(src)
main.py:162
↓ 2 callers
Method
naver_full
(self, keyword, add_url="")
collect_links.py:246
↓ 2 callers
Method
wait_and_click
(self, xpath)
collect_links.py:67
↓ 1 callers
Method
all_dirs
(path)
main.py:85
↓ 1 callers
Method
all_files
(path)
main.py:94
↓ 1 callers
Method
do_crawling
(self)
main.py:269
↓ 1 callers
Method
download_from_site
(self, keyword, site_code)
main.py:221
↓ 1 callers
Method
download_images
(self, keyword, links, site_name, max_count=0)
main.py:167
↓ 1 callers
Method
get_extension_from_link
(link, default='jpg')
main.py:104
↓ 1 callers
Method
get_face_url
(code)
main.py:48
↓ 1 callers
Method
get_keywords
(keywords_file='keywords.txt')
main.py:133
↓ 1 callers
Method
get_text
(code)
main.py:37
↓ 1 callers
Method
google
(self, keyword, add_url="")
collect_links.py:91
↓ 1 callers
Method
google_full
(self, keyword, add_url="", limit=100)
collect_links.py:173
↓ 1 callers
Method
imbalance_check
(self)
main.py:309
↓ 1 callers
Method
make_dir
(dirname)
main.py:126
↓ 1 callers
Method
naver
(self, keyword, add_url="")
collect_links.py:138
↓ 1 callers
Method
save_object_to_file
(object, file_path, is_base64=False)
main.py:151
↓ 1 callers
Method
validate_image
(path)
main.py:119
Method
__init__
(self, no_gui=False, proxy=None)
collect_links.py:30
Method
__init__
:param skip_already_exist: Skips keyword already downloaded before. This is needed when re-downloading. :param n_threads: Number of
main.py:56
Method
download
(self, args)
main.py:263
Method
init_worker
(self)
main.py:266