Functions — github.com/buckyroberts/Spider

CodeHub MCPcopy Create free account

hub / github.com/buckyroberts/Spider / functions

Functions23 in github.com/buckyroberts/Spider

⨍ Functions 23 ◇ Types & classes 2

↓ 4 callersFunctionfile_to_set

↓ 2 callersFunctioncrawl

↓ 2 callersMethodcrawl_page

(thread_name, page_url)

↓ 2 callersFunctionget_domain_name

↓ 2 callersFunctionset_to_file

(links, file_name)

↓ 2 callersFunctionwrite_file

↓ 1 callersMethodadd_links_to_queue

↓ 1 callersMethodboot

↓ 1 callersFunctioncreate_data_files

(project_name, base_url)

↓ 1 callersFunctioncreate_jobs

↓ 1 callersFunctioncreate_project_dir

↓ 1 callersFunctioncreate_workers

↓ 1 callersMethodgather_links

↓ 1 callersFunctionget_sub_domain_name

↓ 1 callersMethodpage_links

link_finder.py:21

↓ 1 callersMethodupdate_files

(self, project_name, base_url, domain_name)

(self, base_url, page_url)

link_finder.py:7

Functionappend_to_file

Functiondelete_file_contents

(self, message)

link_finder.py:24

Methodhandle_starttag

(self, tag, attrs)

link_finder.py:14