hub / github.com/raviqqe/muffet
github.com/raviqqe/muffet @v2.11.5 sqlite
327 symbols
1,429 edges
76 files
4 documented · 1%
README
Muffet
Muffet is a website link checker which scrapes and inspects all pages in a website recursively.
Features
- Massive speed
- High compatibility with web browsers
- Different tag support (
a,img,link,script, etc) - Multiple output formats (text, JSON, and JUnit XML)
Install
go install github.com/raviqqe/muffet/v2@latest
For more information, see the install page.
Usage
muffet https://shady.bakery.hotland
For more information including usage on Docker and GitHub Actions, see the usage page.
License
Extension points exported contracts — how you extend this code
—
Core symbols most depended-on inside this repo
Parsecalled by 90
page_parser.go
Get
called by 27
http_client.go
Run
called by 24
command.go
Add
called by 21
daemon_manager.go
Fetch
called by 21
link_fetcher.go
Find
called by 16
link_finder.go
URL
called by 14
page.go
newHtmlPageParser
called by 14
html_page_parser.go
Shape
Languages
Go100%
Modules by API surface
command_test.go19 symbols
link_finder_test.go17 symbols
link_fetcher_test.go15 symbols
html_page_parser_test.go12 symbols
redirect_http_client_test.go10 symbols
retry_http_client_test.go8 symbols
fake_http_response_test.go8 symbols
command.go8 symbols
page_result_formatter_test.go7 symbols
link_fetcher.go7 symbols
sitemap_page_parser_test.go6 symbols
page_result_formatter.go6 symbols
Dependencies from manifests, versioned
github.com/andybalholm/brotliv1.2.1 · 1×
github.com/benbjohnson/clockv1.3.0 · 1×
github.com/bradleyjkemp/cupaloyv2.3.0+incompatible · 1×
github.com/breml/rootcertsv0.3.5 · 1×
github.com/davecgh/go-spewv1.1.1 · 1×
github.com/jessevdk/go-flagsv1.6.1 · 1×
github.com/klauspost/compressv1.18.6 · 1×
github.com/kr/textv0.2.0 · 1×
github.com/logrusorgru/aurora/v3v3.0.0 · 1×
github.com/mattn/go-colorablev0.1.15 · 1×
github.com/mattn/go-isattyv0.0.22 · 1×
github.com/niemeyer/prettyv0.0.0-2020022712484 · 1×
For agents
$ claude mcp add muffet \
-- python -m otcore.mcp_server <graph>