Functions — github.com/EFForg/badger-sett

CodeHub MCPcopy Create free account

hub / github.com/EFForg/badger-sett / functions

Functions87 in github.com/EFForg/badger-sett

⨍ Functions 87 ◇ Types & classes 8

↓ 12 callersFunctionextract

lib/basedomain.py:12

↓ 7 callersFunctionget_id

(cur, table, field, value)

↓ 5 callersMethodload_extension_page

Loads Privacy Badger's options page.

↓ 5 callersMethodrestart_browser

crawler.py:1049

↓ 5 callersFunctionrun

Convenience wrapper for getting the output of CLI commands

↓ 4 callersMethodfetch

(self, url, filename, expire_cache_hrs=24)

lib/lists/blocklist.py:37

↓ 4 callersMethodget_sitelist

Get the top n sites from the Tranco list

↓ 4 callersMethodhandle_alerts_and

↓ 4 callersFunctionrun

Convenience wrapper for getting the output of CLI commands

↓ 3 callersMethodcleanup

Remove from snitch map any domains that appear to have been added as a result of bugs.

crawler.py:1176

↓ 3 callersMethoddump_data

Extract the objects Privacy Badger learned during its training run.

↓ 3 callersMethodload_user_data

Load saved user data into Privacy Badger after a restart

↓ 3 callersFunctionwait_for_script

(driver, script, *script_args, execute_async=False, timeout=30, message="Timed out waiting

↓ 2 callersMethodclear_data

Clear the training data Privacy Badger starts with.

↓ 2 callersMethodexists_and_unexpired

(self, filename, expire_cache_hrs)

lib/lists/blocklist.py:27

↓ 2 callersMethodget_current_url

crawler.py:1089

↓ 2 callersFunctionget_error_string

↓ 2 callersFunctionget_scan_id

(cur, start_time, end_time, region, num_sites, browser, no_blocking, daily_scan)

↓ 2 callersFunctionhighlight

lib/linters/mdfp.py:57

↓ 2 callersFunctioningest_log

(cur, scan_id, log_txt)

↓ 2 callersFunctioningest_scan

(cur, scan_id, snitch_map, tracking_map)

↓ 2 callersMethodlog_snitch_map_changes

(self, old_snitches, new_snitches)

crawler.py:1084

↓ 2 callersMethodraise_on_security_pages

Detects and errors out on anti-bot CAPTCHA or challenge pages.

↓ 2 callersMethodscroll_page

↓ 2 callersFunctionshould_restart

↓ 2 callersMethodstart_browser

crawler.py:1016

↓ 2 callersMethodtake_screenshot

↓ 1 callersMethod_download

(self, url, filename)

lib/lists/blocklist.py:14

↓ 1 callersMethodclick_internal_link

↓ 1 callersMethodcrawl

Visit each website in `domains` in a browser with Privacy Badger. When finished, export PB's user data.

crawler.py:1095

↓ 1 callersFunctioncreate_argument_parser

↓ 1 callersFunctioncreate_tables

↓ 1 callersFunctiondismiss_alert

(driver, accept=False)

↓ 1 callersMethodfix_chrome_manifest

Sets extension ID and removes extension storage limit.

↓ 1 callersMethodgather_internal_links

↓ 1 callersFunctionget_browser

↓ 1 callersMethodget_exclude_domains_summary

↓ 1 callersMethodget_firefox_options

↓ 1 callersFunctionget_git_info

↓ 1 callersFunctionget_recently_failed_domains

Returns a set of domains that errored or consistently timed out in recent scans.

↓ 1 callersFunctionget_shared_base_root

lib/linters/mdfp.py:14

↓ 1 callersFunctionget_shared_roots

(site_roots, sbr)

lib/linters/mdfp.py:37

↓ 1 callersFunctionget_site_roots

lib/linters/mdfp.py:26

↓ 1 callersFunctionget_status_string

(match_type, line, full_matching_string)

↓ 1 callersMethodget_tranco_domains

↓ 1 callersFunctionhighlight_common_roots

(base, sites, shared_roots)

lib/linters/mdfp.py:56

↓ 1 callersMethodingest

(self, domain, conf)

lib/lists/ddg.py:20

↓ 1 callersFunctioningest_daily_scans

↓ 1 callersFunctioningest_distributed_scans

(badger_swarm_dir, cur)

↓ 1 callersMethodingest_list

(self, url, filename)

lib/lists/adblocker.py:138

↓ 1 callersMethodinit_logging

(self, log_stdout)

↓ 1 callersFunctioninternal_link

(page_url, link_href)

↓ 1 callersFunctionis_mdfp_first_party

↓ 1 callersFunctionload_fp_cdn_domains

lib/linters/unblocked.py:19

↓ 1 callersFunctionload_mdfp

↓ 1 callersMethodlog_scan_summary

↓ 1 callersFunctionoutliers

lib/linters/site_outliers.py:12

↓ 1 callersFunctionprint_prevalence_summary

sql/prevalent.py:6

↓ 1 callersFunctionprint_trends

sql/trending.py:6

↓ 1 callersMethodprocess_entity

(self, category, entity)

lib/lists/disconnect.py:19

↓ 1 callersMethodprocess_line

lib/lists/adblocker.py:112

↓ 1 callersMethodraise_on_chrome_error_pages

Chrome doesn't automatically raise WebDriverExceptions on error pages. This makes Chrome behave more like Firefox.

↓ 1 callersMethodraise_on_datadome_pages

↓ 1 callersMethodraise_on_imperva_pages

↓ 1 callersMethodsave

(self, data, name='results.json')

crawler.py:1239

↓ 1 callersMethodstart_driver

Starts a new Selenium browser session.

↓ 1 callersMethodtop

tests/sitelist_test.py:12

↓ 1 callersMethodvisit_domain

Visit a domain, then spend `self.wait_time` seconds on the site waiting for dynamic loading to complete.

↓ 1 callersMethodwait_for_pb_to_be_ready

lib/lists/ghostery.py:19

lib/lists/ddg.py:42

lib/lists/disconnect.py:30

lib/lists/adblocker.py:162

Method_load_ext_page

Method_scroll_down

Functionexecute_script

Methodget_sitelist

(self, # pylint:disable=too-many-arguments,too-many-positional-arguments monkeypa

tests/sitelist_test.py:38

(cmd, cwd=None)

tests/sitelist_test.py:53

Methodmock_tranco_list

(self, list_version)

tests/sitelist_test.py:10

Functionprint_warnings

lib/linters/unblocked.py:37

Functionprint_warnings

Looks for and warns about common "roots" (base minus PSL TLD). :param snitch_map: Privacy Badger snitch map

lib/linters/mdfp.py:83

Functionprint_warnings

lib/linters/site_outliers.py:19

Functiontest_crash

Methodtest_excluding_suffixes

(self, monkeypatch, exclude_suffixes, expected)

tests/sitelist_test.py:22

Methodtest_get_recently_failed_domains

(self, monkeypatch)

tests/sitelist_test.py:52