MCPcopy Create free account

hub / github.com/alecxe/scrapy-fake-useragent / functions

Functions30 in github.com/alecxe/scrapy-fake-useragent

⨍ Functions 30◇ Types & classes 7
↓ 4 callersMethodfrom_crawler
(cls, crawler)
scrapy_fake_useragent/middleware.py:80
↓ 4 callersMethodget_random_ua
Method needs to be implemented per provider based on BaseProvider.
scrapy_fake_useragent/providers.py:24
↓ 3 callersMethod__init__
(self, crawler)
scrapy_fake_useragent/middleware.py:15
↓ 3 callersMethod__init__
(self, settings)
scrapy_fake_useragent/providers.py:17
↓ 2 callersMethodprocess_request
(self, request, spider)
scrapy_fake_useragent/middleware.py:56
↓ 1 callersMethod_get_provider
(self, crawler)
scrapy_fake_useragent/middleware.py:20
↓ 1 callersMethodprocess_exception
(self, request, exception, spider)
scrapy_fake_useragent/middleware.py:94
↓ 1 callersMethodprocess_response
(self, request, response, spider)
scrapy_fake_useragent/middleware.py:83
Method__init__
(self, crawler)
scrapy_fake_useragent/middleware.py:49
Method__init__
(self, crawler)
scrapy_fake_useragent/middleware.py:75
Method__init__
(self, settings)
scrapy_fake_useragent/providers.py:33
Method__init__
(self, settings)
scrapy_fake_useragent/providers.py:53
Method__init__
(self, settings)
scrapy_fake_useragent/providers.py:78
Functionfake_useragent_always_loads
Mock fake useragent to allow the fake useragent provider to load when testing.
tests/conftest.py:12
Methodfrom_crawler
(cls, crawler)
scrapy_fake_useragent/middleware.py:53
Methodget_random_ua
(self)
scrapy_fake_useragent/providers.py:41
Methodget_random_ua
If the UA type attribute is not found, fake user agent provider falls back to fallback by default. No need to handle Attribut
scrapy_fake_useragent/providers.py:62
Methodget_random_ua
(self)
scrapy_fake_useragent/providers.py:85
Functionmiddleware_request
(fake_useragent_always_loads, request)
tests/conftest.py:67
Functionretry_middleware_exception
Fixture to simplify creating a crawler with an activated retry middleware and going through the request-response cycle. Executes pro
tests/conftest.py:47
Functionretry_middleware_response
Fixture to simplify creating a crawler with an activated middleware and going through the request-response cycle. Executes process_r
tests/conftest.py:26
Functiontest_cannot_load_providers
(mocker)
tests/test_random_ua_middleware/test_load_providers.py:8
Functiontest_faker_bad_type_ua_set
Test FakerProvider with an invalid UA type set. Should still use the default.
tests/test_random_ua_middleware/test_providers/test_faker_provider.py:24
Functiontest_faker_ua_set
Test faker provider working alone.
tests/test_random_ua_middleware/test_providers/test_faker_provider.py:10
Functiontest_fixed_ua_set
(middleware_request)
tests/test_random_ua_middleware/test_providers/test_fixed_provider.py:10
Functiontest_fua_bad_type_ua_set
(middleware_request)
tests/test_random_ua_middleware/test_providers/test_fake_useragent_provider.py:11
Functiontest_random_ua_per_proxy_set
(middleware_request)
tests/test_random_ua_middleware/test_fallback_setting.py:19
Functiontest_random_ua_set
(middleware_request)
tests/test_random_ua_middleware/test_fallback_setting.py:9
Functiontest_random_ua_set_on_exception
(retry_middleware_exception)
tests/test_retry_middleware.py:20
Functiontest_random_ua_set_on_response
(retry_middleware_response)
tests/test_retry_middleware.py:10