MCPcopy
hub / github.com/unclecode/crawl4ai / scrap

Method scrap

crawl4ai/content_scrapping_strategy.py:33–34  ·  view source on GitHub ↗
(self, url: str, html: str, **kwargs)

Source from the content-addressed store, hash-verified

31
32class WebScrappingStrategy(ContentScrappingStrategy):
33 def scrap(self, url: str, html: str, **kwargs) -> Dict[str, Any]:
34 return self._get_content_of_website_optimized(url, html, is_async=False, **kwargs)
35
36 async def ascrap(self, url: str, html: str, **kwargs) -> Dict[str, Any]:
37 return await asyncio.to_thread(self._get_content_of_website_optimized, url, html, **kwargs)

Callers 1

aprocess_htmlMethod · 0.95

Tested by

no test coverage detected