MCPcopy Create free account

hub / github.com/Mamdouh66/Extracty / functions

Functions11 in github.com/Mamdouh66/Extracty

↓ 2 callersMethod__clean_html_content
Cleans the HTML content by removing unwanted tags, extracting text from wanted tags, and removing unnecessary lines. Args:
extracty/scraper.py:22
↓ 2 callersMethod__get_content
Retrieves the content of a web page using a WebScraper object. Returns: str: The content of the web page. Raise
extracty/llm_extractor.py:68
↓ 1 callersMethod__call_openai
( self, prompt: list[dict], pydantic_schema: Type[T], api_key: str, gpt_model: str )
extracty/llm_extractor.py:130
↓ 1 callersMethod__create_pydantic_model
Create a Pydantic model dynamically based on fields provided. Args: fields (Dict[str, Type]): A dictionary containing th
extracty/llm_extractor.py:91
↓ 1 callersMethod__generate_prompt
(self, content: str)
extracty/llm_extractor.py:117
↓ 1 callersMethodscraping_with_langchain
Scrapes the content of a web page using Requests. Args: wanted_tags (list[str], optional): List of HTML tags to extract
extracty/scraper.py:71
Method__async_run_content
Runs the __get_content method asynchronously and returns the content. Returns: str: The content obtained from the __get_
extracty/llm_extractor.py:142
Method__init__
(self, url: HttpUrl)
extracty/scraper.py:19
Method__init__
Initializes an instance of the LLMExtractor class. Args: query (str): The query string used for extraction.
extracty/llm_extractor.py:43
Methodascraping_with_playwright
Scrapes the content of a web page using Playwright. Args: wanted_tags (list[str], optional): List of HTML tags to extrac
extracty/scraper.py:97
Methodextract
Extracts data from a web page using the OpenAI API. Returns: dict: The extracted data. Raises: Time
extracty/llm_extractor.py:155