Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/Mamdouh66/Extracty
/ functions
Functions
11 in github.com/Mamdouh66/Extracty
⨍
Functions
11
◇
Types & classes
3
↓ 2 callers
Method
__clean_html_content
Cleans the HTML content by removing unwanted tags, extracting text from wanted tags, and removing unnecessary lines. Args:
extracty/scraper.py:22
↓ 2 callers
Method
__get_content
Retrieves the content of a web page using a WebScraper object. Returns: str: The content of the web page. Raise
extracty/llm_extractor.py:68
↓ 1 callers
Method
__call_openai
( self, prompt: list[dict], pydantic_schema: Type[T], api_key: str, gpt_model: str )
extracty/llm_extractor.py:130
↓ 1 callers
Method
__create_pydantic_model
Create a Pydantic model dynamically based on fields provided. Args: fields (Dict[str, Type]): A dictionary containing th
extracty/llm_extractor.py:91
↓ 1 callers
Method
__generate_prompt
(self, content: str)
extracty/llm_extractor.py:117
↓ 1 callers
Method
scraping_with_langchain
Scrapes the content of a web page using Requests. Args: wanted_tags (list[str], optional): List of HTML tags to extract
extracty/scraper.py:71
Method
__async_run_content
Runs the __get_content method asynchronously and returns the content. Returns: str: The content obtained from the __get_
extracty/llm_extractor.py:142
Method
__init__
(self, url: HttpUrl)
extracty/scraper.py:19
Method
__init__
Initializes an instance of the LLMExtractor class. Args: query (str): The query string used for extraction.
extracty/llm_extractor.py:43
Method
ascraping_with_playwright
Scrapes the content of a web page using Playwright. Args: wanted_tags (list[str], optional): List of HTML tags to extrac
extracty/scraper.py:97
Method
extract
Extracts data from a web page using the OpenAI API. Returns: dict: The extracted data. Raises: Time
extracty/llm_extractor.py:155