Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/Marketscrape/marketscrape-web
/ functions
Functions
41 in github.com/Marketscrape/marketscrape-web
⨍
Functions
41
◇
Types & classes
8
↓ 3 callers
Function
create_soup
Create a BeautifulSoup object from a URL. Args: url (str): URL of the page to scrape headers (dict): Dictionary of headers t
scraper/utils.py:44
↓ 2 callers
Method
listing_product_similarity
Returns a dictionary of all products listed on the page that are similar to the given title. Args: soup (BeautifulSoup):
scraper/shop_class.py:370
↓ 1 callers
Function
clean_text
Remove non-ASCII characters from title and description fields. Args: title (str): Title of the item. Returns: str: Clea
scraper/utils.py:28
↓ 1 callers
Method
construct_candidates
Constructs a list of candidates from the descriptions, prices, and countries. Args: descriptions: The descriptio
scraper/shop_class.py:262
↓ 1 callers
Function
create_bargraph
Creates a word cloud visualization based on a list of countries. Args: countries (list[str]): A list of countries to be used to gene
scraper/utils.py:285
↓ 1 callers
Function
create_chart
Creates a line chart visualization based on the categorized items, their prices, and their descriptions. Args: categorized (dict): A
scraper/utils.py:160
↓ 1 callers
Method
create_url
Creates a URL to search for a product on Ebay and retrieves the corresponding page using BeautifulSoup. Args: self: The
scraper/shop_class.py:11
↓ 1 callers
Method
filter_products_by_similarity
Filters a list of products based on their similarity to a target product title. Args: product_info (list): A list of pro
scraper/shop_class.py:338
↓ 1 callers
Method
find_viable_product
Finds viable products based on the title of the Marketplace listing, and utilizes the ramp down of the previous product in the sequen
scraper/shop_class.py:289
↓ 1 callers
Method
get
(self, request)
scraper/views.py:9
↓ 1 callers
Method
get_listing_category
Retrieves the category of a product listing. Args: self: The instance of the class. Returns: The ca
scraper/marketplace_class.py:106
↓ 1 callers
Method
get_listing_city
Retrieves the city where a product is located. Args: self: The instance of the class. Returns: The
scraper/marketplace_class.py:63
↓ 1 callers
Method
get_listing_condition
Retrieves the condition of a product listing. Args: self: The instance of the class. Returns: The c
scraper/marketplace_class.py:76
↓ 1 callers
Method
get_listing_currency
Retrieves the currency of a product listing. Args: self: The instance of the class. Returns: The cu
scraper/marketplace_class.py:135
↓ 1 callers
Method
get_listing_date
Retrieves the listing date of a product. Args: self: The instance of the class. Returns: A tuple co
scraper/marketplace_class.py:148
↓ 1 callers
Method
get_listing_description
Retrieves the description of a product listing. Args: self: The instance of the class. Returns: The
scraper/marketplace_class.py:50
↓ 1 callers
Method
get_listing_image
Retrieves the image of a product listing. Args: self: The instance of the class. Returns: The URL o
scraper/marketplace_class.py:119
↓ 1 callers
Method
get_listing_price
Retrieves the price of a product listing. Args: self: The instance of the class. Returns: The price
scraper/marketplace_class.py:24
↓ 1 callers
Method
get_listing_title
Retrieves the title of a product listing. Args: self: The instance of the class. Returns: The title
scraper/marketplace_class.py:37
↓ 1 callers
Method
get_product_condition
Extracts the conditions of each product from the HTML Args: soup: The HTML to extract the condition from. Retur
scraper/shop_class.py:67
↓ 1 callers
Method
get_product_country
Returns the product country in the soup. Args: soup: a BeautifulSoup object containing a product page Returns:
scraper/shop_class.py:117
↓ 1 callers
Method
get_product_info
Extracts product information from the page and returns a list of dictionaries. Each dictionary contains the following keys:
scraper/shop_class.py:193
↓ 1 callers
Method
get_product_price
Extracts the price of each product from the HTML. Args: soup: The HTML to extract the price from. R
scraper/shop_class.py:44
↓ 1 callers
Method
get_product_shipping
Extracts the shipping cost of each product from the HTML. Args: soup: The HTML to extract the shipping cost from.
scraper/shop_class.py:86
↓ 1 callers
Method
get_product_title
Returns the product description in the soup. Args: soup: a BeautifulSoup object containing a product page Retur
scraper/shop_class.py:29
↓ 1 callers
Method
get_similarity
Compares two titles using the SequenceMatcher class from the difflib module. The similarity is returned as a float between 0 and 1.
scraper/shop_class.py:137
↓ 1 callers
Function
isValidUrl
(url)
scraper/static/isValidUrl.js:1
↓ 1 callers
Method
is_listing_missing
Checks if a listing is missing. Args: self: The instance of the class. Returns: True if the listing
scraper/marketplace_class.py:192
↓ 1 callers
Method
lowest_price_highest_similarity
Finds the lowest price and the highest similarity of the filtered prices and descriptions. Args: filtered_prices
scraper/shop_class.py:230
↓ 1 callers
Function
main
Run administrative tasks.
manage.py:7
↓ 1 callers
Function
percentage_difference
Returns a dictionary of both the percentage difference between the listing price and the best found price via Ebay, and whether or not the di
scraper/utils.py:130
↓ 1 callers
Function
price_difference_rating
The rating is based on the difference between the initial and final price. The rating is 0 if the final price is greater than the initial
scraper/utils.py:91
↓ 1 callers
Function
reject_outliers
This function rejects outliers from the input list of data. The outliers are rejected using the Tukey method, which defines the outliers as t
scraper/utils.py:60
↓ 1 callers
Function
remove_illegal_characters
Clean a listing title by removing punctuation and converting to lowercase. Args: title: The listing title to clean. Returns:
scraper/utils.py:12
↓ 1 callers
Method
remove_outliers
Removes outliers from a set of data consisting of titles, prices, and countries. Args: titles (list[str]): A list of tit
scraper/shop_class.py:165
Method
__init__
(self, mobile_soup, base_soup)
scraper/marketplace_class.py:7
Method
__init__
(self)
scraper/shop_class.py:6
Function
clearTable
()
scraper/static/hideTable.js:1
Function
filterTable
()
scraper/static/filterSearchResults.js:1
Method
post
(self, request)
scraper/views.py:15
Function
rowReport
(select)
scraper/static/rowResult.js:19