MCPcopy
hub / github.com/Picsart-AI-Research/Text2Video-Zero / data_scraping

Function data_scraping

hf_utils.py:13–22  ·  view source on GitHub ↗
(url_list)

Source from the content-addressed store, hash-verified

11
12
13def data_scraping(url_list):
14 model_list = []
15 for url in url_list:
16 response = requests.get(url)
17 soup = BeautifulSoup(response.text, "html.parser")
18 div_class = 'grid grid-cols-1 gap-5 2xl:grid-cols-2'
19 div = soup.find('div', {'class': div_class})
20 for a in div.find_all('a', href=True):
21 model_list.append(a['href'])
22 return model_list
23
24
25def get_model_list():

Callers 1

get_model_listFunction · 0.85

Calls 1

getMethod · 0.45

Tested by

no test coverage detected