MCPcopy Index your code
hub / github.com/geekcomputers/Python / crawl_phone_urls

Method crawl_phone_urls

mobilePhoneSpecsScrapper.py:41–51  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

39 exit()
40
41 def crawl_phone_urls(self):
42 phones_urls = []
43 for i in range(1, 238): # Right now they have 237 page of phone data.
44 print(self.url + "page/" + str(i))
45 soup = self.crawl_html_page(self.url + "page/" + str(i))
46 table = soup.findAll("div", {"class": "stream-item"})
47 table_a = [k.find("a") for k in table]
48 for a in table_a:
49 temp = a["href"]
50 phones_urls.append(temp)
51 return phones_urls
52
53 def crawl_phones_models_specification(self, li):
54 phone_data = {}

Callers 1

Calls 2

crawl_html_pageMethod · 0.95
appendMethod · 0.45

Tested by

no test coverage detected