Functions — github.com/TNK-Studio/zh-independent-blog-research

hub / github.com/TNK-Studio/zh-independent-blog-research / functions

Functions57 in github.com/TNK-Studio/zh-independent-blog-research

⨍ Functions 57 ◇ Types & classes 6

↓ 6 callersFunctionrm_slash

(url)

utils.py:74

↓ 4 callersMethodto_data

(self)

site_feature.py:152

↓ 4 callersMethodurl_trans

(self, url)

site_feature.py:40

↓ 3 callersFunctioncomputeGraph

(domain, depth = 2)

site/src/Context.js:38

↓ 3 callersFunctionget_data

(urls, is_zh_i9t_blog=False)

is_site_a_zh_i9t_blog/fetch_data.py:28

↓ 3 callersMethodsave_to_file

(self, f)

schema.py:45

↓ 2 callersFunctionget_url_html

(url)

get.py:54

↓ 2 callersFunctionlearn

()

is_site_a_zh_i9t_blog/is_zh_i9t_blog.py:17

↓ 2 callersFunctionregisterValidSW

(swUrl, config)

site/src/serviceWorker.js:57

↓ 1 callersFunctionaddData2Graph

(domain, depth)

site/src/Context.js:53

↓ 1 callersFunctionapp

(unlimit=False)

app.py:13

↓ 1 callersFunctioncheckValidServiceWorker

(swUrl, config)

site/src/serviceWorker.js:101

↓ 1 callersMethodclean_run_status

如果 pass_domian 漏掉了某些 domain，后续的队列中可能出现一些需要过滤 domain 的站点。为了提高效率，统一在此清理数据，而不是在抓取数据前作判断。

clean_data.py:21

↓ 1 callersMethodclear_pass_domain_data

清理已经爬取的 pass_domain 的站点数据

clean_data.py:11

↓ 1 callersMethodfix_q

修复异常情况导致下队列丢失的问题

clean_data.py:39

↓ 1 callersFunctionget_data

(urls)

get.py:34

↓ 1 callersFunctionget_frineds_and_res

找到给定 url 的友情链接列表,返回 {r,url,friends}

get.py:85

↓ 1 callersFunctionget_frineds_and_res

找到给定 url 的友情链接列表,返回友链 & 友链页面 html

is_site_a_zh_i9t_blog/fetch_data.py:57

↓ 1 callersFunctionget_frineds_page_link

在首页的 html 中，查询最有可能是友链的页面链接。如果友链内容嵌入在首页中则无法获取。

get.py:69

↓ 1 callersFunctionget_url_html

(url)

is_site_a_zh_i9t_blog/fetch_data.py:41

↓ 1 callersFunctiongeuss_link_url

猜测给定 url 的友链地址

utils.py:57

↓ 1 callersFunctionhas_url_html_been_fetched

(url)

utils.py:52

↓ 1 callersFunctionis_zh_i9t_blog

(data)

is_site_a_zh_i9t_blog/is_zh_i9t_blog.py:34

↓ 1 callersFunctionparse_data

添加新的考察特征时，从缓存的 html 中获取数据，更新到站点数据中。

parse_data.py:28

↓ 1 callersFunctionqueryBlog

(q)

site/src/Context.js:23

↓ 1 callersMethodsave_data_to_file

(self)

site_feature.py:169

↓ 1 callersFunctionsave_html

(domain, html)

get.py:28

↓ 1 callersFunctionsave_html

(domain, html)

is_site_a_zh_i9t_blog/fetch_data.py:22

↓ 1 callersFunctiontask

(q, bloom, batch_size)

task.py:15

↓ 1 callersFunctiontest_blog

(feature: dict)

utils.py:29

↓ 1 callersFunctionto_graphql_data

()

get_graph_data.py:17

↓ 1 callersFunctionto_json_data

()

get_graph_data.py:5

↓ 1 callersFunctionurl_trans

(base_url, url: str)

utils.py:45

FunctionAlignItemsList

()

site/src/components/SearchList.js:27

FunctionAppReducer

(state, action)

site/src/Context.js:110

FunctionNetworkGraph

()

site/src/components/Graph.js:7

(self, url, r, friends, is_zh_i9t_blog=True)

is_site_a_zh_i9t_blog/fetch_data.py:42

is_site_a_zh_i9t_blog/fetch_data.py:111

Functionrecovery_data

parse_data.py:17

Functionregister

(config)

site/src/serviceWorker.js:23

site/src/serviceWorker.js:129