MCPcopy Create free account

hub / github.com/CaledoniaProject/awesome-opensource-security / functions

Functions36 in github.com/CaledoniaProject/awesome-opensource-security

↓ 7 callersMethod_normalize_url
Normalize URL by removing trailing slash (except for root path).
scripts/main.py:958
↓ 5 callersMethod_contains_chinese
Check if text contains Chinese characters.
scripts/main.py:1523
↓ 4 callersMethodparse_files
Parse all .md files in the parent directory, excluding specified files.
scripts/main.py:224
↓ 3 callersMethod_parse_markdown_link
Parse markdown link and extract title, description, and comment based on URL type. Returns: (title, description, comment) tuple
scripts/main.py:1176
↓ 3 callersMethod_split_by_separator
Split text by various separator patterns: ' - ', '–', '—', ' – ', ' — ' Returns: (parts, separator_used) tuple
scripts/main.py:1153
↓ 2 callersMethod_iso_to_timestamp
Convert ISO datetime string to Unix timestamp.
scripts/main.py:104
↓ 2 callersMethodget_all_data
Retrieve all data from the database.
scripts/main.py:163
↓ 2 callersMethodprocess_other_url
Process other URLs by fetching metadata.
scripts/main.py:840
↓ 2 callersMethodprocess_url
Process a URL and return metadata based on URL type.
scripts/main.py:915
↓ 2 callersMethodremove_duplicates
Remove duplicate items while preserving order.
scripts/main.py:214
↓ 1 callersMethod_build_url_comment_mapping
Build a mapping from URL to Chinese comment by scanning markdown files once.
scripts/main.py:1294
↓ 1 callersMethod_build_url_description_mapping
Build a mapping from URL to description by scanning markdown files once.
scripts/main.py:1338
↓ 1 callersMethod_build_url_title_mapping
Build a mapping from URL to title by scanning markdown files once.
scripts/main.py:1382
↓ 1 callersMethoddelete_failed_entries
Delete all failed entries (status = 0) from the database.
scripts/main.py:187
↓ 1 callersMethoddump_data
Dump data from the database that exists in markdown files and has succeeded.
scripts/main.py:1037
↓ 1 callersMethoddump_data_minimized
Dump data in JSON format that can be decoded as a list of Go structs.
scripts/main.py:1070
↓ 1 callersMethodget_existing_entry
Get existing entry for a URL.
scripts/main.py:116
↓ 1 callersMethodget_failed_entries
Retrieve only failed entries (status = 0) from the database.
scripts/main.py:175
↓ 1 callersMethodinit_database
Initialize the database with the required table structure.
scripts/main.py:51
↓ 1 callersMethodinsert_or_update
Insert or update a record in the database.
scripts/main.py:75
↓ 1 callersFunctionmain
()
scripts/main.py:1546
↓ 1 callersMethodprocess_crates_url
Process Crates.io URLs.
scripts/main.py:587
↓ 1 callersMethodprocess_gist_url
Process GitHub Gist URLs.
scripts/main.py:355
↓ 1 callersMethodprocess_gitee_url
Process Gitee repository URLs.
scripts/main.py:650
↓ 1 callersMethodprocess_github_url
Process GitHub repository URLs, user/organization URLs, and other GitHub URLs.
scripts/main.py:407
↓ 1 callersMethodprocess_gitlab_url
Process GitLab repository URLs.
scripts/main.py:524
↓ 1 callersMethodprocess_pdf_url
(self, url)
scripts/main.py:733
↓ 1 callersMethodscan_comments
Scan all markdown files and extract Chinese comments matching pattern ` - .* - (.*)`.
scripts/main.py:1475
↓ 1 callersMethodshow_failed_entries
Show only failed entries from the database that exist in markdown files.
scripts/main.py:1426
↓ 1 callersMethodtest_url
Test URL parsing and return the result.
scripts/main.py:1452
↓ 1 callersMethodupdate_database
Update the local SQLite database with data from markdown files.
scripts/main.py:968
Method__init__
(self, db_path="data.db")
scripts/main.py:47
Method__init__
(self, base_path)
scripts/main.py:211
Method__init__
(self, github_token=None, proxy=None)
scripts/main.py:317
Method__init__
(self, github_token=None, proxy=None)
scripts/main.py:947
Methodshould_update_entry
Determine if an entry should be updated based on age and status.
scripts/main.py:128