Functions — github.com/decodingai-magazine/llm-twin-course

hub / github.com/decodingai-magazine/llm-twin-course / functions

Functions323 in github.com/decodingai-magazine/llm-twin-course

⨍ Functions 323◇ Types & classes 158↳ Endpoints 5

↓ 19 callersFunctionget_logger

(cls: str)

src/core/logger_utils.py:4

↓ 14 callersMethodfind

(cls, **filter_options)

src/core/db/documents.py:71

↓ 9 callersMethodload

(self, name: str)

src/bonus_superlinked_rag/server/runner/executor/app/service/data_loader.py:55

↓ 7 callersFunctionget_logger

(cls: str)

src/bonus_superlinked_rag/utils/logging.py:4

↓ 7 callersMethodregister

(self, rest_app: RestApp)

src/bonus_superlinked_rag/server/runner/executor/app/service/persistence_service.py:29

↓ 6 callersMethodget_bucket

(self)

src/bonus_superlinked_rag/server/runner/poller/app/resource_handler/local/local_resource_handler.py:23

↓ 5 callersMethodgenerate

( self, query: str, enable_rag: bool = False, sample_for_evaluation: bool = Fa

src/inference_pipeline/llm_twin.py:31

↓ 5 callersMethodpatch_localhost

(self)

src/core/config.py:60

↓ 4 callersMethod_get_bucket_and_path_or_raise

(self, pattern: str, app_location: str)

src/bonus_superlinked_rag/server/runner/poller/app/app_location_parser/app_location_parser.py:40

↓ 4 callersMethod_get_collection_name

(cls)

src/core/db/documents.py:98

↓ 4 callersMethodclose

(self)

src/core/mq.py:70

↓ 4 callersFunctioncompute_num_tokens

(text: str)

src/inference_pipeline/utils.py:5

↓ 4 callersMethodrun

Start the polling process.

src/bonus_superlinked_rag/server/runner/poller/app/poller/poller.py:49

↓ 4 callersMethodsave

(self, **kwargs)

src/core/db/documents.py:44

↓ 4 callersMethodsearch

( self, collection_name: str, query_vector: list, query_filter: models.Filter

src/core/db/qdrant.py:50

↓ 3 callersMethod__ingest

(self, url: str, data: T)

src/bonus_superlinked_rag/superlinked_client.py:33

↓ 3 callersMethod__search

( self, url: str, document_class: type[T], search_query: str, platform

src/bonus_superlinked_rag/superlinked_client.py:83

↓ 3 callersMethod_scrape_section

Scrape a specific section of the LinkedIn profile.

src/data_crawling/crawlers/linkedin.py:76

↓ 3 callersMethodcheck_and_download

Check if the object's time is more recent than the poller's start time and download it if so. If it's the first run, download the obj

src/bonus_superlinked_rag/server/runner/poller/app/resource_handler/resource_handler.py:57

↓ 3 callersFunctionchunk_text

(text: str)

src/feature_pipeline/utils/chunking.py:9

↓ 3 callersFunctionclean_text

(text_content: str | None)

src/feature_pipeline/utils/cleaning.py:98

↓ 3 callersFunctionclean_text

(text_content: str)

src/bonus_superlinked_rag/utils/cleaning.py:98

↓ 3 callersMethodconnect

(self)

src/core/mq.py:47

↓ 3 callersMethodconnect

(self)

src/bonus_superlinked_rag/mq.py:50

↓ 3 callersMethodcreate_handler

(data_type)

src/feature_pipeline/data_logic/dispatchers.py:46

↓ 3 callersFunctionembedd_text

(text: str)

src/feature_pipeline/utils/embeddings.py:7

↓ 3 callersMethodgenerate_response

( query: str, passages: list[str], keep_top_k: int )

src/core/rag/reranking.py:9

↓ 3 callersMethodgenerate_response

( query: str, passages: list[str], keep_top_k: int )

src/bonus_superlinked_rag/rag/reranking.py:10

↓ 3 callersMethodget_chain

(llm, template: PromptTemplate, output_key: str, verbose=True)

src/bonus_superlinked_rag/llm/chain.py:7

↓ 3 callersMethodget_channel

(self)

src/core/mq.py:66

↓ 3 callersMethodget_channel

(self)

src/bonus_superlinked_rag/mq.py:91

↓ 3 callersMethodread

(self, field_identifier: str, app_identifier: str)

src/bonus_superlinked_rag/server/runner/executor/app/service/file_object_serializer.py:43

↓ 3 callersMethodregister

(self, domain: str, crawler: type[BaseCrawler])

src/data_crawling/dispatcher.py:14

↓ 3 callersFunctionsplit_text

(text: str)

src/bonus_superlinked_rag/data_logic/splitters.py:4

↓ 3 callersMethodwrite

(self, field_identifier: str, serialized_object: str, app_identifier: str)

src/bonus_superlinked_rag/server/runner/executor/app/service/file_object_serializer.py:34

↓ 2 callersMethod_process_file

(self, file_path: str)

src/bonus_superlinked_rag/server/runner/poller/app/resource_handler/local/local_resource_handler.py:59

↓ 2 callersMethodconvert_to_utc

Convert a datetime object to UTC timezone.

src/bonus_superlinked_rag/server/runner/poller/app/resource_handler/resource_handler.py:49

↓ 2 callersFunctioncreate_dataset_from_artifacts

( dataset_name: str, artifact_names: list[str] )

src/core/opik_utils.py:51

↓ 2 callersFunctionexecute_command

(command: list, cwd: str = None)

src/bonus_superlinked_rag/server/tools/deploy.py:73

↓ 2 callersMethodfrom_mongo

Convert "_id" (str object) into "id" (UUID object).

src/core/db/documents.py:22

↓ 2 callersMethodgenerate_filename

(self, field_id: str, app_id: str)

src/bonus_superlinked_rag/server/runner/executor/app/service/file_handler_service.py:17

↓ 2 callersMethodget_or_create

(cls, **filter_options)

src/core/db/documents.py:56

↓ 2 callersMethodingest_article

(self, data: ArticleDocument)

src/bonus_superlinked_rag/superlinked_client.py:30

↓ 2 callersMethodingest_post

(self, data: PostDocument)

src/bonus_superlinked_rag/superlinked_client.py:27

↓ 2 callersMethodingest_repository

(self, data: RepositoryDocument)

src/bonus_superlinked_rag/superlinked_client.py:24

↓ 2 callersMethodis_connected

(self)

src/core/mq.py:63

↓ 2 callersMethodis_connected

(self)

src/bonus_superlinked_rag/mq.py:88

↓ 2 callersMethodpoll

(self)

src/bonus_superlinked_rag/server/runner/poller/app/resource_handler/resource_handler.py:36

↓ 2 callersFunctionpublish_to_rabbitmq

Publish data to a RabbitMQ queue.

src/core/mq.py:77

↓ 2 callersMethodrerank

(self, hits: list, keep_top_k: int)

src/core/rag/retriever.py:127

↓ 2 callersMethodretrieve_top_k

(self, k: int, to_expand_to_n_queries: int)

src/core/rag/retriever.py:93

↓ 2 callersFunctionrun_docker_compose

Run a docker-compose command. Args: command (str): The docker-compose command to run. Supported commands are 'up', 'down', and 'rest

src/bonus_superlinked_rag/server/tools/deploy.py:109

↓ 2 callersMethodscroll_page

Scroll through the LinkedIn page based on the scroll limit.

src/data_crawling/crawlers/base.py:48

↓ 2 callersMethodsearch_article

( self, search_query: str, platform: str, author_id: str, *, limit: int = 3 )

src/bonus_superlinked_rag/superlinked_client.py:71

↓ 2 callersMethodsearch_post

( self, search_query: str, platform: str, author_id: str, *, limit: int = 3 )

src/bonus_superlinked_rag/superlinked_client.py:59

↓ 2 callersMethodsearch_repository

( self, search_query: str, platform: str, author_id: str, *, limit: int = 3 )

src/bonus_superlinked_rag/superlinked_client.py:47

↓ 2 callersMethodsetup_logger

(self, name: str)

src/bonus_superlinked_rag/server/runner/poller/app/config/poller_config.py:37

↓ 2 callersMethodto_mongo

Convert "id" (UUID object) into "_id" (str object).

src/core/db/documents.py:30

↓ 2 callersMethodto_payload

(self)

src/feature_pipeline/models/base.py:24

↓ 2 callersMethodwrite_data

(self, collection_name: str, points: Batch)

src/core/db/qdrant.py:42

↓ 1 callersMethod__read_data

( self, path: str, data_format: DataFormat, pandas_read_kwargs: dict[str, Any] | None )

src/bonus_superlinked_rag/server/runner/executor/app/service/data_loader.py:109

↓ 1 callersMethod_artifact_to_asset

(self, artifact: Artifact, split: str)

src/training_pipeline/finetune.py:70

↓ 1 callersMethod_artifact_to_asset

(self, artifact: Artifact, split: str)

src/training_pipeline/download_dataset.py:58

↓ 1 callersMethod_download_artifact

(self, artifact_name: str, experiment)

src/training_pipeline/finetune.py:57

↓ 1 callersMethod_download_artifact

(self, artifact_name: str, experiment)

src/training_pipeline/download_dataset.py:45

↓ 1 callersMethod_extract_image_urls

Extracts image URLs from button elements. Args: buttons (List[Tag]): A list of BeautifulSoup Tag objects representing bu

src/data_crawling/crawlers/linkedin.py:82

↓ 1 callersMethod_extract_posts

Extracts post texts and combines them with their respective images. Args: post_elements (List[Tag]): A list of Beautiful

src/data_crawling/crawlers/linkedin.py:107

↓ 1 callersMethod_get_page_content

Retrieve the page content of a given URL.

src/data_crawling/crawlers/linkedin.py:101

↓ 1 callersFunction_group_by

(documents: list[Document], selector: Callable)

src/bonus_superlinked_rag/models/utils.py:43

↓ 1 callersMethod_load_data

(self, asset: ArtifactAsset)

src/training_pipeline/finetune.py:83

↓ 1 callersMethod_load_data

(self, asset: ArtifactAsset)

src/training_pipeline/download_dataset.py:71

↓ 1 callersMethod_parse_model_output

(self, content: str)

src/inference_pipeline/evaluation/style.py:74

↓ 1 callersMethod_path_exists

(self)

src/bonus_superlinked_rag/server/runner/poller/app/resource_handler/local/local_resource_handler.py:44

↓ 1 callersMethod_process_directory

(self)

src/bonus_superlinked_rag/server/runner/poller/app/resource_handler/local/local_resource_handler.py:53

↓ 1 callersMethod_process_path

(self)

src/bonus_superlinked_rag/server/runner/poller/app/resource_handler/local/local_resource_handler.py:47

↓ 1 callersMethod_scrape_education

(self, profile_url: str)

src/data_crawling/crawlers/linkedin.py:137

↓ 1 callersMethod_scrape_experience

Scrapes the Experience section of the LinkedIn profile.

src/data_crawling/crawlers/linkedin.py:129

↓ 1 callersMethod_split_dataset

Split dataset into train and test sets. Args: generated_instruct_dataset (dict): Dataset containing content and instruction pairs

src/feature_pipeline/generate_dataset/generate.py:134

↓ 1 callersFunctionadd_to_dataset_with_sampling

(item: dict, dataset_name: str)

src/core/opik_utils.py:128

↓ 1 callersMethodbuild_sagemaker_predictor

(self)

src/inference_pipeline/llm_twin.py:24

↓ 1 callersMethodbulk_insert

(cls, documents: List, **kwargs)

src/core/db/documents.py:85

↓ 1 callersMethodcall_llm_service

(self, messages: list[dict[str, str]])

src/inference_pipeline/llm_twin.py:106

↓ 1 callersMethodcheck_api_health

Check the health of the API and return True if it's healthy, False otherwise.

src/bonus_superlinked_rag/server/runner/poller/app/resource_handler/resource_handler.py:108

↓ 1 callersMethodchunk

(self, data_model: DataModel)

src/feature_pipeline/data_logic/chunking_data_handlers.py:17

↓ 1 callersFunctionchunk_documents

(documents: list[str], min_length: int = 1000, max_length: int = 2000)

src/feature_pipeline/generate_dataset/chunk_documents.py:4

↓ 1 callersMethodclean

(self, data_model: DataModel)

src/feature_pipeline/data_logic/cleaning_data_handlers.py:16

↓ 1 callersMethodclean

(self, data_model: RawModel)

src/bonus_superlinked_rag/data_logic/cleaning_data_handlers.py:17

↓ 1 callersMethodclean_response

(response: str)

src/feature_pipeline/generate_dataset/llm_communication.py:42

↓ 1 callersMethodclose

(self)

src/bonus_superlinked_rag/mq.py:95

↓ 1 callersFunctionconfigure_opik

()

src/core/opik_utils.py:22

↓ 1 callersFunctioncreate_dataset

(name: str, description: str, items: list[dict])

src/core/opik_utils.py:117

↓ 1 callersMethodcreate_handler

(data_type: str)

src/bonus_superlinked_rag/data_logic/dispatchers.py:33

↓ 1 callersMethodcreate_non_vector_collection

(self, collection_name: str)

src/core/db/qdrant.py:29

↓ 1 callersFunctioncreate_sagemaker_execution_role

(role_name: str)

src/core/aws/create_execution_role.py:18

↓ 1 callersFunctioncreate_sagemaker_user

(username: str)

src/core/aws/create_sagemaker_role.py:18

↓ 1 callersMethodcreate_template

(self, enable_rag: bool = True)

src/inference_pipeline/prompt_templates.py:32

↓ 1 callersMethodcreate_template

(self, to_expand_to_n: int)

src/core/rag/prompt_templates.py:25

↓ 1 callersMethodcreate_template

(self)

src/core/rag/prompt_templates.py:60

↓ 1 callersMethodcreate_template

(self, keep_top_k: int)

src/core/rag/prompt_templates.py:77

↓ 1 callersMethodcreate_template

(self, to_expand_to_n: int)

src/bonus_superlinked_rag/llm/prompt_templates.py:25

next →1–100 of 323, ranked by callers