Functions — github.com/MrSuiChuan/data-warehouse-learning

hub / github.com/MrSuiChuan/data-warehouse-learning / functions

Functions532 in github.com/MrSuiChuan/data-warehouse-learning

⨍ Functions 532◇ Types & classes 165

↓ 186 callersMethodgenerateNumber

(int min, int max)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/RandomUtil.java:76

↓ 60 callersMethodbatchInsert

(String sql, List<Object[]> params)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/DbUtil.java:88

↓ 58 callersMethodqueryForInt

(String sql)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/DbUtil.java:161

↓ 20 callersMethodgeneratePrice

(double min, double max)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/RandomUtil.java:71

↓ 15 callersMethodpartition

(String topic, Object key, byte[] keyBytes, Object value, byte[] valueBytes, Cluster

src/main/java/org/bigdatatechcir/learn_kafka/part2_kafka_producer/DemoPartitioner.java:15

↓ 12 callersMethodclose

()

src/main/java/org/bigdatatechcir/learn_kafka/part3_kafka_consumer/CompanyDeserailizer.java:43

↓ 10 callersMethodtoString

()

src/main/java/org/bigdatatechcir/learn_flink/part1_flink_apis/StreamSQLDemo.java:67

↓ 9 callersMethodclose

()

src/main/java/org/bigdatatechcir/learn_kafka/part4_kafka_topic/PolicyDemo.java:10

↓ 8 callersMethod__init__

(self, dim: int, hidden_dim: int, dropout: float)

src/main/java/org/bigdatatechcir/learn_llm/transformer/transformer.py:121

↓ 6 callersMethodgenerateDouble

(int min, int max)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/RandomUtil.java:117

↓ 5 callersMethod__init__

(self, dim: int, hidden_dim: int, multiple_of: int, dropout: float)

src/main/java/org/bigdatatechcir/learn_llm/model/k_model.py:225

↓ 5 callersMethodeval

(String street, String zipCode, String city)

src/main/java/org/bigdatatechcir/learn_flink/part1_flink_apis/TableApiDemo.java:125

↓ 5 callersMethodforward

(self, x)

src/main/java/org/bigdatatechcir/learn_llm/transformer/transformer.py:130

↓ 5 callersMethodgetValue

()

src/main/java/org/bigdatatechcir/learn_flink/part1_flink_apis/ProcessFunctionDemo.java:55

↓ 4 callersMethod__init__

(self, path: str = '')

src/main/java/org/bigdatatechcir/learn_llm/rag/LLM.py:34

↓ 4 callersMethodclose

()

src/main/java/org/bigdatatechcir/learn_kafka/part2_kafka_producer/DemoPartitioner.java:26

↓ 4 callersMethodclose

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/DbUtil.java:155

↓ 4 callersMethodinit

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/DbUtil.java:48

↓ 3 callersFunctionLogger

(content)

src/main/java/org/bigdatatechcir/learn_llm/model/ddp_sft_full.py:23

↓ 3 callersFunctionLogger

(content)

src/main/java/org/bigdatatechcir/learn_llm/model/ddp_pretrain.py:23

↓ 3 callersMethod__init__

(self, path: str = 'jinaai/jina-embeddings-v2-base-zh', is_api: bool = False)

src/main/java/org/bigdatatechcir/learn_llm/rag/Embeddings.py:67

↓ 3 callersMethodgenerateName

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/RandomUtil.java:26

↓ 3 callersMethodgetConnection

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/DbUtil.java:81

↓ 3 callersMethodmain

(String[] args)

src/main/java/org/bigdatatechcir/learn_kafka/part4_kafka_topic/TopicCommandUtils.java:5

↓ 3 callersMethodmap

(String value)

src/main/java/org/bigdatatechcir/learn_dinky/GlobalWindowDemo.java:49

↓ 3 callersMethodnormalize

(String s)

src/main/java/org/bigdatatechcir/learn_flink/part1_flink_apis/TableApiDemo.java:129

↓ 2 callersFunctioncount_parameters

(model)

src/main/java/org/bigdatatechcir/learn_llm/model/export_model.py:9

↓ 2 callersMethodflatMap

对输入的字符串进行分词，并为每个词生成一个计数为1的元组。这是flatMap函数的实现，用于MapReduce模型中的映射阶段。 @param value 输入的字符串，通常是从上游操作符接收的数据。 @param out Collector对象，用于收集和输出处理后的数据。

src/main/java/org/bigdatatechcir/learn_flink/part1_flink_apis/StreamingTableSetApiDemo.java:47

↓ 2 callersMethodforward

(self, x)

src/main/java/org/bigdatatechcir/learn_llm/model/k_model.py:242

↓ 2 callersMethodgenerate

给定输入序列 idx（形状为 (bz,seq_len) 的长整型张量），通过多次生成新 token 来完成序列。在 model.eval() 模式下运行。效率较低的采样版本，没有使用键k/v cache。

src/main/java/org/bigdatatechcir/learn_llm/model/k_model.py:384

↓ 2 callersMethodgenerateAddress

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/RandomUtil.java:61

↓ 2 callersMethodgetId

()

src/main/java/org/bigdatatechcir/learn_flink/part1_flink_apis/ProcessFunctionDemo.java:47

↓ 2 callersMethodget_embedding

(self, text: str)

src/main/java/org/bigdatatechcir/learn_llm/rag/Embeddings.py:71

↓ 2 callersMethodget_tool_schema

(self)

src/main/java/org/bigdatatechcir/learn_llm/agent/src/core.py:24

↓ 2 callersMethodprintToConsole

(String sql, List<Object[]> params)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/DbUtil.java:115

↓ 2 callersMethodprocess

(String s, Context context, Iterable<Tuple3<String, Integer, Long>> elements, Collector<Tuple2<String, Integer

src/main/java/org/bigdatatechcir/learn_flink/part10_flink_restart/NoRestartStrategyDemo.java:140

↓ 2 callersFunctionrepeat_kv

(x: torch.Tensor, n_rep: int)

src/main/java/org/bigdatatechcir/learn_llm/model/k_model.py:122

↓ 2 callersFunctionreshape_for_broadcast

(freqs_cis: torch.Tensor, x: torch.Tensor)

src/main/java/org/bigdatatechcir/learn_llm/model/k_model.py:83

↓ 2 callersMethodstripTrailingSemicolon

(String statement)

src/main/java/org/bigdatatechcir/warehouse/flink/tools/SqlSyntaxValidationRunner.java:75

↓ 1 callersMethod__init__

(self, data_path, tokenizer, max_length=512)

src/main/java/org/bigdatatechcir/learn_llm/model/dataset.py:44

↓ 1 callersMethod_norm

(self, x)

src/main/java/org/bigdatatechcir/learn_llm/model/k_model.py:52

↓ 1 callersFunctionapply_rotary_emb

( xq: torch.Tensor, xk: torch.Tensor, freqs_cos: torch.Tensor, freqs_sin: torch.Tensor )

src/main/java/org/bigdatatechcir/learn_llm/model/k_model.py:95

↓ 1 callersMethodchat

(self, prompt: str, history: List[dict], content: str)

src/main/java/org/bigdatatechcir/learn_llm/rag/LLM.py:37

↓ 1 callersMethodchat_template

(self, prompt)

src/main/java/org/bigdatatechcir/learn_llm/model/model_sample.py:56

↓ 1 callersMethodcloseResources

(Connection conn, PreparedStatement ps)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/util/DbUtil.java:138

↓ 1 callersMethodcommit

()

src/main/java/org/bigdatatechcir/learn_flink/part8_flink_checkpoint/TwoPhaseCommitSinkFunctionDemo.java:251

↓ 1 callersMethodconfigure

(Map<String, ?> configs)

src/main/java/org/bigdatatechcir/learn_kafka/part4_kafka_topic/PolicyDemo.java:7

↓ 1 callersFunctionconvert_message

将原始数据转换为标准格式

src/main/java/org/bigdatatechcir/learn_llm/model/download.py:38

↓ 1 callersMethodcosine_similarity

calculate cosine similarity between two vectors

src/main/java/org/bigdatatechcir/learn_llm/rag/Embeddings.py:33

↓ 1 callersFunctioncount_parameters

(model)

src/main/java/org/bigdatatechcir/learn_llm/model/ddp_sft_full.py:106

↓ 1 callersFunctioncount_parameters

(model)

src/main/java/org/bigdatatechcir/learn_llm/model/ddp_pretrain.py:106

↓ 1 callersMethodcreateTopicIfNotExists

()

src/main/java/org/bigdatatechcir/learn_kafka/part2_kafka_producer/KafkaProducerSyncDemo.java:68

↓ 1 callersMethodcreateTopicIfNotExists

()

src/main/java/org/bigdatatechcir/learn_kafka/part2_kafka_producer/KafkaProducerAsyncDemo.java:84

↓ 1 callersMethodcreateTopicIfNotExists

()

src/main/java/org/bigdatatechcir/learn_kafka/part1_kafka_overwrite/KafkaProducerDemo.java:58

↓ 1 callersFunctioncreate_tokenizer_config

创建完整的tokenizer配置文件

src/main/java/org/bigdatatechcir/learn_llm/model/train_tokenizer.py:33

↓ 1 callersMethoddescribeTopic

()

src/main/java/org/bigdatatechcir/learn_kafka/part4_kafka_topic/KafkaAdminTopicOperation.java:10

↓ 1 callersFunctioneval_tokenizer

评估tokenizer功能

src/main/java/org/bigdatatechcir/learn_llm/model/train_tokenizer.py:128

↓ 1 callersFunctionexport_model

(tokenizer_path, model_config, model_ckpt_path, save_directory)

src/main/java/org/bigdatatechcir/learn_llm/model/export_model.py:13

↓ 1 callersMethodforward

(self, idx, targets=None)

src/main/java/org/bigdatatechcir/learn_llm/transformer/transformer.py:287

↓ 1 callersFunctionfunction_to_json

(func)

src/main/java/org/bigdatatechcir/learn_llm/agent/src/utils.py:5

↓ 1 callersMethodgenerateActions

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/userlog_code/generator/UserLogGenerator.java:68

↓ 1 callersMethodgenerateActivityData

(int activityCount, int skuCount)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/ActivityDataGenerator.java:22

↓ 1 callersMethodgenerateActivityInfo

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/ActivityDataGenerator.java:40

↓ 1 callersMethodgenerateActivityRule

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/ActivityDataGenerator.java:67

↓ 1 callersMethodgenerateActivitySku

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/ActivityDataGenerator.java:96

↓ 1 callersMethodgenerateAttrInfo

(int batchSize)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/BaseDataGenerator.java:112

↓ 1 callersMethodgenerateAttrValue

(int batchSize)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/BaseDataGenerator.java:134

↓ 1 callersMethodgenerateAttrValue

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/CategoryDataGenerator.java:43

↓ 1 callersMethodgenerateBanner

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/CMSDataGenerator.java:26

↓ 1 callersMethodgenerateBaseData

(int batchSize)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/BaseDataGenerator.java:24

↓ 1 callersMethodgenerateCMSData

(int bannerCount, int subjectCount, int commentCount)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/CMSDataGenerator.java:21

↓ 1 callersMethodgenerateCartInfo

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/UserBehaviorGenerator.java:30

↓ 1 callersMethodgenerateCategory1

(int batchSize)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/BaseDataGenerator.java:38

↓ 1 callersMethodgenerateCategory2

(int batchSize)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/BaseDataGenerator.java:56

↓ 1 callersMethodgenerateCategory3

(int batchSize)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/BaseDataGenerator.java:75

↓ 1 callersMethodgenerateCategory3

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/CategoryDataGenerator.java:25

↓ 1 callersMethodgenerateCommentInfo

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/UserBehaviorGenerator.java:72

↓ 1 callersMethodgenerateCommon

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/userlog_code/generator/UserLogGenerator.java:33

↓ 1 callersMethodgenerateCouponData

(int couponCount, int userCount)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/CouponDataGenerator.java:22

↓ 1 callersMethodgenerateCouponInfo

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/CouponDataGenerator.java:37

↓ 1 callersMethodgenerateCouponRange

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/CouponDataGenerator.java:81

↓ 1 callersMethodgenerateCouponUse

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/CouponDataGenerator.java:101

↓ 1 callersMethodgenerateDict

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/BaseDataGenerator.java:218

↓ 1 callersMethodgenerateDisplays

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/userlog_code/generator/UserLogGenerator.java:86

↓ 1 callersMethodgenerateError

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/userlog_code/generator/UserLogGenerator.java:105

↓ 1 callersMethodgenerateFavorInfo

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/UserBehaviorGenerator.java:104

↓ 1 callersMethodgenerateFrontendParam

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/BaseDataGenerator.java:248

↓ 1 callersMethodgenerateLog

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/userlog_code/generator/UserLogGenerator.java:21

↓ 1 callersMethodgenerateOrderData

(int batchSize)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDataGenerator.java:22

↓ 1 callersMethodgenerateOrderDetail

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDataGenerator.java:86

↓ 1 callersMethodgenerateOrderDetail

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDetailGenerator.java:28

↓ 1 callersMethodgenerateOrderDetailActivity

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDataGenerator.java:185

↓ 1 callersMethodgenerateOrderDetailActivity

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDetailGenerator.java:68

↓ 1 callersMethodgenerateOrderDetailCoupon

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDataGenerator.java:211

↓ 1 callersMethodgenerateOrderDetailCoupon

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDetailGenerator.java:100

↓ 1 callersMethodgenerateOrderInfo

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDataGenerator.java:33

↓ 1 callersMethodgenerateOrderRefundInfo

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/RefundGenerator.java:29

↓ 1 callersMethodgenerateOrderRefundInfo

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDataGenerator.java:237

↓ 1 callersMethodgenerateOrderStatusLog

(int count)

src/main/java/org/bigdatatechcir/warehouse/datageneration/business_code/generator/OrderDataGenerator.java:163

↓ 1 callersMethodgeneratePage

()

src/main/java/org/bigdatatechcir/warehouse/datageneration/userlog_code/generator/UserLogGenerator.java:57

next →1–100 of 532, ranked by callers