hub / github.com/f8-pub/go-infer

github.com/f8-pub/go-infer @v0.2.1

repository ↗ · DeepWiki ↗ · release v0.2.1 ↗ · + Follow

131 symbols 341 edges 25 files 80 documented · 61% ● updated 18mo ago★ 51

What it actually does AI analysis from the code graph — generated when you open this

loading…

README

Go实现的模型推理和API部署框架

深度学习模型在部署时通常以云方式部署，通过API对外提供推理服务。这个框架提供了部署API时的基本架构组件，实现了几个目标： - API处理模块与模型推理模块解耦，降低高并发造成的网络和计算阻塞风险 - API处理模块与模型推理模块可进行分布式部署，均可实现横向扩展 - 使用Go语言实现，提高执行效率，简化部署和运维 - 业务逻辑使用callback方式调用，隐藏通用逻辑，开发时只需关注业务逻辑

其他功能：

服务端配置使用Yaml，分布式部署时可进行针对性配置
API验签支持SHA256和SM2算法
模型示例
BERT模型推理示例
CNN模型推理示例
Tensorflow模型权重转换示例
Keras模型权重转换示例
ONNX模型权重推理示例
PyTorch模型转换为ONNX格式示例

分布式部署架构

开发文档

Star History

Extension points exported contracts — how you extend this code

Model (Interface)

base Model interface definition

types/model.go

Core symbols most depended-on inside this repo

create_initializer

called by 10

examples/export/bert_modeling.py

sm3_update

called by 9

examples/utils/libsm3/sm3.c

get_shape_list

called by 9

examples/export/bert_modeling.py

examples/utils/libsm3/sm3.c

sm3_finish

called by 5

examples/utils/libsm3/sm3.c

dropout

called by 4

examples/export/bert_modeling.py

Shape

Function 85

Method 33

Struct 9

Class 3

Interface 1

Languages

Go62%

Python31%

C8%

Modules by API surface

examples/export/bert_modeling.py30 symbols

http/http_helper.go11 symbols

examples/utils/libsm3/sm3.c10 symbols

examples/models/facedet/facedet.go10 symbols

types/model.go8 symbols

infer_test.go7 symbols

helper/redis.go7 symbols

examples/models/embedding/bert_embedding.go7 symbols

http/sm2.go6 symbols

helper/yaml.go6 symbols

examples/models/mobilenet/cnn_embedding.go6 symbols

examples/utils/sm2.py5 symbols

For agents

$ claude mcp add go-infer \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact