Paddle Lite

简体中文 | English

Paddle Lite is an updated version of Paddle-Mobile, an open-open source deep learning framework designed to make it easy to perform inference on mobile, embeded, and IoT devices. It is compatible with PaddlePaddle and pre-trained models from other sources.

For tutorials, please see PaddleLite Document.

Key Features

• Multiple platform support, covering Android and iOS devices, embedded Linux, Windows, macOS and Linux computer.
• Diverse language support, which includes Java, C++, and Python.
• High performance and light weight: optimized for on-device machine learning, reduced model and binary size, efficient inference and reduced memory usage.

Architecture

Paddle Lite is designed to support a wide range of hardwares and devices, and it enables mixed execution of a single model on multiple devices, optimization on various phases, and light-weighted applications on devices.

As is shown in the figure above, analysis phase includes Machine IR module, and it enables optimizations like Op fusion and redundant computation pruning. Besides, excecution phase only involves Kernal execution, so it can be deployed on its own to ensure maximum light-weighted deployment.

Key Info about the Update

The earlier Paddle-Mobile was designed to be compatible with PaddlePaddle and multiple hardwares, including ARM CPU, Mali GPU, Adreno GPU, FPGA, ARM-Linux and Apple's GPU Metal. Within Baidu, inc, many product lines have been using Paddle-Mobile.

As an update of Paddle-Mobile, Paddle Lite has incorporated many older capabilities into the new architecture.

Special Thanks

Paddle Lite has referenced the following open-source projects:

• ARM compute library
• Anakin. The optimizations under Anakin has been incorporated into Paddle Lite, and so there will not be any future updates of Anakin. As another high-performance inference project under PaddlePaddle, Anakin has been forward-looking and helpful to the making of Paddle Lite.

Feedback and Community Support

• Questions, reports, and suggestions are welcome through Github Issues!
• Forum: Opinions and questions are welcome at our PaddlePaddle Forum！
• WeChat Official Account: PaddlePaddle
• QQ Group Chat: 696965088

  WeChat Official Account           QQ Group Chat