A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
awesome deployment inference bolt mace tensorflow-serving tensorrt mnn ncnn tvm onnx tensorflow-lite openvino libtorch mediapipe tnn paddle-lite onnx-runtime megengine-lite openppl
-
Updated
May 3, 2024 - Python