ExecuTorch

ExecuTorch

โ˜… 4 ๐Ÿ”– 2500 saves ๐Ÿ’ฐ Free GitHub

ExecuTorch is PyTorch’s open-source solution for running AI models on-device, across mobile phones, embedded systems and edge hardware. Maintained by the PyTorch team at Meta, the GitHub repository has more than 5,100 stars and is under very active development, with updates continuing through 2026. It is the deployment counterpart to PyTorch training: you export a trained model and run it efficiently on the device itself, with no server round-trip.

Overview

ExecuTorch takes a PyTorch model, exports it through the torch.export pipeline, lowers it for a specific hardware backend, and produces a compact .pte program file that a lightweight C++ runtime can execute. It is the successor path to the older TorchScript mobile stack, designed from the start for the generative AI era, where models are larger and hardware accelerators far more diverse. The runtime is designed for constrained environments, with a small binary footprint and portable kernels, while backend delegates let chips from Apple, Arm, Qualcomm, MediaTek and others accelerate inference with their own NPUs, GPUs and DSPs.

Key Features

  • End-to-end workflow from PyTorch model export to on-device execution in a single toolchain
  • Hardware acceleration through backend delegates for major mobile and embedded chip vendors
  • Tiny, portable C++ runtime suited to memory- and storage-constrained devices
  • Support for LLMs and multimodal models on phones, including quantized execution
  • Profiling and debugging tools for measuring latency, memory and operator coverage
  • Cross-platform reach: iOS, Android, Linux, microcontrollers and wearables
  • Part of the PyTorch Edge ecosystem alongside torchao quantization and related tooling

๐Ÿ’ณ Pricing

Free and open source from the PyTorch project. There is no paid tier or hosted service; you build and ship the runtime inside your own applications.

Who Is It For

Mobile and embedded developers who train in PyTorch and need private, low-latency, offline inference on end-user devices, from smartphone AI features to industrial edge hardware.

๐Ÿš€ Visit ExecuTorch Official Site

๐Ÿšฉ Report an issue