Torq Compiler

• User Manual
  • Introduction
    • Technical Background
    • Distribution Contents
      • Release Package
      • Docker Image
    • System Requirements
    • Getting Started
    • Support and Contact
  • Quickstart
    • Setup
      • Release Package Ubuntu 24.04
      • Docker Image
    • Compile and Run the Model
  • Model Preparation
    • Overview
    • Convert a TFLite model to TOSA and MLIR
    • Convert Torch Model to MLIR
    • References
  • Input Guide
    • Supported model formats for torq-compile
    • Input Structure for iree-run-module
      • Literal Inputs
      • Multiple Inputs
      • Feeding Input from Files
      • Converting Images to .npy or .bin
  • Step-by-Step Model Deployment Examples
    • Converting and Running MobileNetV2 on Torq
      • Set up environment
      • Convert TFLite → TOSA
      • Compile TOSA → Torq model
      • Run inference on Torq
  • Supported Operators
    • Activation related Operators
    • Element-Wise Operators
    • Composite Operators
    • Other Operators
  • Profiling
    • Compile-Time Profiling
    • Runtime Profiling
  • Handling Unsupported Ops
    • CSS Fallback
    • Host Fallback
  • Compiling Models for Custom Synaptics SoCs
    • NSS Subsystem Overview
    • Custom Hardware Configuration
      • Example Configurations
  • Debug tips and tricks
  • References
  • Glossary
  • Release Notes
    • Version 0.9.0
      • Key Features & Enhancements
      • Fixed Issues
      • Known Issues
      • Breaking Changes in This Release
      • Deprecated Features
      • Documentation
• Developer Manual
  • Introduction
  • Build and setup
    • Prerequisites
    • Download the code
    • Install required system packages
    • Build compiler and runtime for host
    • Build runtime for target
  • Compile and run a model
  • Design
    • Torq compiler backend
      • Overview
      • Dialects
      • Passes
      • Data Layout
      • Memory Allocation and Planning
      • Strided Convolutions
      • Torq HAL driver
  • Developer Guide
    • TOSA to Torq Conversion Guide
      • Example
    • Kernel Development Guide
      • Example: Add kernel
      • Kernel Structure
    • Creating a New Compiler Pass
      • Example
    • Implementing Compute Optimizations
    • Super Tiling Optimization
      • Fuse groups
      • Memory footprint check
      • Finding a good tiling factor
  • Recommended submission process
    • Coding Style
    • Updating this Documentation
  • Debug tips and tricks
  • References
    • Glossary
  • Testing
    • Running tests
    • How test code works
      • Fixtures
      • Parametrization
      • Multiple parameters
      • Caching