User Manual

• Introduction
  • Technical Background
  • Distribution Contents
    • Release Package
    • Docker Image
  • System Requirements
  • Getting Started
  • Support and Contact
• Quickstart
  • Setup
    • Release Package Ubuntu 24.04
    • Docker Image
  • Compile and Run the Model
• Model Preparation
  • Overview
  • Convert a TFLite model to TOSA and MLIR
  • Convert Torch Model to MLIR
  • References
• Input Guide
  • Supported model formats for torq-compile
  • Input Structure for iree-run-module
    • Literal Inputs
    • Multiple Inputs
    • Feeding Input from Files
    • Converting Images to .npy or .bin
• Step-by-Step Model Deployment Examples
  • Converting and Running MobileNetV2 on Torq
    • Set up environment
    • Convert TFLite → TOSA
    • Compile TOSA → Torq model
    • Run inference on Torq
• Supported Operators
  • Activation related Operators
  • Element-Wise Operators
  • Other Operators
• Profiling
  • Compile-Time Profiling
  • Runtime Profiling
• Handling Unsupported Ops
  • CSS Fallback
  • Host Fallback
• Compiling Models for Custom Synaptics SoCs
  • NSS Subsystem Overview
  • Custom Hardware Configuration
    • Example Configurations
• Debug tips and tricks
• References
• Glossary
• Release Notes
  • Version 0.9.0
    • Key Features & Enhancements
    • Fixed Issues
    • Known Issues
    • Breaking Changes in This Release
    • Deprecated Features
    • Documentation