Developer Manual

• Introduction
• Build and setup
  • Prerequisites
  • Download the code
  • Install required system packages
  • Build compiler and runtime for host
  • Build runtime for target
• Compile and run a model
• Design
  • Torq compiler backend
    • Overview
    • Dialects
    • Passes
    • Data Layout
    • Memory Allocation and Planning
    • Strided Convolutions
    • Torq HAL driver
• TOSA to Torq Conversion
  • Example
• Kernel Development
  • NPU HW Overview
  • Programming a Slice
  • EasyKernel
  • Tutorial
    • Vector Multiplication (basic)
    • Vector Multiplication (vectorized)
    • Tensor multiplication (vectorized)
    • Tensor multiplication (optimized)
    • Matrix Reduce
  • Reference
    • Kernel Structure
    • ALU Instructions
    • Vectorization
    • Writing output results
• Adding a New Pass
  • Example
• The Super Tiling Pass
  • Fuse groups
  • Memory footprint check
  • Finding a good tiling factor
• Adding a new compute optimization
• Recommended submission process
  • Coding Style
  • Updating this Documentation
• Debug tips and tricks
• References
  • Glossary
• Testing
  • Running tests
  • Profiling of tests
  • How test code works
    • Fixtures
    • Parametrization
    • Multiple parameters
    • Caching
• Tools
  • Template Profiling Tool
    • Overview
    • Prerequisites
      • Hardware Setup for Remote Testing
    • Quick Start
      • Tool Output
    • Architecture
    • How It Works
      • Template MLIR Files
      • Shape Generation Algorithm
      • Compiler Variants
    • Features and Capabilities
      • What It Can Do
        • 1. Multi-Rank Testing
        • 2. Multi-Dtype Support
        • 3. Dynamic Shape Generation
        • 4. Performance Profiling
        • 5. Selective Test Execution
        • 6. Custom Compiler Options
    • Understanding Test Output
      • Profiling Output
    • Limitations and Current Constraints
      • What It Currently Cannot Do
        • 1. Arbitrary Shape Relationships
        • 3. Complex Dtype Interactions
        • 4. Memory Constraint Validation
        • 5. Multi-Input Shape Broadcasting
• Model testing and debugging workflow
  • Running test suite for a model
    • Initial setup
  • Collect all the tests for a model
  • What the tests do
  • Executing the tests
  • Investigating ERORRs
  • Investigating FAILUREs
  • Debugging a test
  • Performance debugging
  • Executing tests using real hardware
    • Auto-deploying the runtime to the board
    • Deploying a custom NPU kernel module
    • Finding boards on the network
  • Using the results dashboard
  • Advanced: Test framework internals and PyTest fixtures
  • TFLite model testing
    • Initial setup
    • Collecting tests
    • What the tests do
    • Environment variables
    • Running specific subsets
    • How layer extraction works
    • Caching
    • Investigating errors and failures
    • Key TFLite fixtures

This manual is structured step-by-step, starting from introduction and setup, through model conversion, compiling & running, supported operators, testing, and advanced topics.