Developer Guide

This guide is intended for developers working on the Torq compiler and runtime. It covers the main workflows and extension points for adding new functionality, optimizing compute patterns, and integrating custom kernels. Each section provides step-by-step instructions, code examples, and references to relevant source files to help you get started quickly.

Topics covered:

• How to add support for new operators and convert them to Torq kernels.

• Guidelines for developing efficient kernels using Torq hardware APIs.

• Instructions for creating and registering new compiler passes.

• Methods for implementing and testing compute optimizations.

Explore the sections below for detailed guides and practical examples:

1. Operator and Kernel Support

• TOSA to Torq Conversion Guide
  • Example
• Kernel Development Guide
  • Example: Add kernel
  • Kernel Structure

2. Compiler Passes and Optimizations

• Creating a New Compiler Pass
  • Example
• Implementing Compute Optimizations
• Super Tiling Optimization
  • Fuse groups
  • Memory footprint check
  • Finding a good tiling factor