Files
sunnypilot-byd/tinygrad_repo/docs/developer/runtime.md
T
github-actions[bot] de77c89cf6 sunnypilot v2026.002.000
version: sunnypilot v2026.002.000 (staging)
date: 2026-07-21T07:44:02
master commit: 2c334ede443d7391d27575af8c854a095ba702a8
2026-07-21 07:44:02 +00:00

1.2 KiB

Runtime Overview

Overview

A typical runtime consists of the following parts:

Compiled

The Compiled class is responsible for initializing and managing a device.

::: tinygrad.device.Compiled options: members: [ "synchronize" ] show_source: false

Allocator

The Allocator class is responsible for managing memory on the device. There is also a version called the LRUAllocator, which caches allocated buffers to optimize performance.

::: tinygrad.device.Allocator options: members: true show_source: false

::: tinygrad.device.LRUAllocator options: members: true show_source: false

Program

The Program class is created for each loaded program. It is responsible for executing the program on the device. As an example, here is a CPUProgram implementation which loads program and runs it.

::: tinygrad.runtime.ops_cpu.CPUProgram options: members: true

Compiler

The Compiler class compiles the output from the Renderer and produces it in a device-specific format.

::: tinygrad.device.Compiler options: members: true