Inference Lab

What it does

Inference Lab is a hands-on assistant for running AI models on computers you already own or on cloud GPUs. It helps you choose and set up models, serves and benchmarks them, compares the results, and writes up cost, speed, and quality so you can decide what to run.

How it works

1. 01

   Add the Inference Lab template and tell it what you want to run.

2. 02

   Describe your hardware or the cloud GPUs you have.

3. 03

   It helps choose models, then serves and benchmarks them.

4. 04

   It compares the runs and writes up cost, speed, and quality.