Bridge

What it does

Bridge sits between your local language models and a cloud model and decides where each job should run. Simple work stays on your local models and heavy work goes to the cloud, and it also watches local model memory and health so your setup doesn't fall over.

How it works

1. 01

   Add the template and tell it about your local models and the cloud model you use.

2. 02

   It looks at each job you hand it and judges how heavy it is.

3. 03

   Simple jobs go to your local models and heavy ones go to the cloud model.

4. 04

   It keeps checking local memory and health and warns you before things fall over.