Routers

Low-latency, high-throughput traffic routing to an unlimited number of ML models.

Supports arbitrary pre-processors and dynamic ensembling of models for each treatment.

Automatically scales up and down (based on a traffic volume) to maximize a throughput and minimize infra bills.

Eliminate engineers from the loop of running an experiment