Inference GPU autoscaler

Hard3 min read