AI-assisted engineering/System design with AI parts

Design the triage system, then price it

System design with AI partsHard45 min

Design a system with model calls in the loop: evals, fallbacks, and cost math included.

Your task

Design the triage system, then prove you can price it.

  • declare your pipeline in PIPELINE: one entry per step, with an eval and a fallback on every model step
  • write monthly_cost(pipeline, prices, items_per_day, days) and get the arithmetic right
  • prices are dollars per million tokens; the cache discount applies to INPUT tokens only
  • runs_per_item is fan-out: a step that runs on 12 percent of items is 0.12, a step that retries once is 2.0
  • design.md and cost_math.md are read by the critique, not by the suite. Write them for a reviewer

The suite runs your cost function against pipelines you have not seen, where the right answer is arithmetic, and checks that your own pipeline has model steps and that every one of them declares an eval and a fallback.