Pick model tiers for 2 million support tickets
Your task
Your Python pipeline will sort 2 million support tickets into 12 routing buckets. One bucket is escalations, about 3% of tickets, and for those it also drafts a careful apology to the customer. A teammate proposes calling the largest, most capable model for every ticket, to keep things simple.
What is your read on that, and how would you set up the pipeline?
It covers
- Model tier
- Cost quality