Skip to content
Bev

Jev vs Bev

A customer has written in about a very slow classifier. Both get the same ticket and the same 27 questions. Jev reads it once. Bev reads it very carefully.

Ticket #4471: URGENT: classifier taking 4+ minutes per ticket
Subject: URGENT: classifier taking 4+ minutes per ticket

Hi, since Monday your classification API has been taking 3 to 5 minutes per request. Our support queue is backed up to 2,400 tickets and two enterprise customers have escalated. To be clear, it gets every answer right. It just takes forever. The status logs show messages like "looking for reading glasses" and "consulting Doreen." Who is Doreen? We have a partner launch tomorrow at 9am. I need this fixed today or we are switching to Jev.

Dana, Head of Support Ops

Same 27 questions. Same order.

  • JEV --
  • BEV --

JEV

$ npx bev-race ask jev

jev-1.13

BEV

$ npx bev-race ask bev

bev (powered by jev-1.13)

Jev

Requests
1
Input tokens
...
Answers
0 of 27
Time
...
Cost
...

Bev

Requests
1 (the same one)
Input tokens
...
Answers
0 of 27
Time
...
Cost
...