Show HN: OmnisBench, a re-gradable, open LLM routing benchmark on fresh tasks

 (github.com)

3 points | by fortitudedev 2 hours ago

2 comments

  • quietraster 2 hours ago
    fresh tasks plus regrading could make routing benchmarks much harder to game. how often will the task set rotate?
    [-]
  • fortitudedev 2 hours ago
    [flagged]