---
title: "Your Judge Is Hallucinating Too"
speakers:
  - name: Brian Kennedy
    affiliation: ZoomInfo
room: "Continental 4–6 (Mainstage)"
starts_at: 2026-11-11T15:06:00-08:00
ends_at: 2026-11-11T15:19:00-08:00
format: talk
recording: 2026-11-11_1522_brian-kennedy
duration: 27.6
source: qwen3-asr-1.7b
---

> A 28-second fragment: the last lines of the talk only, recorded 15:22:39–15:23:07, after the
> slot's scheduled end (15:06–15:19); the talk ran over. Filed on the operator's attribution, not
> on a name in the audio: the folder title names the speaker, and the closing lines answer the
> abstract (a judge measured against a second check run in shadow mode). Neither transcript
> names the talk, the speaker or his company.
>
> Transcribed locally with Qwen3-ASR 1.7B (timings per ~5 s segment), prompted with the
> speaker names and affiliations of overlapping sessions. Qwen's text ends at 00:00:18; the
> closing "Thank you." is only in the Voice Memos transcript. The Voice Memos transcript is kept beside it as `transcript.txt`.

### 00:00:00 — Closing

Then read the cases, see where the two disagree, and don't overthink it. Just start small. We entrusted our judge until we measured it. Measure yours. Run a second check. Run in shadow mode, seeing where it disagrees. You may be surprised at what you find.