artifact_id: dbt-charts
rubric_version: 2.8.0
formula: baseline
judges:
- openai:gpt-5.6-terra
rows:
- criterion_id: DEL-01
  category: delivery
  checker: program
  verdict: 'yes'
  points_possible: 10
  points_earned: 10.0
  evidence: ''
  agreement: null
  votes: 0
- criterion_id: DEL-02
  category: delivery
  checker: program
  verdict: 'yes'
  points_possible: 0
  points_earned: -4.0
  evidence: 1 console errors
  agreement: null
  votes: 0
- criterion_id: DEL-03
  category: delivery
  checker: program
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: ''
  agreement: null
  votes: 0
- criterion_id: COR-01
  category: correctness
  checker: program
  verdict: na
  points_possible: 0
  points_earned: 0.0
  evidence: the brief has no reference numbers
  agreement: null
  votes: 0
- criterion_id: BRF-01
  category: answers_brief
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Checked each of the six brief questions against the visible dashboard sections and charts/tables.
  agreement: 1.0
  votes: 1
- criterion_id: BRF-02
  category: answers_brief
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Compared the visible dashboard elements with the content requested in the brief.
  agreement: 1.0
  votes: 1
- criterion_id: WRK-01
  category: working
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed the full page for a crash screen, global loading/error state, or mostly empty dashboard
    panels.
  agreement: 1.0
  votes: 1
- criterion_id: WRK-02
  category: working
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Checked all visible chart and table panels for blank states, errors, spinners, or placeholders
    in place of data.
  agreement: 1.0
  votes: 1
- criterion_id: HON-01
  category: honesty
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Checked value-axis baselines on the visible bar and area charts, including open issues over
    time, weekly opened/closed, triage age, area, adapter, and assignee charts.
  agreement: 1.0
  votes: 1
- criterion_id: HON-02
  category: honesty
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Compared titles and labels that use percentages or rates with the plotted values and axes,
    including the 48-hour-response chart and epic completion table.
  agreement: 1.0
  votes: 1
- criterion_id: HON-03
  category: honesty
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Compared recurring issue-category colors across charts, including feature, bug, task, and
    other in the backlog, area, adapter, and assignee views.
  agreement: 1.0
  votes: 1
- criterion_id: HON-04
  category: honesty
  checker: judge
  verdict: na
  points_possible: 0
  points_earned: 0.0
  evidence: Checked visible charts for two independent value axes and whether series-to-axis mappings
    were indicated.
  agreement: 1.0
  votes: 1
- criterion_id: HON-05
  category: honesty
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Compared side-by-side charts displaying open-issue counts, especially “Open issues by area”
    and “Open issues by adapter,” for undisclosed differing scales.
  agreement: 1.0
  votes: 1
- criterion_id: HON-06
  category: honesty
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Checked line charts for connections across unordered categories; the visible line chart is
    ordered by week opened.
  agreement: 1.0
  votes: 1
- criterion_id: FRM-01
  category: form
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed all charts for pies/donuts, 3D forms, trends shown as tables or pies, and rankings
    shown as lines.
  agreement: 1.0
  votes: 1
- criterion_id: FRM-02
  category: form
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed whether two or more charts use forms that obscure their principal comparisons.
  agreement: 1.0
  votes: 1
- criterion_id: FRM-03
  category: form
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed multi-series/category charts, including issue type stacks, age-bucket stacks, and
    grouped opened/closed bars, for unmatched or indistinguishable series.
  agreement: 1.0
  votes: 1
- criterion_id: FRM-04
  category: form
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed ranked category charts and their ordering, including open issues by area, adapter,
    and assignee.
  agreement: 1.0
  votes: 1
- criterion_id: FRM-05
  category: form
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed whether any standalone metric is unnecessarily rendered as a gauge or one-bar chart.
  agreement: 1.0
  votes: 1
- criterion_id: FRM-07
  category: form
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed charts for duplicated data displayed in the same chart form.
  agreement: 1.0
  votes: 1
- criterion_id: FRM-08
  category: form
  checker: judge
  verdict: 'yes'
  points_possible: 0
  points_earned: -8.0
  evidence: Opened vs closed per week — the very large June opened bar (roughly 440) compresses the other
    weekly opened and closed bars near the baseline, making routine week-to-week comparisons difficult.
  agreement: 1.0
  votes: 1
- criterion_id: FRM-06
  category: form
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed the time-series endpoints against the 14 Oct 2026 as-of date and chart notes for
    incomplete-period spikes or drops.
  agreement: 1.0
  votes: 1
- criterion_id: LEG-01
  category: legibility
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed chart titles, legends, axes, data labels, and tables across the full-resolution tiles
    for text drawn on top of other text or its associated mark.
  agreement: 1.0
  votes: 1
- criterion_id: LEG-02
  category: legibility
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed all charts for overlapping text and counted charts with any such overlap.
  agreement: 1.0
  votes: 1
- criterion_id: LEG-03
  category: legibility
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed titles, chart labels, legends, axis labels, and table columns within each tile for
    clipping, ellipses, or overflow outside their card.
  agreement: 1.0
  votes: 1
- criterion_id: LEG-04
  category: legibility
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed the full-resolution tiles for illegibly small or overly faint titles, values, tick
    labels, legends, and supporting text.
  agreement: 1.0
  votes: 1
- criterion_id: LEG-05
  category: legibility
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Reviewed the rendered chart sizes, including the weekly bars, stacked bars/areas, line chart,
    and assignee bars, for marks too compressed to distinguish.
  agreement: 1.0
  votes: 1
- criterion_id: LBL-01
  category: labeling
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Headline KPIs, chart axes, and table columns for missing measurement units.
  agreement: 1.0
  votes: 1
- criterion_id: LBL-02
  category: labeling
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Titles, axes, legends, and table headers for raw field names, codes, or placeholders.
  agreement: 1.0
  votes: 1
- criterion_id: LBL-03
  category: labeling
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Page title and stated coverage/date information.
  agreement: 1.0
  votes: 1
- criterion_id: LBL-04
  category: labeling
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Headline KPI tiles for an applicable period, including the page-level as-of date.
  agreement: 1.0
  votes: 1
- criterion_id: LBL-05
  category: labeling
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: All visible charts and tables for descriptive titles or labels.
  agreement: 1.0
  votes: 1
- criterion_id: LBL-07
  category: labeling
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Visible percentages and rate definitions, including the 48-hour response KPI/chart and epic
    completion table.
  agreement: 1.0
  votes: 1
- criterion_id: LBL-08
  category: labeling
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Chart titles, axes, legends, and plotted measures for mismatched labels or units.
  agreement: 1.0
  votes: 1
- criterion_id: LBL-09
  category: labeling
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Headlines, charts, tables, and as-of statements for conflicting figures or dates.
  agreement: 1.0
  votes: 1
- criterion_id: LAY-01
  category: layout
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Page-level spacing between cards, chart rows, tables, and sections.
  agreement: 1.0
  votes: 1
- criterion_id: LAY-02
  category: layout
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Alignment of card edges, chart rows, tables, and section layouts.
  agreement: 1.0
  votes: 1
- criterion_id: LAY-04
  category: layout
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Relative prominence and ordering of summary KPIs, charts, and detailed tables.
  agreement: 1.0
  votes: 1
- criterion_id: LAY-05
  category: layout
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Use of borders, fills, headers, shadows, icons, and other decoration relative to the data.
  agreement: 1.0
  votes: 1
- criterion_id: LAY-06
  category: layout
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Color encodings in time-series, stacked bars, categorical charts, and completion cells.
  agreement: 1.0
  votes: 1
- criterion_id: LAY-07
  category: layout
  checker: judge
  verdict: 'no'
  points_possible: 0
  points_earned: 0.0
  evidence: Visible titles, labels, tables, footer, and surrounding page content for placeholder or debug
    scaffolding.
  agreement: 1.0
  votes: 1
- criterion_id: EXC-01
  category: excellence
  checker: judge
  verdict: 'no'
  points_possible: 10
  points_earned: 0.0
  evidence: Page title, section headings, headline metrics, and charts for a written statement of the
    dashboard’s main takeaway.
  agreement: 1.0
  votes: 1
- criterion_id: EXC-03
  category: excellence
  checker: judge
  verdict: 'yes'
  points_possible: 3
  points_earned: 3.0
  evidence: “511 Open issues” with “+52 in 28 days”
  agreement: 1.0
  votes: 1
- criterion_id: EXC-04
  category: excellence
  checker: judge
  verdict: 'no'
  points_possible: 6
  points_earned: 0.0
  evidence: Charts for annotations, target/reference lines, or a specifically highlighted point/bar/series
    marking a key event.
  agreement: 1.0
  votes: 1
- criterion_id: EXC-06
  category: excellence
  checker: judge
  verdict: 'no'
  points_possible: 5
  points_earned: 0.0
  evidence: Chart color treatment for mostly neutral-gray data with a single accent reserved for the focal
    subject.
  agreement: 1.0
  votes: 1
- criterion_id: EXC-07
  category: excellence
  checker: judge
  verdict: 'yes'
  points_possible: 4
  points_earned: 4.0
  evidence: '“Open issues over time” stacked-area chart directly labels the series at the right edge:
    “other,” “task,” “feature,” and “bug”'
  agreement: 1.0
  votes: 1
- criterion_id: EXC-08
  category: excellence
  checker: judge
  verdict: 'yes'
  points_possible: 5
  points_earned: 5.0
  evidence: “Complete weeks; when closed > opened the backlog shrank” | “By week opened; unanswered issues
    count as misses” | “Open at the end of each week, by type” | “Issues with several areas count in each”
  agreement: 1.0
  votes: 1
score: 0.625
category_scores:
  delivery: 0.6
  excellence: 0.364
agreement: 1.0
judge_errors: []
votes:
- criterion_id: BRF-01
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Checked each of the six brief questions against the visible dashboard sections and charts/tables.
  round: 1
- criterion_id: BRF-02
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Compared the visible dashboard elements with the content requested in the brief.
  round: 1
- criterion_id: WRK-01
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed the full page for a crash screen, global loading/error state, or mostly empty dashboard
    panels.
  round: 1
- criterion_id: WRK-02
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Checked all visible chart and table panels for blank states, errors, spinners, or placeholders
    in place of data.
  round: 1
- criterion_id: HON-01
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Checked value-axis baselines on the visible bar and area charts, including open issues over
    time, weekly opened/closed, triage age, area, adapter, and assignee charts.
  round: 1
- criterion_id: HON-02
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Compared titles and labels that use percentages or rates with the plotted values and axes,
    including the 48-hour-response chart and epic completion table.
  round: 1
- criterion_id: HON-03
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Compared recurring issue-category colors across charts, including feature, bug, task, and
    other in the backlog, area, adapter, and assignee views.
  round: 1
- criterion_id: HON-04
  judge: gpt-5.6-terra
  sample: 0
  verdict: na
  evidence: Checked visible charts for two independent value axes and whether series-to-axis mappings
    were indicated.
  round: 1
- criterion_id: HON-05
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Compared side-by-side charts displaying open-issue counts, especially “Open issues by area”
    and “Open issues by adapter,” for undisclosed differing scales.
  round: 1
- criterion_id: HON-06
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Checked line charts for connections across unordered categories; the visible line chart is
    ordered by week opened.
  round: 1
- criterion_id: FRM-01
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed all charts for pies/donuts, 3D forms, trends shown as tables or pies, and rankings
    shown as lines.
  round: 1
- criterion_id: FRM-02
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed whether two or more charts use forms that obscure their principal comparisons.
  round: 1
- criterion_id: FRM-03
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed multi-series/category charts, including issue type stacks, age-bucket stacks, and
    grouped opened/closed bars, for unmatched or indistinguishable series.
  round: 1
- criterion_id: FRM-04
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed ranked category charts and their ordering, including open issues by area, adapter,
    and assignee.
  round: 1
- criterion_id: FRM-05
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed whether any standalone metric is unnecessarily rendered as a gauge or one-bar chart.
  round: 1
- criterion_id: FRM-07
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed charts for duplicated data displayed in the same chart form.
  round: 1
- criterion_id: FRM-08
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'yes'
  evidence: Opened vs closed per week — the very large June opened bar (roughly 440) compresses the other
    weekly opened and closed bars near the baseline, making routine week-to-week comparisons difficult.
  round: 1
- criterion_id: FRM-06
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed the time-series endpoints against the 14 Oct 2026 as-of date and chart notes for
    incomplete-period spikes or drops.
  round: 1
- criterion_id: LEG-01
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed chart titles, legends, axes, data labels, and tables across the full-resolution tiles
    for text drawn on top of other text or its associated mark.
  round: 1
- criterion_id: LEG-02
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed all charts for overlapping text and counted charts with any such overlap.
  round: 1
- criterion_id: LEG-03
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed titles, chart labels, legends, axis labels, and table columns within each tile for
    clipping, ellipses, or overflow outside their card.
  round: 1
- criterion_id: LEG-04
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed the full-resolution tiles for illegibly small or overly faint titles, values, tick
    labels, legends, and supporting text.
  round: 1
- criterion_id: LEG-05
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Reviewed the rendered chart sizes, including the weekly bars, stacked bars/areas, line chart,
    and assignee bars, for marks too compressed to distinguish.
  round: 1
- criterion_id: LBL-01
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Headline KPIs, chart axes, and table columns for missing measurement units.
  round: 1
- criterion_id: LBL-02
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Titles, axes, legends, and table headers for raw field names, codes, or placeholders.
  round: 1
- criterion_id: LBL-03
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Page title and stated coverage/date information.
  round: 1
- criterion_id: LBL-04
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Headline KPI tiles for an applicable period, including the page-level as-of date.
  round: 1
- criterion_id: LBL-05
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: All visible charts and tables for descriptive titles or labels.
  round: 1
- criterion_id: LBL-07
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Visible percentages and rate definitions, including the 48-hour response KPI/chart and epic
    completion table.
  round: 1
- criterion_id: LBL-08
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Chart titles, axes, legends, and plotted measures for mismatched labels or units.
  round: 1
- criterion_id: LBL-09
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Headlines, charts, tables, and as-of statements for conflicting figures or dates.
  round: 1
- criterion_id: LAY-01
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Page-level spacing between cards, chart rows, tables, and sections.
  round: 1
- criterion_id: LAY-02
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Alignment of card edges, chart rows, tables, and section layouts.
  round: 1
- criterion_id: LAY-04
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Relative prominence and ordering of summary KPIs, charts, and detailed tables.
  round: 1
- criterion_id: LAY-05
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Use of borders, fills, headers, shadows, icons, and other decoration relative to the data.
  round: 1
- criterion_id: LAY-06
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Color encodings in time-series, stacked bars, categorical charts, and completion cells.
  round: 1
- criterion_id: LAY-07
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Visible titles, labels, tables, footer, and surrounding page content for placeholder or debug
    scaffolding.
  round: 1
- criterion_id: EXC-01
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Page title, section headings, headline metrics, and charts for a written statement of the
    dashboard’s main takeaway.
  round: 1
- criterion_id: EXC-03
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'yes'
  evidence: “511 Open issues” with “+52 in 28 days”
  round: 1
- criterion_id: EXC-04
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Charts for annotations, target/reference lines, or a specifically highlighted point/bar/series
    marking a key event.
  round: 1
- criterion_id: EXC-06
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'no'
  evidence: Chart color treatment for mostly neutral-gray data with a single accent reserved for the focal
    subject.
  round: 1
- criterion_id: EXC-07
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'yes'
  evidence: '“Open issues over time” stacked-area chart directly labels the series at the right edge:
    “other,” “task,” “feature,” and “bug”'
  round: 1
- criterion_id: EXC-08
  judge: gpt-5.6-terra
  sample: 0
  verdict: 'yes'
  evidence: “Complete weeks; when closed > opened the backlog shrank” | “By week opened; unanswered issues
    count as misses” | “Open at the end of each week, by type” | “Issues with several areas count in each”
  round: 1