Skip to content

v0.14.0 Release Notes

Release Date: 2026-07-20

This release standardizes VisionSpec's rubrics on the shared structured-evaluation RubricSet — one rubric type across the ecosystem, in Go, on disk, and through evaluation. VisionSpec's parallel rubric types are retired, all profile rubrics are migrated to the canonical format, and the LLM judge prompt now renders the actual scoring criteria.

Highlights

  • Shared rubric spec: rubrics use structured-evaluation's RubricSet everywhere — flat rubrics as categorical scales, rich rubrics as weighted criteria with indicators
  • Canonical canvas assets: profiles consume OpportunitySpec/BMC templates and rubrics from prism-roadmap instead of duplicating them
  • Richer judge prompts: the evaluation prompt renders each category's pass/partial/fail criteria (flat) and weighted criteria with indicators (rich)
  • Per-project rubric config: visionspec.yaml's rubrics block is now honored — custom rubric files and pass-criteria policy apply across every evaluation path

Breaking Changes

  • pkg/rubrics adopts structured-evaluation/rubric.RubricSet as the sole rubric type. The VisionSpec-local RubricSet, Category, CategoricalCriteria, PassCriteria, and ToEvaluationRubricSet are removed. rubrics.Loader.Load, rubrics.Get, and rubrics.MustGet now return *structured-evaluation/rubric.RubricSet.
  • Rubric YAML format is now structured-evaluation native: the spec type comes from the filename (no spec_type field), flat rubrics use scale.options, and pass criteria use passCriteria (minCategoriesPassing / maxFindingsSeverity / scoreThresholds). The legacy flat format (criteria: {pass, partial, fail}, pass_criteria) is no longer parsed. profiles export writes the native format.

What's New

Structured-Evaluation Rubric Type

VisionSpec's registered rubrics and all profile rubrics build/parse into the canonical rubric.RubricSet. Flat categories use a categorical Scale; rich categories decompose into weighted Criteria, each with pass/partial/fail bands carrying a description and concrete indicators.

Canonical Canvas Assets from prism-roadmap

OpportunitySpec and Business Model Canvas templates and rubrics are consumed from prism-roadmap (via embedded loaders) rather than duplicated per profile, eliminating drift. Canvas rubrics are authored in the rich weighted-criteria form and evaluate end-to-end.

Richer Judge Prompts

eval.buildEvalPrompt now includes each category's scoring criteria in the prompt — flat categories render their pass/partial/fail criteria; rich categories render each weighted sub-criterion with its pass description and indicators. Category weights are shown relative to the rubric total.

Project Rubrics Config

A project's visionspec.yaml rubrics block now takes effect during evaluation (previously it was inert):

rubrics:
  directory: .rubrics                  # per-project rubric files
  overrides:
    prd: enterprise/prd.rubric.yaml    # specific file for a spec type
  strict_mode: true                    # every category must reach Acceptable
  max_medium: 3                        # override finding limits

Rubrics resolve overrides → directory → the profile's built-in rubrics (paths relative to the project). strict_mode and the max_* limits apply across eval, synthesize --eval, and the MCP run_eval / eval_draft tools.

Migration Guide

Custom rubric YAML files must be converted to the structured-evaluation format:

# Before (legacy flat)
spec_type: prd
categories:
  - id: problem
    criteria: {pass: "...", partial: "...", fail: "..."}
pass_criteria: {require_all_pass: false, max_critical: 0, max_high: 0, max_medium: 2}

# After (structured-evaluation native; spec type from filename)
id: prd-rubric
categories:
  - id: problem
    scale:
      type: categorical
      options:
        - {value: pass, criteria: ["..."]}
        - {value: partial, criteria: ["..."]}
        - {value: fail, criteria: ["..."]}
passCriteria:
  minCategoriesPassing: all_required
  maxFindingsSeverity: {critical: 0, high: 0, medium: 2, low: -1}

Code that referenced the VisionSpec-local rubric types should switch to github.com/plexusone/structured-evaluation/rubric.

New Dependencies

  • github.com/plexusone/structured-evaluation v0.10.0 — rich weighted-criteria rubric form and YAML tags
  • github.com/grokify/prism-roadmap v0.16.0 — canonical canvas templates and rubrics

Requirements

  • Go 1.26+