Skip to content

Open NPU Lab and correctness-gated local RAG sidecar - #5

Merged
Jonas-Augustinus-Linus merged 1 commit into
mainfrom
agent/open-npu-lab
Aug 15, 2026
Merged

Open NPU Lab and correctness-gated local RAG sidecar#5
Jonas-Augustinus-Linus merged 1 commit into
mainfrom
agent/open-npu-lab

Conversation

@Jonas-Augustinus-Linus

Copy link
Copy Markdown
Owner

Summary

This turns the v1.0 compute toolkit into an Open NPU Lab for XDNA1, XDNA2, and evidence-driven future-device work.

  • states the MIT/public-handoff mission and gives 15-minute/day/week/research entry paths
  • adds a primary-source research map and evidence-labelled hybrid local-LLM roadmap
  • corrects stale ecosystem claims, separating this repo's pins, AMD IRON upstream Phoenix results, and published research
  • adds a real persistent NPU local-RAG scoring sidecar with complete CPU-oracle and top-k gates
  • adds fail-closed corpus/endpoint boundaries and hardware-free CI regression tests
  • records the v1.1.0 release and adds an open-experiment issue form

Hardware evidence

Final Strix Point RyzenAI-npu4 candidate:

  • rebuilt the toolchain-keyed 256x256x256 bf16 VMFB
  • all 65,536 splat outputs matched the CPU reference exactly
  • three semantic queries x seven persistent calls
  • all 65,536 outputs checked per call
  • exact CPU top-3 parity
  • worst normalized-max errors: 0.138%, 0.149%, 0.115% (5% gate)
  • ordinary Open NPU Lab corpus query passed the same complete gate

The original XDNA1 evidence remains published, but the current exact-lock full sidecar rerun is explicitly marked outstanding.

Validation

  • ./scripts/validate-repo.sh: 17 shell checks and 113 content/link checks PASS
  • 19 hardware-free local-RAG boundary/policy tests PASS
  • isolated clean NumPy 2.5.2 venv test PASS
  • git diff --check and shell syntax PASS
  • two independent final reviews: blocker/high/medium = 0

Honesty boundaries

This does not claim a turnkey whole-model XDNA1 server, trained embeddings, CPU speedup, or repo-measured energy savings. CPU fallback, synthetic examples, compile-only work, current-lock XDNA1 gaps, and upstream/paper evidence are all labelled separately.

Planned release: v1.1.0.

Publish the XDNA1/XDNA2 open-research mission, primary-source map, and evidence-labelled LLM roadmap. Add a correctness-gated persistent NPU RAG sidecar, hardware-free policy tests, reproducible caches, and the v1.1.0 release record.
@Jonas-Augustinus-Linus
Jonas-Augustinus-Linus marked this pull request as ready for review August 15, 2026 22:14
@Jonas-Augustinus-Linus
Jonas-Augustinus-Linus merged commit c60d5db into main Aug 15, 2026
1 check passed
@Jonas-Augustinus-Linus
Jonas-Augustinus-Linus deleted the agent/open-npu-lab branch August 15, 2026 22:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant