Skip to content
#

npu-inference

Star

Here are 3 public repositories matching this topic...

Language: All
Filter by language
All 3 C++ 1 Python 1 Shell 1

1bit-MONSTER / 1bit-MONSTER

Star 16

Model-agnostic, hardware-agnostic pure-C++ inference engine — one binary, NPU + GPU + CPU. 94% HF architecture coverage. Reverse-engineered AMD's closed-source Strix Halo NPU stack in 4 days. GGUF/ONNX/1BP. Zero Python. MIT.

vulkan mit-license quantization mamba inference-engine model-agnostic cplusplus-23 ai-inference local-llm one-binary gguf open-source-ai amd-strix-halo npu-inference fused-engine xdna-2 zero-python amd-native 1bp-format ternary-inference
  • Updated Aug 17, 2026
  • C++

Improve this page

Add a description, image, and links to the npu-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the npu-inference topic, visit your repo's landing page and select "manage topics."

Learn more