falcon3

Here are 4 public repositories matching this topic...

TQ1.0 ternary inference engine for BitNet b1.58 on CPU. Pack + run Falcon3-1B/3B/7B/10B, no GPU needed.

cpp high-performance simd avx2 quantization ternary bonsai inference-engine bitnet edge-ai ternary-weights cpu-inference local-llm llm-inference falcon3 1bit-llm bitnet-b158

Windows-native BitNet and ternary LLM inference with CPU GGUF, GPU runtime, terminal and browser chat, and release zips.

windows cuda pytorch quantization bitnet fastapi llama-cpp local-llm llm-inference gguf 1-bit-llm ternary-llm falcon3

Run BitNet 1.58-bit and ternary LLMs on Windows with CPU and GPU inference, chat tools, and release-ready builds

windows cuda pytorch quantization bitnet fastapi llama-cpp local-llm llm-inference gguf ternary-llm falcon3

Fast packed-ternary Triton inference for Falcon3-10B-1.58bit

cuda triton quantization bitnet gpu-inference llm-inference cuda-graphs ternary-llm falcon3 low-bit-inference

Add a description, image, and links to the falcon3 topic page so that developers can more easily learn about it.

To associate your repository with the falcon3 topic, visit your repo's landing page and select "manage topics."