AI Hub
Platformopen-source

openinfer-project/openinfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2 GitHub stars: 528.

githubLLM ToolsPlatformcudacuda-kernelsdeepseek

Discover 5 new AI tools every week

Join our free newsletter and stay ahead of the curve.

Similar Tools in Platform