PowerInfer
High-speed Large Language Model Serving for Local Deployment
Live
Open / InstallLast updated October 12, 2026
Description
High-speed Large Language Model Serving for Local Deployment. An open-source AI framework/SDK by Tiiny-AI, hosted on GitHub.
Community Metrics
Views
9,819
Avg Rating
N/A
Ratings
0
Likes
0
Comments
—
Author
Tiiny-AI
Platform
api
Pricing model
free
Categories
- AI Frameworks
Tags
- large-language-models
- llama
- llm
- llm-inference
- local-inference
- github
Capabilities
- 9,819 stars
- C++
Information
TypeFramework
SourceGitHub
AddedOctober 12, 2026