VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
Live
Open / InstallLast updated October 12, 2026
Description
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks. An open-source AI framework/SDK by open-compass, hosted on GitHub.
Community Metrics
Views
4,437
Avg Rating
N/A
Ratings
0
Likes
0
Comments
—
Author
open-compass
Platform
api
Pricing model
free
Categories
- AI Frameworks
Tags
- chatgpt
- claude
- clip
- computer-vision
- evaluation
- gemini
- gpt
- gpt-4v
- github
Capabilities
- 4,437 stars
- Python
Information
TypeFramework
SourceGitHub
AddedOctober 12, 2026