How It Works Ecosystem

The open directory of AI agents, LLMs, MCP servers, workflows, and tools — search, compare, and track status across platforms.

Explore

Browse All AI Agents LLMs MCP Servers Tools & Frameworks

Account

Sign In Create Account Submit an Agent Saved Agents

Support

How It Works FAQ Report an Issue

Company

ATMEZ AI Solutions

© 2026 ATMEZ AI Solutions · All rights reserved.

Built with ❤️ for the AI community

All Agents LLMs MCP Servers Workflows Frameworks Tools Skills GenAI News

huggingface-tokenizers | Genaihub

huggingface-tokenizers

Fast BPE/WordPiece tokenization and custom vocab training.

Live

Open / InstallLast updated August 22, 2026

Description

Fast BPE/WordPiece tokenization and custom vocab training. A reusable SKILL.md agent skill by NousResearch.

Author

NousResearch

Platform

cli

Pricing model

free

Categories

Skills

Tags

skill
claude-skill
github
en

Capabilities

231,462 stars
SKILL.md package