llama-cpp-agent

Description

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls. An open-source AI framework/SDK by Maximilian-Winter, hosted on GitHub.

Community Metrics

Categories

• AI Frameworks

Tags

• agents
• function-calling
• llamacpp
• llm
• llm-agent
• llm-framework
• llms
• parallel-function-call
• github

Capabilities

• 659 stars
• Python

Information