AI tools tagged Powered By Llama

LlamaIndex

Featured

RAG · BYO (Claude / GPT / open)

8.7

Data framework for connecting LLMs to your data.

Together AI

Featured

Fine-tuning · Llama / Mistral / Qwen / DeepSeek and others

8.6

Fine-tune & serve open-weight models (Llama, Mistral, DeepSeek).

Cline

Coding · Model-agnostic: Claude (Anthropic), GPT (OpenAI), Gemini (Google), DeepSeek, Grok, Mistral, Cerebras, plus local Ollama/LM Studio

8.7

Open-source agentic coding assistant that plans, edits, and runs code inside your IDE

Elasticsearch Vector Search

RAG · BYO embeddings (OpenAI, Cohere, Hugging Face, Mistral, Bedrock, Vertex, Azure) plus Elastic's built-in ELSER sparse model and E5 dense model

8.7

Hybrid vector + keyword search in the enterprise-grade Elasticsearch engine

Snowflake Cortex

RAG · Anthropic Claude, Meta Llama, Mistral Large 2, Snowflake Arctic

8.7

Generative AI and RAG built into the Snowflake data cloud

AWS Bedrock

Agents · Multi-model: Anthropic Claude, Meta Llama, Mistral, Cohere, AI21, Amazon Nova/Titan, DeepSeek, Stability, OpenAI GPT

8.6

Build and scale generative AI applications with foundation models

DataStax Astra DB

RAG · Bring-your-own embeddings; integrates with OpenAI, Cohere, Hugging Face, Mistral, NVIDIA NIM, and Vertex AI via server-side vectorize

8.6

Serverless vector and document database for production RAG and AI agents

Google Vertex AI

Agents · Gemini 2.5 (Pro/Flash/Nano), Imagen, Veo, Chirp, plus Model Garden (Llama, Mistral, Claude via partner)

8.6

Google Cloud's unified platform for building, deploying, and scaling enterprise AI agents and models.

IBM watsonx

Agents · IBM Granite (3.x, Code, Time Series), Meta Llama 3.x, Mistral, plus other curated open models

8.6

Enterprise AI platform for building, deploying, and governing models and agents

MongoDB Atlas Vector Search

RAG · Bring-your-own embeddings (OpenAI, Cohere, open models); native Voyage AI embeddings and rerankers

8.6

Vector search built into the operational database you're already using.

Glean

Agents · Model-agnostic: routes across 35+ LLMs including GPT-4o, Claude 3.5/4 Sonnet, Gemini 1.5/2, Llama 3, Mistral, plus Glean in-house models

8.5

Work AI platform that unifies enterprise knowledge, search, and agents

Replicate

Fine-tuning · Thousands of community + first-party models

8.5

One-API platform for running and fine-tuning open-source models.

Palantir AIP

Agents · Multi-model (GPT, Claude, Llama, customer-hosted)

8.4

Enterprise AI platform that grounds LLMs in your operational data and runs agents against real business systems.

Yi (01.AI)

Agents · Yi-Lightning (MoE), Yi-Large, Yi-1.5 (6B/9B/34B), Yi-VL, Yi-Coder — in-house 01.AI foundation models

8.4

Foundation models from 01.AI — open-weight Yi family plus frontier Yi-Lightning and Yi-Large

Zed

Coding · Claude (Sonnet/Opus), GPT-4o/5, Gemini, Ollama-hosted local models, and Zed's own Zeta2 open-weight edit-prediction model

8.4

A high-performance, multiplayer code editor built in Rust with native AI agent workflows.

LM Studio

Agents · Multi-model (gpt-oss, Qwen3, Gemma, DeepSeek-R1, Llama, others)

8.3

Desktop app for discovering, downloading, and running open-weight LLMs locally with an OpenAI-compatible server.

LangChain

RAG · BYO (any major LLM)

8.3

The broad LLM application framework — chains, agents, retrievers.

Llama

Fine-tuning · Llama 4 (Maverick, Scout), Llama 3.3/3.2/3.1

8.3

Meta's open-weight LLM family covering 1B mobile models up to 405B frontier and natively multimodal 10M-context Llama 4 variants.

Llama 3

Writing · Llama 3 / 3.1 (8B, 70B, 405B)

8.3

Meta's open-weights LLM family that put serious frontier-adjacent models in everyone's hands.

Qwen

Writing · Qwen3 / Qwen-Image / Qwen-MT / Qwen3Guard

8.3

Alibaba's open-weight foundation model family covering chat, vision, image generation, translation, and safety classification.

Skyvern

Agents · Multi-model (OpenAI, Anthropic, Gemini, Ollama)

8.3

AI browser agent that automates web workflows from natural-language instructions, with CAPTCHA and 2FA handling built in.

Vanna.ai

RAG · Multi-model (Anthropic, OpenAI, Gemini, Ollama)

8.3

Open-source text-to-SQL agent that learns your schema and writes queries against your real warehouse.

n8n

Agents · Multi-model

8.3

Source-available workflow automation with first-class AI-agent and RAG building blocks.

vLLM

Fine-tuning · Multi-model (open-weight LLMs: Llama, Qwen, DeepSeek, Mistral, Gemma, Phi, etc.)

8.3

Open-source high-throughput inference engine for serving LLMs with PagedAttention and continuous batching.

BentoML

Agents · Multi-model

8.2

Open-source framework and managed platform for serving and scaling AI models in production.

Browser Use

Agents · Multi-model (BYO LLM; Claude in hosted Box)

8.2

Open-source browser automation harness and cloud platform for LLM agents that drive real websites.

Jan

Writing · Multi-model (local open-weights + OpenAI/Claude/Gemini via API)

8.2

Open-source desktop ChatGPT alternative that runs local LLMs and routes to cloud providers from one app.

LibreChat

Writing · Multi-model (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Ollama, and others)

8.2

Open-source, self-hostable ChatGPT-style frontend that brings every major LLM provider under one roof.

LiveBench

Evaluation · Multi-model

8.2

Contamination-free LLM benchmark that refreshes its questions monthly to keep frontier models honest.

Msty

Writing · Multi-model (Ollama, Claude, GPT, Gemini, others)

8.2

Privacy-first desktop AI workspace that runs local and cloud models side by side.

OpenPipe

Fine-tuning · Llama, Mistral, Qwen and other open-weight base models

8.2

Fine-tuning and reinforcement learning platform for turning expensive prompts into cheap, fast, task-specific models.

SGLang

Fine-tuning · Multi-model (DeepSeek, Qwen, Llama, Mistral, GLM, GPT-OSS)

8.2

Open-source high-throughput inference engine for LLMs and multimodal models with OpenAI-compatible serving.

Unsloth

Fine-tuning · Llama, Mistral, Gemma, Qwen, GLM (multi-model)

8.2

Open-source LLM fine-tuning toolkit with custom kernels that train 2-30x faster and use up to 90% less VRAM.

Databricks Vector Search

RAG · Multi-model (BYO embeddings or Databricks-hosted)

8.1

Managed hybrid vector search that lives inside the Databricks lakehouse and auto-syncs with your source tables.

Langflow

Agents · Multi-model

8.1

Open-source visual builder for LangChain-style AI agents and RAG pipelines.

LocalAI

Writing · Multi-model (llama.cpp, diffusers, whisper, etc.)

8.1

Self-hosted OpenAI-compatible API for running LLMs, image, and audio models on your own hardware.

PyGPT

Writing · Multi-model (GPT-5, Claude, Gemini, Grok, DeepSeek, Mistral, Ollama)

8.1

Open-source desktop AI assistant that wires every major LLM provider into one local app with agents, vision, and a code interpreter.

Together AI Fine-tuning

Fine-tuning · Multi-model (any Hugging Face open-source model)

8.1

Managed fine-tuning platform for open-source LLMs and vision models with LoRA, full fine-tuning, and RL support.

TruLens

Evaluation · Multi-model (LLM-as-judge)

8.1

Open-source evaluation and tracing framework for LLM apps and agents, built on OpenTelemetry.

W&B Weave

Evaluation · Multi-model

8.1

Production observability, tracing, and evaluation for LLM and agent systems from the Weights & Biases stack.

NovelCrafter

Writing · Multi-model (BYO key: OpenAI, Anthropic, Gemini, Mistral, OpenRouter, Ollama)

8.0

Bring-your-own-key novel-writing workspace with a wiki-style codex and multi-model AI assistance.

AnythingLLM

RAG · Multi-model

7.9

Open-source desktop and self-hosted app that turns your documents into a private chat-and-agent workspace.

Continue

Coding · BYO (any OpenAI-compatible API + Ollama for local)

7.9

Open-source, self-hostable VS Code/JetBrains AI assistant.

Meta AI

Writing · Llama (Meta's open-weight family)

7.9

Meta's free consumer AI assistant powered by the Llama family of open-weight models.

TypingMind

Writing · Multi-model (GPT, Claude, Gemini, Mistral, DeepSeek, local)

7.7

BYOK chat frontend that puts GPT, Claude, Gemini, and local models behind one polished UI.

oMLX

Coding · Multi-model (Qwen, Llama, Mistral, Gemma, DeepSeek, MiniMax, GLM)

7.5

Native macOS LLM inference server built on MLX, with paged SSD KV caching for Apple Silicon agents.

Langchain-Chatchat

RAG · Multi-model (GLM-4, Qwen2, Llama 3, etc. via Xinference/Ollama/LocalAI/FastChat)

7.4

Self-hostable RAG and agent framework that wires LangChain to any local open-source LLM and a knowledge base.

AstrBot

Agents · Multi-model (OpenAI, Anthropic, Gemini, DeepSeek, Ollama, Dify, Coze)

7.3

Open-source agentic AI assistant that bridges chat platforms like Telegram, Discord, and QQ with any LLM and a 1000+ plugin ecosystem.