Best AI Tools for Self Hosted Llms

Top-rated AI Tools for Self Hosted Llms

The highest-rated AI tools for self hosted llms our users keep coming back to.

DeepSeek V3

Generates text like a human. Great at coding, math, and understanding languages. Fast and powerful AI for many tasks.

0

CC-Relay

CC-Relay acts as a switchboard for LLMs, letting your apps talk to many AI providers easily.

0

Docify

Docify builds a local, secure AI RAG system for document management and knowledge search.

0

ModelPilot

ModelPilot routes LLM requests to the best AI model for cost, quality, and speed.

0

nanochat

Trains chatbot models and explores open-source LLM. Build AI chatbots from scratch with clear code.

0

OLMo 2

OLMo 2 is a language model. It helps with tasks like writing text, answering questions, and summarizing info!

0

Parallax by Gradient

Deploys and optimizes LLMs across diverse hardware for efficient, decentralized inference.

0

Sarvam 105B

Sarvam 105B: India's AI foundation model for all 22 official languages, built independently.

0

Frequently asked questions

What is the best AI tool for self hosted llms?

Based on community ratings and our editorial review, the top picks are at the start of this page. We've included 8 options so you can compare features and trade-offs side by side.

How do you decide which AI is best for self hosted llms?

We weigh three signals: feature coverage for the task, real-user ratings on AIapps, and the company's track record. Each tool below is hand-reviewed — no affiliate-driven rankings.

Are there new AI tools for self hosted llms?

New options launch every week. The "Newly launched" section above is sorted by date — check there for tools added in the last 30 days, or browse our This Week feed for the very latest.