Skip to main content
Back to Tools

Open-Source AI

Open-weight models, frameworks, and tools you can run locally or self-host for privacy and customisation.

20 tools available

About This Category

Open-source AI tools let you run models and frameworks on your own hardware or servers, giving you full control over your data and customization options. These tools are used by developers, researchers, and organizations that need privacy, cost control, or the ability to modify AI behavior. They solve the problems of vendor lock-in, data privacy concerns, and the need for specialized configurations.

Who Uses These Tools

Privacy-focused enterprises

Compliance-heavy organizations use self-hosted open-source AI to keep sensitive data on-premises and avoid cloud vendor dependencies.

Researchers developing models

Academic and research teams use open frameworks to experiment with custom architectures, train on proprietary datasets, and publish reproducible work.

Edge device applications

Embedded systems engineers and IoT developers deploy lightweight open models directly on phones, cameras, and IoT devices for offline inference.

Frequently Asked Questions

How to Choose

  • Compare total cost of ownership

    Look beyond the free software cost to include hardware, hosting, maintenance, and developer time needed to deploy and manage the solution yourself.

  • Evaluate ease of local setup

    Check documentation, community support, and available guides for installation on your preferred hardware or infrastructure, especially if you lack DevOps expertise.

  • Check integration ecosystem

    Verify what existing tools, libraries, and platforms the framework or model works with, and whether it supports common deployment targets like Docker or Kubernetes.

  • Assess model performance fit

    Compare model size, speed, accuracy, and memory requirements against your actual use case—smaller models run faster locally but may sacrifice quality.

Compare Open-Source AI tools

All comparisons →

Head-to-head breakdowns for the most popular open-source ai tools — updated as the directory grows.

Browse Tools

Open-Source AIVerified Jun

Platform for sharing and discovering machine learning models and datasets.

Editor's PickVerified
freemiumFree Tier
Open-Source AI

Open-source large language model from Meta for developers and researchers.

Verified
open-sourceFree Tier
Open-Source AIVerified Jun

Run AI models locally on your device without cloud dependency

NewVerified
open-sourceFree Tier
Open-Source AI

Node-based workflow editor for Stable Diffusion image generation.

New
open-sourceFree Tier
Open-Source AI

Open-source RAG framework for building AI applications with knowledge bases

NewVerified
open-sourceFree Tier
Open-Source AIVerified May

Open-source RAG engine with document processing and agent capabilities.

NewVerified
open-sourceFree Tier
Open-Source AIVerified Jun

Web interface for running and managing local AI models

NewVerified
open-sourceFree Tier
Open-Source AI

Open-source AI that converts natural language questions into SQL queries.

New
open-sourceFree Tier