Alternatives to llama.cpp.
Other Open source & local AI profiles in the same directory. Shared topics show where they overlap. Nothing here was timed, ranked by revenue, or tested on our laptops.
llama.cpp is Use. A local inference engine for GGUF-style model files.
Use1 shared topicCrewAI
crewAI
A Python framework for role-shaped agents.
The library is MIT. Model calls are billed by the provider you choose.
Read the profile →
Use1 shared topicFlowise
Flowise
A visual builder for LLM flows you host yourself.
Free under Apache 2.0. Any model you connect is billed separately.
Read the profile →
Use1 shared topicOllama
Ollama
A local runner for open-weight chat models.
Free to download. The app license is MIT. Each model you pull has its own license.
Read the profile →
Use1 shared topicvLLM
vLLM
An Apache-licensed server for open-weight models.
Free under Apache 2.0. You pay for the GPUs.
Read the profile →
Watch1 shared topicComfyUI
Comfy Org
A node graph for local image and video models.
Free under GPL-3.0. Nodes and models you add can carry other licenses.
Read the profile →