OpenSource alternatives to ChatGPT
For small Business and starters to get hands on AI and play around before you commit and make up your business case as what you want to get from AI. Here are some good opensource available
Top Open Source Web UI which are good replacement to Chat GPT
Here are some of good AI project that allows you to ask questions about your documents using the power of Large Language Models (LLMs), even in scenarios without an Internet connection. 100% private, no data leaves your execution environment at any point.
The project provides an API offering all the primitives required to build private, context-aware AI applications. It follows and extends the OpenAI API standard, and supports both normal and streaming responses.
The API is divided into two logical blocks:
High-level API, which abstracts all the complexity of a RAG (Retrieval Augmented Generation) pipeline implementation:
- Ingestion of documents: internally managing document parsing, splitting, metadata extraction, embedding generation and storage.
- Chat & Completions using context from ingested documents: abstracting the retrieval of context, the prompt engineering and the response generation.
Low-level API, which allows advanced users to implement their own complex pipelines:
- Embeddings generation: based on a piece of text.
- Contextual chunks retrieval: given a query, returns the most relevant chunks of text from the ingested documents.
Private GPT : https://github.com/imartinez/privateGPT/tree/main
Installation steps with and without GPU
# Clone the repo
git clone https://github.com/imartinez/privateGPT
cd privateGPT
# Install Python 3.11
pyenv install 3.11
pyenv local 3.11
# Install dependencies
poetry install — with ui,local
# Download Embedding and LLM models
poetry run python scripts/setup
# (Optional) For Mac with Metal GPU, enable it. Check Installation and Settings section
to know how to enable GPU on other platforms
CMAKE_ARGS=”-DLLAMA_METAL=on” pip install — force-reinstall — no-cache-dir llama-cpp-python
# Run the local server
PGPT_PROFILES=local make run
# Note: on Mac with Metal you should see a ggml_metal_add_buffer log, stating GPU is
being used
# Navigate to the UI and try it out!
H2oGPT
https://github.com/h2oai/h2ogpt#macos-cpum1m2-with-full-document-qa-capability
Query and summarize your documents or just chat with local private GPT LLMs using h2oGPT, an Apache V2 open-source project.
LibreChat
https://docs.librechat.ai/install/configuration/custom_config.html
https://github.com/danny-avila/LibreChat
And Above All Text Generation Web UI
https://github.com/oobabooga/text-generation-webui?tab=readme-ov-file#one-click-installers
And easy one for beginners LM Studio
