GPT4All,一个免费开源使用、本地运行的、注重隐私的LLM 聊天机器人

它无需 GPU 或互联网，可在 CPU 和几乎任何 GPU 上本地运行的开源大型语言模型。支持Windows、macOS和linux，下载安装完后，选择需要的模型下载即可使用，也支持使用openai key进行使用，响应迅速，功能实用。

模型下载

模型选择

GPT4All 的工作原理

GPT4All 是一个生态系统，用于训练和部署在消费级 CPU 上本地运行的强大且定制的大型语言模型。

目标很简单——成为任何个人或企业都可以自由使用、分发和构建的最佳指令调整助理式语言模型。

GPT4All 模型是一个 3GB – 8GB 文件，您可以下载该文件并将其插入 GPT4All 开源生态系统软件中。Nomic AI 支持并维护这个软件生态系统，以加强质量和安全性，同时带头让任何个人或企业轻松训练和部署自己的边缘大型语言模型。
免费开源 LLM 聊天机器人官网下载

官网：https://gpt4all.io

GitHub：https://github.com/nomic-ai/gpt4all

---------

gpt4all: open-source LLM chatbots that you can run anywhere

gpt4all.io 

GPT4All

Open-source large language models that run locally on your CPU and nearly any GPU

GPT4All Website and Models

GPT4All Documentation

Discord

🦜️🔗 Official Langchain Backend

GPT4All is made possible by our compute partner Paperspace.

Run on an M1 macOS Device (not sped up!)

GPT4All: An ecosystem of open-source on-edge large language models.

Important

GPT4All v2.5.0 and newer only supports models in GGUF format (.gguf). Models used with a previous version of GPT4All (.bin extension) will no longer work.

GPT4All is an ecosystem to run powerful and customized large language models that work locally on consumer grade CPUs and any GPU. Note that your CPU needs to support AVX or AVX2 instructions.

Learn more in the documentation.

A GPT4All model is a 3GB - 8GB file that you can download and plug into the GPT4All open-source ecosystem software. Nomic AI supports and maintains this software ecosystem to enforce quality and security alongside spearheading the effort to allow any person or enterprise to easily train and deploy their own on-edge large language models.

What's New (Issue Tracker)

• October 19th, 2023: GGUF Support Launches with Support for:
  • Mistral 7b base model, an updated model gallery on gpt4all.io, several new local code models including Rift Coder v1.5
  • Nomic Vulkan support for Q4_0, Q6 quantizations in GGUF.
  • Offline build support for running old versions of the GPT4All Local LLM Chat Client.
• September 18th, 2023: Nomic Vulkan launches supporting local LLM inference on AMD, Intel, Samsung, Qualcomm and NVIDIA GPUs.
• August 15th, 2023: GPT4All API launches allowing inference of local LLMs from docker containers.
• July 2023: Stable support for LocalDocs, a GPT4All Plugin that allows you to privately and locally chat with your data.

Chat Client

Run any GPT4All model natively on your home desktop with the auto-updating desktop chat client. See GPT4All Website for a full list of open-source models you can run with this powerful desktop application.

Direct Installer Links:

• macOS

• Windows

• Ubuntu

Find the most up-to-date information on the GPT4All Website

Chat Client building and running

• Follow the visual instructions on the chat client build_and_run page

Bindings

• 🐍 Official Python Bindings
• 💻 Official Typescript Bindings
• 💻 Official GoLang Bindings
• 💻 Official C# Bindings
• 💻 Official Java Bindings

Integrations

• 🗃️ Weaviate Vector Database - module docs

Contributing

GPT4All welcomes contributions, involvement, and discussion from the open source community! Please see CONTRIBUTING.md and follow the issues, bug reports, and PR markdown templates.

Check project discord, with project owners, or through existing issues/PRs to avoid duplicate work. Please make sure to tag all of the above with relevant project identifiers or your contribution could potentially get lost. Example tags: backend, bindings, python-bindings, documentation, etc.

Technical Reports

📗 Technical Report 3: GPT4All Snoozy and Groovy

📗 Technical Report 2: GPT4All-J

📗 Technical Report 1: GPT4All 

from https://github.com/nomic-ai/gpt4all