Using Elephas Inbuilt Offline Models

Elephas now comes with inbuilt offline AI models, giving you the ability to use Elephas without an internet connection. With these models, you can run chat and indexing locally on your machine, ensuring complete privacy and faster performance.

You need Apple Silicon (M1 and later) to use this feature.

No Token Limits – As long as you have a paid plan, Elephas Offline Models can be used without any token restrictions.

Creating a Brain with Offline Models

The primary way to leverage Elephas offline models is through Brain creation. Here's how to set up a Brain using offline models:

1. Open the Create Brain window.
2. Under Mode, select Offline.

1. Choose your models:
   • Indexing Model → Select from offline embedding models (e.g., multilingual-e5-large). multilingual-e5-large offers better quality results than small variant.
   • Default Chat Model → Select from offline chat models (e.g., llama3.2:3b). llama3.2:3b offer good quality results. Uses around 2 GB of memory when running.

1. Click Create Brain to finish.

<aside> 💡

When you create a Brain with an offline model, Elephas takes care of the heavy lifting for you. If the model isn’t already on your machine, it will automatically download and start in the background — no extra clicks needed. Just set it and go!

</aside>

Offline Model Indicator

Once your Brain is created, if it uses Elephas Offline for indexing and chat, an Offline badge will appear at the top-left corner near the Brain name:

This confirms that all indexing and chatting are occurring fully offline, keeping your private data secure and local.

File Indexing in Offline Brains