Using Elephas Inbuilt Offline Models

Elephas comes with powerful built-in offline AI models, allowing you to chat and index files without an internet connection. Everything runs locally on your Mac — faster, private, and fully under your control.

Requirements

• Apple Silicon (M1 or later)
• macOS 14+
• Paid Elephas plan

<aside> 💡

No token limits when using offline models

</aside>

Watch Video :

https://www.youtube.com/embed/0_9gt13C33Q?si=YV5LqJ3oUF7DUPDj

Creating a Brain with Offline Models

The primary way to leverage Elephas offline models is through Brain creation. Here's how to set up a Brain using offline models:

1. Open the Create Brain window.
2. Under Mode, select Offline.

1. Choose your models:
   • Indexing Model → Select from offline embedding models (e.g., multilingual-e5-large). multilingual-e5-large offers better quality results than small variant.
   • Default Chat Model → Select from offline chat models (e.g., llama3.2:3b). llama3.2:3b offer good quality results. Uses around 2 GB of memory when running.

1. Click Create Brain to finish.

<aside> 💡

When you create a Brain with an offline model, Elephas takes care of the heavy lifting for you. If the model isn’t already on your machine, it will automatically download and start in the background — no extra clicks needed. Just set it and go!

</aside>