Changing the prompt and stopping words changed ELO from 1160 to 1211

Baseline.

Elo: 1156

link: https://console.chaiverse.com/models/vicgalle-roleplay-llama-3-8b_v3

Screenshot 2024-04-21 at 09.42.45.png

v2.

Max_output_tokens 64→ 112

Prompt → lots of changes

Elo → +4 (very small improvement!)

link: https://console.chaiverse.com/models/vicgalle-roleplay-llama-3-8b_v4

Screenshot 2024-04-21 at 09.43.50.png

v3.0

Prompt → Change is highlighted below

Elo → +30 (big improvement!)

link: https://console.chaiverse.com/models/vicgalle-roleplay-llama-3-8b_v2

Screenshot 2024-04-21 at 09.46.34.png