Goliath 120B

Released Nov 10, 2023Knowledge cutoff Dec 31, 20236,144 context$3.75/M input tokens$7.50/M output tokens

A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale.

Credits to

@chargoddard(opens in new tab) for developing the framework used to merge the model - mergekit(opens in new tab).
@Undi95(opens in new tab) for helping with the merge ratios.

#merge

Released Nov 10, 2023Knowledge cutoff Dec 31, 20236,144 context$3.75/M input tokens$7.50/M output tokens

A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale.

Credits to

@chargoddard(opens in new tab) for developing the framework used to merge the model - mergekit(opens in new tab).
@Undi95(opens in new tab) for helping with the merge ratios.

#merge