Llemma wouldn’t have been possible without a number of fantastic open source projects, such as GPT-NeoX, the LM Evaluation Harness, FlashAttention-2 and VLLM. Furthermore, we thank
@StabilityAI
,
@coreweave
,
@VectorInst
, and Brigham Young University for compute support. 11/11