LLM360

• llm360 gh (opens in a new tab)

Code Repositories

• Analysis360 (opens in a new tab) - Evaluation and analysis code for all LLM360 models.

K2-65B

• LLM360 K2-65B: Scaling Up Fully Transparent Open-Source LLMs (opens in a new tab) paper pdf
  • the most powerful fully transparent open-source large language model (LLM) released to date.
• k2-data-prep (opens in a new tab) - Data preparation code for K2-65B model.
• k2-train (opens in a new tab) - Training code for K2-65B model.

CrystalCoder-7B

• crystalcoder-data-prep (opens in a new tab) - Data preparation code for CrystalCoder-7B model.
• crystalcoder-train (opens in a new tab) - Training code for CrystalCoder-7B model.

Amber-7B

• amber-data-prep (opens in a new tab) - Data preparation code for Amber-7B model.
• amber-train (opens in a new tab) - Training code for Amber-7B model.