Llama 2

The next generation of our open source large language model This release includes model weights and starting code for pretrained and fine-tuned Llama language models — ranging from 7B to 70B parameters. Llama 2 was trained on 40% more data than Llama 1, and has double the context length. Training Llama-2-chat: Llama 2 is pretrained using publicly available online data. An initial version of Llama-2-chat is then created through the use of supervised fine-tuning. Next, Llama-2-chat is iteratively refined using Reinforcement Learning from Human Feedback (RLHF), which includes rejection sampling and proximal policy optimization (PPO). Meta and Microsoft have partnered to unveil Llama 2, the open-source successor to their widely-utilized large language model, Llama. This groundbreaking model is designed to enhance the capabilities of AI, offering it free for both research and commercial use. Recognized as the preferred partner, Microsoft is integrating Llama 2 into its Azure AI model catalog, providing developers with robust cloud-native tools and optimization for Windows platforms. Llama 2 is also accessible through other major providers like AWS and Hugging Face. Dedicated to responsible AI innovation, Meta and Microsoft emphasize transparency and community-oriented development with resources like red-teaming exercises, a transparency schematic, and a responsible use guide. Collaborative initiatives such as the Open Innovation AI Research Community and the Llama Impact Challenge are also part of the rollout, aiming to spur responsible applications of Llama 2 across various sectors.