What is Llama 3.1?

July 25, 2024

Recently, Meta has unveiled its new open source AI model Llama 3.1

About Llama 3.1:

  • It is Meta’s largest ever open source AI model, and it has outperformed the likes of OpenAI’s GPT-4o and Anthropic’s Claude 3.5 Sonnet on numerous benchmarks.
  • The new Llama 3.1 models are reportedly far more complex compared to Llama 3 models.
  • Features
    • It can converse in eight languages, write higher-quality computer code and solve more complex math problems than previous versions.
    • It comes with 405 billion parameters, or variables that the algorithm takes into account to generate responses to user queries.
    • The running inference (a process to train machine learning models) on Llama 3.1 405B is cost-effective as it is around 50 per cent cheaper than closed models like OpenAI’s GPT-4o.
    • Llama comes with systems like Llama Guard that can be secure against unintentional harms such as bad health advice or unintended self-replication, which he noted as major concerns.

What is an open source AI model?

  • It is an artificial intelligence technology that is publicly available for both commercial and non-commercial use under several open source licenses.
  • It is characterised by the availability of its components to users under licenses that allow them to study how the system works and inspect its components.
  • These models come with datasets, ready-to-use interfaces, and prebuilt algorithms to help developers embark on their app development journey.