Claude 3.5 Sonnet
Anthropic’s first release in the upcoming Claude 3.5 model family, the Claude 3.5 Sonnet, is being released today. With the speed and affordability of our mid-tier model, Claude 3 Sonnet, Claude 3.5 Sonnet surpasses the industry standard for intelligence, exceeding rival models and Claude 3 Opus on a wide range of tests.
Claude Pro and Team plan users can get Claude 3.5 Sonnet with noticeably greater rate restrictions, however it is currently free to use on Claude.ai and the Claude iOS app. Additionally, Google Cloud’s Vertex AI, Amazon Bedrock, and the Anthropic API offer it. With a 200K token context window, the model costs $3 for every million input tokens and $15 for every million output tokens.
Frontier intelligence twice as quickly
For graduate-level reasoning (GPQA), undergraduate-level knowledge (MMLU), and coding proficiency (HumanEval), Claude 3.5 Sonnet establishes new industry standards. It is remarkable at producing excellent text in a conversational, natural tone, and it demonstrates noticeable progress in understanding humour, nuance, and complicated directions.
The speed of Claude 3.5 Sonnet is double that of Claude 3 Opus. Because of its cost-effective pricing and speed enhancement, Claude 3.5 Sonnet is the perfect tool for handling complicated activities like organising multi-step workflows and providing context-sensitive customer care.
Claude 3.5 Sonnet outperformed Claude 3 Opus, which solved 38% of the issues, in an internal agentic coding evaluation, solving 64% of the questions. Anthropic’s assessment looks at the model’s capacity to add features or correct bugs in an open source codebase based on a natural language description of what needs to be improved. Claude 3.5 Sonnet can independently develop, edit, and run code with complex reasoning and troubleshooting abilities when given the necessary instructions and tools. It is especially useful for updating legacy apps and migrating codebases because it manages code translations with simplicity.
Cutting-edge vision
Anthropic’s most advanced vision model to date, Claude 3.5 Sonnet outperforms Claude 3 Opus on common vision benchmarks. The most obvious applications of these step-change benefits are in jobs involving visual reasoning, such as chart and graph interpretation. A crucial feature for the retail, logistics, and financial services industries, where artificial intelligence (AI) can extract more information from photographs, graphics, and illustrations than from text alone, is Claude 3.5 Sonnet’s ability to properly transcribe text from poor images.
Artefacts: A novel application Claude
Anthropic is also excited to provide Artefacts, a brand-new feature on Claude.ai that enhances user interaction with Claude. Claude may produce code snippets, written papers, and website designs upon request from the user. These Artefacts show up alongside the user’s chat in a dedicated window. By doing this, customers are able to easily incorporate AI-generated content into their projects and workflows by seeing, editing, and building upon Claude’s contributions in real-time in a dynamic workspace.
With the release of this preview feature, Claude transitions from a conversational AI to a cooperative workspace. This is just the start of Claude.ai’s larger plan, which will soon include more features to facilitate teamwork. With Claude acting as an on-demand teammate, teams and eventually entire organisations will be able to safely centralise their knowledge, papers, and ongoing work in one common area in the near future.
Dedication to privacy and safety
Anthropic’s models undergo extensive testing and are trained to minimise mishandling. Claude 3.5 Sonnet has improved his IQ, but their red teaming evaluations have shown that he is still only at ASL-2. The model card addendum has more information.
Anthropic worked with outside experts to test and improve the safety features in this most recent model as part of their dedication to safety and openness. The UK Artificial Intelligence Safety Institute (UK AISI) just received Claude 3.5 Sonnet from us for pre-deployment safety assessment. As part of an MOU made possible by the cooperation between the US and UK AISIs established earlier this year, the UK AISI finished testing 3.5 Sonnet and communicated its findings with the US AI Safety Institute (US AISI).
Anthropic has included policy input from independent subject matter experts to make sure their assessments are thorough and account for emerging abuse tendencies. Through this partnership, Anthropic experts have been able to assess 3.5 Sonnet against a wider range of usage scenarios. For instance, Anthropic updated their classifiers and adjusted their models based on input from Thorn’s kid safety experts.
Privacy is one of the fundamental constitutional values that informs the creation of Anthropic’s AI model. Unless the user explicitly grants us permission to do so, they do not use user-submitted data to train our generative models. Anthropic haven’t trained their generative models with any user- or customer-submitted data up to this point.
Soon to come
Every few months, Anthropic want to significantly improve the tradeoff curve between cost, speed, and intelligence. They plan to release Claude 3.5 Haiku and Claude 3.5 Opus later this year to complete the Claude 3.5 model family.
Anthropic is creating new modalities and features to support more use cases for businesses, including integrations with enterprise apps, in addition to working on their next-generation model family. Anthropic’s team is also investigating features like Memory, which will allow Claude to keep track of a user’s interaction history and preferences as defined, further personalising and streamlining their experience.
Anthropic is enjoy hearing from their consumers and are always looking for ways to make Claude better. In order to help their teams improve your experience and shape their development roadmap, you can provide feedback on Claude 3.5 Sonnet directly within the product.
