meta-llama

Meta: Llama 3.1 70B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Context
131k tokens
Input / 1M tokens
$0.40
Output / 1M tokens
$0.40
Benchmark

Pricing

Input tokens$0.40 per 1M tokens
Output tokens$0.40 per 1M tokens

Technical details

Model IDmeta-llama/llama-3.1-70b-instruct
Context window131k tokens
Input modalitiestext
Output modalitiestext
TokenizerLlama3
Max output tokens16,384

Use with MegaBrain

import OpenAI from 'openai'

const client = new OpenAI({
  baseURL: 'https://getmegabrain.com/api/gateway/v1',
  apiKey: process.env.MEGABRAIN_API_KEY,
})

const response = await client.chat.completions.create({
  model: 'meta-llama/llama-3.1-70b-instruct',
  messages: [{ role: 'user', content: 'Hello!' }],
})

Ready to use Meta: Llama 3.1 70B Instruct?

Get an API key and start making requests in minutes.

Get an API key
Meta: Llama 3.1 70B Instruct — MegaBrain Gateway