meta-llama
Meta: Llama 3.1 70B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Context
131k tokens
Input / 1M tokens
$0.40
Output / 1M tokens
$0.40
Benchmark
—
Pricing
Input tokens$0.40 per 1M tokens
Output tokens$0.40 per 1M tokens
Technical details
Model IDmeta-llama/llama-3.1-70b-instruct
Context window131k tokens
Input modalitiestext
Output modalitiestext
TokenizerLlama3
Max output tokens16,384
Use with MegaBrain
import OpenAI from 'openai'
const client = new OpenAI({
baseURL: 'https://getmegabrain.com/api/gateway/v1',
apiKey: process.env.MEGABRAIN_API_KEY,
})
const response = await client.chat.completions.create({
model: 'meta-llama/llama-3.1-70b-instruct',
messages: [{ role: 'user', content: 'Hello!' }],
})Ready to use Meta: Llama 3.1 70B Instruct?
Get an API key and start making requests in minutes.
Get an API key