meta-llama
Meta: Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
Context
131k tokens
Input / 1M tokens
$0.02
Output / 1M tokens
$0.03
Benchmark
—
Pricing
Input tokens$0.02 per 1M tokens
Output tokens$0.03 per 1M tokens
Technical details
Model IDmeta-llama/llama-3.1-8b-instruct
Context window131k tokens
Input modalitiestext
Output modalitiestext
TokenizerLlama3
Max output tokens16,384
Use with MegaBrain
import OpenAI from 'openai'
const client = new OpenAI({
baseURL: 'https://getmegabrain.com/api/gateway/v1',
apiKey: process.env.MEGABRAIN_API_KEY,
})
const response = await client.chat.completions.create({
model: 'meta-llama/llama-3.1-8b-instruct',
messages: [{ role: 'user', content: 'Hello!' }],
})Ready to use Meta: Llama 3.1 8B Instruct?
Get an API key and start making requests in minutes.
Get an API key