Llama 3.1 405B
meta-llama/llama-3.1-405b-instructRun Llama 3.1 405B in a hosted Python Task with file inputs.
Meta's largest open-source Llama 3.1 model via OpenRouter with 405B parameters. Delivers frontier-level performance with instruction tuning for complex reasoning and generation tasks.
This model is deprecated and not recommended for new projects.
What Llama 3.1 405B supports in qbash
- Document inputReads PDF, TEXT, DOC, XLS, RTF and 7 more files.
What is qbash?
qbash is where you build Tasks: Python programs that run a business process on managed infrastructure. Your code runs the steps and calls a model like Llama 3.1 405B only at the ones that need judgment, with integrations, memory and files available in the same script.
A developer writes the Task once, and anyone on the team runs it from a form, on a schedule, from a webhook or from chat. Each Task is versioned and every run is logged.
Specifications
- Context window
- 128Ktokens
- Max output
- 4,096tokens
- Temperature
- 0 to 2default 1
Use Llama 3.1 405B in a Python Task
qbash.ai.raw calls Llama 3.1 405B from a Task and returns its reply as a string.
notes = qbash.inputs.get("notes")
summary = qbash.ai.raw(
f"Summarize these meeting notes in five bullets:\n\n{notes}",
model="meta-llama/llama-3.1-405b-instruct",
system="You are a concise analyst.",
)
qbash.output({"summary": summary})
Llama 3.1 405B pricing
| Input | $4.00 per 1M tokens |
|---|---|
| Output | $4.00 per 1M tokens |
Standard rates in USD.
Supported file formats
Documents
- TEXT
- DOC
- XLS
- RTF
- DOCX
- XLSX
- PPTX
- PPT
- ODT
- ODP
- ODS