Llama 3.1 70B

meta-llama/llama-3.1-70b-instruct

Run Llama 3.1 70B in a hosted Python Task with structured output and file inputs.

Meta's high-performance Llama 3.1 model via OpenRouter with 70B parameters. Balances quality and efficiency with instruction tuning for diverse applications.

What Llama 3.1 70B supports in qbash

Structured outputReplies as JSON that matches a schema you pass.
Document inputReads PDF, TEXT, DOC, XLS, RTF and 7 more files.

What is qbash?

qbash is where you build Tasks: Python programs that run a business process on managed infrastructure. Your code runs the steps and calls a model like Llama 3.1 70B only at the ones that need judgment, with integrations, memory and files available in the same script.

A developer writes the Task once, and anyone on the team runs it from a form, on a schedule, from a webhook or from chat. Each Task is versioned and every run is logged.

How Tasks work

Specifications

Context window: 128Ktokens
Max output: 4,096tokens
Temperature: 0 to 1default 1

Structured output with Llama 3.1 70B in a Python Task

qbash.ai.raw calls Llama 3.1 70B from a Task. Pass a JSON Schema as output_schema and the reply comes back as a Python dict that matches it, ready to route to a connector.

main.py
ticket = qbash.inputs.get("ticket")

triage = qbash.ai.raw(
    f"Summarize this support ticket and rate its urgency:\n\n{ticket}",
    model="meta-llama/llama-3.1-70b-instruct",
    output_schema={
        "type": "object",
        "properties": {
            "summary": {"type": "string"},
            "urgency": {"type": "string", "enum": ["low", "medium", "high"]},
        },
        "required": ["summary", "urgency"],
    },
)

# triage is a dict, e.g. {"summary": "...", "urgency": "high"}
if triage["urgency"] == "high":
    qbash.integrations.slack.create_message(
        channel="#support",
        text=triage["summary"],
    )

qbash.output(triage)

Structured output in Tasks

Llama 3.1 70B pricing

Input	$0.40 per 1M tokens
Output	$0.40 per 1M tokens

Standard rates in USD.

Supported file formats

Documents

PDF
TEXT
DOC
XLS
RTF
DOCX
XLSX
PPTX
PPT
ODT
ODP
ODS