This website uses cookies to anonymously analyze website traffic using Google Analytics.
AcceptDecline

Models / Chat / NIM Mixtral 8x7B Instruct v0.1 API

NIM Mixtral 8x7B Instruct v0.1 API

Chat

NVIDIA NIM for GPU accelerated Mixtral 8x7B Instruct inference through OpenAI compatible APIs.

Deploy this NIM model
API Usage
How to use NIM Mixtral 8x7B Instruct v0.1Model CardPrompting NIM Mixtral 8x7B Instruct v0.1Applications & Use CasesHow to use NIM Mixtral 8x7B Instruct v0.1

This model is available as a Together Dedicated Endpoints deployment.

Follow our Docs to configure an endpoint via our API or CLI.

NIM Mixtral 8x7B Instruct v0.1 API Usage

Endpoint

nim/mistralai/mixtral-8x7b-instruct-v01
Curl
Python
Typescript

RUN INFERENCE

JSON RESPONSE

RUN INFERENCE

JSON RESPONSE

RUN INFERENCE

JSON RESPONSE

Model Provider:

Meta

Type:

Chat

Variant:

Instruct

Parameters:

46B

Deployment:

✔ Serverless

✔️ On-Demand Dedicated

Quantization

Context length:

32768

Pricing:

Check pricing

Run in playground

Deploy model

Deploy model

Quickstart docs

Quickstart docs

How to use NIM Mixtral 8x7B Instruct v0.1

Model details

Prompting NIM Mixtral 8x7B Instruct v0.1

Applications & Use Cases

How to use NIM Mixtral 8x7B Instruct v0.1

Looking for production scale? Deploy on a dedicated endpoint

Deploy NIM Mixtral 8x7B Instruct v0.1 on a dedicated endpoint with custom hardware configuration, as many instances as you need, and auto-scaling.

Get started
Get started

Subscribe to newsletter

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.