JPQ24

Natural-Synthesis-8b-3.1-v3-4bit

README

License: apache-2.0

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Model Details

Model Provider

JPQ24

Model Tree

Base

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Quantized

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated Endpoints