Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more
Container

Run this model inference with full control and performance in your environment.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

License: apache-2.0

Quick Start

Via the olaverse library (recommended)

bash

pip install olaverse[legal]

python

from olaverse.llm import LegalPeace
model = LegalPeace() # defaults to "olaverse/legal-peace-v1.0"
model.load() # requires GPU + unsloth
prompt = "Analyze this clause: 'All disputes shall be resolved through binding arbitration in Delaware.' What are the key implications?"
response = model.generate(prompt, max_new_tokens=300, temperature=0.7)
print(response)

Via Hugging Face directly

python

from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
model_name="olaverse/legal-peace-v1.0",
max_seq_length=2048,
dtype=None,
load_in_4bit=True,
)
FastLanguageModel.for_inference(model)
prompt = "Analyze this clause: 'All disputes shall be resolved through binding arbitration in Delaware.'"
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
outputs = model.generate(**inputs, max_new_tokens=300, temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Performance vs Base Mistral-7B

BenchmarkImprovement
Inference Speed⚡ 10.3% faster (9.27s vs 10.33s)
Contract Analysis📋 32.6% faster
Case Predictions⚖️ 14.0% faster
Response Quality📝 More structured, professional legal responses

Model Details

PropertyValue
Base ModelMistral-7B-v0.3
Parameters7B
Quantization4-bit (unsloth BnB)
TrainingSFT (4,800 cases) + DPO (419 legal reasoning examples)
LicenseApache 2.0

Use Cases

✅ Contract clause analysis and review ✅ Legal research assistance ✅ Evidence evaluation ✅ Case outcome prediction ✅ Legal Q&A

Limitations

⚠️ Beta model — not for production use ⚠️ Not a replacement for legal professionals ⚠️ Always verify outputs with qualified attorneys ⚠️ Trained primarily on U.S. legal data

Links


Made with ❤️ by Olaverse AI

Model provider

olaverse

Model tree

Base

unsloth/mistral-7b-v0.3-bnb-4bit

Fine-tuned

this model

Modalities

Input

Text

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today