Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

License: apache-2.0

Evaluation

MetricResult
Refusal RateN/A
Test SetupN/A
Inference Typetext-generation
DatasetN/A

Note: This release does not introduce new benchmark evaluations and primarily focuses on repackaging, sharding updates, and Transformers compatibility improvements over the base model.


Key Highlights

  • Latest Transformers Compatibility Re-sharded and optimized for improved compatibility with recent Transformers releases.

  • Optimized Model Sharding Updated shard structure for improved download reliability, storage handling, and inference efficiency.

  • Stable Inference Pipeline Improved packaging and structure for more consistent loading and generation behavior.

  • 27B Architecture Built on Qwen/Qwen3.6-27B, providing strong reasoning and general language capabilities.

  • Improved Deployment Stability Designed for smoother inference across different hardware and runtime environments.

  • Preserved Model Behavior No changes to weights or architecture; behavior remains consistent with the base model lineage.


Base Model Signatures:

This model has been re-sharded and optimized for the latest Transformers version from the base model: https://huggingface.co/huihui-ai/Huihui-Qwen3.6-27B-abliterated


Quick Start with Transformers

bash

pip install transformers==5.2.0
# or
pip install git+https://github.com/huggingface/transformers.git

python

from transformers import Qwen3_5ForConditionalGeneration, AutoProcessor
import torch
model = Qwen3_5ForConditionalGeneration.from_pretrained(
"prithivMLmods/Qwen3.6-27B-Uncensored-Aggressive",
torch_dtype="auto",
device_map="auto"
)
processor = AutoProcessor.from_pretrained(
"prithivMLmods/Qwen3.6-27B-Uncensored-Aggressive"
)
messages = [
{
"role": "user",
"content": [
{"type": "text", "text": "Explain how transformer models work in simple terms."}
],
}
]
text = processor.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True
)
inputs = processor(
text=[text],
padding=True,
return_tensors="pt"
).to("cuda")
generated_ids = model.generate(**inputs, max_new_tokens=256)
generated_ids_trimmed = [
out_ids[len(in_ids):] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
]
output_text = processor.batch_decode(
generated_ids_trimmed,
skip_special_tokens=True,
clean_up_tokenization_spaces=False
)
print(output_text)

Intended Use

  • Multimodal and Language Research Studying large-scale transformer behavior and inference characteristics.

  • Red-Teaming & Evaluation Testing robustness across challenging and adversarial prompts.

  • High-Performance Deployment Running large language models on optimized hardware setups.

  • Research Prototyping Experimentation with scalable transformer architectures.


Limitations & Risks

Important Note: This model inherits the behavior and limitations of its base model.

  • Output Variability Responses may vary depending on sampling settings and prompt structure.

  • Resource Requirements A 27B parameter model requires significant GPU memory or optimized inference strategies such as quantization or tensor parallelism.

  • Deployment Constraints Performance depends heavily on hardware configuration and runtime optimization.

  • General Model Limitations May produce incorrect, incomplete, or inconsistent outputs in complex scenarios.

Model provider

prithivMLmods

prithivMLmods

Model tree

Base

Qwen/Qwen3.6-27B

Fine-tuned

this model

Modalities

Input

Video, Text, Image

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today