Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Get help setting up a custom Dedicated Endpoints.
Talk with our engineer to get a quote for reserved GPU instances with discounts.
README
License: apache-2.0Evaluation
| Metric | Result |
|---|---|
| Refusal Rate | N/A |
| Test Setup | N/A |
| Inference Type | text-generation |
| Dataset | N/A |
Note: This release does not introduce new benchmark evaluations and primarily focuses on repackaging, sharding updates, and Transformers compatibility improvements over the base model.
Key Highlights
-
Latest Transformers Compatibility Re-sharded and optimized for improved compatibility with recent Transformers releases.
-
Optimized Model Sharding Updated shard structure for improved download reliability, storage handling, and inference efficiency.
-
Stable Inference Pipeline Improved packaging and structure for more consistent loading and generation behavior.
-
27B Architecture Built on Qwen/Qwen3.6-27B, providing strong reasoning and general language capabilities.
-
Improved Deployment Stability Designed for smoother inference across different hardware and runtime environments.
-
Preserved Model Behavior No changes to weights or architecture; behavior remains consistent with the base model lineage.
Base Model Signatures:
This model has been re-sharded and optimized for the latest Transformers version from the base model: https://huggingface.co/huihui-ai/Huihui-Qwen3.6-27B-abliterated
Quick Start with Transformers
bash
pip install transformers==5.2.0# orpip install git+https://github.com/huggingface/transformers.git
python
from transformers import Qwen3_5ForConditionalGeneration, AutoProcessorimport torchmodel = Qwen3_5ForConditionalGeneration.from_pretrained("prithivMLmods/Qwen3.6-27B-Uncensored-Aggressive",torch_dtype="auto",device_map="auto")processor = AutoProcessor.from_pretrained("prithivMLmods/Qwen3.6-27B-Uncensored-Aggressive")messages = [{"role": "user","content": [{"type": "text", "text": "Explain how transformer models work in simple terms."}],}]text = processor.apply_chat_template(messages,tokenize=False,add_generation_prompt=True)inputs = processor(text=[text],padding=True,return_tensors="pt").to("cuda")generated_ids = model.generate(**inputs, max_new_tokens=256)generated_ids_trimmed = [out_ids[len(in_ids):] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)]output_text = processor.batch_decode(generated_ids_trimmed,skip_special_tokens=True,clean_up_tokenization_spaces=False)print(output_text)
Intended Use
-
Multimodal and Language Research Studying large-scale transformer behavior and inference characteristics.
-
Red-Teaming & Evaluation Testing robustness across challenging and adversarial prompts.
-
High-Performance Deployment Running large language models on optimized hardware setups.
-
Research Prototyping Experimentation with scalable transformer architectures.
Limitations & Risks
Important Note: This model inherits the behavior and limitations of its base model.
-
Output Variability Responses may vary depending on sampling settings and prompt structure.
-
Resource Requirements A 27B parameter model requires significant GPU memory or optimized inference strategies such as quantization or tensor parallelism.
-
Deployment Constraints Performance depends heavily on hardware configuration and runtime optimization.
-
General Model Limitations May produce incorrect, incomplete, or inconsistent outputs in complex scenarios.
Model provider
prithivMLmods
Model tree
Base
Qwen/Qwen3.6-27B
Fine-tuned
this model
Modalities
Input
Video, Text, Image
Output
Text
Pricing
Dedicated Endpoints
View detailsSupported Functionality
Model APIs
Dedicated Endpoints
Container
More information