GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
aciklab
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
aciklab
Model Tree
unsloth/gemma-3-12b-it-qat-bnb-4bit
Input Modalities
Output Modalities
Supported Functionality
This model consists of LoRA adapters fine-tuned on unsloth/gemma-3-12b-it-qat-bnb-4bit using a comprehensive dataset of Kubernetes documentation, Stack Overflow questions, and DevOps scenarios.
Primary Purpose: Answer Kubernetes-related questions in Turkish language.
python
from unsloth import FastLanguageModelfrom peft import PeftModelimport torch # Load base Gemma 3 12B modelmodel, tokenizer = FastLanguageModel.from_pretrained( model_name="unsloth/gemma-3-12b-it-qat-bnb-4bit", max_seq_length=2048, dtype=None, load_in_4bit=True, # Use 4-bit quantization to fit in GPU memory) # Load Kubernetes AI LoRA adaptersmodel = PeftModel.from_pretrained( model, "aciklab/kubernetes-ai") # Enable inference modeFastLanguageModel.for_inference(model) # Example usage (Turkish question)messages = [ {"role": "user", "content": "Kubernetes'te 3 replikaya sahip bir deployment nasıl oluştururum?"}] inputs = tokenizer.apply_chat_template( messages, tokenize=True, add_generation_prompt=True, return_tensors="pt").to("cuda") outputs = model.generate( input_ids=inputs, max_new_tokens=512, temperature=0.7, top_p=0.9, do_sample=True) response = tokenizer.decode(outputs[0], skip_special_tokens=True)print(response)python
# Deployment creation"Node.js uygulaması için 3 replika, sağlık kontrolleri ve kaynak limitleri olan bir Kubernetes deployment oluştur." # Troubleshooting"Pod'um CrashLoopBackOff durumunda. Yaygın nedenleri nelerdir ve nasıl debug ederim?" # kubectl commands"Production namespace'indeki çalışmayan tüm pod'ları gösteren kubectl komutunu yaz." # Best practices"Kubernetes'te container güvenliği için en iyi uygulamalar nelerdir?" # Service creation"LoadBalancer tipinde bir Kubernetes servisi nasıl yapılandırılır?"python
"How do I create a Kubernetes deployment with 3 replicas?""What are the common causes of CrashLoopBackOff?""Show me kubectl command to get all pods in production namespace."The model was trained on ~157,000 examples from multiple high-quality Kubernetes and DevOps datasets:
| Dataset | Count | Description |
|---|---|---|
| Kubernetes Official Documentation | ||
| - Concepts | 2,700 | Core Kubernetes concepts |
| - Kubectl Reference | 600 | kubectl command documentation |
| - Setup Guides | 430 | Installation and setup |
| - Tasks | 4,300 | Practical task guides |
| - Tutorials | 880 | Step-by-step tutorials |
| Stack Overflow | ||
| mcipriano/stackoverflow-kubernetes-questions | 30,000 | Kubernetes Q&A |
| peterpanpan/stackoverflow-kubernetes-questions | 22,000 | Additional Kubernetes Q&A |
| DevOps Datasets | ||
| Szaid3680/Devops | 42,000 | General DevOps content |
| ahmedgongi/Devops_LLM | 20,500 | Kubernetes-filtered DevOps (from 140k) |
| Configuration & Operations | ||
| HelloBoieeee/kubernetes_config | 10,000 | Kubernetes configurations |
| sidddddddddddd/kubernetes-with-ood | 6,000 | Kubernetes scenarios (incl. Turkish translations) |
| dereklck/kubernetes_cli_dataset_20k | 19,000 | kubectl CLI examples |
| dereklck/kubernetes_operator_3b_1.5k | 1,800 | Kubernetes operator patterns |
Total Training Examples: ~157,210
This model is released under the MIT License. Free to use in commercial and open-source projects.
For questions or feedback, please open an issue on the model repository.
Note: This is a LoRA adapter, not a full model. You must load it on top of unsloth/gemma-3-12b-it-qat-bnb-4bit to use it.
bibtex
@misc{stackoverflow-kubernetes-mcipriano, author = {mcipriano}, title = {Stack Overflow Kubernetes Questions}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/mcipriano/stackoverflow-kubernetes-questions}} @misc{devops-szaid, author = {Szaid3680}, title = {DevOps Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/Szaid3680/Devops}} @misc{devops-llm-ahmed, author = {ahmedgongi}, title = {DevOps LLM Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/ahmedgongi/Devops_LLM}} @misc{kubernetes-config-hello, author = {HelloBoieeee}, title = {Kubernetes Config Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/HelloBoieeee/kubernetes_config}} @misc{kubernetes-ood-sidddddddddddd, author = {sidddddddddddd}, title = {Kubernetes with OOD Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/sidddddddddddd/kubernetes-with-ood}} @misc{stackoverflow-kubernetes-peter, author = {peterpanpan}, title = {Stack Overflow Kubernetes Questions}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/peterpanpan/stackoverflow-kubernetes-questions}} @misc{kubernetes-operator-derek, author = {dereklck}, title = {Kubernetes Operator Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/dereklck/kubernetes_operator_3b_1.5k}} @misc{kubernetes-cli-derek, author = {dereklck}, title = {Kubernetes CLI Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/dereklck/kubernetes_cli_dataset_20k}}bibtex
@misc{kubernetes-ai, author = {aciklab}, title = {Kubernetes AI Turkish - Gemma 3 12B LoRA Adapters}, year = {2025}, publisher = {HuggingFace}, url = {https://huggingface.co/aciklab/kubernetes-ai}, note = {Trained on RTX 5070 12GB in 28 hours}}from unsloth import FastLanguageModelfrom peft import PeftModelimport torch # Load base Gemma 3 12B modelmodel, tokenizer = FastLanguageModel.from_pretrained( model_name="unsloth/gemma-3-12b-it-qat-bnb-4bit", max_seq_length=2048, dtype=None, load_in_4bit=True, # Use 4-bit quantization to fit in GPU memory) # Load Kubernetes AI LoRA adaptersmodel = PeftModel.from_pretrained( model, "aciklab/kubernetes-ai") # Enable inference modeFastLanguageModel.for_inference(model) # Example usage (Turkish question)messages = [ {"role": "user", "content": "Kubernetes'te 3 replikaya sahip bir deployment nasıl oluştururum?"}] inputs = tokenizer.apply_chat_template( messages, tokenize=True, add_generation_prompt=True, return_tensors="pt").to("cuda") outputs = model.generate( input_ids=inputs, max_new_tokens=512, temperature=0.7, top_p=0.9, do_sample=True) response = tokenizer.decode(outputs[0], skip_special_tokens=True)print(response)# Deployment creation"Node.js uygulaması için 3 replika, sağlık kontrolleri ve kaynak limitleri olan bir Kubernetes deployment oluştur." # Troubleshooting"Pod'um CrashLoopBackOff durumunda. Yaygın nedenleri nelerdir ve nasıl debug ederim?" # kubectl commands"Production namespace'indeki çalışmayan tüm pod'ları gösteren kubectl komutunu yaz." # Best practices"Kubernetes'te container güvenliği için en iyi uygulamalar nelerdir?" # Service creation"LoadBalancer tipinde bir Kubernetes servisi nasıl yapılandırılır?""How do I create a Kubernetes deployment with 3 replicas?""What are the common causes of CrashLoopBackOff?""Show me kubectl command to get all pods in production namespace."@misc{stackoverflow-kubernetes-mcipriano, author = {mcipriano}, title = {Stack Overflow Kubernetes Questions}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/mcipriano/stackoverflow-kubernetes-questions}} @misc{devops-szaid, author = {Szaid3680}, title = {DevOps Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/Szaid3680/Devops}} @misc{devops-llm-ahmed, author = {ahmedgongi}, title = {DevOps LLM Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/ahmedgongi/Devops_LLM}} @misc{kubernetes-config-hello, author = {HelloBoieeee}, title = {Kubernetes Config Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/HelloBoieeee/kubernetes_config}} @misc{kubernetes-ood-sidddddddddddd, author = {sidddddddddddd}, title = {Kubernetes with OOD Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/sidddddddddddd/kubernetes-with-ood}} @misc{stackoverflow-kubernetes-peter, author = {peterpanpan}, title = {Stack Overflow Kubernetes Questions}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/peterpanpan/stackoverflow-kubernetes-questions}} @misc{kubernetes-operator-derek, author = {dereklck}, title = {Kubernetes Operator Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/dereklck/kubernetes_operator_3b_1.5k}} @misc{kubernetes-cli-derek, author = {dereklck}, title = {Kubernetes CLI Dataset}, year = {2024}, publisher = {HuggingFace}, url = {https://huggingface.co/datasets/dereklck/kubernetes_cli_dataset_20k}}@misc{kubernetes-ai, author = {aciklab}, title = {Kubernetes AI Turkish - Gemma 3 12B LoRA Adapters}, year = {2025}, publisher = {HuggingFace}, url = {https://huggingface.co/aciklab/kubernetes-ai}, note = {Trained on RTX 5070 12GB in 28 hours}}