GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
eddy624
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
eddy624
Model Tree
unsloth/Phi-3-mini-4k-instruct-bnb-4bit
Input Modalities
Output Modalities
Supported Functionality
Feed the model a raw CVE description, CVSS score, and vendor, and it will generate a comprehensive report including:
Phi-3-mini-4k-instruct (3.8B parameters)python
from transformers import AutoModelForCausalLM, AutoTokenizerimport torchmodel_id = "vanshkamra12/CyberSecurity-Model"tokenizer = AutoTokenizer.from_pretrained(model_id)model = AutoModelForCausalLM.from_pretrained(model_id,torch_dtype=torch.float16,device_map="auto")prompt = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.### Instruction:Analyze the following vulnerability data and produce a structured threat intelligence report.### Input:CVE ID: CVE-2024-21762Description: A out-of-bound write vulnerability in FortiOS SSL VPN allows a remote unauthenticated attacker to execute arbitrary code or commands via specially crafted HTTP requests.CVSS Score: 9.8 CRITICALVendor: Fortinet### Response:"""inputs = tokenizer(prompt, return_tensors="pt").to(model.device)outputs = model.generate(**inputs, max_new_tokens=1000, temperature=0.7)print(tokenizer.decode(outputs[0], skip_special_tokens=True))