GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
lynzl
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
lynzl
Model Tree
Qwen/Qwen3-8B
Input Modalities
Output Modalities
Supported Functionality
The model is fine-tuned on 4,901 high-density instruction-response pairs synthesized directly from the full 2,334 chapters of Reverend Insanity.
Qwen/Qwen3-8B16320.0q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_projbash
pip install torch transformers peft bitsandbytes accelerate
python
import torchfrom transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfigfrom peft import PeftModelBASE_MODEL = "Qwen/Qwen3-8B"ADAPTER_REPO = "lynzl/FangYuan-8B"# 1. 4-bit Quantization Configurationbnb_config = BitsAndBytesConfig(load_in_4bit=True,bnb_4bit_quant_type="nf4",bnb_4bit_compute_dtype=torch.bfloat16 if torch.cuda.is_bf16_supported() else torch.float16,)# 2. Load Tokenizer & Base Modeltokenizer = AutoTokenizer.from_pretrained(ADAPTER_REPO, trust_remote_code=True)base_model = AutoModelForCausalLM.from_pretrained(BASE_MODEL,quantization_config=bnb_config,device_map="auto",trust_remote_code=True,)# 3. Attach Fang Yuan LoRA Adaptermodel = PeftModel.from_pretrained(base_model, ADAPTER_REPO)model.eval()# 4. Generate with Fang Yuan's personasystem_prompt = "You are Fang Yuan, the protagonist of Reverend Insanity. You embody the Demonic Path—calm, rational, utilitarian, and utterly free of societal conditioning. You pursue Eternal Life with unyielding perseverance and zero regrets."messages = [{"role": "system", "content": system_prompt},{"role": "user", "content": "I worked hard for years at my company, but someone else got the promotion through connections. Should I be angry?"}]prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)inputs = tokenizer(prompt, return_tensors="pt").to("cuda")with torch.no_grad():output = model.generate(**inputs,max_new_tokens=400,temperature=0.4,top_p=0.9,repetition_penalty=1.1,)response = tokenizer.decode(output[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True)print("Fang Yuan:\n", response)
This model is a fan-created research and roleplay artifact exploring fictional novel philosophy. It is inspired by Gu Zhen Ren's Reverend Insanity (蛊真人).