GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
labos1
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
labos1
Model Tree
Qwen/Qwen2.5-VL-7B-Instruct
Input Modalities
Output Modalities
Supported Functionality
Qwen/Qwen2.5-VL-7B-Instruct32640.05q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, and down_projcheckpoint-750lab_supervision_25k_train.jsonl / lab_supervision_25k_val.jsonl2.08 GPUs (global_world_size=8)1432 examples per optimizer step11e-4Install the Qwen video runtime dependencies and MS-SWIFT in your environment, then run:
bash
swift infer \--model Qwen/Qwen2.5-VL-7B-Instruct \--adapters labos1/labos-vlm-7b \--infer_backend pt
For local staged weights before upload:
bash
swift infer \--model Qwen/Qwen2.5-VL-7B-Instruct \--adapters /data/david/models/release/labos-vlm-7b \--infer_backend pt
python
from peft import PeftModelfrom transformers import Qwen2_5_VLForConditionalGeneration, AutoProcessorbase_model = "Qwen/Qwen2.5-VL-7B-Instruct"adapter = "labos1/labos-vlm-7b"processor = AutoProcessor.from_pretrained(base_model)model = Qwen2_5_VLForConditionalGeneration.from_pretrained(base_model,torch_dtype="auto",device_map="auto",)model = PeftModel.from_pretrained(model, adapter)
This adapter was fine-tuned with prompts similar to:
text
You are a real-time lab assistant monitoring a scientist's wet-lab procedure from short video windows.The current protocol state/history is provided below. Watch the current window and update the state.Report protocol errors only when supported by the visible time window or state.Ignore irrelevant unknown keys in the state JSON.Compare the protocol order, prior history, and watched window.Identify the main protocol step being performed in this watched video window.STATE:{"equipment":["P20 pipette","sterile tips","microcentrifuge tube rack"],"history":[{"step":"1","tas":20,"tds":20}],"objects":{},"on":"2","protocol":[{"desc":"Place the tubes in a clean rack.","order":1,"step":"1"},{"desc":"Attach a new sterile pipette tip.","order":2,"step":"2"},{"desc":"Aspirate reagent without touching the tube wall.","order":3,"step":"3"}],"protocol_summary":"Demonstration of aseptic pipetting technique.","reagents":["sample buffer"]}Return strict JSON only.## Response Format{"explanation": "string","observed_step_id": "string or null"}## QuestionWhich protocol step is being performed in this video window?
Run python generate_monitoring_prompts.py from this folder to print example monitoring prompts that match the training/evaluation prompt style.
0.03adamw_torch_fused0.1(0.9, 0.95)1.0bfloat164096freeze_vit=true)freeze_aligner=true)250 steps250 steps