GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
AMAImedia
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
AMAImedia
Model Tree
Input Modalities
Output Modalities
Supported Functionality
Browser DOM automation agent mounted on ui-agent.amaimedia.com
(Phase 2 desktop agent / auto-clipper UI nav subdomain). This 2B
variant is the lightweight fallback for the canonical 8B NF4
sibling and the staging ground for LoRA recipe validation before
committing GPU hours on 8B.
markdown
ui-agent.amaimedia.com (browser DOM automation)│├── PRIMARY : NOESIS-Qwen3-VL-8B-MAI-UI-NF4 (~5 GB VRAM)│ R-AGENT-PRIMARY-MAI-UI-8B-NF4│└── SECONDARY: NOESIS-Qwen3-VL-2B-MAI-UI-NF4 (this, ~1.6 GB VRAM)• low-VRAM fallback• LoRA recipe staging• parallel-environment scaling tests
| Property | Value |
|---|---|
| Immediate parent | Tongyi-MAI-UI-2B-BF16 (AMAImedia BF16 repack of Tongyi/MAI-UI-2B) |
| Upstream lineage | Qwen/Qwen3-VL-2B (Apache 2.0) → Tongyi/MAI-UI-2B (Apache 2.0) → AMAImedia BF16 repack → AMAImedia NF4 |
| Architecture | Qwen3VLForConditionalGeneration (multimodal, vision tower retained) |
| Text hidden | 2 048 / 28 layers / 16 heads (GQA 2 : 1, 8 kv heads) |
| Vision tower | depth 24, hidden 1024, patch 16, deepstack at layers [5,11,17] |
| Vocab size | 151 936 |
| Context | 262 144 (mRoPE [24,20,20] interleaved, rope_theta 5M) |
| Format | NF4 (bnb 4-bit, double-quant, bf16 compute) |
| Bundle size on disk | 1.57 GB (single safetensors) |
| VRAM target (inference) | 1.5 GB ✅ RTX 3060 6 GB |
| VRAM peak (load) | 1.6 GB |
| License | Apache 2.0 (commercial-ok) |
The development of GUI agents could revolutionize the next generation of human-computer interaction. Motivated by this vision, we present MAI-UI, a family of foundation GUI agents spanning the full spectrum of sizes, including 2B, 8B, 32B, and 235B-A22B variants. We identify four key challenges to realistic deployment: the lack of native agent–user interaction, the limits of UI-only operation, the absence of a practical deployment architecture, and brittleness in dynamic environments. MAI-UI addresses these issues with a unified methodology: a self-evolving data pipeline that expands the navigation data to include user interaction and MCP tool calls, a native device–cloud collaboration system that routes execution by task state, and an online RL framework with advanced optimizations to scale parallel environments and context length.
MAI-UI establishes new state-of-the-art across GUI grounding and mobile navigation.
| Parameter | Value |
|---|---|
| Library | bitsandbytes 0.49.2 |
| Method | NF4 (Normalized Float 4-bit) |
bnb_4bit_use_double_quant | True (saves ~5% via nested quant) |
bnb_4bit_compute_dtype | bfloat16 |
| Device map | {"": 0} (R-NF4-DEVICE-MAP-EXPLICIT) |
| Source dir | D:\models\vlm-gui-mot\Tongyi-MAI-UI-2B-BF16 |
Standard from_pretrained path — no custom workarounds needed for
Qwen3-VL family. Vision tower retained (required for screenshot
grounding tasks).
python
import torchfrom transformers import AutoProcessor, Qwen3VLForConditionalGenerationbundle = "B:/Downloads/Portable/NOESIS-VC-ONE/models/llm/NOESIS-Qwen3-VL-2B-MAI-UI-NF4"processor = AutoProcessor.from_pretrained(bundle)model = Qwen3VLForConditionalGeneration.from_pretrained(bundle,device_map={"": 0}, # NEVER "auto" with NF4torch_dtype=torch.bfloat16,).eval()# Browser DOM screenshot grounding examplemessages = [{"role": "user","content": [{"type": "image", "image": "screenshot.png"},{"type": "text", "text": "Click the 'Submit' button."},],},]inputs = processor.apply_chat_template(messages, tokenize=True, add_generation_prompt=True,return_tensors="pt",).to(0)with torch.no_grad():outputs = model.generate(**inputs, max_new_tokens=128, do_sample=False)print(processor.decode(outputs[0], skip_special_tokens=True))# → predicted bounding box / click coordinates for the Submit button
| Endpoint | Role | Backend |
|---|---|---|
ui-agent.amaimedia.com (PRIMARY tier) | Browser DOM automation, full SOTA quality | NOESIS-Qwen3-VL-8B-MAI-UI-NF4 (sibling, ~5 GB VRAM) |
ui-agent.amaimedia.com (SECONDARY tier) | Low-VRAM fallback, LoRA staging, parallel-env scaling | THIS bundle (~1.6 GB VRAM) |
ui-agent.amaimedia.com (FALLBACK tier) | Alternative training pipeline (4-stage RFT) | NOESIS-Qwen3-VL-2B-UI-Venus-NF4 (sibling, ~3.5 GB VRAM peak) |
R-APACHE-CLEAN — Apache 2.0 preserved end-to-end (Qwen Team → Alibaba Tongyi → AMAImedia BF16 repack → AMAImedia NF4 quant).R-NF4-DEVICE-MAP-EXPLICIT — must load with device_map={"": 0}; never device_map="auto" with NF4 (CLAUDE.md GOLDEN RULE 2).R-AGENT-PRIMARY-MAI-UI-8B-NF4 — the 8B NF4 sibling is the PRIMARY ui-agent.amaimedia.com agent; this 2B variant is SECONDARY (fallback + LoRA validation).R-MAI-UI-SOTA-AGENT — SOTA on ScreenSpot-Pro 73.5%, MMBench GUI L2 91.3%, OSWorld-G 70.9%, AndroidWorld 76.7%, MobileWorld 41.7%.R-DEVICE-CLOUD-COLLAB-CAPABLE — native device-cloud collaboration: +33% on-device, -40% cloud API calls per upstream report.R-QWEN3-VL-MROPE-INTERLEAVED — mRoPE [24, 20, 20] interleaved with rope_theta 5M (text); 256K context capable.| Step | Source / output |
|---|---|
| Base architecture | Qwen/Qwen3-VL-2B (© Alibaba Cloud / Qwen Team 2025-2026, Apache 2.0) |
| GUI agent fine-tune | Tongyi/MAI-UI-2B (© Alibaba Tongyi 2026, Apache 2.0) |
| BF16 dtype-repack (intermediate) | Tongyi-MAI-UI-2B-BF16 (© AMAImedia 2026, Apache 2.0) |
| NF4 quantization | bitsandbytes 0.49.2 + double-quant + bf16 compute |
| Local file | model.safetensors (1.57 GB) + config.json + processor + tokenizer |
Reference docs:
R-AGENT-PRIMARY-MAI-UI-8B-NF4NOESIS_NF4_MANIFEST.json in this folderApache License 2.0. Qwen3-VL base architecture © Alibaba Cloud / Qwen Team. Tongyi MAI-UI 2B fine-tune © Alibaba Tongyi. BF16 dtype-repack + NF4 quantization + NOESIS bundling + sealed-rule wiring: © AMAImedia (NOESIS DHCF-FNO project) 2026.
Commercial use is permitted subject to the standard Apache 2.0
preservation requirements (copyright + LICENSE + NOTICE-equivalent
attribution must travel with redistributions). See LICENSE and
LICENSE.md in this folder for the full Apache 2.0 text plus the
NOESIS attribution / NOTICE block.
Tongyi-MAI-UI-2B-BF16 (D:\models\vlm-gui-mot)Produced 2026-05-21 by NOESIS DHCF-FNO v15.8 — AMAImedia.com
| Output disk size | 1.57 GB (single safetensors) |
| VRAM target (inference) | 1.5 GB |
| VRAM peak (load) | 1.6 GB |
| Quant date | 2026-05-21 08:50:12 |
R-UI-AGENT-PRODUCT-SCOPE — mounted on ui-agent.amaimedia.com (browser DOM automation), NOT the dubbing pipeline core path.R-VENDORED-INTERNAL — plain LICENSE preserved alongside LICENSE.md.R-THIRD-PARTY-WRAPPERS-ONLY — Phase 1 SCOPE LOCK — third-party + wrappers only, no own training.R-VISION-TOWER-RETAINED — full Qwen3-VL ViT preserved (depth 24, deepstack at [5,11,17]) — required for screenshot grounding.R-QWEN-VOCAB-151936 — compatible within Qwen3 family — can KD with sibling Qwen3 text models if needed.| Quant date | 2026-05-21 08:50:12 |
| NOESIS version | v15.8 |
| Production endpoint | ui-agent.amaimedia.com (Phase 2 subdomain) |