GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
linlp22
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
linlp22
Model Tree
Qwen/Qwen3-4B-Instruct-2507
Input Modalities
Output Modalities
Supported Functionality
Install the SC-Embedding package and download this adapter and its base model. Base weights are required separately.
bash
hf download linlp22/SC-Embedding-4B --local-dir checkpoints/SC-Embedding-4Bhf download Qwen/Qwen3-4B-Instruct-2507 --local-dir models/Qwen3-4B-Instruct-2507python
import torchimport torch_npufrom sc_embedding.model import SCEmbedding torch.npu.set_device(0)model = SCEmbedding.from_pretrained( "/path/to/Qwen3-4B-Instruct-2507", adapter="/path/to/SC-Embedding-4B", device="npu:0",)documents = model.encode_passages([ "Alice moved to Paris.", "She now works at the city hospital.",])queries = model.encode_queries(["Where does Alice work?"])scores = queries @ documents.TEach passage list is one ordered document or conversation. Queries are encoded independently. Use contextual=False for passages without history. For CUDA, use device="cuda:0" and omit the Ascend import and device selection.
Qwen/Qwen3-4B-Instruct-2507.sc_config.json supplies the inference configuration. This repository contains the LoRA adapter, not the full base model, optimizer state, or a separate teacher.
This selected existing adapter retains its original fixed-initial-teacher training provenance. The companion repository's training entry point implements online cross-view self-distillation. The exported tensors are unchanged and are not relabeled as outputs of that entry point. See provenance.json for the source policy and checksums.
Adapter SHA-256: ad64cbe0fedaf2ece963a08a249e7be8b77e765570782c6af20df98ffc8232eb.
The adapter is distributed under Apache-2.0. Its base model and training data retain their respective licenses. Training builds on EvoEmbedding / EvoTrain-180K, Qwen, Transformers, and PEFT.
import torchimport torch_npufrom sc_embedding.model import SCEmbedding torch.npu.set_device(0)model = SCEmbedding.from_pretrained( "/path/to/Qwen3-4B-Instruct-2507", adapter="/path/to/SC-Embedding-4B", device="npu:0",)documents = model.encode_passages([ "Alice moved to Paris.", "She now works at the city hospital.",])queries = model.encode_queries(["Where does Alice work?"])scores = queries @ documents.T