thisisayush

Qwen2.5-Coder-7B-Instruct-openvino

README

License: apache-2.0

This model was converted to OpenVINO from Qwen/Qwen2.5-Coder-7B-Instruct using optimum-intel via the export space.

First make sure you have optimum-intel installed:

bash

pip install optimum-intel

To load your model you can do as follows:

python

from optimum.intel import OVModelForCausalLM model_id = "thisisayush/Qwen2.5-Coder-7B-Instruct-openvino"model = OVModelForCausalLM.from_pretrained(model_id)

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

thisisayush

Model Tree

Base

Qwen/Qwen2.5-Coder-7B-Instruct

Fine-tuned

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated Endpoints

Explore FriendliAI today

Get started Talk to an engineer