Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Get help setting up a custom Dedicated Endpoints.
Talk with our engineer to get a quote for reserved GPU instances with discounts.
README
License: mitTraining
- Base model: microsoft/Phi-3-mini-4k-instruct
- Method: QLoRA (4-bit quantization + LoRA, rank=8, alpha=16)
- Target modules: q/k/v/o/gate/up/down projections
- Dataset: Custom text-to-SQL pairs over a sales schema (employees, departments, products, sales)
Usage
Load with PEFT:
```python from peft import PeftModel from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-3-mini-4k-instruct") model = PeftModel.from_pretrained(model, "Bhuvandesai/phi3-text-to-sql-adapter") ```
Demo: phi3-text-to-sql-studio
Model provider
Bhuvandesai
Model tree
Base
microsoft/Phi-3-mini-4k-instruct
Adapter
this model
Modalities
Input
Text
Output
Text
Pricing
Dedicated Endpoints
View detailsSupported Functionality
Model APIs
Dedicated Endpoints
Container
More information