Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Get help setting up a custom Dedicated Endpoints.
Talk with our engineer to get a quote for reserved GPU instances with discounts.
README
License: mitImportant Caveats
This is not a conventional supervised fine-tune on rust-lightning examples. It is a repository-conditioned adapter generated by the Code2LoRA hypernetwork. The released Code2LoRA checkpoint was trained/evaluated on Python repositories, so Rust/LDK quality should be treated as experimental.
For chat use, prefer the GGUF instruct variant in
benthecarman/rust-lightning-code2lora-gguf.
Local Use
python
from peft import PeftModelfrom transformers import AutoModelForCausalLM, AutoTokenizerbase = "Qwen/Qwen2.5-Coder-1.5B"adapter = "benthecarman/rust-lightning-code2lora-adapter"tokenizer = AutoTokenizer.from_pretrained(base)model = AutoModelForCausalLM.from_pretrained(base, device_map="auto")model = PeftModel.from_pretrained(model, adapter)
Provenance
- Target repository:
lightningdevkit/rust-lightning - Local source commit used during generation:
5049f7c02 - Code2LoRA checkpoint:
code2lora/code2lora-direct - Rank: 16
- Alpha: 32
Model provider
benthecarman
Model tree
Base
Qwen/Qwen2.5-Coder-1.5B
Adapter
this model
Modalities
Input
Text
Output
Text
Pricing
Dedicated Endpoints
View detailsSupported Functionality
Model APIs
Dedicated Endpoints
Container
More information