Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Get help setting up a custom Dedicated Endpoints.
Talk with our engineer to get a quote for reserved GPU instances with discounts.
README
License: mitQuick Start
python
from transformers import AutoModelForCausalLM, AutoTokenizermodel_name = "fableforge-ai/ShellWhisperer-1.5B"tokenizer = AutoTokenizer.from_pretrained(model_name)model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")prompt = """You are an AI agent. Complete the following task:Task: Write a Python function to calculate the Fibonacci sequence.Reasoning:"""inputs = tokenizer(prompt, return_tensors="pt").to(model.device)outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.6, top_p=0.9)print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Use Cases
- Shell command completion and suggestion
- Terminal error diagnosis and fix suggestion
- Infrastructure-as-code generation
- DevOps automation assistance
Integration with FableForge Ecosystem
python
from fableforge_agent_runtime import AgentRuntimefrom fableforge_agent_skills import SkillLibraryruntime = AgentRuntime(model="fableforge-ai/ShellWhisperer-1.5B",skills=SkillLibrary.all(),verification=True)result = runtime.run("Deploy a web server on AWS")print(result.output)print(result.verification_score)
Ecosystem Integration
Part of the FableForge Agent Ecosystem - 21 open-source projects for building, testing, and deploying AI agents.
| Package | Install | Purpose |
|---|---|---|
fableforge | pip install fableforge | Unified CLI |
fableforge-anvil-agent | pip install fableforge-anvil-agent | Self-verified coding agent |
fableforge-agent-swarm | pip install fableforge-agent-swarm | Multi-agent orchestration |
fableforge-agent-runtime | pip install fableforge-agent-runtime | Production agent runtime |
fableforge-agent-skills | pip install fableforge-agent-skills | Skill library |
verifyloop | pip install verifyloop | Verification loops |
reason-critic | pip install reason-critic | Reasoning assessment |
Model Details
| Attribute | Value |
|---|---|
| Architecture | LlamaForCausalLM |
| Parameters | 1.5B |
| Hidden Size | 2048 |
| Layers | 24 |
| Attention Heads | 16 |
| KV Heads | 16 |
| Max Context | 2048 |
| Training Data | Fable5 agent traces + curated reasoning datasets |
| License | MIT |
Limitations
- May generate incorrect code -- always use with verifyloop for critical tasks
- Trained primarily on English data; multilingual performance is limited
- Can hallucinate API signatures or tool parameters
- Not suitable for medical, legal, or financial advice without human review
Citation
bibtex
@misc{shellwhisperer1.5b2024,title={ShellWhisperer-1.5B: Agent Orchestration via Fine-Tuned Language Models},author={FableForge Team},year={2024},url={https://huggingface.co/fableforge-ai/ShellWhisperer-1.5B}}
License
MIT License - see LICENSE for details.
Built with hammer by the Anvil team. Part of the FableForge ecosystem.
Model provider
fableforge-ai
Model tree
Base
this model
Modalities
Input
Text
Output
Text
Pricing
Dedicated Endpoints
View detailsSupported Functionality
Model APIs
Dedicated Endpoints
Container
More information