- November 1, 2022
- 1 min read
Save on Training Costs of Generative AI with Friendli Training
Generative AI is already widely used for chatbots, translation, code generation, summarization, image generation, and much more. Thanks to recent advances in generative AI, it can now generate high-quality texts and images. A report from Sequoia Capital says “Just as mobile unleashed new types of applications …, we expect these large models to motivate a new wave of generative AI applications.”¹ A notable example of generative AI is GPT-3², a pre-trained language model for diverse text generation tasks.
We recently had a chance to compare Friendli Training with Microsoft DeepSpeed on training a 16B GPT-3 model.
To train the model, we used 16 VMs, each of which hosts 8 NVIDIA A100 40GB GPUs. In total, we used 128 A100 GPUs and ran 150K steps to train the model.
Friendli Training speeds up training by 3.5x compared to Microsoft DeepSpeed on one of the top 3 public clouds thanks to its engine-cloud co-optimization. Friendli Training chooses the best time-cost tradeoff based on the chosen model and cloud, supporting AWS, Azure, and GCP. Save time and reduce costs significantly with Friendli Training. Try out Friendli Training now to train your own generative AI models!
[1] https://www.sequoiacap.com/article/generative-ai-a-creative-new-world/
Written by
FriendliAI Tech & Research
Share
General FAQ
What is FriendliAI?
FriendliAI is the Frontier Inference Cloud for Agents, delivering high throughput, low latency, and reliability at scale for agentic workloads. Through vertically optimized inference infrastructure, it delivers 2–5× faster output token speed and a 99.99% uptime SLA for high-volume production traffic.
How does FriendliAI reduce inference costs?
FriendliAI reduces inference costs through higher GPU utilization and optimized inference performance. FriendliAI's patented continuous batching technique, along with quantization, speculative decoding, KV cache offloading, multi-LoRA serving, and autoscaling, helps you serve more tokens with fewer GPUs, lowering your infrastructure costs without sacrificing performance.
Why should I choose FriendliAI over other inference providers?
FriendliAI is built for production AI agents, combining speed, reliability, and efficiency at scale. It delivers low-latency streaming, reliable long-context inference, and robust tool calling without compromising stability. According to independent OpenRouter benchmarks, FriendliAI consistently ranks among the top providers for throughput, latency, and reliability across leading open-weight models. See why customers choose FriendliAI
Which open-weight models does FriendliAI support?
Run today’s frontier open-weight models—including GLM, MiniMax, Kimi, DeepSeek, Qwen, Gemma, and more—with a simple API call. FriendliAI Model API gives you instant access to the latest models with optimized inference performance for production workloads. Explore models and pricing
How do I get started?
Getting started takes just a few minutes. [1] Sign up for FriendliAI, [2] Generate your API key, and [3] Make your first inference request with frontier open-weight models.
Still have questions?
If you want a customized solution for that key issue that is slowing your growth, support@friendli.ai or click Talk to an engineer — our engineers (not a bot) will reply within one business day.
