FriendliAI
Use Cases
Industry
Explore detailed use cases tailored to various industries, including healthcare, finance, and e-commerce. Learn how industry-specific applications of AI can drive efficiency, innovation, and growth in your sector.
Book DemoCustomer Stories
Discover how we’ve helped businesses and individuals achieve their goals by exploring our customers’ success stories. Learn about the unique challenges they faced, the solutions we provided, and the lasting impact we made.
Challenge
High-traffic conversational chatbots face significant GPU costs,
with average daily usage of 2 hours per user.
Solution
FriendliAI's optimization techniques reduce GPU costs by
50% to 90% for chatbot companies.
Conversational Chatbot
NextDay AI's personalized character chatbot, ranked among the top 15 generative AI web products by a16z, processes over 0.5 trillion tokens monthly.
Read morewith Friendli Container
3×
LLM
throughput
50%+
GPU
cost saving
Conversational Chatbot
ScatterLab's 'Zeta', a top 10 mobile app for South Korean teenagers, leveraged Friendli Container to manage real-time responses with 17 times more parameters than their previous RAG version.
Friendli Engine is an irreplaceable solution for generative AI serving, both in terms of speed and cost-effectiveness. It eliminates the need for serving optimization tests.
Conversational Chatbot
TUNiB's DearMate chatbot service offers various personas like friend, lover, counselor, and coach. Friendli Dedicated Endpoints' managed platform allows TUNiB to focus on model training while automating GPU resource management and fault recovery.
Read moreFriendli Dedicated Endpoints simplifies generative AI model serving and optimizes our service development process.
Telecom Service
SKT is South Korea's leading telecom operator known for its innovative mobile services, extensive 5G infrastructure and advancements in AI development.
Building and serving AI agents for SKT’s massive customer base required strict SLAs, high reliability, and the ability to efficiently handle heavy traffic.
Friendli Dedicated Endpoints enabled exceptional reliability and traffic efficiency while reducing operational costs.
Within
few hours of
onboarding
5×
LLM
throughput
3×
Cost
saving
Productivity
Upstage's Solar Pro 22B is an advanced LLM that excels at processing extensive documents and structured text, such as HTML and Markdown. It offers multilingual support with strong domain expertise in finance, healthcare, and legal sectors.
Translation
Upstage's Solar Mini 10.7B powers translation, chat, document parsing, and OCR capabilities.
Efficiently managing LLM serving under fluctuating input traffic for stable performance and reliability.
Friendli Dedicated Endpoints easily managed varying traffic with autoscaling and automatic fault recovery systems.