FriendliAI
Use Cases
Industry
Explore detailed use cases tailored to various industries, including healthcare, finance, and e-commerce. Learn how industry-specific applications of AI can drive efficiency, innovation, and growth in your sector.
Book DemoCustomer Stories
Discover how we’ve helped businesses and individuals achieve their goals by exploring our customers’ success stories. Learn about the unique challenges they faced, the solutions we provided, and the lasting impact we made.
Challenge
High-traffic conversational chatbots face significant GPU costs,
with average daily usage of 2 hours per user.
Solution
FriendliAI's optimization techniques reduce GPU costs by
50% to 90% for chatbot companies.
Conversational Chatbot
NextDay AI's personalized character chatbot, ranked among the top 15 generative AI web products by a16z, processes over 3 trillion tokens monthly.
Read moreNextDay AI processes over 3 trillion tokens monthly, leading to high H100 GPU costs.
By leveraging Friendli Container, NextDay AI effectively managed its traffic, achieving 3x higher LLM throughput and over 50% GPU cost savings.
Conversational Chatbot
ScatterLab's 'Zeta' ranked among the top 10 mobile applications for South Korean teenagers. Zeta users spend an average of 140 minutes daily, generating 800 million conversations monthly.
GPU costs take up to 70% of Scatter Lab's operational cost.
Using Friendli Container, ScatterLab reduced its GPU cost by over 50%, and Friendli Inference's powerful optimization eliminated the need for additional optimization tests.
Conversational Chatbot
TUNiB’s DearMate chatbot service offers various personas like friend, lover, counselor, and coach.
Read moreWith limited engineering resources, TUNiB aimed to prioritize model development.
Friendli Dedicated Endpoints’ managed platform enabled TUNiB to focus on model training by automating GPU resource management and fault recovery.
Telecom Service
SKT is South Korea’s leading telecom operator known for its innovative mobile services, extensive 5G infrastructure and advancements in AI development.
Building and serving AI agents for SKT’s massive customer base required strict SLAs, high reliability, and the ability to efficiently handle heavy traffic.
Friendli Dedicated Endpoints delivered exceptional reliability and traffic efficiency while reducing operational costs. Within hours of onboarding, SKT achieved a 5x increase in LLM throughput and 3x cost savings.
Productivity
Upstage's Solar Pro 22B is an advanced LLM that excels at processing extensive documents and structured text, such as HTML and Markdown. It offers multilingual support with strong domain expertise in finance, healthcare, and legal sectors.
Translation
Upstage's Solar Mini 10.7B powers translation, chat, document parsing, and OCR capabilities.
Efficiently managing LLM serving under fluctuating input traffic for stable performance and reliability.
Friendli Dedicated Endpoints easily managed varying traffic with autoscaling and automatic fault recovery systems.
