Are you ready to build and deploy your generative AI application effortlessly?
Get started free
FriendliAI
Use Cases
USE CASES
Industry
Explore detailed use cases tailored to various industries, including healthcare, finance, and e-commerce. Learn how industry-specific applications of AI can drive efficiency, innovation, and growth in your sector.
Book DemoCustomer Stories
Discover how we’ve helped businesses and individuals achieve their goals by exploring our customers’ success stories. Learn about the unique challenges they faced, the solutions we provided, and the lasting impact we made.
Challenge
High-traffic conversational chatbots face significant GPU costs,
with average daily usage of 2 hours per user.
Solution
FriendliAI's optimization techniques reduce GPU costs by
50% to 90% for chatbot companies.
Conversational Chatbot
NextDay AI's personalized character chatbot, ranked among the top 15 generative AI web products by a16z, processes over 0.5 trillion tokens monthly.
Read moreRESULT
with Friendli Container
3×
LLM
throughput
50%+
GPU
cost saving
Conversational Chatbot
ScatterLab's 'Zeta', a top 10 mobile app for South Korean teenagers, leveraged Friendli Container to manage real-time responses with 17 times more parameters than their previous RAG version.
Friendli Engine is an irreplaceable solution for generative AI serving, both in terms of speed and cost-effectiveness. It eliminates the need for serving optimization tests.
Conversational Chatbot
TUNiB's DearMate chatbot service offers various personas like friend, lover, counselor, and coach. Friendli Dedicated Endpoints' managed platform allows TUNiB to focus on model training while automating GPU resource management and fault recovery.
Read moreFriendli Dedicated Endpoints simplifies generative AI model serving and optimizes our service development process.
Telecom Service
SKT is South Korea's leading telecom operator known for its innovative mobile services, extensive 5G infrastructure and advancements in AI development.
CHALLENGE
Building and serving AI agents for SKT’s massive customer base required strict SLAs, high reliability, and the ability to efficiently handle heavy traffic.
SOLUTION
Friendli Dedicated Endpoints enabled exceptional reliability and traffic efficiency while reducing operational costs.
RESULT
Within
few hours of
onboarding
5×
LLM
throughput
3×
Cost
saving
Productivity
Upstage's Solar Pro 22B is an advanced LLM that excels at processing extensive documents and structured text, such as HTML and Markdown. It offers multilingual support with strong domain expertise in finance, healthcare, and legal sectors.
Translation
Upstage's Solar Mini 10.7B powers translation, chat, document parsing, and OCR capabilities.
CHALLENGE
Efficiently managing LLM serving under fluctuating input traffic for stable performance and reliability.
SOLUTION
Friendli Dedicated Endpoints easily managed varying traffic with autoscaling and automatic fault recovery systems.
MORE TO READ
Read more of our customers’ success stories
1. Testing conducted by FriendliAI in October 2023 using Llama-2-13B running on Friendli Engine. See the detailed results and methodology here.
2. Performance compared to vLLM on a single NVIDIA A100 80GB GPU running AWQ-ed Mixtral 8x7B from Mistral AI with the following settings: mean input token length = 500, mean output token length = 150. Evaluation conducted by FriendliAI.
3. Performance of Friendli Container compared to vLLM on a single NVIDIA A100 80GB GPU running AWQ-ed Mixtral 8x7B from Mistral AI with the following settings: mean input token length = 500, mean output token length = 150, mean request per second = 0.5. Evaluation conducted by FriendliAI.