Three ways to run generative AI models with Friendli Engine:
02
Friendli Dedicated Endpoints
Run custom LLMs on autopilot with Friendli Dedicated Endpoints
Learn moreIntegration of Friendli Engine with Amazon Sagemaker Jumpstart
Amazon Sagemaker Jumpstart users can run VARCO LLMs with Friendli Engine, FriendliAI’s cutting-edge generative AI engine. This opens a door to integrate other Jumpstart foundation models with Friendli.
Problem
Serving JumpStart Foundation Models incurs performance and cost challenges.
Solution
Friendli Engine has been integrated with Amazon Sagemaker Jumpstart to serve JumpStart Foundation Models.
Result
Harness the power of Friendli Engine to serve JumpStart Foundation Models.
TUNiB’s emotional chatbots with Friendli Dedicated Endpoints
TUNiB’s chatbot services operate smoothly with Friendli Dedicated Endpoints.
Problem
Managing chatbot LLMs incurs significant engineering effort.
Solution
Use Friendli Dedicated Endpoints for the models.
Result
Convenient, reliable, and cost-efficient service without the need for self-management.
Lee Luda 2.0 blooms with Friendli Container
Scatter Lab’s chatbot serves their users with Friendli Engine.
Problem
The generative model is expensive to run.
Solution
Use Friendli Container for Lee Luda 2.0.
Result
Cut costs by 50%.