News Highlights
FriendliAI's PeriFlow Accelerates Large Language Model Inference Serving
FriendliAI, a leading generative AI serving engine company, has released a new version of their inference serving engine PeriFlow. This new release dramatically improves serving performance for large language models (LLMs) and includes features such as quantization support, expanded compatibility, and state caching.
Read the full story
FriendliAI is excited to participate in AWS reInvent 2023!
In AWS reInvent 2023, we will present how companies automate and save costs in serving their LLMs with PeriFlow! (Demonstration of the performance: significantly faster than competitors / Our patented iterative batching technology: increasing LLM inference serving throughput / Native 4-bit quantization support: unlocking extra efficiency with AWQ on PeriFlow / Multi-adapter support: running multiple...
Read the full storyFriendliAI joins the SC23
We are thrilled to announce our participation in the SC23 Exhibits in Denver! Join us at SC23 Booth 901 (right next to AWS) from November 14-16 to discover how you can supercharge LLM serving with PeriFlow!
FriendliAI has been named to KOREA AI STARTUP 100 for the second consecutive year.
FriendliAI, a generative AI engine company, was selected as an outstanding AI startup in the AI platform category at the 2023 KOREA AI STARTUP 100 event held in Seoul on October 27. This marks the second consecutive year that FriendliAI has been recognized as an exceptional company due to its advanced technology. The KOREA AI...
Read the full storyFriendliAI Launches Public Beta of PeriFlow Cloud
FriendliAI, a leading generative AI engine company, is proud to announce the public beta release of PeriFlow Cloud. This powerful platform empowers users to run PeriFlow, an engine for generative AI serving, within a managed cloud environment.
Read the full story
FriendliAI joined the K-AI alliance as a member
FriendliAI joined the K-AI alliance as a member. We look forward to collaborating with the alliance members in the generative AI space.
Read the full storyFriendliAI CEO to attend Korea-US Business Alliance Event
FriendliAI has been selected as a representative for the Korea-US Business Alliance event on the state visit to the US. The event is hosting the largest representative group ever, and the theme is “strengthening the cutting-edge technology alliance”. Byung-Gon Chun, CEO of FriendliAI, has been invited to attend the welcome event at the White House...
Read the full storyOur work on large-scale LM training got accepted into ICML 2023!
Our work on large-scale LM training got accepted into ICML 2023! We pushed the boundary of large-scale LM training and achieved the state-of-the-art performance on training large-scale LMs like GPT models.
Read the full story
Making Generative AI training simple and cost-efficient with PeriFlow and Azure
Two years ago, I founded FriendliAI to provide startups with easy access to innovative Generative AI. We first helped realize this mission by introducing PeriFlow – a solution to train and serve Generative AI models effortlessly with remarkable training and inference speeds and minimal costs. Our ambition has taken us on an incredible journey. We...
Read the full story
FriendliAI is now part of Microsoft for Startups Founders Hub
FriendliAI is now part of Microsoft for Startups Founders Hub! We're getting a $150K Azure credit for scaling up our product! Thank you, Microsoft! #friendliai #periflow #generativeai #startups #founders #microsoft #azure
FriendliAI has been selected for the 2022 KOREA AI STARTUP 100
We're happy to announce that FriendliAI has been selected for the 2022 KOREA AI STARTUP 100. Hosted by AI ONE TEAM & The Korea Economic Daily, KOREA AI STARTUP is an initiative that selects and supports 100 companies leading the Korean AI industry. We're delighted to see our generative and analytical AI system technology being...
Read the full story
FriendliAI Announces New System to Hike Up the Serving Efficiency of Large-scale AI Models at OSDI 2022
Orca is a serving system that enables the efficient operation of large-scale AI models. It can remove the inefficient delays of existing serving systems by using two core techniques: ‘iteration level scheduling’ and ‘selective batching’
Read the full storyKorean large-scale AI startup FriendliAI raises 8 billion KRW (~6.8 million USD) in Series A funding round
FriendliAI CEO Byung-Gon Chun disclosed on Wednesday that the large-scale AI development platform has raised 8 billion KRW in a Series A round funded by joint investors Capstone Partners, KB Investment, and KB Securities.
Read the full story