News Highlights
FriendliAI Introduces Friendli Dedicated Endpoints, A Managed Service Version of Friendli Container to Increase Accessibility
FriendliAI, a frontrunner in inference serving for generative AI, is thrilled to announce Friendli Dedicated Endpoints, which offers the capabilities of Friendli Container as a managed service. This latest addition to the Friendli Suite eliminates th...
Read the full story
FriendliAI has announced that it will be participating in NVIDIA GTC 2024
At NVIDIA GTC 2024, FriendliAI will demonstrate its proprietary Friendli Engine. This engine can achieve cost savings of up to several tens of times compared to conventional methods. They will also showcase how they can easily deploy and service larg...
Read the full story
FriendliAI met with Meta founder Mark Zuckerberg at the Developers Roundtable
On Feb 28, our CEO Byung-Gon Chun and CTO Gyeong-In Yu met with Meta founder Mark Zuckerberg at the Developers Roundtable held at Meta's office in South Korea. FriendliAI was among the five companies invited to the meeting, presenting an excellent op...
Read the full story
FriendliAI has been selected for the 2024 Emerging AI+X Top 100 companies
FriendliAI has been selected for the 2024 Emerging AI+X Top 100 companies. The Artificial Intelligence Industry Association (AIIA) has chosen 100 companies expected to lead future innovation through the convergence of artificial intelligence technolo...
FriendliAI Unveils Serverless Endpoints for Widespread, Affordable Access to Open-source Generative AI Models
FriendliAI, a leader in inference serving for generative AI, announced the launch of Friendli Serverless Endpoints today for accessible development with generative AI models. This service removes the technical barriers of managing the underlying infr...
Read the full story
FriendliAI's PeriFlow Accelerates Large Language Model Inference Serving
FriendliAI, a leading generative AI serving engine company, has released a new version of their inference serving engine PeriFlow. This new release dramatically improves serving performance for large language models (LLMs) and includes features such ...
Read the full storyFriendliAI is excited to participate in AWS reInvent 2023!
In AWS reInvent 2023, we will present how companies automate and save costs in serving their LLMs with PeriFlow! (Demonstration of the performance: significantly faster than competitors / Our patented iterative batching technology: increasing LLM inf...
Read the full storyFriendliAI joins the SC23
We are thrilled to announce our participation in the SC23 Exhibits in Denver! Join us at SC23 Booth 901 (right next to AWS) from November 14-16 to discover how you can supercharge LLM serving with PeriFlow!
FriendliAI has been named to KOREA AI STARTUP 100 for the second consecutive year.
FriendliAI, a generative AI engine company, was selected as an outstanding AI startup in the AI platform category at the 2023 KOREA AI STARTUP 100 event held in Seoul on October 27. This marks the second consecutive year that FriendliAI has been reco...
Read the full storyFriendliAI Launches Public Beta of PeriFlow Cloud
FriendliAI, a leading generative AI engine company, is proud to announce the public beta release of PeriFlow Cloud. This powerful platform empowers users to run PeriFlow, an engine for generative AI serving, within a managed cloud environment.
Read the full story
FriendliAI joined the K-AI alliance as a member
FriendliAI joined the K-AI alliance as a member. We look forward to collaborating with the alliance members in the generative AI space.
Read the full storyFriendliAI CEO to attend Korea-US Business Alliance Event
FriendliAI has been selected as a representative for the Korea-US Business Alliance event on the state visit to the US. The event is hosting the largest representative group ever, and the theme is “strengthening the cutting-edge technology alliance”....
Read the full storyOur work on large-scale LM training got accepted into ICML 2023!
Our work on large-scale LM training got accepted into ICML 2023! We pushed the boundary of large-scale LM training and achieved the state-of-the-art performance on training large-scale LMs like GPT models.
Read the full story
Making Generative AI training simple and cost-efficient with PeriFlow and Azure
Two years ago, I founded FriendliAI to provide startups with easy access to innovative Generative AI. We first helped realize this mission by introducing PeriFlow – a solution to train and serve Generative AI models effortlessly with remarkable train...
Read the full story
FriendliAI is now part of Microsoft for Startups Founders Hub
FriendliAI is now part of Microsoft for Startups Founders Hub! We're getting a $150K Azure credit for scaling up our product! Thank you, Microsoft! #friendliai #periflow #generativeai #startups #founders #microsoft #azure
FriendliAI has been selected for the 2022 KOREA AI STARTUP 100
We're happy to announce that FriendliAI has been selected for the 2022 KOREA AI STARTUP 100. Hosted by AI ONE TEAM & The Korea Economic Daily, KOREA AI STARTUP is an initiative that selects and supports 100 companies leading the Korean AI industry. W...
Read the full story
FriendliAI Announces New System to Hike Up the Serving Efficiency of Large-scale AI Models at OSDI 2022
Orca is a serving system that enables the efficient operation of large-scale AI models. It can remove the inefficient delays of existing serving systems by using two core techniques: ‘iteration level scheduling’ and ‘selective batching’
Read the full storyKorean large-scale AI startup FriendliAI raises 8 billion KRW (~6.8 million USD) in Series A funding round
FriendliAI CEO Byung-Gon Chun disclosed on Wednesday that the large-scale AI development platform has raised 8 billion KRW in a Series A round funded by joint investors Capstone Partners, KB Investment, and KB Securities.
Read the full story