News Highlights
Friendli Dedicated Endpoints serves Upstage's Solar translation LLMs
FriendliAI and Upstage are working together to deliver the best translation service. Friendli Dedicated Endpoints serves Upstage’s Solar translation LLMs, automating inference operations and reducing GPU costs with the FriendliAI’s engine to run LLMs...
Read the full story
FriendliAI integrates with Weights & Biases to streamline Generative AI deployment workflows
Today, FriendliAI, the leading generative AI infrastructure company, announced an integration with Weights & Biases, the leading AI developer platform, to accelerate the development and deployment workflow for machine learning (ML) developers working...
Read the full story
Join FriendliAI at the AI Engineer World's Fair in San Francisco
Join us at the AI Engineer World's Fair in San Francisco from June 25-27! Find out how FriendliAI can accelerate the building and serving your generative AI models with our highly optimized generative AI infrastructure.
Read the full story
Meet FriendliAI at STK 2024
Visit booth A243 in Hall A to see how Friendli is revolutionizing LLMs/LMMs and supercharging your operations to build and serve generative AI effectively.
Read the full story
FriendliAI LLM Hackathon concludes with innovative projects
Last Saturday, the Seoul National University campus was buzzing with excitement as the FriendliAI LLM hackathon came to a thrilling conclusion. The event showcased the creativity and ingenuity of the participants, who presented a variety of cool proj...
Read the full story
Meet FriendliAI at Databricks Data+AI Summit
Join us at the Data+AI Summit by Databricks in San Francisco from June 10-13. We showcase how Friendli can accelerate the development and deployment of your generative AI models with our highly-optimized generative AI infrastructure.
Read the full story
Meet FriendliAI at SuperAI Conference in Singapore
At our booth, K01, on the 4th Floor, we'll showcase how Friendli is revolutionizing the landscape of LLMs / LMMs, empowering you to supercharge your operations to build and serve generative effectively.
Read the full story
FriendliAI will be part of Beyond Asia Tech Summit 2024
This summit bridges Asian and Silicon Valley tech communities to discuss the latest in AI. FriendliAI is perfect for the venue, given its operations in Silicon Valley and Seoul. Byung-Gon Chun, the CEO of FriendliAI, will be there, speaking on democr...
Read the full story
FriendliAI presents session on 'FriendliAI's Journey to Build Global Generative AI Infrastructure' at the AWS Summit Seoul
As an Amazon Web Services (AWS) partner, Gyeong-In Yu, CTO of FriendliAI, showcases how FriendliAI + AWS enable powerful, efficient, and cost-effective generative AI solutions.
Read the full story
FriendliAI was invited by Meta to attend the Global Llama Community Summit at Meta's headquarters
Byung-Gon Chun, CEO of FriendliAI, presented “Supercharge LLM inference serving with Friendli” to share how FriendliAI helps organizations innovate using Llama models and Friendli. He also emphasized energizing the generative AI ecosystems with parti...
Read the full story
FriendliAI joins AWS partner network
We are excited to announce that FriendliAI, a leading LLM serving platform, has been officially recognized as an Amazon Web Services (AWS) Partner. This milestone ensures our commitment to working with AWS and reinforces our dedication to providing h...
Read the full story
FriendliAI introduces Friendli Dedicated Endpoints, a managed service version of Friendli Container to increase accessibility
FriendliAI, a frontrunner in inference serving for generative AI, is thrilled to announce Friendli Dedicated Endpoints, which offers the capabilities of Friendli Container as a managed service. This latest addition to the Friendli Suite eliminates th...
Read the full story
Meet FriendliAI at NVIDIA GTC 2024
At NVIDIA GTC 2024, FriendliAI will demonstrate its proprietary Friendli Engine. This engine can achieve cost savings of up to several tens of times compared to conventional methods. They will also showcase how they can easily deploy and service larg...
Read the full story
FriendliAI met with Meta founder Mark Zuckerberg at the Developers Roundtable
On Feb 28, our CEO Byung-Gon Chun and CTO Gyeong-In Yu met with Meta founder Mark Zuckerberg at the Developers Roundtable held at Meta's office in South Korea. FriendliAI was among the five companies invited to the meeting, presenting an excellent op...
Read the full story
FriendliAI has been selected for the 2024 Emerging AI+X Top 100 companies
FriendliAI has been selected for the 2024 Emerging AI+X Top 100 companies. The Artificial Intelligence Industry Association (AIIA) has chosen 100 companies expected to lead future innovation through the convergence of artificial intelligence technolo...
FriendliAI unveils Serverless Endpoints for widespread, affordable access to open-source generative AI models
FriendliAI, a leader in inference serving for generative AI, announced the launch of Friendli Serverless Endpoints today for accessible development with generative AI models. This service removes the technical barriers of managing the underlying infr...
Read the full storyFriendliAI's Friendli Engine accelerates large language model inference serving
FriendliAI, a leading generative AI serving engine company, has released a new version of their inference serving engine Friendli. This new release dramatically improves serving performance for large language models (LLMs) and includes features such ...
Read the full storyMeet FriendliAI at AWS reInvent 2023
In AWS reInvent 2023, we will present how companies automate and save costs in serving their LLMs with Friendli Engine! (Demonstration of the performance: significantly faster than competitors / Our patented iterative batching technology: increasing ...
Read the full storyFriendliAI joins the SC23
We are thrilled to announce our participation in the SC23 Exhibits in Denver! Join us at SC23 Booth 901 (right next to AWS) from November 14-16 to discover how you can supercharge LLM serving with Friendli Suite!
FriendliAI has been named to KOREA AI STARTUP 100 for the second consecutive year.
FriendliAI, a generative AI engine company, was selected as an outstanding AI startup in the AI platform category at the 2023 KOREA AI STARTUP 100 event held in Seoul on October 27. This marks the second consecutive year that FriendliAI has been reco...
Read the full storyFriendliAI launches public beta of Friendli Dedicated Endpoints
FriendliAI, a leading generative AI engine company, is proud to announce the public beta release of Friendli Dedicated Endpoints (formerly known as PeriFlow Cloud). This powerful platform empowers users to run PeriFlow, an engine for generative AI se...
Read the full story
FriendliAI joined the K-AI alliance as a member
FriendliAI joined the K-AI alliance as a member. We look forward to collaborating with the alliance members in the generative AI space.
Read the full storyFriendliAI CEO to attend Korea-US Business Alliance Event
FriendliAI has been selected as a representative for the Korea-US Business Alliance event on the state visit to the US. The event is hosting the largest representative group ever, and the theme is “strengthening the cutting-edge technology alliance”....
Read the full storyFriendliAI's work on large-scale LM training got accepted into ICML 2023
Our work on large-scale LM training got accepted into ICML 2023! We pushed the boundary of large-scale LM training and achieved the state-of-the-art performance on training large-scale LMs like GPT models.
Read the full story
Making generative AI training simple and cost-efficient with Friendli Suite and Azure
Two years ago, I founded FriendliAI to provide startups with easy access to innovative Generative AI. We first helped realize this mission by introducing Friendli Suite – a solution to train and serve Generative AI models effortlessly with remarkable...
Read the full story
FriendliAI is now part of Microsoft for Startups Founders Hub
FriendliAI is now part of Microsoft for Startups Founders Hub! We're getting a $150K Azure credit for scaling up our product!
FriendliAI has been selected for the 2022 KOREA AI STARTUP 100
We're happy to announce that FriendliAI has been selected for the 2022 KOREA AI STARTUP 100. Hosted by AI ONE TEAM & The Korea Economic Daily, KOREA AI STARTUP is an initiative that selects and supports 100 companies leading the Korean AI industry. W...
Read the full story
FriendliAI Announces new system to hike up the serving efficiency of large-scale AI models at OSDI 2022
Orca is a serving system that enables the efficient operation of large-scale AI models. It can remove the inefficient delays of existing serving systems by using two core techniques: ‘iteration level scheduling’ and ‘selective batching’
Read the full storyKorean large-scale AI startup FriendliAI raises 8 billion KRW (~6.8 million USD) in Series A funding round
FriendliAI CEO Byung-Gon Chun disclosed on Wednesday that the large-scale AI development platform has raised 8 billion KRW in a Series A round funded by joint investors Capstone Partners, KB Investment, and KB Securities.
Read the full story