Welcome to the captivating world of Text Generation Models (TGMs)! These AI models learn from massive datasets of text and code, mimicking human language patterns to generate creative and informative outputs. Friendli empowers you to harness the potential of several cutting-edge TGMs through its convenient interface, letting you unlock the magic of words with ease. This guide dives into the characteristics of popular TGMs available on Friendli Serverless Endpoints:

​
Model Supports

  • LGAI-EXAONE/EXAONE-4.0.1-32B
  • K-intelligence/Midm-2.0-Base-Instruct
  • K-intelligence/Midm-2.0-Mini-Instruct
  • skt/A.X-4.0
  • skt/A.X-3.1
  • naver-hyperclovax/HyperCLOVAX-SEED-Think-14B
  • deepseek-ai/DeepSeek-R1-0528
  • meta-llama/Llama-4-Maverick-17B-128E-Instruct
  • meta-llama/Llama-4-Scout-17B-16E-Instruct
  • meta-llama/Llama-3.3-70B-Instruct
  • and more!
Please note that the pricing for each model can be found in the pricing section.
In addition, you can deploy any model of your choice. Check out more models we support here!

​
Llama 3.3 70B Instruct

  • Focus: Engaging dialogues and interactive experiences.
  • Strengths:
    • Natural language understanding and human-like response generation in conversational settings.
    • Maintains coherence and context throughout dialogues, fostering seamless interactions.
    • Can adapt to different conversation styles and tones.
  • Example Use Cases:
    • Building customer service chatbots that understand natural language and offer personalized support.
    • Creating interactive storytelling experiences and AI companions.
    • Developing game AI characters with engaging back-and-forth conversations.

​
Examples

You can generate chat responses using cURL, OpenAI Python SDK, or Friendli Python SDK.
Refer to this guide for general instructions on the Friendli Token. Prerequisites: Set your Friendli token as an environment variable: 
export FRIENDLI_TOKEN=<your_friendli_token>
Friendli offers full compatibility with the OpenAI Python SDK—simply set the base URL to Friendli’s endpoint and authenticate using your Friendli token to start making requests. Install with pip install openai.
import os
from openai import OpenAI

client = OpenAI(
    api_key=os.getenv("FRIENDLI_TOKEN"),
    base_url="https://api.friendli.ai/serverless/v1",
)

completion = client.chat.completions.create(
    model="meta-llama/Llama-3.3-70B-Instruct",
    messages=[
        {
            "role": "user",
            "content": "Tell me how to make a delicious pancake"
        }
    ],
)

print(completion.choices[0].message.content)

​
Beyond the Models: Generation Settings:

Friendli Serverless Endpoints unlocks further customization through various generation settings, allowing you to fine-tune your Text Generation Model (TGM) outputs:
  • max_tokens: This defines the maximum number of words your TGM generates. Lower values produce concise outputs, while higher values allow for longer narratives.
  • temperature: Think of temperature as a creativity knob. Higher values promote more imaginative and surprising outputs, while lower values favor safe and predictable responses.
  • top_p: This parameter governs the diversity of your output. Lower values focus on the most likely continuation, while higher values encourage exploration of less probable but potentially interesting options.
For more details, see here.

​
Unleashing the Full Potential:

Friendli Serverless Endpoints removes the technical hurdles, letting you focus on exploring the magic of TGMs. Start experimenting with different models and settings, tailoring the outputs to your unique vision. Remember, practice makes perfect – the more you interact with these models, the more you’ll understand their strengths and discover the incredible possibilities they hold.
Ready to embark on your text generation journey? Friendli Serverless Endpoints is your gateway to a world of boundless creativity and innovative applications. Sign up today and let the words flow!