How to use
Before you start, ensure you’ve already obtained theFRIENDLI_TOKEN
from the Friendli Suite.
Instantiation
Now we can instantiate our model object and generate chat completions. The default model (i.e.meta-llama-3.3-70b-instruct
) will be used if no model is specified.