GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
MarinaraSpaghetti
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
MarinaraSpaghetti
Model Tree
Input Modalities
Output Modalities
Supported Functionality
Okay, I tried really hard to improve my ChatML merges, but that has gone terribly wrong. Everyone is adding special tokens with different IDs so can't even make a proper union tokenizer for them, damn. Not to mention, I made some... interesting discoveres in regards to some models' context lenghts. You can watch the breakdown of how it went down here: https://www.captiongenerator.com/v/2303039/marinaraspaghetti's-merging-experience.
This one feels a bit different to my previous attempts and seems less prone to repetition, especially on higher contexts, which is great for me! I'll probably improve on it even further, but for now, it feels rather nice. Great for RP and storytelling. All credits and thanks go to the amazing MistralAI, Intervitens, Sao10K and Nbeerbower for their amazing models! Plus, special shoutouts to Parasitic Rogue for ideas and Prodeus Unity and Statuo for cool exl2 quants of my previous merges. Cheers to folks over at the Drummer's server! Have a good one, everyone.
Sigh, Mistral Instruct, I'm afraid.
UPDATE: WE HAD THE WRONG FORMAT ALL ALONG, JUST RECEIVED HOW IT'S SUPPOSED TO LOOK LIKE FROM THE OFFICIAL MISTRALAI TEAM MEMBER.
...This had made me question everything I thought I knew.
text
<s>[INST]{system}[/INST]{response}</s>[INST]{user's message}[/INST]{response}</s>I recommend running Temperature 1.0-1.25 with 0.1 Top A or 0.01-0.1 Min P, and with 0.8/1.75/2/0 DRY. Also works with lower Temperatures below 1.0. Nothing more needed.
You can use my exact settings from here (use the ones from the Mistral Base/Customized folder, I also recommend checking the Mistral Improved folder): https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings/tree/main.
https://huggingface.co/bartowski/NemoMix-Unleashed-12B-GGUF
https://huggingface.co/Statuo/NemoMix-Unleashed-EXL2-8bpw
This is a merge of pre-trained language models created using mergekit.
This model was merged using the della_linear merge method using E:\mergekit\mistralaiMistral-Nemo-Base-2407 as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
yaml
models: - model: E:\mergekit\mistralaiMistral-Nemo-Instruct-2407 parameters: weight: 0.1 density: 0.4 - model: E:\mergekit\nbeerbower_mistral-nemo-bophades-12B parameters: weight: 0.12 density: 0.5 - model: E:\mergekit\nbeerbower_mistral-nemo-gutenberg-12B parameters: weight: 0.2 density: 0.6 - model: E:\mergekit\Sao10K_MN-12B-Lyra-v1 parameters: weight: 0.25 density: 0.7 - model: E:\mergekit\intervitens_mini-magnum-12b-v1.1 parameters: weight: 0.33 density: 0.8merge_method: della_linearbase_model: E:\mergekit\mistralaiMistral-Nemo-Base-2407parameters: epsilon: 0.05 lambda: 1dtype: bfloat16tokenizer_source: basemodels: - model: E:\mergekit\mistralaiMistral-Nemo-Instruct-2407 parameters: weight: 0.1 density: 0.4 - model: E:\mergekit\nbeerbower_mistral-nemo-bophades-12B parameters: weight: 0.12 density: 0.5 - model: E:\mergekit\nbeerbower_mistral-nemo-gutenberg-12B parameters: weight: 0.2 density: 0.6 - model: E:\mergekit\Sao10K_MN-12B-Lyra-v1 parameters: weight: 0.25 density: 0.7 - model: E:\mergekit\intervitens_mini-magnum-12b-v1.1 parameters: weight: 0.33 density: 0.8merge_method: della_linearbase_model: E:\mergekit\mistralaiMistral-Nemo-Base-2407parameters: epsilon: 0.05 lambda: 1dtype: bfloat16tokenizer_source: base