More parameters to control in Advanced Parameters section (Like Trim incomplete Sentences Toggle) #202
Closed
KristinaKira
started this conversation in
Ideas
Replies: 1 comment
|
Trim the incomplete sentences we should add, good call. Minimum token lengths and repetition penalties are unsupported by most, if not all, API providers, and, in general, the repetition penalty is an outdated parameter that does more harm than good. And yes, you can use that model if you download it. And thank you! |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hiya,
Just hoping to see a few more options in the Advanced parameters section for RP.
Some items I'd love to see are:
-Trim Incomplete sentences toggle (I see this feature on places like Chub.AI where it prevents the model from writing sentences that get cut off because of setting a max token limit for messages. This one is the one I'd hope for the most because it's a massive Quality of Life thing).
-Minimum Token Length parameter (So you can tell the model the minimum tokens you want it to output for sentences)
-Repetition Penalty (I saw you have Frequency and Presence Penalty but I don't know think they're the same as Repetition Penalty that I usually see on Chub.AI for reference. It says there that Positive Values Penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics.)
-Question: Are we able to call the gemma 4 E2B model you have nestled in Marinara Engine? I want to know if I can make little agents do extra things too (like the trim sentences thing if it isn't added as a feature later) but I'm new to that. So I don't know if I can access it or if its built into Marinara. I saw where it's located at the least.
But these are my main suggestions so far!
AWESOME WORK BY THE WAY!! I LOVE MARINARA ENGINE :D
All reactions