SillyTavern 1.12.4

Backends

• OpenAI: added GPT-4o mini model to the list.
• KoboldCpp: enabled DRY sampling controls.
• OpenRouter: added "Allow fallback providers" option.
• MistralAI: added Mistral Nemo, Large v2 models to the list
• MistralAI: improved prompt conversion, added experimental toggle for assistant prefilling.
• Groq: added Gemma 2 and Llama 3.1 models to the list.
• TabbyAPI: added model downloading dialog.
• vLLM: now supports token counting endpoint.

Improvements

• Text Completion: updated sampling parameter presets to include default values for all settings.
• Instruct Mode: added template for Gemma 2.
• Instruct Mode: added ability to set prefixes for first/last user messages.
• Instruct Mode: {{name}} macro is now replaced in message suffixes.
• Prompt Itemization: can now view a diff between the chosen and previous prompt.
• Prompt Itemization: added Vector Storage extension prompts to itemization.
• World Info: improved scanning performance for large files.
• World Info: added a toggle to exclude names from scanning.
• World Info: added an ability to auto-assign entry order using current sorting.
• Group Chats: added an option to view the group chat reply queue.
• Chat Completion: added 'None' postfix for continuation options.
• Chat Completion: added 'None' option for names behavior (previous option renamed to 'Default').
• Chat Completion: added warnings for import/export of presets containing proxy or custom endpoint fields.
• Chat Completion: a first connection to the reverse proxy now must be confirmed by the user.
• Context Template: the Story String is now validated for missing placeholders that have content.
• Personas: added ability to duplicate personas.
• Server: session expiration time is now configurable (default is 24 hours).
• Accounts: basic auth is no longer required if all accounts are password-protected.
• Spec V3: limited support for WI entry decorators (documentation pending).
• Spec V3: exported cards now contain a 'ccv3' PNG chunk.
• Spec V3: added {{reverse}} macro.
• UX: improved responsiveness of user input and message edit fields.
• UX: added auto-scroll snapping during message streaming.
• UX: renamed several prompt fields and presets using more neutral terminology.
• UX: decreased CPU usage when streaming messages.
• Moving UI: can now be toggled on any device. Still not functional on mobile!
• CSS: switched to dynamic viewport units for screen-relative sizing.
• Various localization fixes and improvements.

Extensions

• Manage Extensions: now opens immediately and loads 3rd-party extensions in the background.
• Image Generation: added StabilityAI backend, added VAE selection for supported backends.
• Assets: improved UI clues related to installing third-party extensions.
• Summary: added {{summary}} macro to access the last generated summary.

STscript

• Added /stop command to stop generation.
• Added await argument for the /continue command.
• Added mode argument for the /fuzzy command.
• Cancelling the /sd command execution now stops the image generation.
• disabled status for WI entries set with the /setentryfield command now takes priority over constant.

Bug fixes

• Fixed confirmation dialog when both WI and regex card embeds are present.
• Fixed UI shift caused by Token Probabilities in mobile view.
• Fixed empty chats not showing in the chat manager.
• Fixed creation of new chats for cards without the first message.
• Fixed /trigger command getting stuck on generation lock timeout.
• Fixed swipeId .mes attribute not updating on swipe.
• Fixed /send command not saving the chat after execution.
• Fixed seed randomization for HuggingFace inference endpoints.
• Chat Completion: fixed unknown relative extension injects not working.
• World Info: fixed interaction between min. activations and recursive entries.
• ComfyUI: fixed modified workflow changes not saving.
• Gallery: fixed duplicate image uploads.
• TTS: fixed pitch slider not working for system voices.
• Speech Recognition: fixed on-the-fly model switching.

Community updates

• /stop slash command to stop generation by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2465
• Improve ja-jp translation by @Risenafis in https://github.com/SillyTavern/SillyTavern/pull/2459
• Update server.js to trust UserAccounts securely by @steve02081504 in https://github.com/SillyTavern/SillyTavern/pull/2447
• Validate story string about missing fields by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2462
• Changes the name of the Absolute label for Position within Prompt Manager's edit screen to In-chat by @Succubyss in https://github.com/SillyTavern/SillyTavern/pull/2470
• Tweaks to activateNaturalOrder by @Esalarc in https://github.com/SillyTavern/SillyTavern/pull/2474
• Fix trim macro breaking on CRLF by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2475
• Adding display of queued speakers in group chat windows. by @Esalarc in https://github.com/SillyTavern/SillyTavern/pull/2469
• Stable image from StabilityAI api by @WBlair1 in https://github.com/SillyTavern/SillyTavern/pull/2471
• Fix min activations for non-recursable entries by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2468
• Add instruct/context for Gemma 2 by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2477
• Implement toggle for User/Char name searching in world info by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2480
• Add a token counting endpoint for vLLM by @sasha0552 in https://github.com/SillyTavern/SillyTavern/pull/2428
• Translate fix by @M0ch0 in https://github.com/SillyTavern/SillyTavern/pull/2481
• Adding diff functionality to prompt dialog by @Esalarc in https://github.com/SillyTavern/SillyTavern/pull/2485
• Add tabbyAPI model downloader by @bdashore3 in https://github.com/SillyTavern/SillyTavern/pull/2489
• Add Gemma 2 9b to available Groq models by @fizzAI in https://github.com/SillyTavern/SillyTavern/pull/2492
• Fix package-lock.json by @wrvsrx in https://github.com/SillyTavern/SillyTavern/pull/2486
• Added /continue "await" arg by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2494
• Fix transformers model changes by @Risenafis in https://github.com/SillyTavern/SillyTavern/pull/2495
• Do not translate randomly in /api/speech/recognize by @Risenafis in https://github.com/SillyTavern/SillyTavern/pull/2497
• Tests by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2499
• Move locale file load awaits into its init function by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2503
• Extensions & Assets UI updates - More info, tooltips & helpful guides by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2504
• Includes captioning error messages in toast by @Therosin in https://github.com/SillyTavern/SillyTavern/pull/2508
• Preset manager popups by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2509
• sendTextArea: The same ... but prettier! by @Succubyss in https://github.com/SillyTavern/SillyTavern/pull/2517
• ask user to confirm proxy connections by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/2510
• Update presets by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2518
• Update most char submenu popups to new popup by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2521
• Enable DRY for koboldcpp by @pi6am in https://github.com/SillyTavern/SillyTavern/pull/2502
• WI scan refactoring: Extended logging, updated code flow, changed Min Activations by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2479
• CCv3 Partial Implementation by @kwaroran in https://github.com/SillyTavern/SillyTavern/pull/2512
• Fix popup onClosing handling not working correctly by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2520
• Includes a layman's explanation of REPLACE_GETVAR in its tooltip by @Succubyss in https://github.com/SillyTavern/SillyTavern/pull/2524
• Add gpt-4o-mini by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2530
• Update language code for Chinese Traditional translations(zh-TW) on LibreTranslate endpoint. by @blackmesataiwan in https://github.com/SillyTavern/SillyTavern/pull/2534
• Substance over form by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2537
• Adds "chatvar" aliases & "length" alias by @Succubyss in https://github.com/SillyTavern/SillyTavern/pull/2540
• Remove DOM queries and jQuery during streaming by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/2543
• WI update "Order" from custom sorting button by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2541
• World Info: slash commands performance improvements by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2542
• Improve auto-scroll snapping by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2546
• Update ru-ru locale by @Yokayo in https://github.com/SillyTavern/SillyTavern/pull/2547
• Update zh-cn.json by @steve02081504 in https://github.com/SillyTavern/SillyTavern/pull/2551
• Fix /send not saving chat in all cases by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2553
• Minor group chat timestamp fix by @Succubyss in https://github.com/SillyTavern/SillyTavern/pull/2554
• Timestamp Fixes & Refactoring by @Succubyss in https://github.com/SillyTavern/SillyTavern/pull/2555
• Improve Mistral prompt conversion by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2559
• Use dvh/dvw units in CSS by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2562
• Dupe persona by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2560
• refactor: timestampToMoment, parseTimestamp by @Succubyss in https://github.com/SillyTavern/SillyTavern/pull/2563
• Add first/last user messages prefixes for instruct mode by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2564
• More sensible UI WI entries sorting by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2569
• Fix apply WI sorting to order field by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2568
• Staging by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2571

New Contributors

• @Esalarc made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2474
• @WBlair1 made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2471
• @M0ch0 made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2481
• @fizzAI made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2492
• @wrvsrx made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2486
• @Therosin made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2508
• @pi6am made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2502
• @kwaroran made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2512
• @blackmesataiwan made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2534

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.12.3...1.12.4