SillyTavern 1.12.7

Breaking changes

Third-party server plugins that used require to import core server modules are no longer supported. Use import function instead or update the plugin to ES6 modules.

Deprecations

• Removed legacy API toggle for Text Generation WebUI.
• Removed instruct override mode for Chat Completions OpenRouter.
• Removed an opt-in toggle for model-scoped vector storage.

Backends

• Updated the lists with new models for Google AI Studio, Claude, MistralAI, Groq.
• Enabled XTC controls for llama.cpp, TabbyAPI and Text Generation WebUI.
• Migrated Cohere to v2 chat and embeddings API.
• New UI for Featherless model selection.

Improvements

• Added a new function tool calling framework. See the documentation for details.
• Better compatibility with light themes: buttons and links use theme colors, input area no longer highlights red on no connection.
• Added a theme toggle to display swipe counters on previous messages.
• Added an ability to omit settings from Connection Profiles.
• Added an ability to rename Advanced Formatting templates and settings presets.
• Chat Completion: Token counting during the prompt building is now asynchronous.
• Chat Completion: Append continuation message after prefill when using "Continue Prefill" with Claude.
• Chat Completion: Added "Squash" and "Strict" prompt post-processors for Custom API.
• Multi-user: Added per-user basic auth and Authelia login methods.
• Migrated Node server to ES6 modules.

Extensions

• Assets: Extensions that provide function tools are now marked with a special icon.
• TTS: Added unofficial CosyVoice and GPT-SoVITS-V2 providers.
• Image Generation: Extended /sd command with arguments for the extension settings. Added /sd-source to switch between sources. Added a function tool for triggering the image generation. Added ADetailer (face) toggle for SD WebUI.
• Web Search: Added Tavily as a new provider.

STscript

• /if and /while: rule and right arguments are now optional.
• Added return argument to commands that add content to the chat.
• Added /char-find to find a character and return a unique string key.
• Added commands for managing UI extensions: /extension-enable, /extension-disable, /extension-exists, etc.
• Added /sort command to sort a JSON list.

Fixes

• Fixed /model not working for Horde and NovelAI.
• Fixed sending empty stop strings to the backend.
• Fixed drawer icon highlighting for locked panels.
• Fixed wrapping of empty system prompts in instruct mode.
• Fixed free mode extension on empty chats when {{charPrefix}} is used.
• Fixed highlighting of i18n quotes in the chat.
• Fixed doubled quotes on copy in Firefox.
• Fixed macros not being replaced in user filler message.

Community updates

• Support gemini-1.5-series-002 and new 8B exp model by @M0ch0 in https://github.com/SillyTavern/SillyTavern/pull/2898
• Deprecate forced instruct on OpenRouter for Chat Completion by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2852
• Add certs to .gitignore by @sasha0552 in https://github.com/SillyTavern/SillyTavern/pull/2899
• Alt greetings restyle by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2902
• /if and /while now allow "right" and "rule" to be optional by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2891
• Add ability to omit settings from Connection Profile by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2901
• Slash commands to manage Extensions by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2903
• Improve gallery layout by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2908
• TTS API for the CosyVoice by @v3ucn in https://github.com/SillyTavern/SillyTavern/pull/2804
• TTS API for the GPT-SoVITS-V2 model zero-shot by @v3ucn in https://github.com/SillyTavern/SillyTavern/pull/2807
• Enable XTC for TextGen WebUI by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2742
• Update ru-ru translation by @Yokayo in https://github.com/SillyTavern/SillyTavern/pull/2915
• STscript allow named arguments to be an array by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2917
• Char find and sendas extended by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2918
• Fix piping not actually using/inputting an array for empty unnamed args by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2923
• Fix and improve math slash commands by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2925
• fix google-ai reverse proxy ignoring user provided path by @notfiz in https://github.com/SillyTavern/SillyTavern/pull/2926
• Exit scripts when try to update non-git installs by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2927
• Image Generation command improvements by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2924
• Update various sending commands to return a value by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2922
• Append continuation message after prefill when using "Continue Prefill" with Claude by @nyxkrage in https://github.com/SillyTavern/SillyTavern/pull/2830
• add swipe counter to all messages (needs debug) by @RossAscends in https://github.com/SillyTavern/SillyTavern/pull/2919
• /model: Better support for write-in controls by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2929
• Add Featherless to modelSelectMap for /model by @ceruleandeep in https://github.com/SillyTavern/SillyTavern/pull/2931
• Keyboard shortcut related fixes by @FriedCaper in https://github.com/SillyTavern/SillyTavern/pull/2940
• Support new gemini-1.5-flash-8B model, and flash-002's context reduction. by @M0ch0 in https://github.com/SillyTavern/SillyTavern/pull/2945
• Add german readme by @X00LA in https://github.com/SillyTavern/SillyTavern/pull/2914
• Fix out-of-sync pinned drawer icons by @Goshe-nite in https://github.com/SillyTavern/SillyTavern/pull/2944
• Polyfill for dialogues in old safari on iOS by @QuantumEntangledAndy in https://github.com/SillyTavern/SillyTavern/pull/2942
• Add clickable buttons in Welcome chat message. by @ceruleandeep in https://github.com/SillyTavern/SillyTavern/pull/2949
• Work on translation by @Yokayo in https://github.com/SillyTavern/SillyTavern/pull/2930
• Localize chat timestamps by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2950
• Support more pairs of international quotes by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2951
• Tool calling by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2932
• Add rename buttons for advanced formatting presets by @Yokayo in https://github.com/SillyTavern/SillyTavern/pull/2955
• Migrate Cohere to /v2/chat by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2962
• Add additional login methods by @QuantumEntangledAndy in https://github.com/SillyTavern/SillyTavern/pull/2953
• Featherless model search improvements. by @DarokCx in https://github.com/SillyTavern/SillyTavern/pull/2964
• Add /sort slash command by @InspectorCaracal in https://github.com/SillyTavern/SillyTavern/pull/2965
• Center the crop popup on change, when polyfilled by @QuantumEntangledAndy in https://github.com/SillyTavern/SillyTavern/pull/2970
• Fix World Info Entry Priority Sort by @KhreedAI in https://github.com/SillyTavern/SillyTavern/pull/2967
• Remove a trailing slash from the Gemini API URL in case it gets added in by URL.toString by @honey-tree in https://github.com/SillyTavern/SillyTavern/pull/2973
• Support the non-deprecated Together.ai Create Image API by @akvadrako in https://github.com/SillyTavern/SillyTavern/pull/2975
• Expand WORLDINFO_FORCE_ACTIVATE API to allow for dynamically modified entries by @honey-tree in https://github.com/SillyTavern/SillyTavern/pull/2971
• Migrate Node server to ES Modules by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2974
• LB entry extensions field retention through card exports/imports by @honey-tree in https://github.com/SillyTavern/SillyTavern/pull/2978
• Chat Completion: switch to async token handling by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2976
• TTS: Add Google Translate TTS by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2979
• Add ability to rename TC presets by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2983
• TextGenWebUI: remove legacy API mode by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2987
• Add client side cacheing of vector summaries by @QuantumEntangledAndy in https://github.com/SillyTavern/SillyTavern/pull/2988
• Enable XTC support for llama.cpp by @theo77186 in https://github.com/SillyTavern/SillyTavern/pull/2993
• Disable swipe gestures while in edit mode by @QuantumEntangledAndy in https://github.com/SillyTavern/SillyTavern/pull/2999
• Fix double double quotes when copying chat message text in Firefox by @artisticMink in https://github.com/SillyTavern/SillyTavern/pull/2994
• ADetailer functionality for stable-diffusion extension by @error-usernotavailable in https://github.com/SillyTavern/SillyTavern/pull/3000
• Correctly interpret some alternate whitespaces in token names by @50h100a in https://github.com/SillyTavern/SillyTavern/pull/3001
• Correctly view token probabilities when 'Continue'-ing a response. by @50h100a in https://github.com/SillyTavern/SillyTavern/pull/3002
• Add support for Claude Sonnet 3.5 20241022 API model by @dvejmz in https://github.com/SillyTavern/SillyTavern/pull/3007
• Add Claude 3.5 Sonnet (latest) options by @WolframRavenwolf in https://github.com/SillyTavern/SillyTavern/pull/3013
• Staging by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/3016

New Contributors

• @v3ucn made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2804
• @notfiz made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2926
• @X00LA made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2914
• @Goshe-nite made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2944
• @QuantumEntangledAndy made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2942
• @InspectorCaracal made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2965
• @KhreedAI made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2967
• @akvadrako made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2975
• @theo77186 made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2993
• @error-usernotavailable made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/3000
• @dvejmz made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/3007

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.12.6...1.12.7