SillyTavern 1.12.0

Important news

This is an incremental update over the 1.12.0-preview and includes several breaking changes.

View the Migration Guide for details on how to prepare for the update.

Also, several new features require having a modern web browser that supports CSS Nesting. If you experience visual glitches - update your browser and/or operating system to the latest available version.

External media in chats is now blocked by default. Enable it manually if required.

Improvements

• Migrated to a new format for user data storage and added support for user accounts. See the documentation: Users.
• Implemented the Data Bank: a method for adding external sources of LLM knowledge. See the documentation: Data Bank.
• Added vLLM as a Text Completion source and Groq as a Chat Completion source
• Added new models from OpenAI (GPT-4o), PerplexityAI (Llama 3 Sonar), and Google (Gemini Flash 1.5).
• Added an ability to select OpenRouter providers in both API modes.
• TabbyAPI: added min_tokens and banned_strings parameters.
• LlamaCpp: allowed JSON schema usage (conflicts with grammar).
• Added the AI assistant contest winner character card (Sakana) to the "Download Extensions & Assets" menu and first run onboarding dialog. There you can also view and download past contest winners.
• World Info improvements: added ability to activate entries using the Vector Storage extension, Example Messages insertion position, weighted and scored inclusion groups, prioritized entries in inclusion groups, support for multiple inclusion groups per entry, ability to delay the entry evaluation until the first recursion step, regular expression type for the entry key, entry duplication, and many more. See the documentation: World Info.
• Settings are now backed up automatically every 10 minutes instead of on startup. Increased the limit of snapshots to 50 per user.
• Added Llama 3 model tokenizer. Claude tokenizer is now initialized lazily.
• Added instruct/context templates for the Phi model, and variants of Llama 3 and ChatML with message names inclusion.
• The "Advanced search" option now sorts the search results by relevance.
• Tags & Folders: added the ability to show only or hide folders. Added a toggle for alphabetical tag sorting.
• Added the ability to hide avatar images in the chat. Reorganized User Settings menu.
• Added the ability to import from AICharacterCards.com and generic URLs using the external import dialog.
• Added a quality setting for image inlining in Chat Completion.
• Forwarded IP whitelisting: can now be disabled with a configuration option.
• Added a console script for server plugin management.
• Various localization improvements.

STscript

• A brand new parser with support for closures, auto-complete, and syntax highlighting. See the documentation: STscript.
• Added a "negative" argument to the /imagine slash command.
• Added "role" and "hidden" arguments to the /messages slash command.
• Added optional "name" argument to the /send slash command.
• Added the /renamechat slash command.
• /summarize can now summarize any text, not just the chat messages.
• /sendas old syntax is now deprecated. Use the new syntax: /sendas name=<character> <message>.

Extensions

• Image Generation: added new NovelAI model, prompt prefixes now support macros.
• Vector Storage: added settings for WI activation and Data Bank inclusion.
• Chat Translation: added an option to translate user input text.
• TTS: MsEdgeTTS is now supported via the server-side plugin. Added a universal playback speed setting.
• Regex: added an ability to run Regex on the WI entries.
• Macros: added {{char_version}}, {{timeDiff}} macros.
• Added more downloadable extensions to the "Download Extensions & Assets" menu. Check them out!

Bug fixes

• Fixed InfermaticAI non-streamed response parsing.
• Fixed start.sh script to allow starting the server from any directory on Mac.
• Fixed a vertical alignment of zoomed avatars in visual novel mode on phones.
• Fixed the main prompt being purged from the prompt manager when disabled.
• Fixed the "Replace/Update card" function with UTF-8 characters in the filter name.
• Fixed text copy not working on messages hidden from the prompt.
• Fixed whole-word WI search to include punctuation and other non-alphanumeric characters.
• Fixed Trigger% being displayed as 0% when imported from external lorebooks.
• Fixed the "Narrate translated" option not working with TTS.
• Fixed first message regeneration on character modification if the message was edited.
• Fixed boolean values matching when searching for WI entries with /findentry.
• Fixed custom ordering of WI entries being able to sort past the header element.
• Fixed auto-selection of settings presets by name match (now requires an exact match instead of partial).
• Fixed multiswipe interaction with response streaming.

Community updates

• Changed fs.renameSync() to fs.copyFileSync() by @isaac-mcfadyen in https://github.com/SillyTavern/SillyTavern/pull/2105
• Neo server by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2113
• Fix: Handle InformaticAI Endpoint response without message in response payload by @joenunezb in https://github.com/SillyTavern/SillyTavern/pull/2122
• Phi Instruct context+instruct presets by @StefanDanielSchwarz in https://github.com/SillyTavern/SillyTavern/pull/2134
• Fix expression list resolve by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2138
• Add json extension to exported oai and LogitBias presets by @sirius422 in https://github.com/SillyTavern/SillyTavern/pull/2144
• style: .mes_block { overflow-y: clip; } by @aisu-wata0 in https://github.com/SillyTavern/SillyTavern/pull/2143
• Change the naming rule of regex exporting by @sirius422 in https://github.com/SillyTavern/SillyTavern/pull/2145
• Fix SillyTavern being launched from a different working directory by @johnflux in https://github.com/SillyTavern/SillyTavern/pull/2135
• Clean up Generate(), part 4 by @valadaptive in https://github.com/SillyTavern/SillyTavern/pull/2141
• Added import function for AICharacterCards.com cards by @BlueprintCoding in https://github.com/SillyTavern/SillyTavern/pull/2136
• Localization enhancements by @Yokayo in https://github.com/SillyTavern/SillyTavern/pull/2131
• Use names in place of roles for ChatML and LLama-3-Instruct by @HiroseKoichi in https://github.com/SillyTavern/SillyTavern/pull/2148
• Option to auto-sort tags (+UI improvements) by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2152
• Button to duplicate WI entries by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2149
• World Info inclusion group prio toggle by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2147
• add a button to translate input message by @evpeople in https://github.com/SillyTavern/SillyTavern/pull/2150
• feat: Third-Party Parser Support by @Bronya-Rand in https://github.com/SillyTavern/SillyTavern/pull/2119
• Debounce WI, Character and Persona search + common debounce timeouts by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2156
• Fix bogus folder not working if tag was cut off by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2155
• chore: disable merge conflict workflow on forks by @Bronya-Rand in https://github.com/SillyTavern/SillyTavern/pull/2154
• refactor: prompt itemization split to multiple functions by @racinmat in https://github.com/SillyTavern/SillyTavern/pull/2158
• WI search bar now flexibly scales width by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2168
• Improve performance of drawing WI panel by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2170
• Fixes WI word matching not working for non-words by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2169
• Scored search sorting by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2165
• Character card import from generic sources (specifically Discord, Catbox.moe) by @24adamcho in https://github.com/SillyTavern/SillyTavern/pull/2171
• WI world search allows quick-select by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2175
• vLLM support by @sasha0552 in https://github.com/SillyTavern/SillyTavern/pull/2177
• Fix the /send command by @bdashore3 in https://github.com/SillyTavern/SillyTavern/pull/2184
• Localization enhancements by @Yokayo in https://github.com/SillyTavern/SillyTavern/pull/2178
• mesExamples anchor for World Info by @bdashore3 in https://github.com/SillyTavern/SillyTavern/pull/2191
• don't replace codeblock textContent with innerText in hljs by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/2194
• also run regex on worldinfo by @steve02081504 in https://github.com/SillyTavern/SillyTavern/pull/2193
• remove empty entrys from WIs by @steve02081504 in https://github.com/SillyTavern/SillyTavern/pull/2199
• Do not double-parse WI content on "always on" by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2201
• move expression buttons above Sprite set by @deffcolony in https://github.com/SillyTavern/SillyTavern/pull/2205
• Expand global.d.ts with code docs by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2208
• Upgrade token API settings by @bdashore3 in https://github.com/SillyTavern/SillyTavern/pull/2212
• Create char-data.js for type hint by @steve02081504 in https://github.com/SillyTavern/SillyTavern/pull/2209
• Added {{timeDiff}} macro. by @Hydroerotic in https://github.com/SillyTavern/SillyTavern/pull/2215
• impl {{char_version}} by @steve02081504 in https://github.com/SillyTavern/SillyTavern/pull/2204
• STscript Parser Rewrite by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/1965
• Default content by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2218
• populate parser flag doclinks in user settings by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/2223
• More worldinfo page sizes by @steve02081504 in https://github.com/SillyTavern/SillyTavern/pull/2221
• gpt-4o by @kingbased in https://github.com/SillyTavern/SillyTavern/pull/2225
• Parser improvements by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/2226
• fix autocomplete sort by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/2228
• Update ko-kr.json by @deffcolony in https://github.com/SillyTavern/SillyTavern/pull/2230
• WI entry setting "Delay until recursion" by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2229
• WI support multiple inclusion groups by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2231
• add import tags in list of more opt by @steve02081504 in https://github.com/SillyTavern/SillyTavern/pull/2243
• fix QR editor on narrow screen by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/2242
• Typo fix for /while example by @Succubyss in https://github.com/SillyTavern/SillyTavern/pull/2238
• Add /renamechat slash command by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2244
• Added TTS Audio Playback Speed Config by @Surye in https://github.com/SillyTavern/SillyTavern/pull/2249
• Tag folders folder filter by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2246
• Add support for new characterhub.org url (chub.ai legacy site) by @hexa4ce in https://github.com/SillyTavern/SillyTavern/pull/2257
• allow custom source url by @steve02081504 in https://github.com/SillyTavern/SillyTavern/pull/2255
• WI regex keys by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2200
• feat: add default tip to welcome screen by @Bronya-Rand in https://github.com/SillyTavern/SillyTavern/pull/2233
• [Claude] Implements Assistant Impersonation Prefill by @Succubyss in https://github.com/SillyTavern/SillyTavern/pull/2259
• Fix some typo and add zh-tw locale. by @PasserDreamer in https://github.com/SillyTavern/SillyTavern/pull/2263
• Add slash commands for tag management by @Wolfsblvt in https://github.com/SillyTavern/SillyTavern/pull/2258
• fix: correct usage of fuzzy search in emotion detection by LLM by @racinmat in https://github.com/SillyTavern/SillyTavern/pull/2264
• Follow ups and fixes for the new STscript parser by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/2265
• vLLM fixes by @sasha0552 in https://github.com/SillyTavern/SillyTavern/pull/2266
• More subcommand shenanigans by @LenAnderson in https://github.com/SillyTavern/SillyTavern/pull/2270
• Staging by @Cohee1207 in https://github.com/SillyTavern/SillyTavern/pull/2272

New Contributors

• @isaac-mcfadyen made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2105
• @joenunezb made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2122
• @johnflux made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2135
• @evpeople made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2150
• @racinmat made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2158
• @24adamcho made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2171
• @Hydroerotic made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2215
• @Succubyss made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2238
• @Surye made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2249
• @hexa4ce made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2257
• @PasserDreamer made their first contribution in https://github.com/SillyTavern/SillyTavern/pull/2263

Full Changelog: https://github.com/SillyTavern/SillyTavern/compare/1.11.8...1.12.0