https://koboldai.net

KoboldAI LiteKoboldAI LiteKoboldAI Lite Welcome To KoboldAI Lite Welcome to KoboldAI Lite!Pick a UI Style to get started. You can always change it later in the Settings menu. Classic UI Aesthetic UI Corpo UI Alternatively, you can Load A Savefile or Quick Start Scenario Set UI Cancel Admin Reconnect Select Endpoint AI New Session Scenarios Quick Start Save / Load Settings Join Multiplayer Exit Multiplayer Connecting (Proxied) Loading... Sorry, KoboldAI Lite requires Javascript to function. Context Back Redo Retry Add Img   Enter Sends Allow Editing Story ChatSelect Loading [ABORT] WebSearch... The AI is typing... Context Back Redo Retry Add Img   Edit × Context Data Memory World Info TextDB WebSearch Tokens Memory?Put the information you want the AI to always remember. It will be inserted into the top of every request sent to the AI. Newline After Memory Author's Note?Similar to Memory, but inserted near the end of the text instead of the start. A good way to control the mood/behavior of the AI. Notes AutoGenerate Memory Author's Note Template?A placeholder, will be inserted with the author's note replacing the <|>. You generally don't need to change this. A/N Strength?Controls how far back to insert the Author's Note. Notes injected closer to the end have a stronger effect. Weak Medium Strong Immediate +Add WI Insert Location ?Controls where the world info should be inserted After Memory Before A/N WI Search Depth ?Controls how far back in the text to search for World Info Keys Full Context Last 8192 Last 4096 Last 2048 Last 1024 Last 512 Last 256 Case Sensitive Keys Automatically search and include relevant snippets from a text document or history. Enable TextDB Search Includes Context History ? If enabled, the entire story/chat history is used as a searchable document Num. Search Results ? Controls how many snippets to retrieve from DB Nearby Text Amount ? Controls amount of nearby text included in the search query Search Chunk Size ? Controls the size of each snippet being searched for TextDB Storage?Paste as much raw text data here as you like. E.g. background information, reference documents, etc. This text will populate the database that will be chunked and searched by TextDB. Search the Web for relevant information when using instruct mode(Requires WebSearch enabled KoboldCpp) WebSearch Not Supported Enable WebSearch Use Multiple Passes ?Using this option will run a second LLM tool call to summarize context and create a more accurate search query. Slower but may be more accurate. Multipass WebSearch Template ?The template used to generate the search query when multipass search is used Extra Stopping Sequences ?Triggers the text generator to stop generating early if this sequence appears, in addition to default stop sequences. If you want multiple sequences, separate them with the following delimiter: ||$|| Stop Sequences may be unavailable. Add New Logit Biases ?Specify a dictionary of token IDs to modify the probability of occuring. Expand Section Logit bias may be unavailable. Enter OpenAI-formatted logit bias dictionary. Each key is the integer token IDs and their values are the biases (-100.0 to 100.0). Leave blank to disable.Input is a JSON object, reference here. Add New Input Strings Instead of IDs (Uses KCPP Tokenizer) ?If enabled, allows you to input strings instead of only token IDs, and tokenizes them for you. Phrase / Word Ban (Anti-Slop) ?Prevents specific words or phrases from being generated, either modifying model vocab or by backtracking and regenerating when they appear. If you want multiple sequences, separate them with the following delimiter: ||$|| Expand Section Phrase banning may be unavailable. Prevents specific words or phrases from being generated, either modifying model vocab or by backtracking and regenerating when they appear. If you want multiple sequences, separate them with the following delimiter: ||$||Note: If you're trying to ban a specific token by ID, you should use Logit Bias instead! Add New Regex Replace ?Allows transforming incoming text with regex patterns, modifying all matches. Replacements will be applied in sequence. Expand Section Thinking / Reasoning Tags ?Allows hiding or removing thinking tags. Expand Section This allows you to specify regex to handle output from reasoning models, to hide, remove, or ignore the Chain-Of-Thought. CoT Regex Pattern: CoT Handling: Display Collapse Hide Remove Don't Submit Old Thoughts Force Insert Thinking Tag Note: 'Force Insert Thinking Tags' does not work with the 'Remove' option of CoT handling regex. Placeholder Tags ?Configure automatic substitutions for placeholders in text. Expand Section Stories can use placeholders like {{user}} and {{[INPUT]}} that require dynamic substitution. If disabled, uses plaintext tags verbatim. Enable Placeholder Tags ?If enabled, uses placeholders that get swapped on submit. If disabled, uses plaintext verbatim. To modify {{[INPUT]}} or {{[OUTPUT]}} and other instruct tags, please edit them in the Settings > Format page. OK Cancel Apply Settings Format Samplers Media Advanced Usage Mode ?Story Mode is best for novel style writing. Adventure Mode is best for Interactive Fiction RPGs. Chat Mode is best for chat conversations with the AI. Instruct mode is for giving the AI ChatGPT styled tasks. Instruct Mode Story Mode Adventure Mode Chat Mode UI Style Select ?Select your preferred UI style, which affects text formatting and display. Some UIs are only available for specific modes. Classic Theme Messenger Theme Aesthetic Theme Corpo Theme ⚙️ Customize Your Name ?The name the AI will see you as AI Name ?Name of the person(s) you want to chat with. Multiple opponents can be specified, creating a group chat, separate their names using multiple lines. Add Another Participant Instruct Tag Preset ?Quickly select between common instruct tag formats. Different models are trained with different tags. Instruct Tag Format ?Specify the exact text formatting used for instruct mode. System Tag ?The sequence to start the system prompt Sys. Prompt ?A fixed system message sent at the very start to guide the AI behavior. Usually NOT needed User Tag ?The sequence to start an instruction prompt Assistant Tag ?The sequence to start an assistant response Multiline Replies ?Whether to allow multiple lines in AI responses (Chat/Adventure). Disable this if the AI starts generating rubbish. Continue Bot Replies ?Allow AI to continue incomplete past responses, which can be extended by pressing submit again. Not recommended for newbies. Chat Match Any Name ?In Chat Mode, match formatting against any name, instead of only specified chat names. Chat PrePrompt ?Modifies the context, injecting tokens to improve chat quality for new chats. Adventure PrePrompt ?Modifies the context, injecting tokens to improve adventure quality for new adventures. Fix Alpaca Leakage ?Prevents leaking when Alpaca instruct format is used on models trained with bad/different formats. Enable Markdown ?Allows the UI to use markdown formatting such as quotes, LaTeX, and code blocks. Trim Sentences ?Trims incomplete sentences in AI output. Trim Whitespace ?Removes trailing whitespace in AI output. Compress Newlines ?Compresses multiple newlines into one newline in AI output. Inject Timestamps ?Injects timestamps into context (Chat/Instruct), allowing the AI to have a sense of time. Inject ChatNames ?Appends chat names after every instruct tag, a hybrid chat mode. Assistant Jailbreak ?Automatically injects a jailbreak message after every instruct query, to make the AI more likely to obey you. Set Separate End Tags ?Allows using separate Instruction and Response End Tags, instead of combing them with the start tag. Not recommended for beginners. Sampler Preset ?Pick from an easy selection of curated generation presets, or configure your own. [Default] Context Size ?Maximum number of context tokens submitted to the AI. Must exceed max output tokens. Can be further increased by editing the textbox. Older models stop at 2048, newer ones can do 4096 or greater. 512 4096 Auto-Adjust Limits Max Output ?Number of tokens the AI should generate. Higher numbers will take longer to generate. 16 512 Auto-Adjust Limits Temperature ?Randomness of sampling. High values can increase creativity but may make text less sensible. Lower values will make text more predictable but can become repetitious. 0.1 2 Repetition Penalty ?Used to penalize words that were already generated or belong to the context (too high causes incoherence!). 1 2 Top-P Sampling ?Used to discard unlikely text in a nucleus sampling process. Lower values will make text more predictable but can become repetitious. Set to 1 to deactivate it. 0 1 Top-K Sampling ?Top-K Sampling. Discards all but the K most likely tokens. Set 0 to Deactivate. 0 1 Advanced Sampler Config ?These settings control alternative samplers configurations. They are inactive by default, you usually do not need to change them. Top-A Typical TFS Min-P Pr. Pen. Seed Rp.Range Rp.Slope Smooth.F DyTemp OFF EOS Token Ban ?Allow the End-Of-Stream (EOS) token and potentially other restricted special tokens to be generated. Auto Unban Ban Bypass Token Limit Multiplier ?Adds a multiplier to token estimations, useful if token counts are inaccurate. Influences text truncation. Higher values increases token allowance. 0.7x 0.8x 0.9x 1.0x 1.1x 1.2x 1.3x Sampler Order ? The order by which all 7 samplers are applied, separated by commas. 0=top_k, 1=top_a, 2=top_p, 3=tfs, 4=typ, 5=temp, 6=rep_pen Mirostat ? Replaces your samplers with mirostat, an alternative sampling method. May not be available depending on backend, not supported on Horde. Mode Off 1 2 Tau Eta Mirostat Not Supported DRY (If supported) ?An advanced multi-token repetition penalty. Range controlled by Rep-Pen Range. May not be available depending on backend, not supported on Horde. Mult. Base A.Len Seq. Breaks DRY Not Supported XTC ? Enables Exclude Top Choices (XTC) Sampling. May not be available depending on backend, not supported on Horde. Threshold Probability XTC Not Supported Grammar ? Grammar Sampling (KCPP) - Allows you to constrain output to fit specific structures. Resets grammar state every generation unless Retain is checked. GBNF Retain T.NSigma Generate Images ?Use the AI Horde or a local KoboldCpp / Forge / A1111 instance to insert AI generated images into your story. [Disabled] AI Horde KCPP / Forge / A1111 OpenAI DALL-E ComfyUI Set Horde Key Allow NSFW [None] ⚙️ Save In A1111/Forge [None] ⚙️ Set URL Set Key Model Detect ImgGen Instructions Autogenerate Save Images Alerts ?Triggers alerts when a generation is completed. Beep on Done Notify on Done Text To Speech ?Enable Text-To-Speech to have your story automatically read to you. Test Set URL female_calmfemalemale Language Audio Streaming RVC Voice Disabled RVC Pitch 0 Set URL Set Key TTS Model TTS Voice KoboldCpp TTS Unavailable TTS Voice kobo cheery sleepy shouty chatty custom voiceclone Set VCJson Narrate Both Sides Narrate Only Dialog Browser TTS Speed: Voice Input ?Requires KoboldCpp with Whisper model loaded. Enables Speech-To-Text voice input. Automatically listens for speech in 'On' mode (Voice Detection), or use Push-To-Talk (PTT). Off Detect Voice Push-To-Talk Suppress Non-Speech Language Voice Delay: Transcribe File Style tags to use for generating images:(E.g. Sketch, Realistic, Anime, 3D Render, Drawing) Negative Prompt: Number of Steps: Cfg. Scale: Sampler: Euler Euler A Heun DPM2 LCM DPM++ 2M Resolution ? Changing resolution will affect the aspect ratio used to generate. This may impact quality or memory usage. : 512 x 512 (Square) 512 x 768 (Portrait) 768 x 512 (Landscape) 768 x 768 (BigSquare) 512 x 1024 (TallPortrait) 1024 x 512 (LongLandscape) 1024 x 1024 (HugeSquare) Img2Img Strength ? Higher values lead to a more different image. : Clip Skip: Save Higher-Res ? This option will result in larger save files which may be slower. Changing this setting only applies to NEW images. : Crop Images ? If enabled, oversized imported images will be cropped to fit. If disabled, images will be letterboxed instead. : Insert Images as New Message ? If enabled, images will be added in a new turn message instead of the existing one. : Token Streaming ?Use token streaming for partial responses. SSE is smoother but less well-supported. Poll is chunkier but more reliable. Not available on Horde. Off Poll SSE Idle Responses  Off 1x 2x 3x 5x 8x 10x 5s 15s 30s 60s 2m 5m 10m Auto Never Escape HTML ?Avoids escaping any HTML tags, allowing HTML injections. Not recommended! Placeholder Tags ?If enabled, uses universal {{user}} and {{[INPUT]}} placeholders that get swapped on submit. If disabled, uses plaintext chat or instruct tags verbatim. Render Sp.Tags ?If enabled, renders special tags like EOS and padding tokens. Not recommended. Request Logprobs ?If enabled, request top 5 alternative token log-probabilities for each generated token. Incurs an overhead. Autosave Session ?Autosaves your current story and settings on exit, reloads when you return Embed Settings File ?Includes your current settings when saving or sharing your story Rename Save File ?Prompts to input a different filename when saving file. Show Advanced Load ?If enabled, allows you to select additional configurations during file load Card Import Prompt ?If enabled, prompts the user to choose what mode to import a character card in. If disabled, automatically picks chat mode. Run In Background ?Prevents the browser from suspending KoboldAI Lite by playing a silent audio track. This setting cannot be saved. User Mods ?Allows you to load third-party user created mods (caution). Apply User Mod Custom CSS ?Allows you to load third-party CSS styles (caution). Apply Custom CSS Autoscroll Text ?Automatically scrolls the text window down when new text is generated Unlock Scroll Height ?Unlocks the text viewport, allowing for infinite height without scrolling Viewport Width ?Controls horizontal scaling of the viewport window Adapt Clamp HDClamp Unlock SidePanel Mode ?Displays the settings and context panels permanently on the sides, instead of as popups. Not available on Mobile displays. Inverted Colors ?Inverts all colors, simple light mode Background Img Set Clear Reset ALL Settings OK Cancel Apply Aesthetic UI customization panel Background Style Bubble Color: System 🖌️ You 🖌️ AI 🖌️ Rounded Bubbles: Color Background: Min Height: px Horizontally-centered text: Margin (px): L: R: T: B: Padding (px): L: R: T: B: Portrait Style Portraits: 🖼️ Your Portrait 🖼️ AI's Portrait Portrait Style: None Circle Rounded Rect (Reset Image) User Portrait: Size: px A/R: AI Portrait: Size: px A/R: Show Names (Chat Mode): Font Style Font Size: px Customize: Per-entity: Style Text: Colors: text🖌️ "speech"🖌️ *action*🖌️ You: text🖌️ "speech"🖌️ *action*🖌️ AI: text🖌️ "speech"🖌️ *action*🖌️ System: text🖌️ "speech"🖌️ *action*🖌️ Code blocks: background🖌️ foreground🖌️ (Reset All Styles) OK Cancel Style Preview Quick Start - Select A Scenario All Story Adventure Chat Instruct Automatically select AI model ? This option picks a suitable AI model based on the selected scenario. If no text model is currently selected, an appropriate one will be automatically picked for you. Ok Cancel Roleplay Character Creator This tool is an easy way to create your own roleplay characters.Alternatively, you can click here to import an existing Tavern Character Card. Character Name: Character Avatar: Select Image Character Persona: Describe Scenario: Character Greeting: After creating your character, you can edit it further at any time in the 'Context' memory window. Confirm Cancel Save File / Load File / Export File 💾Download File 📁Open File 🌐Share Slot Storage Option Data Location Local Browser Cache KoboldCpp Server Storage Selected Slot Save Slot Load Slot Download Delete Slot Caution: Local Storage Slots are saved to a temporary cache and can be deleted by your browser. KoboldCpp remote storage will save data to a file in your KoboldCpp server. To avoid losing data, use the download file button. Back Select your AI provider AI Horde KoboldAI Remote API OpenAI Compatible API OpenRouter API Claude By Anthropic API PaLM/Gemini By Google API Cohere API MistralAI API Featherless API Grok API The AI Horde is a service that generates text using crowdsourced GPUs run by independent volunteer workers. Avoid sending privacy sensitive information. Click here for more info Your AI Horde API Key ? You need an API key to use AI Horde to generate text. Get one at https://aihorde.net/register or use the anonymous key 0000000000. [Manage My Workers] Need a Key?(Register New User) Select AI Horde Model ? These are the models currently provided by AI Horde volunteers. [Reset] [See Current Volunteers] Select By Worker ? This option explicitly assigns worker IDs, fixed based on the current workers available at model selection time. You can use this to connect to a KoboldAI instance running via a remote tunnel such as trycloudflare, localtunnel, ngrok. Localhost IPs require host mode enabled. You can use the remote address displayed in the terminal console or colab window, note that the model must be loaded first. Please input URL of the KoboldAI instance. Show Console Logging Entering your OpenAI API key will allow you to use KoboldAI Lite with their API. Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the OpenAI API and is not transmitted to us.Only Temperature, Top-P and Repetition Penalty samplers are used. Please input OpenAI API URL and Key. Entering your OpenRouter API key will allow you to use KoboldAI Lite with their API. Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the OpenRouter API and is not transmitted to us.Only Temperature, Top-P and Repetition Penalty samplers are used. Please input OpenRouter Key. Entering your MistralAI API key will allow you to use KoboldAI Lite with their API. Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the MistralAI API and is not transmitted to us.Only Temperature and Top-P samplers are used. Please input MistralAI Key. Entering your Featherless API key will allow you to use KoboldAI Lite with their API. Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the Featherless API and is not transmitted to us.Only Temperature, Top-P, Top-K, Min-P and Repetition Penalty samplers are used. Please input Featherless Key. Entering your Grok API key will allow you to use KoboldAI Lite with their API. Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the Grok API and is not transmitted to us.Only Temperature, Top-P, Top-K, Min-P and Repetition Penalty samplers are used. Please input Grok Key. Model Choice: gpt-3.5-turbo-instruct davinci-002 gpt-3.5-turbo gpt-3.5-turbo-16k gpt-4 gpt-4-turbo gpt-4o gpt-4-32k o1-mini o1-preview [Custom] openai/gpt-3.5-turbo openai/gpt-4 openai/gpt-3.5-turbo-instruct mistralai/mistral-7b-instruct gryphe/mythomax-l2-13b huggingfaceh4/zephyr-7b-beta anthropic/claude-2.0 [Custom] open-mistral-7b open-mistral-nemo open-mixtral-8x22b mistral-tiny mistral-small mistral-medium-latest mistral-large-latest pixtral-12b-latest pixtral-large-latest codestral-latest [Custom] Sao10K/L3-8B-Lunaris-v1 Sao10K/L3-8B-Stheno-v3.2 unsloth/llama-3-8b-Instruct beomi/Llama-3-Open-Ko-8B Sao10K/Fimbulvetr-11B-v2 HuggingFaceH4/zephyr-7b-beta upstage/SOLAR-10.7B-Instruct-v1.0 alpindale/magnum-72b-v1 Sao10K/L3-70B-Euryale-v2.1 alpindale/WizardLM-2-8x22B meta-llama/Meta-Llama-3.1-405B-Instruct [Custom] grok-beta [Custom] Fetch List Use Custom Emulate Completions API with Prefill Add Ver. Num Streaming Chat-Completions API Non-Standard Fields Main Message Role: User Assistant System AutoRole Add Prefix Add Postfix User Assistant System User Assistant System Preferred Provider: Entering your Claude API key will allow you to use KoboldAI Lite with their API. Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. At this time, the official Claude API has CORS restrictions and must be accessed with a CORS proxy. Your connection WILL be proxied.Only Temperature, Top-P and Top-K samplers are used. Please input Claude API URL and Key. Model Choice: claude-v1 claude-v1-100k claude-instant-v1 claude-instant-v1-100k claude-2 claude-2.1 claude-2.0 claude-3-opus claude-3-sonnet claude-3-haiku claude-3-5-sonnet-20240620 claude-3-5-sonnet-20241022 claude-3-5-sonnet-latest claude-3-5-haiku-20241022 claude-3-7-sonnet-20250219 Fetch List Add Endpoint Version Claude Compatibility Rename Fix Enable Thinking Uses Gemini or PaLM Text Bison by Google. Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the Gemini API and is not transmitted to us. gemini-pro gemini-1.5-pro-001 gemini-1.5-pro-002 gemini-1.5-pro-latest gemini-1.5-flash-latest gemini-1.5-pro-exp-0801 gemini-1.5-pro-exp-0827 gemini-2.0-flash gemini-2.0-pro-exp gemini-exp-1114 gemini-exp-1121 text-bison-001 Fetch List Please input Gemini or PaLM API Key. Main Message Role: Default User Model User Model Uses Cohere's models through their own API. Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Your API key is used directly with the Cohere API and is not transmitted to us. command command-r command-r-plus command-r-08-2024 command-r-plus-08-2024 command-r7b-12-2024 command-a-03-2025 Please input Cohere API Key. Use WebSearch Use Preamble Ok Cancel Change Loaded KoboldCpp Config Warning: This will terminate the current KoboldCpp instance and relaunch it with a new config. If an invalid configuration is selected, the new server may fail to relaunch! Reload KoboldCpp Cancel Really Start A New Session? Unsaved data will be lost. Keep AI Selected? Keep Memory and World Info? Ok Cancel Advanced Load File Select categories to import from saved file. Selected categories will be overwritten. Unselected categories will retain original values. Main Story Memory and Author's Note World Info Stop Sequences General Settings Aesthetic Settings Ok Cancel Image Information Loading... Delete Image Close Worker List NameModelCapabilitiesUptimeKudos OK My Worker List NameDescriptionUptimeKudosMaint.Del. OK Share Story Copy Close Warning: This story is very long. It may not load in some browsers. You should save it as a file instead. Dynamic Temperature Wizard Dynamic temperature is specified by a Temperature Value and a Temperature Range. Actual temperature is allowed to be automatically adjusted dynamically between (DynaTemp ± DynaRange). For ease of use, a simple converter is provided here. Setting both values to the same temperature disables DynaTemp. Minimum Temperature: Maximum Temperature: Temperature: DynaTemp-Range: DynaTemp-Exponent: Ok Add New Image Generate Image (Automatic) Generate Image (Custom Prompt) Upload Image File Drag Drop / Paste from Clipboard Customize Image Settings Go To StableUI Cancel Paste Image From Clipboard Cancel Share Story Import / Export Export Share as TextData Export Share as Web URL Export Share as Plaintext Import Share from TextData Cancel Chat Selectors Ok Cancel OK Cancel Yes No OKenen1771376641https://koboldai.net

Sahypaňyzy redaktirläňmi?

Näme edýärsiň?