[BUG] Vector Storage - Generation interceptor aborted
Environment
Linux
System
Ubuntu
Version
SillyTavern 1.18.0 'release' (8172dcd0e)
Desktop Information
No response
Describe the problem
Using internal vector storage, if I use the "Continue" feature to have the AI continue generation without a new prompt, it will eventually corrupt the vector storage file, giving the error above.
This issue was previously closed without being diagnosed or fixed here: https://github.com/SillyTavern/SillyTavern/issues/2328 but I believe that I have information that is not in the previous thread or that the issue may be different. I posted my logs in that thread but am adding them here as well since the issue was previously closed without resolution.
Additional info
The error I get in the UI is:
Vector Storage
Generation interceptor aborted. Check browser console for more details. ..When I check F12:
Vectors: Failed to rearrange chat
Error: Failed to query multiple collections
at queryMultipleCollections (index.js:1197:15)
at async activateWorldInfo (index.js:1706:26)
at async rearrangeChat (script.js:792:13)
at async runGenerationInterceptors (extensions.js:2028:17)
at async Generate (script.js:4505:25)
...And in the Sillytavern log I get a massive spam which I've clipped out the repetitive bits of:
std::bad_alloc
An error occurred during model execution: "Error: failed to call OrtRun(). error code = 6.".
Inputs given to model: [Object: null prototype] {
input_ids: Tensor {
dims: [ 1, 4315 ],
type: 'int64',
data: BigInt64Array(4315) [
101n, 12849n, 6499n, 2506n, 2551n, 2014n, 22418n, 2007n, 2010n,
4416n, 1998n, 4344n, 1010n, 2551n, 2000n, 5676n, 2008n, 2016n,
2038n, 2012n, 2560n, 2028n, 1010n, 2030n, 2672n, 2048n, 1010n,
13892n, 2015n, 2077n, 2002n, 3138n, 2014n, 1012n, 1031n, 100n,
2051n, 2340n, 1024n, 2321n, 1064n, 100n, 19348n, 2475n, 1011n,
5840n, 1011n, 2861n, 1010n, 1064n, 100n, 2530n, 22944n, 1011n,
---- thousands and thousands of lines removed ------
6718n, 1010n, 15080n, 2068n, 1996n, 4223n, 2027n, 25155n, 1012n,
1026n, 999n, 1011n, 1011n, 1043n, 2546n, 2595n, 1035n, 2203n,
1011n, 1011n, 1028n, 102n
],
size: 4315
},
attention_mask: Tensor {
dims: [ 1, 4315 ],
type: 'int64',
data: BigInt64Array(4315) [
1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n,
1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n,
1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n,
---- thousands and thousands of lines removed ------
1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n,
1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n,
1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n, 1n,
1n, 1n, 1n, 1n, 1n, 1n, 1n
],
size: 4315
},
token_type_ids: Tensor {
dims: [ 1, 4315 ],
type: 'int64',
data: BigInt64Array(4315) [
0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n,
0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n,
0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n,
0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n,
---- thousands and thousands of lines removed ------
0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n,
0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n, 0n,
0n, 0n, 0n, 0n, 0n, 0n, 0n
],
size: 4315
}
}
Error: failed to call OrtRun(). error code = 6.
at e.run (/home/aelfwyne/SillyTavern/node_modules/onnxruntime-web/dist/ort-web.node.js:6:454392)
at e.run (/home/aelfwyne/SillyTavern/node_modules/onnxruntime-web/dist/ort-web.node.js:6:443740)
at e.OnnxruntimeWebAssemblySessionHandler.run (/home/aelfwyne/SillyTavern/node_modules/onnxruntime-web/dist/ort-web.node.js:6:446675)
at m.run (/home/aelfwyne/SillyTavern/node_modules/onnxruntime-common/dist/ort-common.node.js:6:9992)
at sessionRun (file:///home/aelfwyne/SillyTavern/node_modules/sillytavern-transformers/src/models.js:207:36)
at Function.encoderForward [as _forward] (file:///home/aelfwyne/SillyTavern/node_modules/sillytavern-transformers/src/models.js:520:18)
at Function.forward (file:///home/aelfwyne/SillyTavern/node_modules/sillytavern-transformers/src/models.js:820:27)
at Function._call (file:///home/aelfwyne/SillyTavern/node_modules/sillytavern-transformers/src/models.js:809:27)
at Function.closure [as model] (file:///home/aelfwyne/SillyTavern/node_modules/sillytavern-transformers/src/utils/core.js:62:28)
at Function._call (file:///home/aelfwyne/SillyTavern/node_modules/sillytavern-transformers/src/pipelines.js:1182:36)
Applying custom prompt post-processing of type semi_tools
Chat Completion request: {
messages: [
{
role: 'system',
content: '\n' +
'\n' +
'<summary>\n' +
"2092-02-17 | 12:45: Ousef repairs armor with wood plates while discussing the mystery of ancient civilizations; a heavy thud and snapping branch in the canopy signal an imminenPlease tick the boxes
- I have explained the issue clearly, and I included all relevant info
- I have checked that this issue hasn't already been raised
- I have checked the docs
- I confirm that my issue is not related to third-party content, unofficial extension or patch. If in doubt, check with a new user account and with extensions disabled
Source: SillyTavern/SillyTavern