Crash after updating to 29.9.0

Bug description

• I updated the server: dnf update from 29.0 to 29.9
• Then restarted searchd with searchd --config /home/manticore/config/test.conf --stopwait && searchd --config /home/manticore/config/test.conf

[Tue Sep 15 15:14:19.062 2026] [823115] caught SIGTERM, shutting down [Tue Sep 15 15:14:19.066 2026] [823128] WARNING: conn 127.0.0.1:58482(7956298), sock=30: failed to receive HTTP request, AsyncNetInputBuffer_c::AppendData: got SIGTERM, return -1 [Tue Sep 15 15:14:22.073 2026] [823115] WARNING: still 1 alive tasks during shutdown, after 3.009 sec [Tue Sep 15 15:15:14.003 2026] [823114] WARNING: GlobalCrashQueryGetRef: thread-local info is not set! Use ad-hoc

--- crashed invalid query ---

--- request dump end --- --- local index: Manticore 29.0.2 2f9c226b6@26081409 (columnar 13.9.0 dbc40aa@26080509) (secondary 13.9.0 dbc40aa@26080509) (knn 13.9.0 dbc40aa@26080509) (embeddings 1.1.1 dbc40aa@26080509) Handling signal 8 -------------- backtrace begins here --------------- Program compiled with Clang 16.0.6 Configured with flags: Configured with these definitions: -DDISTR_BUILD=rhel9 -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_NLJSON=1 -DWITH_UNIALGO=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_JIEBA=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ZSTD=1 -DDL_ZSTD=1 -DZSTD_LIB=libzstd.so.1 -DWITH_CURL=1 -DDL_CURL=1 -DCURL_LIB=libcurl.so.4 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmariadb.so.3 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore -DFULL_SHARE_DIR=/usr/share/manticore Built on Linux x86_64 (rhel9) (cross-compiled) Stack bottom = 0x7fffdefbd607, thread stack size = 0x20000 Trying manual backtrace: Something wrong with thread stack, manual backtrace may be incorrect (fp=0x20000) Wrong stack limit or frame pointer, manual backtrace failed (fp=0x20000, stack=0x558fa23e0000, stacksize=0x20000) Trying system backtrace: begin of system symbols: searchd(_Z12sphBacktraceib+0x227)[0x558f9f2ed7f7] searchd(_Z11HandleCrashi+0x2e3)[0x558f9ef88b43] /lib64/libc.so.6(+0x3fb30)[0x7f88ce03fb30] /lib64/libc.so.6(wait4+0x1a)[0x7f88ce0da34a] searchd(_Z11SetWatchDogi+0x164)[0x558f9f16f8e4] searchd(_Z11ServiceMainiPPc+0x1cb8)[0x558f9f176288] searchd(main+0x48)[0x558f9f17a788] /lib64/libc.so.6(+0x2a610)[0x7f88ce02a610] /lib64/libc.so.6(__libc_start_main+0x80)[0x7f88ce02a6c0] searchd(_start+0x25)[0x558f9ef74a25] Trying boost backtrace: 0# sphBacktrace(int, bool) in searchd 1# HandleCrash(int) in searchd 2# 0x00007F88CE03FB30 in /lib64/libc.so.6 3# wait4 in /lib64/libc.so.6 4# SetWatchDog(int) in searchd 5# ServiceMain(int, char**) in searchd 6# main in searchd 7# 0x00007F88CE02A610 in /lib64/libc.so.6 8# __libc_start_main in /lib64/libc.so.6 9# _start in searchd

-------------- backtrace ends here --------------- Please, create a bug report in our bug tracker (https://github.com/manticoresoftware/manticore/issues) and attach there: a) searchd log, b) searchd binary, c) searchd symbols. Look into the chapter 'Reporting bugs' in the manual (https://manual.manticoresearch.com/Reporting_bugs) Dump with GDB via watchdog [Tue Sep 15 15:15:15.048 2026] [1028856] watchdog: main process 1028857 forked ok [Tue Sep 15 15:15:15.052 2026] [1028857] WARNING: Error initializing time zones: Error resolving local time zone from '/etc/localtime' and time zone dir '/usr/share/zoneinfo/' [Tue Sep 15 15:15:15.052 2026] [1028857] Using local time zone 'UTC' [Tue Sep 15 15:15:15.053 2026] [1028857] starting daemon version '29.9.0 58e88d5ab@26091108 (columnar 14.2.1 cb282a2@26090615) (secondary 14.2.1 cb282a2@26090615) (knn 14.2.1 cb282a2@26090615) (embeddings 1.1.1 cb282a2@26090615)' ... [Tue Sep 15 15:15:15.053 2026] [1028857] listening on all interfaces for mysql, port=2471 [Tue Sep 15 15:15:15.053 2026] [1028857] listening on all interfaces for sphinx and http(s), port=2479 [Tue Sep 15 15:15:15.238 2026] [1028858] rotating table 'test': success [Tue Sep 15 15:15:16.011 2026] [1028861] prereading 7 tables [Tue Sep 15 15:15:16.038 2026] [1028857] accepting connections [Tue Sep 15 15:15:16.298 2026] [1028862] [BUDDY] started v4.4.3+26083121-976df147 'manticore-executor /usr/share/manticore/modules/manticore-buddy/src/main.php --listen=http://0.0.0.0:2479 --threads=14 ' at http://127.0.0.1:39889 [Tue Sep 15 15:15:16.298 2026] [1028862] [BUDDY] Loaded plugins: [Tue Sep 15 15:15:16.298 2026] [1028862] [BUDDY] core: empty-string, backup, emulate-elastic, fuzzy, create-table, create-cluster, drop, insert, alias, select, replace-select, show, plugin, test, alter-column, alter-distributed-table, alter-rename-table, modify-table, knn, replace, queue, sharding, update, autocomplete, cli-table, truncate, optimize, flush, metrics, conversational-search, plugins-auth-permissions [Tue Sep 15 15:15:16.298 2026] [1028862] [BUDDY] local: [Tue Sep 15 15:15:16.298 2026] [1028862] [BUDDY] extra: [Tue Sep 15 15:15:16.704 2026] [1028861] preread 5 tables in 0.693 sec --- active threads --- --- Totally 0 threads, and 0 client-working threads --- ------- CRASH DUMP END -------

After killing searchd (kill -9) and starting searchd it all worked again.

Manticore Search version

29.9.0

Operating system version

Almalinux

Have you tried the latest development version?

Yes — the issue still occurs

How does this bug affect you?

Production is down or this is a major incident

How do you use Manticore Search?

No response

What do you use Manticore for?

No response

Company or project

No response

Approximate scale

No response

Can we learn more about your use case?

• Yes — feel free to @mention me in this issue if you'd like to ask more about how we use Manticore.

Internal Checklist

To be completed by the assignee. Check off tasks that have been completed or are not applicable.

• Implementation completed
• Tests developed
• Documentation updated
• Documentation reviewed