#2581·openbao

Flaky Tests

Author: satoqzCreated Mar 4, 2026Updated Sep 22, 2026
Labelsbughelp wanted

[!NOTE] This issue is automatically updated every day and provides an overview of flaky tests that have appeared in CI over the past 7 days.

Candidates are chosen by selecting CI workflow runs that failed and succeeded after being re-triggered (no pushes can occur inbetween, as that would create an entirely new run). While this approach minimizes false positives, note that many failed runs are not manually retriggered and thus not taken into consideration. As a result, the number of failed runs below is almost guaranteed to be lower than the number of failures technically observable.

We highly appreciate all help in fixing flaky tests! Once a fix has been merged, the test should eventually fade out of the below list.


TestHTTP_Index_Defaults (internal/vault/external_tests/api)

Last seen 22/09/2026 in https://github.com/openbao/openbao/commit/e98dc184344fe84ee4e69965ac3f4217d5b6a45d

go test github.com/openbao/openbao/v2/internal/vault/external_tests/api -run '^TestHTTP_Index_Defaults$'
15 past failures:  
Date Job Commit PR
22/09/2026 Logs https://github.com/openbao/openbao/commit/e98dc184344fe84ee4e69965ac3f4217d5b6a45d N/A
20/09/2026 Logs https://github.com/openbao/openbao/commit/dddb7c9577574b82585c5e685548ec3a83a4a322 N/A
18/09/2026 Logs https://github.com/openbao/openbao/commit/2bb7416708534c53966eb48c4366ceaff48a2143 https://github.com/openbao/openbao/pull/4010
18/09/2026 Logs https://github.com/openbao/openbao/commit/d35936417dd08df32207889ab90a16c2242d090b https://github.com/openbao/openbao/pull/4033
18/09/2026 Logs https://github.com/openbao/openbao/commit/4dd77d9e07886ae432b07161430f34fc34983e9f https://github.com/openbao/openbao/pull/4028
18/09/2026 Logs https://github.com/openbao/openbao/commit/d1f0e316cb6eeb87ee361658f5e70e94c654ed8f https://github.com/openbao/openbao/pull/4016
17/09/2026 Logs https://github.com/openbao/openbao/commit/735723da5628148f232497a48a35a137b6512103 N/A
17/09/2026 Logs https://github.com/openbao/openbao/commit/fac11a74c9bff363ab6a72443d271556de47b772 https://github.com/openbao/openbao/pull/4007
16/09/2026 Logs https://github.com/openbao/openbao/commit/0646d5920ae43f4c595de89d7c511207126292e0 https://github.com/openbao/openbao/pull/4014
15/09/2026 Logs https://github.com/openbao/openbao/commit/038f4dc50e899f899d0c8ccd78aab18f7b8c0018 https://github.com/openbao/openbao/pull/4009
10/09/2026 Logs https://github.com/openbao/openbao/commit/687adbf48a238be50d4e096c00d460a10bedacba https://github.com/openbao/openbao/pull/3846
10/09/2026 Logs https://github.com/openbao/openbao/commit/4db4c4161dd591e8790666bfc10be7b0b3f09f4b N/A
10/09/2026 Logs https://github.com/openbao/openbao/commit/cec335b9babb81017f19c4e113a39d56433eec46 https://github.com/openbao/openbao/pull/3973
10/09/2026 Logs https://github.com/openbao/openbao/commit/ac4f491c0c347fee0ae5668cf9e9d872178ac531 https://github.com/openbao/openbao/pull/3978
10/09/2026 Logs https://github.com/openbao/openbao/commit/c997a8114476cdbc4aae47a809a3d65e081600b8 https://github.com/openbao/openbao/pull/3971

TestNamespaceStore (internal/vault)

Last seen 21/09/2026 in https://github.com/openbao/openbao/pull/4040

go test github.com/openbao/openbao/v2/internal/vault -run '^TestNamespaceStore$'
4 past failures:  
Date Job Commit PR
21/09/2026 Logs https://github.com/openbao/openbao/commit/b4326798b8ab09d0dbca7f0885aa9f057c18b45c https://github.com/openbao/openbao/pull/4040
15/09/2026 Logs https://github.com/openbao/openbao/commit/73dc6be29b9a7812dfce62a98aa21279ebd07106 https://github.com/openbao/openbao/pull/4006
28/07/2026 Logs https://github.com/openbao/openbao/commit/5eff630ea4456c8eb6bc2f1a4d242a2940dd105b https://github.com/openbao/openbao/pull/3542
02/07/2026 Logs https://github.com/openbao/openbao/commit/4c044ac3c133792af7005f21de23127be5cdf4bd https://github.com/openbao/openbao/pull/3415

TestPostgreSQL_Scalability (internal/vault/external_tests/postgresql_binary)

Last seen 21/09/2026 in https://github.com/openbao/openbao/commit/9c6fa01053194e94e670e81d037513823e96cb77

go test github.com/openbao/openbao/v2/internal/vault/external_tests/postgresql_binary -run '^TestPostgreSQL_Scalability$'
16 past failures:  
Date Job Commit PR
21/09/2026 Logs https://github.com/openbao/openbao/commit/9c6fa01053194e94e670e81d037513823e96cb77 N/A
17/09/2026 Logs https://github.com/openbao/openbao/commit/8b635d30582115db6a03df646c88b75e3e575081 https://github.com/openbao/openbao/pull/4016
10/09/2026 Logs https://github.com/openbao/openbao/commit/4db4c4161dd591e8790666bfc10be7b0b3f09f4b N/A
10/09/2026 Logs https://github.com/openbao/openbao/commit/a2c5e45378a8b45bf87c0c70428c1f364737e42f https://github.com/openbao/openbao/pull/3972
10/09/2026 Logs https://github.com/openbao/openbao/commit/c997a8114476cdbc4aae47a809a3d65e081600b8 https://github.com/openbao/openbao/pull/3971
04/09/2026 Logs https://github.com/openbao/openbao/commit/6c0def8cc02b0fabe8a87f5e51fbc178bc0a0b38 https://github.com/openbao/openbao/pull/3904
04/09/2026 Logs https://github.com/openbao/openbao/commit/991495ea347fc7d506ba6f2b343f3086d0ba7e3b https://github.com/openbao/openbao/pull/3932
13/08/2026 Logs https://github.com/openbao/openbao/commit/1de39e42cb39d2b8886784564b2180785ea77830 https://github.com/openbao/openbao/pull/3759
12/08/2026 Logs https://github.com/openbao/openbao/commit/b4024b9d2542afae5b9ae7fb276fcf9be6cccf92 https://github.com/openbao/openbao/pull/3759
11/08/2026 Logs https://github.com/openbao/openbao/commit/dd94b950283a60480c9d873a08816a62663eb1a2 https://github.com/openbao/openbao/pull/3759
11/08/2026 Logs https://github.com/openbao/openbao/commit/9bdbbb7e2bbdd11fd229a076ac2a8161cf53cb02 https://github.com/openbao/openbao/pull/3752
10/08/2026 Logs https://github.com/openbao/openbao/commit/ee9700ff465ef1806e70cab423049a5c7d99a704 https://github.com/openbao/openbao/pull/3738
07/08/2026 Logs https://github.com/openbao/openbao/commit/9ee6ebb3f2560cf4f39a26dad0770817e9fb3f0b https://github.com/openbao/openbao/pull/3662
30/07/2026 Logs https://github.com/openbao/openbao/commit/15df940a76fab0e578199a367cca149e1ba8a8ae https://github.com/openbao/openbao/pull/3649
30/07/2026 Logs https://github.com/openbao/openbao/commit/52a2d493951593faf19da1f4badb40ae394678c8 https://github.com/openbao/openbao/pull/3642
29/07/2026 Logs https://github.com/openbao/openbao/commit/b7a61e67247ab8e56f04568c202e8946650374c2 https://github.com/openbao/openbao/pull/3602

TestSSHBackend_BasicIssuerOperations (internal/builtin/logical/ssh)

Last seen 21/09/2026 in https://github.com/openbao/openbao/commit/9c6fa01053194e94e670e81d037513823e96cb77

go test github.com/openbao/openbao/v2/internal/builtin/logical/ssh -run '^TestSSHBackend_BasicIssuerOperations$'
21 past failures:  
Date Job Commit PR
21/09/2026 Logs https://github.com/openbao/openbao/commit/9c6fa01053194e94e670e81d037513823e96cb77 N/A
03/09/2026 Logs https://github.com/openbao/openbao/commit/1e91a0b628cf9d3a559d05cdc97b0fbb955bafd5 https://github.com/openbao/openbao/pull/3660
23/07/2026 Logs https://github.com/openbao/openbao/commit/d71e1ed49edc7a304fe6f16ec3b02fcae19bdb98 https://github.com/openbao/openbao/pull/3580
16/07/2026 Logs https://github.com/openbao/openbao/commit/aee62976fa100535428c5ac3369cb1333e60e15d https://github.com/openbao/openbao/pull/3212
30/06/2026 Logs https://github.com/openbao/openbao/commit/77e81b60852faacd8df4b5a36485282f9589ee9a https://github.com/openbao/openbao/pull/3394
30/06/2026 Logs https://github.com/openbao/openbao/commit/77e81b60852faacd8df4b5a36485282f9589ee9a https://github.com/openbao/openbao/pull/3394
30/06/2026 Logs https://github.com/openbao/openbao/commit/06b35f3fae9743e9c51b1bfe3680042759f661fd https://github.com/openbao/openbao/pull/3395
30/06/2026 Logs https://github.com/openbao/openbao/commit/06b35f3fae9743e9c51b1bfe3680042759f661fd https://github.com/openbao/openbao/pull/3395
12/06/2026 Logs https://github.com/openbao/openbao/commit/caf90245b5b391ce0abf8c58613c04498f1bea00 https://github.com/openbao/openbao/pull/3283
28/05/2026 Logs https://github.com/openbao/openbao/commit/91d2fbf97683916d5e537bec0d695fb9ffb809cc N/A
30/04/2026 Logs https://github.com/openbao/openbao/commit/702fad2346fafd89adc3493c845e1a65a5a59d95 https://github.com/openbao/openbao/pull/3009
30/03/2026 Logs https://github.com/openbao/openbao/commit/9ba41b93b9b14753f51db55debc0f7be5a547b1c N/A
17/03/2026 Logs https://github.com/openbao/openbao/commit/e50f9bf6c4aba116ad7f130d3763785e4e56bb5e https://github.com/openbao/openbao/pull/2654
16/03/2026 Logs https://github.com/openbao/openbao/commit/37c03395cc3b876b855a959f43c60bc869490582 N/A
16/03/2026 Logs https://github.com/openbao/openbao/commit/a727d06bc4e31d93dc8deaaed5be9274fc13ca99 N/A
16/03/2026 Logs https://github.com/openbao/openbao/commit/4bbf1fe21c1fa3ac222216502e2ed8323b0ba52a https://github.com/openbao/openbao/pull/2643
16/03/2026 Logs https://github.com/openbao/openbao/commit/3931038b1891ae72dfbc901b92477800675c0b80 https://github.com/openbao/openbao/pull/2640
06/03/2026 Logs https://github.com/openbao/openbao/commit/03c8872cf062f9cffca63e5899208bd096a57558 https://github.com/openbao/openbao/pull/2588
27/02/2026 Logs https://github.com/openbao/openbao/commit/34c26c8ab1481639a2eca2c4ec338873db6ece7c https://github.com/openbao/openbao/pull/2552
16/02/2026 Logs https://github.com/openbao/openbao/commit/5e8539dd2267f62b13d8dbf9f65def3b93c10748 https://github.com/openbao/openbao/pull/2472
16/02/2026 Logs https://github.com/openbao/openbao/commit/677503dd38eba8f4cd3c272d62f862d1cdf0b252 https://github.com/openbao/openbao/pull/2481

TestSSH_ConfigCASubmitDefaultIssuer (internal/builtin/logical/ssh)

Last seen 17/09/2026 in https://github.com/openbao/openbao/pull/4028

go test github.com/openbao/openbao/v2/internal/builtin/logical/ssh -run '^TestSSH_ConfigCASubmitDefaultIssuer$'
19 past failures:  
Date Job Commit PR
17/09/2026 Logs https://github.com/openbao/openbao/commit/e1db985d55a5eddc12c013f63bb933b1da35190a https://github.com/openbao/openbao/pull/4028
13/09/2026 Logs https://github.com/openbao/openbao/commit/1b6f643d5f62023bd78f67e646460e3617bf06cd https://github.com/openbao/openbao/pull/3994
10/09/2026 Logs https://github.com/openbao/openbao/commit/4db4c4161dd591e8790666bfc10be7b0b3f09f4b N/A
04/09/2026 Logs https://github.com/openbao/openbao/commit/f67b2137069673fda60a8a96e3083e705f4f7e42 https://github.com/openbao/openbao/pull/3914
22/07/2026 Logs https://github.com/openbao/openbao/commit/7f6845bc48384ecf15dbb5115c90edd2d83cb61b https://github.com/openbao/openbao/pull/3534
30/06/2026 Logs https://github.com/openbao/openbao/commit/77e81b60852faacd8df4b5a36485282f9589ee9a https://github.com/openbao/openbao/pull/3394
30/06/2026 Logs https://github.com/openbao/openbao/commit/77e81b60852faacd8df4b5a36485282f9589ee9a https://github.com/openbao/openbao/pull/3394
30/06/2026 Logs https://github.com/openbao/openbao/commit/06b35f3fae9743e9c51b1bfe3680042759f661fd https://github.com/openbao/openbao/pull/3395
30/06/2026 Logs https://github.com/openbao/openbao/commit/06b35f3fae9743e9c51b1bfe3680042759f661fd https://github.com/openbao/openbao/pull/3395
11/06/2026 Logs https://github.com/openbao/openbao/commit/2aa23b45a145237cf97788a830792d725c346a9a https://github.com/openbao/openbao/pull/3272
08/06/2026 Logs https://github.com/openbao/openbao/commit/a39107b07bf4f9316e5980e897999b11ae1c598d https://github.com/openbao/openbao/pull/3209
03/06/2026 Logs https://github.com/openbao/openbao/commit/601b32b68b32cd60e93915fc0181a71e08179dcb https://github.com/openbao/openbao/pull/3117
21/05/2026 Logs https://github.com/openbao/openbao/commit/6dddfabed041e9f7baae967a09d5de15cb6e809d https://github.com/openbao/openbao/pull/3162
20/04/2026 Logs https://github.com/openbao/openbao/commit/7d68ac8ab27aa23f0642b10d43e5a865f53c0d50 N/A
25/03/2026 Logs https://github.com/openbao/openbao/commit/aa7c82459b04760d385f72271647e8013069db55 N/A
18/03/2026 Logs https://github.com/openbao/openbao/commit/06a2fee1d45b1222fc7d8352d2d144147ec6adcd N/A
16/03/2026 Logs https://github.com/openbao/openbao/commit/5942016c8adf527ee13bfb906e78db8a52931ddf https://github.com/openbao/openbao/pull/2642
16/03/2026 [Logs](https://github.com/openbao/openbao/actions/run