Baike.dev
Log in
Back to tool/Back to issues
#1830·ArchiveBox

Bug: Crawl automatically seals, but works when recrawling

Author: v4u6h4nCreated Jun 23, 2026Updated Jul 3, 2026

Provide a screenshot and describe the bug

It seems like every crawl just automatically defaults to sealed, and only crawls once I open it up and click the recrawl button, then it all seems to work as expected. Not sure if the logs have caught it or not.

Steps to reproduce

markdown
1. Add a URL to crawl.
2. Confirm to start the crawl.

Logs or errors

bash
[*] Verifying and updating existing ArchiveBox collection to v0.9.35rc88...
----------------------------------------------------------------------

[*] Verifying archive folder structure...
    + ./archive, ./sources, ./logs...
    + ./ArchiveBox.conf...

[*] Verifying main SQL index and running any migrations needed...

    √ ./index.sqlite3

[*] Checking links from indexes and archive folders (safe to Ctrl+C)...
    √ Loaded 164 links from existing main index.
    > Skipping orphan snapshot import during init.

    Hint: To import orphaned snapshot directories and reconcile filesystem 
state, run:
        archivebox update

----------------------------------------------------------------------
[√] Done. Verified and updated the existing ArchiveBox collection.
[+] Starting ArchiveBox webserver...
    > Starting ArchiveBox webserver on BIND_ADDR http://0.0.0.0:8000
    > Log in to ArchiveBox Admin UI on BASE_URL  
http://archivebox.localhost:50062/admin/
    > Writing ArchiveBox error log to ./logs/errors.log

[!] BASE_URL (http://archivebox.localhost:50062) port 50062 does not match the 
port the server is running on (8000). Make sure this is intentional!

[‍♂ Supervisord starting...
    > Writing supervisord logs to: ./logs/supervisord.log
    > Writing task worker logs to: ./logs/worker_*.log
    > Using supervisord config file: /tmp/archivebox/supervisord.conf
    > Using supervisord UNIX socket: /tmp/archivebox/supervisord.sock

[‍♂ Supervisord connected (pid=149) via 
unix:///tmp/archivebox/supervisord.sock.
[*] Starting orchestrator, server, sonic in this process (pid=2)...

[‍♂ Supervisord syncing subprocess worker: worker_daphne...
     - Worker worker_daphne: started RUNNING (pid 150, uptime 0:00:00)
[‍♂ Supervisord syncing subprocess worker: worker_sonic...
     - Worker worker_sonic: started RUNNING (pid 151, uptime 0:00:00)
[‍♂ Supervisord syncing subprocess worker: worker_runner...
     - Worker worker_runner: started RUNNING (pid 152, uptime 0:00:00)
[‍♂ Supervisord syncing subprocess worker: 
worker_supervisord_parent_watchdog...
     - Worker worker_supervisord_parent_watchdog: started RUNNING (pid 153, 
uptime 0:00:00)

Tailing worker logs (Ctrl+C to stop)...

    
    
    

[2026-06-23 02:45:02] INFO     daphne.cli Starting server at          cli.py:284
                               tcp:port=8000:interface=0.0.0.0
                      INFO     daphne.server HTTP/2 support not    server.py:126
                               enabled (install the http2 and tls
                               Twisted extras)
                      INFO     daphne.server Configuring endpoint  server.py:135
                               tcp:port=8000:interface=0.0.0.0
                      INFO     daphne.server Listening on TCP      server.py:166
                               address 0.0.0.0:8000
2026-06-23 02:45:34 HTTP     GET /admin/ 302 10.89.6.3
2026-06-23 02:45:35 HTTP     GET /admin/ 200 10.89.6.3
2026-06-23 02:45:41 HTTP     GET /admin/crawls/crawl/ 200 10.89.6.3
2026-06-23 02:45:59 HTTP     GET 
/admin/crawls/crawl/06a38edad60171d68000cb0a6100971c/change/ 200 10.89.6.3
2026-06-23 02:46:25 HTTP     GET /add/ 200 10.89.6.3
[+] Adding URL: https://eventsinukraine.substack.com/archive?sort=new
[2026-06-23 02:47:16] WARNING  archivebox.workers.models           models.py:327
                               Crawl.save() outside runner
                               process:
                               id=06a39f3b4b62787c8000c102f8c46853
                               status=queued retry_at=2026-06-23
                               02:47:16.711515+00:00 process=cli
                               root=server
                               caller=/opt/uv/python/cpython-3.13.
                               14-linux-x86_64-gnu/lib/python3.13/
                               concurrent/futures/thread.py:59;
                               queue/status writes outside the
                               runner should usually use
                               safe_update()
[+] Created Crawl 06a39f3b4b62787c8000c102f8c46853 with max_depth=0
    First URL: https://eventsinukraine.substack.com/archive?sort=new
[*] URLs queued. The background runner will process them (run `archivebox 
server` or `archivebox run --daemon` if not already running).
[‍♂ Supervisord connected (pid=149) via 
unix:///tmp/archivebox/supervisord.sock.
2026-06-23 02:47:16 HTTP     POST /add/ 302 10.89.6.3
2026-06-23 02:47:17 HTTP     GET 
/admin/crawls/crawl/06a39f3b4b62787c8000c102f8c46853/change/ 200 10.89.6.3
[Crawl#f8c46853] [STARTED] archivebox@2697fa3c2a4e $ 
/venv/lib/python3.13/site-packages/daphne/__main__.py --bind=0.0.0.0 --port=8000
archivebox.core.asgi:application [2026-06-23__02-47-16]
Runner error: Error: 
[('/data/personas/Default/chrome_profile/Default/blob_storage/394df2d6-6535-44ac
-a9f7-5fd0babd0277',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Default/blob_storage/
394df2d6-6535-44ac-a9f7-5fd0babd0277',
"[Errno 13] Permission denied: 
'/data/personas/Default/chrome_profile/Default/blob_storage/394df2d6-6535-44ac-a
9f7-5fd0babd0277'"), 
('/data/personas/Default/chrome_profile/Default/DataSharing',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Default/DataSharing',
 "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/Default/DataSharing'"), 
('/data/personas/Default/chrome_profile/Default/Collaboration',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Default/Collaboration
', "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/Default/Collaboration'"), 
('/data/personas/Default/chrome_profile/Default/Feature Engagement Tracker',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Default/Feature 
Engagement Tracker', "[Errno 13] Permission
denied: '/data/personas/Default/chrome_profile/Default/Feature Engagement 
Tracker'"), ('/data/personas/Default/chrome_profile/Default/Secure Preferences',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Default/Secure 
Preferences', "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/Default/Secure Preferences'"), 
('/data/personas/Default/chrome_profile/Default/Search Logos',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Default/Search 
Logos', "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/Default/Search Logos'"), 
('/data/personas/Default/chrome_profile/Default/Network Persistent State',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Default/Network 
Persistent State', "[Errno 13] Permission
denied: '/data/personas/Default/chrome_profile/Default/Network Persistent 
State'"), ('/data/personas/Default/chrome_profile/Default/Preferences',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Default/Preferences',
 "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/Default/Preferences'"), 
('/data/personas/Default/chrome_profile/Dictionaries',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Dictionaries', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/Dictionaries'"), 
('/data/personas/Default/chrome_profile/WidevineCdm',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/WidevineCdm', "[Errno
13] Permission denied:
'/data/personas/Default/chrome_profile/WidevineCdm'"), 
('/data/personas/Default/chrome_profile/OptimizationHints',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/OptimizationHints', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/OptimizationHints'"), 
('/data/personas/Default/chrome_profile/FileTypePolicies',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/FileTypePolicies', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/FileTypePolicies'"), 
('/data/personas/Default/chrome_profile/CertificateRevocation',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/CertificateRevocation
', "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/CertificateRevocation'"), 
('/data/personas/Default/chrome_profile/OriginTrials',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/OriginTrials', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/OriginTrials'"), 
('/data/personas/Default/chrome_profile/TrustTokenKeyCommitments',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/TrustTokenKeyCommitme
nts', "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/TrustTokenKeyCommitments'"), 
('/data/personas/Default/chrome_profile/OnDeviceHeadSuggestModel',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/OnDeviceHeadSuggestMo
del', "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/OnDeviceHeadSuggestModel'"), 
('/data/personas/Default/chrome_profile/Subresource Filter',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Subresource Filter', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/Subresource Filter'"), 
('/data/personas/Default/chrome_profile/MEIPreload',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/MEIPreload', "[Errno 
13] Permission denied:
'/data/personas/Default/chrome_profile/MEIPreload'"), 
('/data/personas/Default/chrome_profile/PrivacySandboxAttestationsPreloaded',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/PrivacySandboxAttesta
tionsPreloaded', "[Errno 13] Permission
denied: 
'/data/personas/Default/chrome_profile/PrivacySandboxAttestationsPreloaded'"), 
('/data/personas/Default/chrome_profile/HistorySearch',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/HistorySearch', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/HistorySearch'"), 
('/data/personas/Default/chrome_profile/SSLErrorAssistant',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/SSLErrorAssistant', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/SSLErrorAssistant'"), 
('/data/personas/Default/chrome_profile/Crowd Deny',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Crowd Deny', "[Errno 
13] Permission denied:
'/data/personas/Default/chrome_profile/Crowd Deny'"), 
('/data/personas/Default/chrome_profile/ZxcvbnData',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/ZxcvbnData', "[Errno 
13] Permission denied:
'/data/personas/Default/chrome_profile/ZxcvbnData'"), 
('/data/personas/Default/chrome_profile/SafetyTips',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/SafetyTips', "[Errno 
13] Permission denied:
'/data/personas/Default/chrome_profile/SafetyTips'"), 
('/data/personas/Default/chrome_profile/PKIMetadata',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/PKIMetadata', "[Errno
13] Permission denied:
'/data/personas/Default/chrome_profile/PKIMetadata'"), 
('/data/personas/Default/chrome_profile/PKIMetadataFastpush',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/PKIMetadataFastpush',
 "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/PKIMetadataFastpush'"), 
('/data/personas/Default/chrome_profile/ActorSafetyLists',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/ActorSafetyLists', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/ActorSafetyLists'"), 
('/data/personas/Default/chrome_profile/WasmTtsEngine',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/WasmTtsEngine', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/WasmTtsEngine'"), 
('/data/personas/Default/chrome_profile/CaptchaProviders',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/CaptchaProviders', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/CaptchaProviders'"), 
('/data/personas/Default/chrome_profile/AmountExtractionHeuristicRegexes',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/AmountExtractionHeuri
sticRegexes', "[Errno 13] Permission
denied: 
'/data/personas/Default/chrome_profile/AmountExtractionHeuristicRegexes'"), 
('/data/personas/Default/chrome_profile/TranslateKit',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/TranslateKit', 
"[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/TranslateKit'"), 
('/data/personas/Default/chrome_profile/hyphen-data',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/hyphen-data', "[Errno
13] Permission denied:
'/data/personas/Default/chrome_profile/hyphen-data'"), 
('/data/personas/Default/chrome_profile/OptGuideOnDeviceModel',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/OptGuideOnDeviceModel
', "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/OptGuideOnDeviceModel'"), 
('/data/personas/Default/chrome_profile/OptGuideOnDeviceClassifierModel',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/OptGuideOnDeviceClass
ifierModel', "[Errno 13] Permission
denied: 
'/data/personas/Default/chrome_profile/OptGuideOnDeviceClassifierModel'"), 
('/data/personas/Default/chrome_profile/FirstPartySetsPreloaded',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/FirstPartySetsPreload
ed', "[Errno 13] Permission denied:
'/data/personas/Default/chrome_profile/FirstPartySetsPreloaded'"), 
('/data/personas/Default/chrome_profile/Local State',
'/data/archive/users/<user>/crawls/20260623/eventsinukraine.substack.com/06a39f
3b4b62787c8000c102f8c46853/.persona/Default/chrome_profile/Local State', "[Errno
13] Permission denied:
'/data/personas/Default/chrome_profile/Local State'")]
⚠ Repairing: Closing 1 interrupted process(es) (ArchiveBox may have been 
interrupted before it was able to record that they stopped; any affected work 
can now be retried).

ArchiveBox Version

bash
0.9.35rc88
ArchiveBox v0.9.35rc88 COMMIT_HASH=369d41f BUILD_TIME=2026-06-22 11:21:18 1782127278
IN_DOCKER=True IN_QEMU=False ARCH=x86_64 OS=Linux PLATFORM=Linux-6.18.34-1-lts-x86_64-with-glibc2.41 
PYTHON=Cpython (venv)
EUID=911:911 UID=911:911 ARCHIVEBOX_USER=911:911 FS_UID=911:911 FS_PERMS=644 FS_ATOMIC=True 
FS_REMOTE=True
DEBUG=False IS_TTY=True SUDO=False ID=76a7f338:ba83bdb6 SEARCH_BACKEND=ripgrep LDAP=False


 Binary Dependencies:
                                                                                          Binary Dependencies                                                                                           
                                                                                                                                                                                                        
  Binary                       Plugin                     State      Status   Version            Provider   Path                                                                                        
 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 
  chromium                     accessibility              enabled      √      149.0.7827         playwrig   ABXPKG_LIB_DIR/playwright/cache/chromium-1228/chrome-linux64/chrome                         
  archivewebpage               archivewebpage             enabled      √      0.16.2             chromewe   ABXPKG_LIB_DIR/chromewebstore/extensions/archivewebpage.extension.json                      
  node                         chrome                     enabled      √      24.16.0            env        /opt/node/bin/node                                                                          
  playwright                   chrome                     enabled      √      1.62.0             pnpm       ABXPKG_LIB_DIR/pnpm/packages/playwright/node_modules/.bin/playwright                        
  abxbus                       chrome                     enabled      √      2.5.9              pnpm       ABXPKG_LIB_DIR/pnpm/packages/abxbus/node_modules/.pnpm/[email protected]/node_modules/abxbus/di  
                                                                                                            st/cjs/index.js                                                                             
  browsers                     chrome                     enabled      √      3.0.4              pnpm       ABXPKG_LIB_DIR/pnpm/packages/chrome/node_modules/.bin/browsers                              
  claudechrome                 claudechrome               disabled     -      1.0.75             chromewe   ABXPKG_LIB_DIR/chromewebstore/extensions/claudechrome.extension.json                        
  claude                       claudecode                 disabled     -      2.1.177            pnpm       ABXPKG_LIB_DIR/pnpm/packages/claudecode/node_modules/.bin/claude                            
  defuddle

Source: ArchiveBox/ArchiveBox

View original on GitHubView discussion on GitHub