:pager: 存档所有 Chrome 扩展 (至 2019 年 2 月 4 日)
In maintenance: disk is full ! (2 To)
The goal is to provide a complete archive of the chrome web store with version history.
You can see the current status of what's archived and download the files here: dam.io/chrome-extensions-archive/
To install an extension, go to chrome://extensions/ and drop the file.
To avoid the auto-update, load it as an unpacked extension
Files are named as .zip but they are the exact same .crx stored on the store.
scripts are python 3.5+ only
Install dependencies: pip3 install -r req.txt
Create some folders and initialize some files:
mkdir data
mkdir crawled
mkdir crawled/sitemap
mkdir crawled/pages
mkdir crawled/crx
mkdir crawled/tmp
mkdir ../site
mkdir ../site/chrome-extensions-archive
mkdir ../site/chrome-extensions-archive/ext
echo "{}" > data/not_in_sitemap.jsonCrawling:
crawl_sitemap.py: gets you the list of all the extensions in data/sitemap.jsoncrawl_crx.py: use data/sitemap.json to download the crxSite & stats:
scan_pages_history_to_big_list.py: makes data/PAGES.json by scanning the pages
you crawledcrx_stats.py: makes data/crx_stats.json (what's currently stored)make_site.py: use data/crx_stats.json + data/PAGES.json to generate the sitemake_json_site.py: data/crx_stats.json + data/PAGES.json to generate JSONThen I serve the files directly with nginx (see nginx.conf file for example)
I have a few things in mind for the future:
Don't hesitate to reach out (here on issues, [email protected] or @dam_io on twitter)
To propose changes, just do a PR.
暂无开放 Issues,或尚未同步最近议题。