MetaStack

A metasearch engine to search dumps from StackExchange sites locally.

Setup

1. Clone the repo

$ git clone https://codeberg.org/Clew/MetaStack
$ cd MetaStack

2. Create and enter a virtual environment

$ python -m venv .venv
$ source .venv/bin/activate

3. Install dependencies

$ pip install -r requirements.txt

Then create a ./dumps/ directory:

$ mkdir dumps
$ cd dumps

For every site you want, download the dumps from https://seqlite.puny.engineering/ and decompress them.

$ wget --continue https://seqlite.puny.engineering/2024-04-01/worldbuilding.stackexchange.com.sqlite.br
$ brotli -d worldbuilding.stackexchange.com.sqlite.br
$ rm worldbuilding.stackexchange.com.sqlite.br
$ ls
worldbuilding.stackexchange.com.sqlite

You can place as many dumps as you like in this directory and they will automatically be loaded. They must be named in the format [site domain].sqlite.

4. Run server

You'll likely want to figure out a more complete way to serve the python app (like uwsgi), but the simple flask command from within the virtual environment will work well to start out:

flask --app server.py run

There you go, you're all set up!