Step 1: Install GaiaNet node

curl -sSfL 'https://github.com/GaiaNet-AI/gaianet-node/releases/latest/download/install.sh' | bash

Step 2: Init with the Phi-3-medium-128k model

gaianet init --config https://raw.githubusercontent.com/GaiaNet-AI/node-configs/main/phi-3-medium-instruct-128k/config.json

Step 3: Start the node

gaianet start

Now you can use the node as a web-based chatbot or as an OpenAI API drop-in replacement.

This model has a large (128k) context window and hence requires a large amount of RAM. If your machine is not able to start, you could try to reduce the chat_ctx_size field in $HOME/gaianet/config.json file to 8192.

• Official PyTorch model
• GGUF formatted model
• GaiaNet node quick start guide