Companion repository for the Builder Journal — a hands-on guide to building production-ready GenAI applications with Ragbits.

This repository contains working code for each section of the Builder Journal. Each section builds on the previous one, progressively adding capabilities to a chat application:

• Python 3.10+
• An API key from any supported LLM provider (OpenAI, Anthropic, Azure, etc.)

Install dependencies using uv:

uv sync

Set your LLM provider API key:

# OpenAI
export OPENAI_API_KEY="your-api-key"

# Or Anthropic
export ANTHROPIC_API_KEY="your-api-key"

# Or any other provider supported by LiteLLM

Start the chat server:

uv run ragbits api run ragbits_example.main:SimpleStreamingChat

Open http://127.0.0.1:8000 in your browser to access the chat interface.

# Custom host and port
uv run ragbits api run ragbits_example.main:SimpleStreamingChat --host 0.0.0.0 --port 9000

# Auto-reload for development
uv run ragbits api run ragbits_example.main:SimpleStreamingChat --reload

# Debug mode
uv run ragbits api run ragbits_example.main:SimpleStreamingChat --debug

In order to deploy the app on GCP/AWS follow instructions in infrastructure/README.md

ragbits-example/
├── src/
│   └── ragbits_example/
│       ├── __init__.py
│       ├── config.py    # UI, forms, auth, and settings configuration
│       └── main.py      # Chat application implementation
├── infrastructure/      # IaaC for deploying the app on GCP or AWS
│   ├── aws/
│   │   ├── terraform/
│   │   │   ├── backend.tf
│   │   │   ├── main.tf
│   │   │   ├── outputs.tf
│   │   │   ├── providers.tf
│   │   │   └── variables.tf
│   │   ├── deploy.sh
│   │   └── destroy.sh
│   ├── gcp/
│   │   ├── terraform/
│   │   │   ├── backend.tf
│   │   │   ├── main.tf
│   │   │   ├── outputs.tf
│   │   │   ├── providers.tf
│   │   │   └── variables.tf
│   │   ├── deploy.sh
│   │   └── destroy.sh
│   ├── config.sh
│   ├── deploy_infra.sh
│   ├── destroy_infra.sh
│   └── README.md
├── pyproject.toml       # Project configuration and dependencies
└── README.md

1. Read a section in the Builder Journal
2. Reference the corresponding code in this repository
3. Run and experiment with the application
4. Modify and extend based on your needs

The documentation explains the concepts while this repository provides the working implementation.

• Builder Journal — Step-by-step tutorial
• Ragbits Documentation — Full documentation
• Ragbits GitHub — Main repository
• LiteLLM Providers — Supported LLM providers