A comprehensive PostgreSQL database migration suite for migrating data between databases while handling foreign key dependencies and identity columns.

• Complete Database Migration: Migrate all tables with proper foreign key dependency ordering
• Identity Column Handling: Proper handling of PostgreSQL identity/serial columns
• Foreign Key Management: Automatic dependency resolution and constraint handling
• Progress Tracking: Real-time migration progress with detailed statistics

├── main.go                     # Main database migration tool
├── drop/
│   └── drop.go                 # Drop all the tables in the target database
├── go.mod                      # Go module dependencies
├── go.sum                      # Go module checksums
├── .env                        # Environment configuration
├── env.example                 # Environment configuration example
└── README.md                   # This file

• Go 1.21 or higher
• PostgreSQL databases (source and target)

1. Clone the repository:

git clone https://github.com/bograh/db_migrate.git
cd db_migrate

2. Install dependencies:

go mod tidy

3. Create a .env file with your configuration:

# Source Database Configuration
SOURCE_DB_HOST=
SOURCE_DB_PORT=
SOURCE_DB_USER=
SOURCE_DB_PASSWORD=
SOURCE_DB_NAME=
SOURCE_DB_SSL=disable

# Target Database Configuration
TARGET_DB_HOST=
TARGET_DB_PORT=
TARGET_DB_USER=
TARGET_DB_PASSWORD=
TARGET_DB_NAME=
TARGET_DB_SSL=disable

Migrate complete database from source to target:

go run main.go

Features:

• Migrates tables in dependency order
• Handles foreign key constraints
• Preserves identity column values
• Provides detailed migration statistics
• Continues on errors with other tables

The tool provides detailed statistics including:

• Tables migrated
• Rows migrated per table
• Migration duration per table
• Total migration time
• Error summary

Example output:

================================================================================
MIGRATION SUMMARY
================================================================================
Table                               Rows     Duration Status
--------------------------------------------------------------------------------
tbl_1                            5       125ms    SUCCESS
tbl_2                            5       125ms    SUCCESS
tbl_3                            5       125ms    SUCCESS
tbl_4                            5       125ms    SUCCESS
tbl_5                            5       125ms    SUCCESS
...
--------------------------------------------------------------------------------
TOTAL                             25      650ms
================================================================================

1. Backup your target database before running migrations
2. Foreign key constraints are temporarily disabled during migration
3. Identity columns are handled with OVERRIDING SYSTEM VALUE
4. Sequences are reset to match migrated data
5. The tool continues on errors but reports them in the summary

1. Connection failures: Check database credentials and network connectivity
2. Permission errors: Ensure database user has appropriate privileges
3. Foreign key violations: Tables are migrated in dependency order, but check for circular references
4. Identity column issues: The tool uses OVERRIDING SYSTEM VALUE to handle these automatically

• The migration continues even if individual tables fail
• All errors are logged and reported in the final summary
• Check the console output for detailed error messages

This project is licensed under the MIT License - see the LICENSE file for details.

1. Fork the repository
2. Create a feature branch
3. Make your changes
4. Add tests if applicable
5. Submit a pull request

For issues and questions:

1. Open an issue in the repository
2. Review the error logs