This repo contains all the scripts needed to set up a Ubuntu box with several NoSQL Databases and a Jupyter environment to play with them

• Postgres
• Riak
• Cassandra
• Mongodb
• Neo4j
• Glances
• Portainer
• JupyterLab

Most of the services are powered by Docker and Docker Compose.

A machine with Ubuntu is needed to deploy all these services.

The requirements are:

• 20.04 Ubuntu Server
• At least 2 Gb of Memory
• Local RSA SSH key to remote access

There are two possibilities:

• A box deployed in your local machine with Vagrant & VirtualBox: https://github.com/dvillaj/NoSQL-box
• A box deployed with a Cloud Provider like DigitalOcean or similar (Azure, Google, AWS, etc.) to access it remotely

In order to do a cloud deployment you need:

• Create an account in DigitalOcean
• Create an account in DuckDns
• Create a personal domain in DuckDns
• Create a personal SSH key in your local computer
• Register your personal SSH key in DigitalOcean

Follow the next steps to do a manual deployment:

• Create a Personal RSA Key
• Create an droplet in DigitalOcean following the requeriments and configure it with your personal RSA Key
• Update DigitalOcean Maniche's IP in the DuckDNS's domain (In my case I have created a domain named nosql so the full url will be: nosql.duckdns.org)
• Check you can access to the remote machine with ssh [email protected] from a terminal in you local machine
• Execute the following script to setup the box: ssh [email protected] -o "UserKnownHostsFile=/dev/null" -o "StrictHostKeyChecking no" "git clone https://github.com/dvillaj/NoSQL-Services.git /opt/deploy && /opt/deploy/install.sh
• Execute the following script to secure the box: ssh [email protected] -o "UserKnownHostsFile=/dev/null" -o "StrictHostKeyChecking no" /opt/deploy/securebox.sh (a firewall will be installed and the only port allowed will be the SSH Port)

This following video is an example of how to create a Ubuntu box in DigitalOcean cloud provider and setup the remote machine to access all the NoSql services

Before follow the example create a new ssh key, if needed:

ssh-keygen

https://youtu.be/obbbQvBMTsM

This repo contains a GitHub action that follows the manual steps automatically. To use this automatic deployment you need to have an account at GitHub and fork this repo

To configure this action do before executing in

• Generate a new Token (API menu) in DigitalOcean and copy it
• Copy the DuckDNS's token from DuckDns's main page. No token generation is needed.
• Add a new repository secret named DIGITALOCEAN_ACCESS_TOKEN with the token from DigitalOcean
• Add a new repository secret named DUCKDNS_TOKEN with the token from DuckDns
• Edit .github\workflows\deploy-digitalocean.yml file to set DUCKDNS_DOMAIN variable with the name of your personal DuckDNS's domain.

This action will do:

• Check if Droplet exists previosly (It will not be created twice)
• Create a new 2 GB RAM droplet with Ubuntu 20.04. This droplet can be power up later on DigitalOcean dashboard.
• Configure the access to the remote machine with your personal SSH key
• Execute the setup procedure in the remote machine
• Secure the remote machine disabling all ports exect 22 (SSH Port)
• Update DuckDNS domain with the Droplet IP

This action have to be trigger manually

NOTE: Execute the Destroy to DigitalOcean Infrastructure Github's action to destroy the NoSql droplet on DigitalOcean and save money (You will have to do this if you want to execute this action a second time!)

We will access all the services from local using a SSH Tunnelling. Open a terminal in your local machine and execute the following script:

ssh -N -L 8001:127.0.0.1:8001 \
             -L 3100:127.0.0.1:3100 \
             -L 27017:127.0.0.1:27017 \
             -L 7474:127.0.0.1:7474 \
             -L 5050:127.0.0.1:5050 \
             -L 8098:127.0.0.1:8098 \
             -L 8082:127.0.0.1:8082 \
             -L 7687:127.0.0.1:7687 \
             -L 61208:127.0.0.1:61208 \
             -L 9000:127.0.0.1:9000 \
             -o "StrictHostKeyChecking no" \
             -o "UserKnownHostsFile=/dev/null" \
            [email protected]

• Check the jupyterlab service

sudo systemctl status jupyter

• Check de Jupyter logs

sudo journalctl -f -u jupyter

• Restart the machine

sudo restart

• Postgres Docker Compose
• Cassandra Docker Compose
• MongoDb Docker Compose
• Neo4j Docker Compose
• Riak Docker Compose
• Riak Docker Image
• Cql Python package
• Portainer Docker Compose

http://localhost:8001

postgres up -d

postgres down

http://localhost:5050

User: [email protected]
Password: admin

To connect with the postgres server create a new Server Connection using the following parameters:

General/Name: postgres
Connection/Host: postgres
Connection/Username: postgres
Connection/Password: postgres

riak up -d coordinator

riak up -d --scale member=4

riak down

http://localhost:8098/admin/

cassandra up -d

cassandra down

Download latest version of Robo 3T and connect to Mongo: localhost:27017

mongo up -d

mongo down

http://localhost:3100/

http://localhost:7474

neo4j up -d

neo4j down

http://localhost:61208

portainer up -d

portainer down

http://localhost:9000

User: admin
Password: password