You can run this code on your own local machine or as a Google Colab Notebook.

1. Local option:

• Make sure to install all the required packages manually or by pip install -e .
• You will also need to run pip install gymnasium[box2d]

2. Colab option: First couple of sections in the notebook will install the required dependencies for you.

Please go through the assignment PDF for detailed instructions on this.