This nanodegree program by Udacity consists of 4 courses - Foundations of Reinforcement Learning, Value-Based Methods, Policy-Based Methods, Multi-Agent Reinforcement Learning - to learn cutting-edge deep reinforcement learning algorithms from Deep Q-Networks (DQN) to Deep Deterministic Policy Gradients (DDPG) and apply these concepts to train agents to walk, drive, or perform other complex tasks.
The 3 projects I completed as part of this nanodegree:
First clone this repository. To set up your python environment, follow the instructions below.
- Create (and activate) a new environment with Python 3.6.
python -m ipykernel install --user --name drlnd --display-name "drlnd"
conda create --name drlnd python=3.6
activate drlnd
-
Follow the instructions in this repository to perform a minimal install of OpenAI gym.
- Next, install the classic control environment group by following the instructions here.
- Then, install the box2d environment group by following the instructions here.
pip install gym
-
Install several dependencies
conda install Pillow matplotlib numpy jupyter pytest docopt pyyaml protobuf grpcio pandas scipy ipykernel
conda install -y pytorch -c pytorch
pip install tensorflow==2.2.0rc4
pip install unityagents
-
Download the environment from one of the links below. You need only select the environment that matches your operating system:
- Linux: click here
- Mac OSX: click here
- Windows (32-bit): click here
- Windows (64-bit): click here
Project 2: Continuous Control: Reacher environment.
- One (1) Agent
- Linux: click here
- Mac OSX: click here
- Windows (32-bit): click here
- Windows (64-bit): click here
Project 3: Collaboration and Competition Tennis environment.
- Linux: click here
- Mac OSX: click here
- Windows (32-bit): click here
- Windows (64-bit): click here
-
Place the environment file in the corresponding project folder
navigation/
orcontinuous-control/
orcollab-compet/
and unzip (or decompress) the file. -
Follow the instructions in
Navigation.ipynb
/Continuous_Control.ipynb
/Tennis.ipynb
to get started with training your own agent!