GNN-RL-Map

to improve the mapping quality for CGRAs, GNN-RL-Map integrates the routing explorations into the mapping process and has more opportunities to find a globally optimized solution. With a reduced resource graph defined, the searching space of GNN-RL-Map is not greatly increased. To efficiently solve the problem, it introduces graph neural network (GNN) based reinforcement learning (RL) to predict a placement distribution over different resource nodes for all operations in a DFG. Using the routing connectivity as the reward signal, it optimizes the parameters of neural network to find a valid mapping solution with a policy gradient method. Without much engineering and heuristic designing, GNN-RL-Map achieves considerable improvement in mapping quality.Please find the paper for more rerefence.

Table of contents

1. Overview
   1. Directory Structure
2. Getting Started
   1. Requirement
   2. Running Example
   3. Modify the parameters
3. Reference

Overview

The entire process and an example of the mapping are shown below:

Directory Structure

GNN-RL-Map
│   README.md
│   flow_diagram.png
│   Mapping_diagram.png
│   Agent.py 
│   config.py (Read the configuration from the script)
│   dataGenerator.py (Generate dataset)
│   environment_routing.py (Including state, action, reward, etc)
│   graph_routing.py (Adding routing nodes)
│   main.py 
│   minPE.py (ILP solution scheduling)
│   Networks.py (Network structure)
│   run.sh (Run script)
└───data (Graph data)

Getting started

Requirement:

• Ubuntu (we have tested Ubuntu 18.04)
• tensorflow2.6.0

Running Example:

bash run.sh demo

Modify the parameters

If you want to modify the parameters of the code, open the run.sh file and modify the specified parameter information The following is an explanation of some key parameters

• src_file_path(For example, data/o22m.txt is the 22nd kernel)
• actor_lr(Representation learning rate)
• gcn_dims(Indicates the hidden layer dimension)
• max_iteration(Indicates the maximum number of iterations)
• batch_size(Represents the number of samples in a batch)
• pea_width(Indicates the scale of the CGRA. For example, 6 indicates that the scale of the CGRA is 6x6)
• reward_mode(Indicates the CGRA structure, 1 indicates the mesh structure, 2 indicates the torus structure, 3 indicates the Diagonal structure, and 4 indicates the 1-HOP structure)
• max_LRF(the number of LRF resources in one FU)
• max_memory(the number of LSU resources in a time slot)
• max_GRF(the number of GRF resources in a time slot)

Data Formats

The first column indicates the node number and the middle 8 columns are 4 child node numbers and corresponding edge types, and the next two columns represent ASAP and ALAP for the node, The last two columns indicate the route information and whether the entry degree is zero(0 indicates true,1 indicates false).

For example:

it should be:
1 2 0 5 0 0 0 0 0 0 0 0 0
2 3 0 4 0 0 0 0 0 1 1 0 1
3 4 0 0 0 0 0 0 0 2 2 0 1
4 5 0 0 0 0 0 0 0 3 3 0 1
5 0 0 0 0 0 0 0 0 4 4 0 1

Publication

@inproceedings{zhuang2022towards,
  title={Towards High-Quality CGRA Mapping with Graph Neural Networks and Reinforcement Learning},
  author={Zhuang, Yan and Zhang, Zhihao and Liu, Dajiang},
  booktitle={Proceedings of the 41st IEEE/ACM International Conference on Computer-Aided Design},
  pages={1--9},
  year={2022}
}