Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change input on the Actor-Critic neural network model #1

Open
FanchenBao opened this issue Apr 18, 2021 · 0 comments
Open

Change input on the Actor-Critic neural network model #1

FanchenBao opened this issue Apr 18, 2021 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@FanchenBao
Copy link
Owner

The current model naively takes in the grid coordinates as input, which includes the value 0. This is bad for neural network because no learning is possible when the input is 0. To resolve this issue, we shall use other ways to encode the state. One way is to use on-hot encoding for each cell in the grid. It might also be possible to use a simple labeling system from 1 to 100 for each cell, and then normalize the label as the input. They are both worth the shot. Maybe by changing the input, we can make the on-policy learning work.

@FanchenBao FanchenBao added the enhancement New feature or request label Apr 18, 2021
@FanchenBao FanchenBao self-assigned this Apr 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant