Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reinitialization #61

Open
TheMightiestCarrot opened this issue Jan 26, 2023 · 1 comment
Open

Reinitialization #61

TheMightiestCarrot opened this issue Jan 26, 2023 · 1 comment
Assignees

Comments

@TheMightiestCarrot
Copy link

TheMightiestCarrot commented Jan 26, 2023

Hello,

i have a task with unknown global optima and since optimizers can stuck in local optima i want to make sure the achieved optima is reached from various random starting points. Therefore i would like to incorporate some kind of reinitialization of whole search (basically starting trainer.run with multiple different seeds).
Is it even necessary? Does SimManager -> eval_params -> _for_loop_eval -> policy_reset_func perform reliable reinitialization of policy state?

Thanks in advance for your advice.

@lerrytang lerrytang self-assigned this Jan 31, 2023
@lerrytang
Copy link
Contributor

Hi, thanks for the question.

Therefore i would like to incorporate some kind of reinitialization of whole search (basically starting trainer.run with multiple different seeds).

The seed that trainer accepts is mainly for environmental randomness.
For policies, you can programmatically supply different initial values (e.g., here is the code in PGPE)

Let me know if this answers your question.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants