Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hyper-Parameter Optimization Framework - WIP #477

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from
Draft

Conversation

ctrl-z-9000-times
Copy link
Collaborator

@breznak,
As promised, here is my attempt at using NNI:
https://github.com/Microsoft/nni

I started from their MNIST example, and I modified the following files to work with Nupic:

  • src/examples/mnist_nni/search_space.json
  • src/examples/mnist_nni/config.yml
  • src/examples/mnist_nni/mnist.py

I accidentally added the MNIST data files into git version control, so this branch is large and should never be merged to master :(

@ctrl-z-9000-times ctrl-z-9000-times added tooling research new functionality of HTM theory, research idea labels May 17, 2019
@breznak
Copy link
Member

breznak commented May 17, 2019

Perfect, thank you!
I'll add just FTR that this is an alternative to #433.

  • I think we could pick the python version of SP MNIST you've implemented.
  • the JSON with param space looks quite neat 👍

So one of the problems of this approach is lack of "default starting point params configuration"? Which is a failr choice, would make sense to put our so far best as a starting point.

@breznak
Copy link
Member

breznak commented Sep 3, 2020

Another hyper-param optimization framework, should support automated multithreading etc.
https://optuna.org/
Might look at, instead of our handwritten solution.

@breznak breznak changed the title NNI Meta-Parameter Optimization Framework - WIP Hyper-Parameter Optimization Framework - WIP Sep 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
research new functionality of HTM theory, research idea tooling
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants