Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Denoising with wavelet transform #12

Closed
danizil opened this issue Jun 12, 2019 · 2 comments
Closed

Denoising with wavelet transform #12

danizil opened this issue Jun 12, 2019 · 2 comments
Assignees

Comments

@danizil
Copy link

danizil commented Jun 12, 2019

I've been thinking about the data leakage from the wavelet transform, not sure how to apply it to a live data stream. Denoise with the same modes? Scaling has a similar problem...
I think I'll try building the denoising into the AE: fitting the noisy (or even raw) data with the scaled denoised data on the other side. Maybe its a bit voodoo, but it's one of the main usages of AEs . What do you think?

@timothyyu
Copy link
Owner

I believe the phase goes along the lines of something like this:
"There is more than one way to skin a cat"

Thus, there are multiple different approaches to take in applying a wavelet transform to a live stream of data (streaming/online model) vs. a batch model.

I'd say it's worth testing or trying out. The wavelet transform is a complex component by itself - combined with other machine learning/deep learning layers, the complexity overall exponentially goes up depending on how you have your pipeline setup/constructed.

@timothyyu timothyyu self-assigned this Jul 11, 2019
@timothyyu
Copy link
Owner

duplicate/directed related to #6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants