Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Have the new methods been tested on periods with no known exogenous factors? #15

Open
steevschmidt opened this issue Oct 4, 2020 · 1 comment

Comments

@steevschmidt
Copy link

I haven't reviewed the final document(s) completely (huge!) but I did scan it.

Question: Was there any analysis done on residential exogenous factor predictions during non-COVID periods, as a test of the new methods?

I see some charts with CalTRACK savings estimates on homes between 3/1/20 and 3/19/20, but that period is quite small and it's hard to see if there was any exogenous effect identified.

Is there perhaps a summary chart like Figure 2 (here and on page 9 of the PDF) that covers a longer non-COVID period (e.g. all of 2018 compared to all of 2019) to demonstrate how the new methods work during periods with no known exogenous factor(s)? Seems this would be useful information.

@mcgeeyoung
Copy link
Contributor

With limited time, we decided to focus on the period of COVID impacts, figuring that if we could get results to a reasonable level during this time of high volatility, it would only be better as volatility would decrease. We did some other testing during non-COVID periods to look at underlying uncertainty metrics but the work with a stratified comparison group was done on post-COVID.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants