Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Double precision and uvfits data #250

Open
nicholebarry opened this issue Feb 6, 2021 · 0 comments
Open

Double precision and uvfits data #250

nicholebarry opened this issue Feb 6, 2021 · 0 comments
Labels
discussion needed A call for discussion enhancement An upgrade option

Comments

@nicholebarry
Copy link
Contributor

We have a keyword, double_precision to do a majority of calculations in double precision. However, we always read in floating point data from the uvfits file. This renders some of the double precision calculations moot . For example, when trying to do double precision linear least squares solving in the calibration, the data in the equation is always float and thus the answer is always float (related to the underflow error of most convergences being zero that Mike saw).

We can read in double precision from the uvfits file. Should this be the same keyword? Also, I'm unsure if the data truly is double in the uvfits file or if it's being casted to a double on read-in. @bhazelton Is the data natively double?

@nicholebarry nicholebarry added discussion needed A call for discussion enhancement An upgrade option labels Feb 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discussion needed A call for discussion enhancement An upgrade option
Projects
None yet
Development

No branches or pull requests

1 participant