Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add threshold value to SurrogateTest and LocalPermutationTest #339

Open
kahaaga opened this issue Oct 2, 2023 · 0 comments
Open

Add threshold value to SurrogateTest and LocalPermutationTest #339

kahaaga opened this issue Oct 2, 2023 · 0 comments

Comments

@kahaaga
Copy link
Member

kahaaga commented Oct 2, 2023

A common use case for independence is to use SurrogateTest and LocalPermutationTest to test for independence between two or more variables using some information theoretic (conditional) independence measure.

Currently, for both SurrogateTest and LocalPermutationTest, in the summary printout, it is checked whether the estimated measure m_est computed on the original data exceeds some percentile of the estimated measure computed over an ensemble of shuffled input data. Here's one example of such a print-out.

It would be nice to specify some threshold value that, if m_est < threshold, the interpretation printed to the user is always that we can't reject the null hypothesis. For example, with transfer entropy, we know that the value should be non-negative, so any values that are non-negative should immediately lead to rejection of the null.

It is up to the analyst to decide whether to do this, so threshold should be a keyword to the tests themselves. It can for example be a Real or a Nothing (in which case no threshold is applied).

Skjermbilde 2023-10-02 kl  20 28 57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant