Task that clears old polls results

[Leosantos25]

Hi everyone,

We've recently noticed this task that apparently clears results for old polls (90 days prior to the current date):

ureport/ureport/polls/tasks.py

Line 202 in 89b9f40

def clear_old_poll_results(org, since, until):

.
The question is: why is this task necessary since we want to display data for longer that? Any particular reason?

Thanks in advance.

[matmsa27]

Some UReporters customers have questioned why old polls has no data

[matmsa27]

Hi @norkans7 , can you help us with this?

[norkans7]

@matmsa27 @Leosantos25 on rapidpro flow runs for flows older than 90days are moved to the archives.
And to keep U-Report DB small and performant we clear those unnecessary results, in that process we mark the poll as stopped_syncing and the stats are calculated one more last time.

If polls are missing stats then you can investigate to know the reason why for each.

You can refresh the results and that will use the archives for older polls,
Recently we also added a fix to make sure we always pull results from archives for polls that were added when the flow runs were already moved to archives

[Leosantos25]

@norkans7 Alright, so the idea is to give older polls 90 one last update and store them.
What is interesting here is the amount of polls displaying no results, especially the ones between 2018-2019 we had to refresh.
Maybe it was something that was really affecting polls some time ago but has been fixed?

Do you remember having to deal with this a couple of years ago, maybe other workspaces hosts?

Thanks for the help!

[norkans7]

Previously we assumed polls are added as soon as the flow is created/sent on RapidPro.
that was not quite right as some admins add polls after more that 90 days after the are sent so that required the results to be manually synced by restarting that task for it
Now that is addressed to make sure those polls gets the initial results properly #696

For every polls that did not have results, we restarted them until we added that recent way to address that automatically.

You can investigate to make sure that is the same problem as there might be other reasons for not having results for a poll.