code refactor for version 1.0

[vecna]

The branch where development is happening is: https://github.com/tracking-exposed/facebook/tree/yS
below the two priority tasks as discussed with @rugantio @fedebarba @joxer)

P0 - Show data on realitycheck

1. Have robust parsers (me and @fedebarba )

• Maintain a QOS of acceptable service (this should be measured with a better interace than the current)
  • 80% of posts in a month are collected well
  • SLA 72 hours on breaking parser

2. Redo the part of the site that shows the data (graphic part, stripped down)

• Change the reality check system and focus on interactive tables
• search / sort / filter
• at the moment the problem lies in the heaviness of the query and the answer, so the API must be redone

3. Complete the separation of the 3 services, integrate system logs.

• split the static web pages, the collector, the API

P1 - Having constant logging and showing transparency to users

1. Having a monitoring and logging infrastructure (ELK, currently in testing on log.tracking.exposed)
2. Something custom that reads from elasticsearch with statistics

Next steps (still to be documented/addressed)

P2 - Having batch processes that allow you to have the aggregated data aggregated for users

P3 - allow those who "create a research group" to see aggregate data of users who have opted in his group.

P4 - allow users to share portions of their timeline (so as to make comparisons between them)