Skip to content

Web application that extracts information from the vendorlist of IAB Europe Transparency & Consent Framework and makes this information human-readable.

License

Notifications You must be signed in to change notification settings

Perdu/vendorlistexplorer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Vendorlist explorer

A Flask application to run the Vendorlist explorer. See live version here.

This website extracts information from the vendorlist of IAB Europe Transparency & Consent Framework and makes this information human-readable. The goal is to provide Data Protection Agencies, privacy researchers and activists a tool to easily get statistics on purpose declarations by advertisers and their legal basis, and obtain lists of vendor in potentiel violation of the GDPR and other European laws. This website get automatically updated with the latest vendorlist every week.

Associated paper: Purposes in IAB Europe's TCF: which legal basis and how are they used by advertisers?
Célestin Matte*, Cristiana Santos*, Nataliia Bielova (*co-first authors)
APF'20 (Annual Privacy Forum)
paper slides video

Author: Célestin Matte

This repository contains:

  • a script to automatically download TCFv2 vendorlists and import them into a database,
  • the Web application to display statistics about advertisers declarations in these vendorlists

Dependencies

  • Flask
  • python-sqlalchemy
  • MySQL/MariaDB

Install

Simple install (Docker)

./gen_password.sh
sudo docker-compose up --build

All vendorlists will be automatically downloaded and added to the database (this will take a while). Once this is done, application is reachable on http://localhost

Manual install

Database

Create a database, create database user and give it access right to the iabsite catabase:

CREATE DATABASE iabsite;
CREATE USER '<user>'@localhost IDENTIFIED BY '<password>';
GRANT ALL ON iabsite.* TO '<user>'@localhost;

The database tables will be created automatically when the first vendorlist is imported.

Vendorlists downloading

  • fill config.conf.example and rename it config.conf
  • In your crontab, add a line to execute download_import_vendorlists.sh every week:
45 17 * * 4 /path/to/vendorlistexplorer/download_import_vendorlists.sh

You can also download vendorlists manually (they're all stored on the following address: https://vendor-list.consensu.org/v2/archives/vendor-list-vVERSION.json where VERSION is the version number). Then import them using:

python import_vendorlist.py vendor-list-vVERSION.json

If you want to download older vendorlists, this is pretty straightforward since they all remain on IAB's server:

for i in $(seq 1 68) ; do wget -O vendorlistv2_"$i".json https://vendor-list.consensu.org/v2/archives/vendor-list-v"$i".json ; done

Web application

  • run iabsite.py:
python iabsite.py

If you want it to run inside apache2:

Tests

  • On local install, with the application running:
./tests/integration.sh

Or:

  • Using Docker:
sudo ./regtest_docker.sh

About

Web application that extracts information from the vendorlist of IAB Europe Transparency & Consent Framework and makes this information human-readable.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published