A/B testing, feature flags, continuous experimentation

[monperrus]

Wikipedia:

• https://en.wikipedia.org/wiki/A/B_testing
• https://en.wikipedia.org/wiki/Feature_toggle (feature flags, dark launching)

[monperrus]

"Online controlled experiments at large" KDD'2013 about the Microsoft use case

[monperrus]

"Holistic Configuration Management at Facebook"

[bbaudry]

Search-Based Scheduling of Experiments in Continuous Deployment

[monperrus]

It’s All A/Bout Testing: The Netflix Experimentation Platform
https://medium.com/netflix-techblog/its-all-a-bout-testing-the-netflix-experimentation-platform-4e1ca458c15

[monperrus]

How The Huffington Post uses real-time testing to write better headlines
http://www.niemanlab.org/2009/10/how-the-huffington-post-uses-real-time-testing-to-write-better-headlines/

[monperrus]

Dynamic knobs for responsive power-aware computing
https://dspace.mit.edu/openaccess-disseminate/1721.1/72445

[monperrus]

About feature toggles:

The modular and feature toggle architectures of Google Chrome
https://link.springer.com/article/10.1007%2Fs10664-018-9639-0

[monperrus]

Dark launching has its downsides:

Jane Manchun Wong: App researcher who unlocks new features before they launch
https://www.bbc.co.uk/news/technology-47630849

[bbaudry]

Top 5 mistakes with statistics in A/B testing
https://towardsdatascience.com/top-5-mistakes-with-statistics-in-a-b-testing-9b121ea1827c

[monperrus]

Bullet Train: Open-source feature flagging
https://bullet-train.io/

[bbaudry]

The Netflix Recommender System: Algorithms, Business Value, and Innovation
https://dl.acm.org/doi/pdf/10.1145/2843948

[monperrus]

Feature toggles as code: Heuristics and metrics for structuring feature toggles
IST 2022

[bbaudry]

There exist different techniques and frameworks to engineer feature flags. They are good topics for a contribution to the course

[bbaudry]

Piranha: Reducing feature flag debt at uber

[bbaudry]

Software development with feature toggles: practices used by practitioners

[monperrus]

Flagsmith - Open Source Feature Flag & Remote Config Service

[monperrus]

Unleash: Another Open-source feature flags platform https://www.getunleash.io/

[matsskoglund]

Gitlab includes unleashed. You can controll the feature flags in your project directly from within Gitlab. https://docs.gitlab.com/ee/operations/feature_flags.html

[monperrus]

Discovering feature flag interdependencies in Microsoft office.

[monperrus]

Snowplow Open Source, the world’s largest developer-first engine for collecting behavioral data.
https://github.com/snowplow

[monperrus]

The Only Guide to Dark Launching You’ll Ever Need
https://launchdarkly.com/blog/guide-to-dark-launching/

[monperrus]

"Split provides everything you need to create, target, and manage feature flags."
https://www.split.io/

[bbaudry]

A/B Testing: A Systematic Literature Review.
http://arxiv.org/abs/2308.04929

https://www.sciencedirect.com/science/article/pii/S0164121224000542?dgcid=rss_sd_all

[bbaudry]

A tool for refactoring code related to feature flag APIs
https://github.com/uber/piranha