forked from openwpm/OpenWPM
-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGELOG
150 lines (129 loc) · 5.37 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
v0.9.0 - under development
======
Changes:
* The `automation` library can now be used with Python 3.4 or later,
as well as Python 2.7.
* Bump to Firefox 52 ESR, Selenium 3.4.0+, and geckodriver 0.15.0.
* geckodriver is required for Selenium 3+. `install.sh` will download
and install it.
* geckodriver 0.16.0+ does not support Firefox 52 or lower, so we are
stuck with 0.15.0 (and any bugs it may have) until the next ESR release.
* These versions of geckodriver and Selenium require Firefox 48+.
* MITMProxy support has been removed. Use `http_instrument` instead.
* Bundled Firefox privacy extensions have been updated.
* AdBlock Plus support has been removed.
* uBlock Origin and Disconnect added.
* Ghostery has been updated.
* Extensions built using the WebExtensions API are now supported. Our
extension still uses the add-on sdk.
v0.8.0 - 2017-10-09
======
A long overdue version bump to checkpoint the final version to support
Selenium 2 + FF 45. Note we recommend against using the release as Firefox
45ESR is no longer receiving security patches.
Changes:
* Add extension-based HTTP instrumentation, including POST body processing
* Deprecate proxy-based HTTP instrumentation
* Save stacktrace of HTTP requests
* Prevent Selenium 2 from self identifying in the DOM
* Add support for blocking commands
* Improve exception handling in child processes
* Refactor of socket interface in extension
* Improvements to manual testing code
* Add a logging module to the extension, logs to central log file
* Instrument `document.cookie`
* A number of improvements to the `instrumentObject` instrumentation
interface in extension
* Make `install.sh` scriptable
v0.7.0 - 2016-11-15
======
Changes:
* Bugfixes to extension instrumentation where records would be dropped when
the extension was under heavy load and fail to re-enable until the browser
was restarted.
* Bugfix to extension / socket interface
* Add `run_custom_function` command
* Using alternative serialization/parallelization with `dill` and
`multiprocess`
* Better documentation
* Bugfixes to install script
* Add `save_screenshot` and `dump_page_source` commands
* Add Audio API instrumentation
* Bugfix to `browse` command
* Bugfix to extension instrumentation injection to avoid Security Errors
v0.6.2 - 2016-04-08
======
Changes:
* Bugfix to browse command. Now supports sleeping after get.
v0.6.1 - 2016-04-08
======
Critical:
* Bugfix in LevelDBAggregator preventing data loss
Changes:
* Bump to Firefox 45 & Selenium 2.53.0
* Update certificate stored
* Added sleep argument to `get` command
* Added install script for development dependencies
* Improved error handling in TaskManager and Proxy
* Version bumps and bugfixes in HTTPS Everywhere, Ghostery, and ABP
* Tests added!
* Numerous bugfixes and improvements in Javascript Instrumentation
v0.6.0 - 2015-12-22
======
Changes:
* Cleanup of Firefox prefs to make browsers faster and reduce phoning home
* Use LevelDB for javascript file storage
* Improved HTTP Cookie Parsing
* Several bugfixes to extension instrumentation
* Improved profile handling during shutdown and crashes
* Improved handling of child Exceptions
* Inital platform tests
* Improvements to javascript instrumentation
v0.5.1 - 2015-10-15
======
Changes:
* Save json serialized headers and fix cookie parsing
v0.5.0 - 2015-10-14
======
Changes:
* Added support for saving all javascript files de-duplicated and compressed
* Created two configuration dictionaries. One for individual browsers and
another for the entire infrastructure
* Support for using OpenWPM as a submodule
* Firefox (v39) and Selenium (v2.47.1)
* Added support for launching Ghostery, HTTPS Everywhere, and AdBlock Plus
* Removed Random Extension Support
* Bugfix for broken profile saving.
* Bugfix for profile clearing when memory limits are exceeded
* Numerous stability fixes
* Full Logging support in all commands
v0.4.0
======
Changes:
* Significant stability improvements for long crawls
* Support for logging with logging module
* A large number of bugfixes related to process handling
* Prevention of a large number of stray tmp files/folders during long crawls
* Process/memory watchdog to handle orphaned processes and keep memory usage
reasonable
* Numerous bugfixes for extension
* Failure thresholds to prevent infinite loops of browser respawns or
command execution attempts (instead, Errors and raised)
* Script to install dependencies
* API changes to command timeouts
* Move SocketInterface from pickle to json serialization
Known Issues:
* Encoding issues cause a very small percentage of data to be dropped by the
extension
* Malformed queries are occassionally sent to the DataAggregator and are
dropped. The cause is unknown.
* Forking can be done in a more memory efficient way
0.3.1 - Fixes #5
0.3.0 - Experimental merge of Fourthparty + framework to allow additional
javascript instrumentation.
0.2.3 - Timeout logging
0.2.2 - Browse command + better scrolling + bugfixes
0.2.1 - Support for MITMProxy v0.11 + minor bugfixes
0.2.0 - Complete re-write of HTTP Cookie parsing
0.1.1 - Simplfied load of default settings, including wiki demo
0.1.0 - Initial Public Release