splash:go() does not always return the same HAR data

[k-liao]

When I call splash:go() using the url http://bit.ly/1dNVPAW and wait for 0.5 seconds using splash:wait(), I don't always get the same HAR entries (see screenshots). I'm interested in using splash:history() to build up a redirection chain that includes both JS and HTTP redirects from a given url, but I've found the HAR data to be inconsistent.

Is there a better/more reliable API call to help with building the redirection chain?

Here's the Lua script that I'm using:

function main(splash)
    assert(splash:go(splash.args.url))
    splash:wait{time=0.5}
    return {
    har = splash:har(),
    }
end

[nirvana-msu]

This is likely due to the fact that cached requests/responses do not appear in har/history. More discussion at scrapy-plugins/scrapy-splash#168. You could solve that problem by building a custom Splash image where caching is disabled.