eventmachine not initialized - proxy isn't working #253

knagode · 2018-10-17T14:55:19Z

I am getting this error

An error occurred in an `after(:suite)` hook.
Failure/Error: Socket.unpack_sockaddr_in(EM.get_sockname(@signature)).first

RuntimeError:
  eventmachine not initialized: evma_get_sockname
# /Users/klemennagode/.rvm/gems/ruby-2.3.7/gems/puffing-billy-1.1.2/lib/billy/proxy.rb:43:in `get_sockname'

Anyone has idea why?

My setup in rails_helper.rb:

Capybara.register_driver :chrome do |app|
  options = Selenium::WebDriver::Chrome::Options.new
  options.add_argument('--lang=de')
  options.add_argument('--verbose')
  options.add_argument("--proxy-server=#{Billy.proxy.host}:#{Billy.proxy.port}")

  Capybara::Selenium::Driver.new(
    app,
    browser: :chrome,
    options: options
  )
end

Capybara.javascript_driver = :chrome

When I run test chrome looks like this:

The text was updated successfully, but these errors were encountered:

ronwsmith · 2018-10-18T02:10:23Z

@knagode can you try running on the branch in this PR and see if it works? #251

knagode · 2018-10-18T15:16:24Z

@knagode I tried but it didn't help. Other ideas maybe?

ronwsmith · 2018-10-19T13:21:47Z

Looks like someone had a similar issue a couple years ago: #43 (comment)

gagalago · 2018-10-25T12:23:32Z

this seems to be related to #239 but I can't understand how exactly

knagode · 2018-10-29T15:07:35Z

I tried to install it in clean project on same machine and it worked.. Apparently there is a conflict with another gem/configuration.

I removed all the spec configuration in problematic project (in files rspec_helper.rb and spec_helper.rb).

I noticed that proxy started working but still there is an error

An error occurred in an `after(:suite)` hook.
Failure/Error: Socket.unpack_sockaddr_in(EM.get_sockname(@signature)).first

knagode · 2018-10-30T13:44:02Z

I found that problem is happening due to WebMock which we heavily use. I think that both gems are super useful and they should work together.

Example controller method:

  def test_page
    data = HTTParty.get('http://yahoo.com/data.json', format: :json)
    # stub code: WebMock.stub_request('http://yahoo.com/data.json').to_return(body: { data: 'fake' }.to_json, headers: {})
  
    render html: ('<html><body><b>Data=' + data.to_json + '</b> <script src="http://google.com/script.js"></script></body></html>').html_safe
    # stub code:  proxy.stub('http://google.com/script.js').and_return(:text => "document.write('Yeeeyyy')")
  end

Is there no way to make those two gems work together?

ronwsmith · 2018-10-30T13:56:22Z

In this example, what do you expect WebMock to do and what do you expect PuffingBilly to do?

knagode · 2018-10-30T14:31:54Z

@ronwsmith Thnx for question. I would like to stub both Rails&browser based requests:

Browser specific stub (via Puffing Billy proxy):

proxy.stub('http://google.com/script.js').and_return(:text => "document.write('Yeeeyyy')")

Ruby/Rails specific stub (via WebMock) :

WebMock.stub_request('http://yahoo.com/data.json').to_return(body: { data: 'fake' }.to_json, headers: {})

I would like to block all network requests inside tests and wherever they occur by default(either on Rails or browser side). I would then whitelist/handle some specific requests via PuffiingBilly/WebMock.

ronwsmith · 2018-11-04T03:21:32Z

@knagode so it seems to work now but you still get an error in the after suite? Maybe we can just add a check to only shut it down if it's still running?

knagode · 2019-01-02T12:52:33Z

@ronwsmith I was slowly removing gems from my repo and managed to fix eventmachine not initialized: evma_get_sockname.

In my case problem was: gem fake_stripe. Anyway I wasn't able to use Puffing Billy because it doesnt allow me to use WebMock & Chrome proxy together. Why is this not possible? Do you see that this gem would be really powerful if it would allow co-existance of both as they are both super important gems ... Do you know why exactly do they not work together? What should be changed in order to use both?

ronwsmith · 2019-01-03T02:45:06Z

Puffing-billy is a proxy itself. If you use it as the proxy in Chrome, it will work just fine. Not sure what other proxy settings you're using in Chrome or why, but as far as I know you can only use one proxy in any browser.

knagode · 2019-01-03T09:37:50Z

dSure. PuffingBilly is proxy for browser based requests.

But if you are building app which is also making requests to external servers (e.g. requests to Stripe, Facebook Graph, etc ...) you sooner or later need something for stubbing those requests. That is why we use WebMock.

I would expect that those 2 gems would work together because they are solving 2 problems. I saw that I am not the only one who expected that this to work out of the box.

ronwsmith · 2019-01-03T14:35:48Z

Have you tried the suggestions in that linked issue? Happy to accept a PR with README changes that document it better.

fukayatsu · 2019-01-07T08:27:49Z

I saw the same error(eventmachine not initialized: evma_get_sockname) when using knapsackpro queue mode.
It seems that knapsackpro queue mode calls after(:suite) hook multiple times on a job.

My current workaround is:

# rails_helper.rb

...

module BillyProxyPatch
  # @see https://github.com/oesmith/puffing-billy/blob/v1.1.2/lib/billy/proxy.rb#L26
  def stop
    super
    @signature = nil
  end
end

Billy::Proxy.prepend(BillyProxyPatch)

ronwsmith · 2019-01-07T22:49:28Z

Just updated eventmachine in 1.1.3. Please try it out and see if this issue persists.

fukayatsu · 2019-01-08T03:03:45Z

This issue persists on puffing-billy v1.1.3 with knapsack_pro queue mode.

An error occurred in an `after(:suite)` hook.
--
  | Failure/Error: Socket.unpack_sockaddr_in(EM.get_sockname(@signature)).first
  |  
  | RuntimeError:
  | eventmachine not initialized: evma_get_sockname
  | # /bundle/gems/puffing-billy-1.1.3/lib/billy/proxy.rb:43:in `get_sockname'
  | # /bundle/gems/puffing-billy-1.1.3/lib/billy/proxy.rb:43:in `port'
  | # /bundle/gems/puffing-billy-1.1.3/lib/billy/proxy.rb:29:in `stop'
  | # /bundle/gems/puffing-billy-1.1.3/lib/billy/init/rspec.rb:17:in `block (2 levels) in <top (required)>'
  | # /bundle/gems/knapsack_pro-1.2.0/lib/knapsack_pro/runners/queue/rspec_runner.rb:81:in `run_tests'
  | # /bundle/gems/knapsack_pro-1.2.0/lib/knapsack_pro/runners/queue/rspec_runner.rb:34:in `run'
  | # /bundle/gems/knapsack_pro-1.2.0/lib/tasks/queue/rspec.rake:6:in `block (3 levels) in <top (required)>'

ronwsmith · 2019-01-10T03:07:08Z

@AlanFoster can you take a look at this issue? Seems to be introduced by your PR #239 . Thanks!

julioolvr · 2019-01-29T16:53:43Z

I don't want to add much noise, but we've been looking into an issue similar to this one today. Seems like eventmachine's reactor is a singleton, right? So other gems that use it could theoretically stop it before puffing-billy does? We'll work around this for now by adding a check for EM.reactor_running? before Billy::Proxy#stop and see how that goes, so just sharing in case it makes sense to add this to puffing-billy.

ronwsmith · 2019-06-16T01:58:43Z

@knagode is this still an issue for you?

@julioolvr how did that workaround work? If it works, can you submit a PR with it? Thanks!

julioolvr · 2019-06-16T07:17:23Z

We haven’t had issues in a while to the point I had completely forgot about this, so I guess the workaround was a success. I’ll see if I have time to send a PR during the week, but in the meantime this is the whole code for the patch (we have it in our rails_helper.rb file)

# Patch `puffing-billy`'s proxy so that it doesn't try to stop
# eventmachine's reactor if it's not running.
module BillyProxyPatch
  def stop
    return unless EM.reactor_running?

    super
  end
end

Billy::Proxy.prepend(BillyProxyPatch)

julioolvr · 2019-06-17T14:33:40Z

I looked a bit into opening a PR but I'm not sure how I'd write a test for it. Additionally, I had some issues bundle installing on macOS (when trying to compile capybara-webkit, apparently) and I wasn't able to build an image out of the provided Dockerfile. In any case, the change would literally be adding that guard clause with EM.reactor_running?, in case someone with the project already up and running wants to give it a try.

thbar · 2019-09-23T11:25:27Z

@julioolvr thanks for your patch, which apparently removes the error in my case too.

ArturT · 2019-10-08T21:24:17Z

@fukayatsu You asked about the case when puffing-billy gem fails when using knapsack_pro gem in Queue Mode to run your tests in parallel on CI server. I got patch fix from one of users that was helpful:

# rails_helper.rb or spec_helper.rb

# A patch to `puffing-billy`'s proxy so that it doesn't try to stop
# eventmachine's reactor if it's not running.
module BillyProxyPatch
  def stop
    return unless EM.reactor_running?
    super
  end
end
Billy::Proxy.prepend(BillyProxyPatch)

# A patch to `puffing-billy` to start EM if it has been stopped
Billy.module_eval do
  def self.proxy
    if @billy_proxy.nil? || !(EventMachine.reactor_running? && EventMachine.reactor_thread.alive?)
      proxy = Billy::Proxy.new
      proxy.start
      @billy_proxy = proxy
    else
      @billy_proxy
    end
  end
end

if ENV["KNAPSACK_PRO_TEST_SUITE_TOKEN_RSPEC"]
  KnapsackPro::Hooks::Queue.before_queue do
    # executes before Queue Mode starts work
    Billy.proxy.start
  end

  KnapsackPro::Hooks::Queue.after_queue do
    # executes after Queue Mode finishes work
    Billy.proxy.stop
  end
end

I've updated FAQ in my docs https://github.com/KnapsackPro/knapsack_pro-ruby#how-to-configure-puffing-billy-gem-with-knapsack-pro-queue-mode

ronwsmith · 2019-10-27T02:16:46Z

Happy to accept a PR with that patch (and tests) if someone wants to put one up.

dlozano · 2021-03-22T16:35:13Z

I am also having the this issue when I switch to unicorn as Capybara rack server. In addition to @ArturT patch I needed to patch port_in_use?

I use both puffing-billy and webmock

module BillyProxyPatch
  def stop
    return unless EM.reactor_running?
    super
  end

  def port_in_use?(port)
    return unless EM.reactor_running?
    super
  end
end

senid231 · 2022-04-18T12:35:51Z

I have a similar problem but none of above fixes didn't work for me

following works for me

module BillyProxyPatch
  protected

  def port_in_use?(port)
    Timeout::timeout(1) do
      super
    end
  rescue Timeout::Error
    false
  end
end

Billy::Proxy.prepend(BillyProxyPatch)

because in my case TCPSocket#new hangs for 60 seconds (then timeout in wait_for_server_shutdown being called)

PS TCPSocket#new has a connection_timeout option, but we use socksify as a dependency of one of our gems which monkey patch TCPSocket and removes this option.

ahukkanen mentioned this issue Feb 12, 2021

Fix an issue with puffing-billy event machine not running decidim/decidim#7364

Merged

12 tasks

andreslucena mentioned this issue Jan 26, 2023

Add "Setup Election" step in admin decidim-vocdoni/decidim-module-vocdoni#18

Merged

4 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

eventmachine not initialized - proxy isn't working #253

eventmachine not initialized - proxy isn't working #253

knagode commented Oct 17, 2018 •

edited

Loading

ronwsmith commented Oct 18, 2018

knagode commented Oct 18, 2018

ronwsmith commented Oct 19, 2018

gagalago commented Oct 25, 2018

knagode commented Oct 29, 2018 •

edited

Loading

knagode commented Oct 30, 2018 •

edited

Loading

ronwsmith commented Oct 30, 2018

knagode commented Oct 30, 2018 •

edited

Loading

ronwsmith commented Nov 4, 2018

knagode commented Jan 2, 2019

ronwsmith commented Jan 3, 2019

knagode commented Jan 3, 2019 •

edited

Loading

ronwsmith commented Jan 3, 2019

fukayatsu commented Jan 7, 2019

ronwsmith commented Jan 7, 2019

fukayatsu commented Jan 8, 2019

ronwsmith commented Jan 10, 2019

julioolvr commented Jan 29, 2019

ronwsmith commented Jun 16, 2019

julioolvr commented Jun 16, 2019

julioolvr commented Jun 17, 2019

thbar commented Sep 23, 2019

ArturT commented Oct 8, 2019

ronwsmith commented Oct 27, 2019

dlozano commented Mar 22, 2021

senid231 commented Apr 18, 2022 •

edited

Loading

eventmachine not initialized - proxy isn't working #253

eventmachine not initialized - proxy isn't working #253

Comments

knagode commented Oct 17, 2018 • edited Loading

ronwsmith commented Oct 18, 2018

knagode commented Oct 18, 2018

ronwsmith commented Oct 19, 2018

gagalago commented Oct 25, 2018

knagode commented Oct 29, 2018 • edited Loading

knagode commented Oct 30, 2018 • edited Loading

ronwsmith commented Oct 30, 2018

knagode commented Oct 30, 2018 • edited Loading

ronwsmith commented Nov 4, 2018

knagode commented Jan 2, 2019

ronwsmith commented Jan 3, 2019

knagode commented Jan 3, 2019 • edited Loading

ronwsmith commented Jan 3, 2019

fukayatsu commented Jan 7, 2019

ronwsmith commented Jan 7, 2019

fukayatsu commented Jan 8, 2019

ronwsmith commented Jan 10, 2019

julioolvr commented Jan 29, 2019

ronwsmith commented Jun 16, 2019

julioolvr commented Jun 16, 2019

julioolvr commented Jun 17, 2019

thbar commented Sep 23, 2019

ArturT commented Oct 8, 2019

ronwsmith commented Oct 27, 2019

dlozano commented Mar 22, 2021

senid231 commented Apr 18, 2022 • edited Loading

knagode commented Oct 17, 2018 •

edited

Loading

knagode commented Oct 29, 2018 •

edited

Loading

knagode commented Oct 30, 2018 •

edited

Loading

knagode commented Oct 30, 2018 •

edited

Loading

knagode commented Jan 3, 2019 •

edited

Loading

senid231 commented Apr 18, 2022 •

edited

Loading