Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A flag for making AnalyzerBeans concurrent also at a step/component level #33

Open
kaspersorensen opened this issue Jun 26, 2014 · 0 comments

Comments

@kaspersorensen
Copy link
Member

A tweak for jobs with "heavy" components and low-record count...

Right now we are concurrent on a record-by-record level. This is great for most batch jobs since it does a good job at automatically spreading the load evenly on processors and avoids bottlenecks etc.

But say you have just one record which needs to do a couple of (independent) steps. For instance, it might be calling 3 different web services (transformers), without any particular dependency/chaining inbetween. Then the 3 transformers should be invoked in parallel and thereby the overhead of waiting for the previous step to finish be gone.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant