You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
How to specify number of workers?
I tried using --api-workers in bentoml serve, but it seems that it doesn't make any difference.
Here is screenshot of my experiment with one of examples:
I added print in serve.py and I can see multiple prints even if I specify number of api-workers=1. I observe this behaviour on other examples as welI. I also tried to set number of workers in configuration:
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
How to specify number of workers?
I tried using --api-workers in bentoml serve, but it seems that it doesn't make any difference.
Here is screenshot of my experiment with one of examples:
I added print in serve.py and I can see multiple prints even if I specify number of api-workers=1. I observe this behaviour on other examples as welI. I also tried to set number of workers in configuration:
But it didn't help either.
How should I correctly specify number of workers?
Beta Was this translation helpful? Give feedback.
All reactions