Remove max_number_of_messages
for SQS+S3-based inputs
#12101
Labels
Integration:amazon_security_lake
Amazon Security Lake
Integration:aws
AWS
Integration:canva
Canva
Integration:carbon_black_cloud
VMware Carbon Black Cloud
Integration:cloudflare_logpush
Cloudflare Logpush
Integration:f5_bigip
F5 BIG-IP
Integration:imperva_cloud_waf
Imperva Cloud WAF
Integration:jamf_protect
Jamf Protect
Integration:sentinel_one_cloud_funnel
SentinelOne Cloud Funnel
Integration:servicenow
ServiceNow
Integration:sublime_security
Sublime Security
Integration:symantec_endpoint_security
Symantec Endpoint Security
Integration:tanium
Tanium
Integration:trellix_edr_cloud
Trellix EDR Cloud
With elastic/beats#40699 the max_number_of_messages setting is now ignored for SQS inputs as of 8.15. It is still exposed in integration settings. It is still relevant for <8.15.
The new setting is number_of_workers, which the SQS-based input shares with the S3 bucket polling input in integration settings.
Unfortunately, the default value for number_of_workers is just
1
. Users using an SQS-based S3 input upgrading to 8.15 agents will find that they've gone from having five workers (or whatever number they had customized it to) for processing objects to just a single worker processing objects.We should consider one or more of the following:
max_number_of_messages
setting for thenumber_of_workers
value ifqueue_url
is present to maintain backwards compatibility while indicating that the setting will be removed in a future version.max_number_of_messages
is no longer applicable for 8.15 and to usenumber_of_workers
when using an SQS queuenumber_of_workers
default value to 5The text was updated successfully, but these errors were encountered: