Limit the number of messages being sent to channel

[ahmednasir91]

So we are facing a situation where RabbitMQ is closing the connect of celery queue on write time and basically it comes with PRECONDITION_FAILED message size is greater than 128MB (the default in RMQ).

We tried to override the kombu.Producer.publish to catch which message is causing the issue, looks like the tasks we have payload size each of 22MB but when they start executing as chunks in a chord there is a message sent which contains multiple tasks and hence the timeout.

How can i limit batching of these messages in kombu or is this happening in celery itself?