1

I am running an eperiments which includes around 20 containers heavily communicating with each other through TCP, grpcs, etc. I use Docker stack command to start the containers on an overlay network. However, I have a feeling that there is a bottleneck in my network limiting the bandwidth as my containers are often not able to reach the others. When I monitor the Swarm, it seems that the containers don't use much of the network. so Is there a limit on Docker Swarm overlay networks' bandwidth? The grafana plots on network usage

Nima Afraz
  • 13
  • 1
  • 4

1 Answers1

1

Based on a benchmarking held by Vadim Tkachenko (original post), docker overlay network has shown a very poor performance. Please check ksoftirq of your servers and if there's a high CPU load then using Calico overlay plugin is suggested.

Farzan
  • 126
  • 3
  • Userful link: [Running Calico on a Docker Swarm](https://github.com/CiscoCloud/calico-docker/blob/master/docs/getting-started/powerstrip/CalicoSwarm.md) – Janez Kuhar Jan 02 '22 at 14:07
  • Calico overlay plugin integration documentation with Docker Swarm is dated. I don't think that Calico still supports Docker Swarm. – Janez Kuhar Jan 12 '22 at 22:39
  • @JanezKuhar ATM, my suggestion is either to use [Weave plugin for docker](https://www.weave.works/docs/net/latest/install/plugin/plugin-v2/) or switch to Kubernetes to be able to use Calico. It depends on your use-case. However, as it's been a very long time since I posted this answer, I also suggest to run your own benchmark on Docker's overlay network vs Weave vs Calico to see if there have been any performance improvements. – Farzan Jan 13 '22 at 23:44