I have been using Pure Mesos setup, without DC/OS for 2.5 years.
We have the following infra features.:
- 120 micro-services running using marathon.
- 10 batch jobs running using Chronos.
- So far, everything is reliable and no downtime.
- We have Ip-Per-Task enabled with Project Calico.
- We have Public, Private, and IP Access-list enabled per container using Nginx and ELBs.
- The max number of containers we ran on the cluster so far is 3620 containers.
- We have detailed graphs monitoring per-container generated automatically.
- We have (slack #alerts) alerting enabled.
- We have secrets store using vault.
In the end we had to use (Mesos, Marathon, Chronos, Vault, Consul, Nginx, Calico, ELK, TICK.) on AWS.
The thing is, We had to configure these things to work together nicely so it is not out-of-the-box solution. Even though we haven't used Kubernetes yet, we are not religious to Mesos.
But at the moment, it seems we have everything we need and the team is happy with the current setup.