https://www.uber.com/en-TW/blog/migrating-ubers-compute-platform-to-kubernetes-a-technical-journey/
> Operating large clusters on Kubernetes posed challenges with managing the API server load to prevent bottlenecks, ensuring that the scheduler can handle the scale even with high pod churn, and dealing with fragmentation issues that arise from running large clusters with varied workloads.
Large cluster 都必須要處理的 scheduler, high pod churn 還有可怕的 etcd fragmentations…
> We had to make some optimizations and tune parameters to achieve these numbers. We tuned the QPS settings and parallelism in the controller manager and scheduler to handle high loads. We used API priority and fairness to limit expensive API calls like list and get. We switched from JSON to Proto encoding for better performance. Lastly, we modified the pod topology spread scheduler plugin for faster processing.
APF 看來似乎是一個讓應用程式不要弄壞 cluster 的方向，降低 API 的忙碌，甚至連 Controller/Scheduler 都調整了
May 1, 2025 1.1K 1
