MSK Express Intelligent Rebalancing Now Available on Existing Clusters
Amazon MSK Express now supports Intelligent Rebalancing on existing clusters, simplifying partition management and improving utilization.
Editorial summary and commentary based on the original from AWS What's New. Read the original
What's new
Amazon MSK Provisioned clusters using Express brokers can now leverage Intelligent Rebalancing on existing deployments, not just new ones. This feature, previously limited to new cluster creations, automatically rebalances Kafka partitions to optimize resource utilization and performance. It's available at no extra cost.
Why it matters
This update removes a significant barrier for adopting Intelligent Rebalancing. Previously, engineers had to create new clusters to benefit from automatic partition balancing, which is a complex and time-consuming task to manage manually or with external tooling. Now, existing MSK Express clusters can be rebalanced on the fly, improving throughput and reducing operational overhead without downtime. The speed improvement over Standard brokers (up to 180x faster) means quicker adjustments to changing workloads, leading to more consistent performance and better capacity management.
How to use it
Intelligent Rebalancing is enabled by default on MSK Provisioned clusters with Express brokers. For existing clusters, you may need to enable it via the AWS console or API.
Source (AWS What's New): Amazon MSK Express brokers now support Intelligent Rebalancing on existing clusters