{"id":5308,"date":"2026-06-03T08:00:35","date_gmt":"2026-06-03T15:00:35","guid":{"rendered":"https:\/\/www.couchbase.com\/blog\/?p=5308"},"modified":"2026-06-03T08:00:35","modified_gmt":"2026-06-03T15:00:35","slug":"unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer","status":"publish","type":"post","link":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/","title":{"rendered":"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer"},"content":{"rendered":"\n<p><span>In any distributed database, managing index data across servers is a fundamental challenge. It\u2019s like moving to a new home with hundreds of items to pack. You need to find the perfect balance: cram too many items (indexes) into one box (shard), and it becomes heavy, slow to move, and risks widespread impact if damaged. Create too many tiny boxes, and the overhead of tracking and managing them drowns you in complexity.<\/span><\/p>\n\n\n\n<p><span>Couchbase solves this complex index organization problem with the <\/span><b>Shard Dealer<\/b><span>, an intelligent system designed to automatically pack and organize index data across your distributed cluster for maximum efficiency and flexibility.<\/span><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span>The Foundation of Scale: The Goldilocks Problem of Index Management<\/span><\/h2>\n\n\n\n<p><span>A database index is the engine of fast queries \u2013 it&#8217;s what allows the system to jump directly to the data you need, like an index at the back of a book. In Couchbase, <\/span><b>shards<\/b><span> group related indexes together, allowing the system to manage dozens of logical units instead of thousands of individual indexes. When you scale or perform maintenance, you move entire shards rather than individual indexes.<\/span><\/p>\n\n\n\n<p><span>The biggest operational challenge is determining the <\/span><b>right number of shards<\/b><span> \u2013 the &#8220;Goldilocks problem&#8221;:<\/span><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><b>Too few shards<\/b><span> means heavy lifting and slow cluster rebalancing, and performance problems in one shard affect all indexes inside it.<\/span><\/li>\n\n\n<li><b>Too many shards<\/b><span> increases memory overhead, as each shard requires its own memory buffers, and tracking thousands of tiny shards is difficult.<\/span><\/li>\n\n<\/ul>\n\n\n\n<p><span>The Shard Dealer dynamically finds the sweet spot based on your cluster size:<\/span><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><b>Small clusters<\/b><span> (256MB\u20131GB memory) run optimally with 10\u201340 shards.<\/span><\/li>\n\n\n<li><b>Large clusters<\/b><span> (16GB+ memory) can efficiently handle 600\u20132,000 shards.<\/span><\/li>\n\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span>Future-Proofing Performance: Automatic Workload Isolation<\/span><\/h2>\n\n\n\n<p><span>Not all indexes are created equal, especially with the rise of AI workloads. The Shard Dealer is designed for this modern reality by ensuring your index types are never mixed:<\/span><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><b>Traditional indexes:<\/b><span> Optimized for standard operations like exact matches and range queries (&#8220;find all users named John&#8221;).<\/span><\/li>\n\n\n<li><b>Vector indexes:<\/b><span> Designed for demanding AI and machine learning workloads, enabling capabilities like similarity search (&#8220;find products similar to this image&#8221;). These are CPU-intensive and benefit from specialized hardware.<\/span><\/li>\n\n<\/ul>\n\n\n\n<p><span>This separation is crucial for modern resource optimization:<\/span><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><b>Optimize resources:<\/b><span> Direct resource-intensive vector indexes to specialized shards.<\/span><\/li>\n\n\n<li><b>Prevent bottlenecks:<\/b><span> Tune memory and performance settings for a specific workload type without impacting other standard queries.<\/span><\/li>\n\n<\/ul>\n\n\n\n<p><span>This intelligent organization is powered by the Shard Dealer&#8217;s core logic, which uses a multi-pass algorithm to manage placement for maximum efficiency.<\/span><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span>The Intelligence Inside: Multi-Pass Algorithm for Predictable Scaling<\/span><\/h2>\n\n\n\n<p><span>The Shard Dealer uses a sophisticated <\/span><b>multi-pass algorithm<\/b><span> to decide where each new index should be placed, continuously managing index placement for maximum utilization without overloading servers. Think of it as a decision tree with escalating fallback options:<\/span><\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><b>Establishing flexibility:<\/b><span> It first ensures each node builds up a minimal foundation of at least six shards to guarantee flexibility during rebalancing. This prevents having only two &#8220;boxes&#8221; where your only option is to &#8220;move everything.&#8221;<\/span><\/li>\n\n\n<li><b>Optimizing capacity:<\/b><span> Once the foundation is built, it prioritizes reusing existing shards that are under 50% full and most evenly loaded, avoiding situations where a shard is dominated by a few huge indexes.<\/span><\/li>\n\n\n<li><b>Preventing overload:<\/b><span> A new shard is created only when no existing shard has comfortable room available, ensuring existing shards do not become performance bottlenecks.<\/span><\/li>\n\n\n<li><b>Emergency fallback:<\/b><span> In rare cases, such as during upgrades from older versions or when a node hits its comfortable limit, the system ensures index creation never fails by finding any shard under the hard capacity limit or creating a temporary overflow shard if necessary.<\/span><\/li>\n\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\"><span>Architecture for Resilient Scaling<\/span><\/h2>\n\n\n\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-18143\" src=\"https:\/\/www.couchbase.com\/wp-content\/uploads\/sites\/5\/2026\/05\/Screenshot-2026-05-20-at-2.19.05-PM.png\" alt=\"\" width=\"1380\" height=\"906\"><\/p>\n\n\n\n<p><span>Database resilience depends on <\/span><b>replicas<\/b><span> \u2013 copies of data on different servers. The Shard Dealer continues to ensure <\/span><b>index replicas and shard replicas are perfectly aligned<\/b><span>. This alignment means that during a server failover, entire, consistent index groupings on the shard can be activated together, dramatically simplifying and speeding up failover and recovery.<\/span><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span>The Business Impact: Core Benefits of the Shard Dealer<\/span><\/h2>\n\n\n\n<p><span>By automating the complexity of index management, the Shard Dealer provides measurable benefits:<\/span><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><b>Effortless scaling:<\/b><span> When scaling your cluster, the system moves fewer, well-organized shards instead of thousands of individual indexes, significantly speeding up the rebalancing process.<\/span><\/li>\n\n\n<li><b>Guaranteed performance:<\/b><span> By enforcing strict size limits on shards, the system prevents any single shard from monopolizing memory or CPU, leading to predictable performance.<\/span><\/li>\n\n\n<li><b>Operational clarity:<\/b><span> Instead of monitoring thousands of individual indexes, operators can manage and troubleshoot in terms of dozens of shards, making management more manageable.<\/span><\/li>\n\n\n<li><b>Future-proofing:<\/b><span> The Shard Dealer provides a future-proof architecture that supports evolving data models \u2013 from traditional queries to AI-powered vector search \u2013 without requiring manual intervention or locking you into current decisions.<\/span><\/li>\n\n<\/ul>\n\n\n\n<p><i><span>This post explains the Shard Dealer feature in <\/span><\/i><a href=\"https:\/\/www.couchbase.com\/downloads\/?family=couchbase-server\"><i><span>Couchbase Server 8.0+<\/span><\/i><\/a><i><span> introduced for enhancing <\/span><\/i><a href=\"https:\/\/docs.couchbase.com\/server\/current\/vector-index\/vectors-and-indexes-overview.html\"><i><span>vector indexing<\/span><\/i><\/a><i><span> rebalances.<\/span><\/i><\/p>\n\n\n\n<p>\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In any distributed database, managing index data across servers is a fundamental challenge. It\u2019s like moving to a new home with hundreds of items to pack. You need to find the perfect balance: cram too many items (indexes) into one box (shard), and it becomes heavy, slow to move, and risks widespread impact if damaged. [&hellip;]<\/p>\n","protected":false},"author":85718,"featured_media":5305,"comment_status":"open","ping_status":"open","sticky":true,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[179],"tags":[],"ppma_author":[1039],"class_list":["post-5308","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-couchbase-architecture"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.6 (Yoast SEO v27.6) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer - The Couchbase Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer\" \/>\n<meta property=\"og:description\" content=\"In any distributed database, managing index data across servers is a fundamental challenge. It\u2019s like moving to a new home with hundreds of items to pack. You need to find the perfect balance: cram too many items (indexes) into one box (shard), and it becomes heavy, slow to move, and risks widespread impact if damaged. [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/\" \/>\n<meta property=\"og:site_name\" content=\"The Couchbase Blog\" \/>\n<meta property=\"article:published_time\" content=\"2026-06-03T15:00:35+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/05\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer-1024x536.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"536\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Dhruvil Shah, Senior Software Engineer\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@dhruvilshah98\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Dhruvil Shah, Senior Software Engineer\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/\"},\"author\":{\"name\":\"Dhruvil Shah, Senior Software Engineer\",\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/#\\\/schema\\\/person\\\/8993a78da6692f8643f2b7db98f3b683\"},\"headline\":\"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer\",\"datePublished\":\"2026-06-03T15:00:35+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/\"},\"wordCount\":800,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2026\\\/05\\\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer.png\",\"articleSection\":[\"Couchbase Architecture\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/\",\"url\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/\",\"name\":\"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer - The Couchbase Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2026\\\/05\\\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer.png\",\"datePublished\":\"2026-06-03T15:00:35+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2026\\\/05\\\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer.png\",\"contentUrl\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2026\\\/05\\\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer.png\",\"width\":2400,\"height\":1256},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/\",\"name\":\"The Couchbase Blog\",\"description\":\"Couchbase, the NoSQL Database\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/#organization\",\"name\":\"The Couchbase Blog\",\"url\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2026\\\/06\\\/logo.svg\",\"contentUrl\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/5\\\/2026\\\/06\\\/logo.svg\",\"width\":\"1024\",\"height\":\"1024\",\"caption\":\"The Couchbase Blog\"},\"image\":{\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/#\\\/schema\\\/person\\\/8993a78da6692f8643f2b7db98f3b683\",\"name\":\"Dhruvil Shah, Senior Software Engineer\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/fe87ed7362e72b88c5d2faad23a3479a8744422d76e0c93127c7e59468518d10?s=96&d=mm&r=g60e15567261eedaa46d1ce52c18946bb\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/fe87ed7362e72b88c5d2faad23a3479a8744422d76e0c93127c7e59468518d10?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/fe87ed7362e72b88c5d2faad23a3479a8744422d76e0c93127c7e59468518d10?s=96&d=mm&r=g\",\"caption\":\"Dhruvil Shah, Senior Software Engineer\"},\"sameAs\":[\"https:\\\/\\\/www.instagram.com\\\/dhruvils98\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/dhruvilshah98\",\"https:\\\/\\\/x.com\\\/dhruvilshah98\"],\"url\":\"https:\\\/\\\/www.couchbase.com\\\/blog\\\/author\\\/dhruvilshah\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer - The Couchbase Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/","og_locale":"en_US","og_type":"article","og_title":"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer","og_description":"In any distributed database, managing index data across servers is a fundamental challenge. It\u2019s like moving to a new home with hundreds of items to pack. You need to find the perfect balance: cram too many items (indexes) into one box (shard), and it becomes heavy, slow to move, and risks widespread impact if damaged. [&hellip;]","og_url":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/","og_site_name":"The Couchbase Blog","article_published_time":"2026-06-03T15:00:35+00:00","og_image":[{"width":1024,"height":536,"url":"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/05\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer-1024x536.png","type":"image\/png"}],"author":"Dhruvil Shah, Senior Software Engineer","twitter_card":"summary_large_image","twitter_creator":"@dhruvilshah98","twitter_misc":{"Written by":"Dhruvil Shah, Senior Software Engineer","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/#article","isPartOf":{"@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/"},"author":{"name":"Dhruvil Shah, Senior Software Engineer","@id":"https:\/\/www.couchbase.com\/blog\/#\/schema\/person\/8993a78da6692f8643f2b7db98f3b683"},"headline":"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer","datePublished":"2026-06-03T15:00:35+00:00","mainEntityOfPage":{"@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/"},"wordCount":800,"commentCount":0,"publisher":{"@id":"https:\/\/www.couchbase.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/#primaryimage"},"thumbnailUrl":"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/05\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer.png","articleSection":["Couchbase Architecture"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/","url":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/","name":"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer - The Couchbase Blog","isPartOf":{"@id":"https:\/\/www.couchbase.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/#primaryimage"},"image":{"@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/#primaryimage"},"thumbnailUrl":"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/05\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer.png","datePublished":"2026-06-03T15:00:35+00:00","breadcrumb":{"@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/#primaryimage","url":"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/05\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer.png","contentUrl":"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/05\/Unlock-Massive-Scale-for-AI-and-Traditional-Workloads_-Meet-the-Couchbase-Secondary-Index-Shard-Dealer.png","width":2400,"height":1256},{"@type":"BreadcrumbList","@id":"https:\/\/www.couchbase.com\/blog\/unlock-massive-scale-for-ai-and-traditional-workloads-meet-the-couchbase-secondary-index-shard-dealer\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.couchbase.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Unlock Massive Scale for AI and Traditional Workloads: Meet the Couchbase Secondary Index Shard Dealer"}]},{"@type":"WebSite","@id":"https:\/\/www.couchbase.com\/blog\/#website","url":"https:\/\/www.couchbase.com\/blog\/","name":"The Couchbase Blog","description":"Couchbase, the NoSQL Database","publisher":{"@id":"https:\/\/www.couchbase.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.couchbase.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.couchbase.com\/blog\/#organization","name":"The Couchbase Blog","url":"https:\/\/www.couchbase.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.couchbase.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/06\/logo.svg","contentUrl":"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/06\/logo.svg","width":"1024","height":"1024","caption":"The Couchbase Blog"},"image":{"@id":"https:\/\/www.couchbase.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.couchbase.com\/blog\/#\/schema\/person\/8993a78da6692f8643f2b7db98f3b683","name":"Dhruvil Shah, Senior Software Engineer","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/fe87ed7362e72b88c5d2faad23a3479a8744422d76e0c93127c7e59468518d10?s=96&d=mm&r=g60e15567261eedaa46d1ce52c18946bb","url":"https:\/\/secure.gravatar.com\/avatar\/fe87ed7362e72b88c5d2faad23a3479a8744422d76e0c93127c7e59468518d10?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/fe87ed7362e72b88c5d2faad23a3479a8744422d76e0c93127c7e59468518d10?s=96&d=mm&r=g","caption":"Dhruvil Shah, Senior Software Engineer"},"sameAs":["https:\/\/www.instagram.com\/dhruvils98","https:\/\/www.linkedin.com\/in\/dhruvilshah98","https:\/\/x.com\/dhruvilshah98"],"url":"https:\/\/www.couchbase.com\/blog\/author\/dhruvilshah\/"}]}},"acf":[],"authors":[{"term_id":1039,"user_id":85718,"is_guest":0,"slug":"dhruvilshah","display_name":"Dhruvil Shah, Senior Software Engineer","avatar_url":{"url":"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/05\/Dhruvil_shah-1.png","url2x":"https:\/\/www.couchbase.com\/blog\/wp-content\/uploads\/sites\/5\/2026\/05\/Dhruvil_shah-1.png"},"0":null,"1":"","2":"","3":"","4":"","5":"","6":"","7":"","8":""}],"_links":{"self":[{"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/posts\/5308","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/users\/85718"}],"replies":[{"embeddable":true,"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/comments?post=5308"}],"version-history":[{"count":0,"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/posts\/5308\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/media\/5305"}],"wp:attachment":[{"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/media?parent=5308"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/categories?post=5308"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/tags?post=5308"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.couchbase.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=5308"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}