{"id":14991,"date":"2023-10-26T11:49:50","date_gmt":"2023-10-26T18:49:50","guid":{"rendered":"https:\/\/www.couchbase.com\/blog\/?p=14991"},"modified":"2025-06-13T19:49:20","modified_gmt":"2025-06-14T02:49:20","slug":"cloud-to-edge-ai-with-a-mobile-database-platform","status":"publish","type":"post","link":"https:\/\/www.couchbase.com\/blog\/cloud-to-edge-ai-with-a-mobile-database-platform\/","title":{"rendered":"Cloud to Edge AI with a Mobile Database Platform"},"content":{"rendered":"

Edge computing<\/a>\u00a0is a technical architecture that extends data processing from the cloud to the edge, moving it closer to the point of interaction, including onto mobile devices. From the database perspective, a typical architecture includes a database in the cloud, a database at the edge in an edge data center and embedded databases running within apps on edge devices like phones and tablets, all linked via data synchronization for consistency. Modern mobile database platforms combine all of these capabilities.<\/p>\n

\"AI<\/a>

A typical edge computing architecture<\/p><\/div>\n

This architecture provides four distinct advantages for applications:<\/p>\n

    \n
  1. \n
      \n
    1. Speed\u00a0<\/strong>\u2014 By processing data closer to the point of interaction, the distance it has to travel is reduced, dramatically reducing app latency.<\/li>\n
    2. Resilience<\/strong>\u00a0\u2014 By processing data at the edge, you reduce dependencies on an inherently unreliable internet for data, reducing app downtime. If any upstream layer of the architecture is disrupted, downstream applications are not affected at all.<\/li>\n
    3. Data governance<\/strong>\u00a0\u2014 With edge computing, sensitive data never has to leave the edge.<\/li>\n
    4. Bandwidth efficiency<\/strong>\u00a0\u2014 By distributing data storage to the edge, you reduce bandwidth use and egress costs of pulling data from the cloud.<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n

      When applied to an AI system, the edge computing advantages can greatly accelerate and amplify AI capabilities, both in the training of learning algorithms, as well as in practical application of models.<\/p>\n

      \u2018Hybrid\u2019 AI Is Both Centralized and Decentralized<\/h2>\n

      A recent\u00a0Forbes article<\/a>\u00a0talks about the notion that the \u201cfuture of AI is hybrid,\u201d meaning AI needs the ability to process data both in the cloud and at the edge to realize its full potential. In the article, the author states:<\/p>\n

      \u201cAI needs somewhere powerful and stable for model training and inference, which require huge amounts of space for processing complex workloads. That\u2019s where the cloud comes in. At the same time, AI also needs to happen fast. For it to be useful, it needs to process closer to where the action actually happens \u2014 the edge of a mobile device.\u201d<\/em><\/p>\n

      This observation highlights the notion that\u00a0LLM<\/a>-powered AI is gravitationally centralized, while the creation and consumption of the data it uses and produces will be decentralized and highly distributed.<\/p>\n

      The hybrid aspect of AI described in the article can be elegantly achieved with an edge computing architecture, where the cloud, the edge data center and edge devices aren\u2019t separate environments, per se, but are actually layers within a data-processing ecosystem linked via synchronization.<\/p>\n

      In this model, AI workloads can be processed where most appropriate \u2014\u00a0deep learning<\/a>\u00a0AI training happens against immense amounts of data in the central cloud, where storage and horsepower are limited only by budget, while smaller\u00a0machine learning<\/a>\u00a0AI models can run at the edge directly on edge devices, where they can do things like make on-the-spot recommendations to a user based on local data and current situation.<\/p>\n

      What\u2019s needed to facilitate the hybrid AI concept is a database built for edge computing that also supports AI.<\/p>\n

      The Main Ingredient of AI: Data<\/h2>\n

      Regardless of the techniques or algorithms used, the backbone and most necessary resource for achieving AI is data. Data is fuel for machine learning, both historic for context and precedence, and in real time for situational awareness. But it\u2019s much more than simply acquiring data. Where you store and process that data has huge implications on the success (or failure) of AI-based systems, so careful consideration is required when designing an AI architecture.<\/p>\n

      AI at the Edge with a Mobile Database<\/h2>\n

      Couchbase<\/a>\u00a0is an in-memory, distributed JSON-document cloud database that supports SQL, search, eventing and analytics. The platform is used to powering large enterprise applications and can scale to millions of users with 24\u00d7365 uptime. It also provides unique support for edge computing as well as AI processing.<\/p>\n

      Couchbase can run in the cloud, at the edge and on devices, and it can sync data across these layers, achieving the edge computing advantages of speed, reliability, data governance and bandwidth efficiency for applications.<\/p>\n

      \"Couchbase<\/a>

      Couchbase edge computing architecture<\/p><\/div>\n

      Couchbase is also able to integrate AI across the architecture through its ability to call models directly from the database and feed them with real-time operational data, whether it be in the cloud, at the edge or on a mobile device. These capabilities combine to make the \u201chybrid AI\u201d concept a reality.<\/p>\n

      Let\u2019s explore this in more detail.<\/p>\n

      Edge Native<\/h2>\n

      The\u00a0Couchbase Mobile<\/a>\u00a0product stack natively supports edge computing architectures by providing:<\/p>\n

      A cloud native database<\/strong>: Available as a fully managed and hosted Database as a Service with\u00a0Couchbase Capella<\/a>, or deploy and host\u00a0Couchbase Server<\/a>\u00a0on your own.<\/p>\n

      An embedded database<\/strong>: Couchbase Lite<\/a>\u00a0is the embeddable version of Couchbase for mobile and IoT apps that stores data locally on the device. It provides full CRUD and SQL query functionality, and it supports all major platforms including iOS, OS X, tvOS, Android, Linux, Windows, Xamarin, Kotlin and more.<\/p>\n

      Data synchronization from the cloud to the edge<\/strong>: A secure, hierarchical gateway for data sync over the web, as well as peer-to-peer sync between devices, with support for authentication, authorization and fine-grained access control. Choose from fully hosted and managed data sync with\u00a0Capella App Services<\/a>, or install and manage\u00a0Couchbase Sync Gateway<\/a>\u00a0yourself.<\/p>\n

      Couchbase Mobile\u2019s built-in data synchronization connects the stack, syncing data between the backend cloud database and the embedded database running on edge devices as connectivity allows, while during network disruptions apps continue to operate due to local data processing.<\/p>\n

      With the Couchbase Mobile stack you can create multi-tier edge architectures to support any speed, availability or low bandwidth requirement.<\/p>\n

      AI Ready<\/h2>\n

      Couchbase Mobile is not only designed for edge computing, it also supports AI from cloud to edge, including on devices.<\/p>\n

      Cloud AI with the Couchbase Analytics Service<\/h3>\n

      Couchbase provides in-memory processing for hyper-fast responsiveness and a distributed architecture for scale and resilience, bringing the necessary speed, storage capacity and workload horsepower required for processing the huge amounts of data needed for training AI models.<\/p>\n

      It also provides a built-in\u00a0Analytics Service<\/a>, a feature that allows analysis of operational data without requiring it to be moved into a separate analytic system, eliminating the need for lengthy\u00a0ETL<\/a>\u00a0(extract, transform, load) processes to run before data can be used for model training or analysis.<\/p>\n

      What\u2019s more, even though Couchbase is a document database, data scientists work with it using a familiar language:\u00a0SQL<\/a>, complete with joins and aggregations. This allows them to write complex and highly contextual queries against massive datasets that return results in milliseconds or sub milliseconds, reducing time to insight and speeding up data prep and model training iterations.<\/p>\n

      The Couchbase Analytics Service offers a feature for integrating AI called\u00a0Python User Defined Functions (UDF)<\/a>, which allows developers to bind Python code as a function and call it in SQL queries. This enables them to create a seamless pipeline, without tedious ETL processes, from Python-based machine learning models to Couchbase Analytics for applying AI at scale to things like sentiment analysis, predicting likely outcomes or classifying items based on operational data returned from analytics queries.<\/p>\n

      An example of using machine learning models with Couchbase Analytics can be found in this\u00a0blog post<\/a>.<\/p>\n

      With the Analytics Service, Couchbase fulfills the cloud side of the \u201chybrid AI\u201d concept.<\/p>\n

      Edge AI with Couchbase Lite Predictive Query<\/h3>\n

      While heavy-duty AI workloads can run efficiently at scale in the cloud with Couchbase, there are cases where running smaller models at the edge on mobile devices is desired, for example to do things like make recommendations based on local real-time data. And the increasing power of today\u2019s mobile devices, as well as the emergence of mobile-optimized machine learning models, are making AI at the edge a reality.<\/p>\n

      In fact, Couchbase Lite\u2019s\u00a0Predictive Query API<\/a>\u00a0was designed for edge AI, allowing mobile apps to use pretrained machine learning models and run predictive queries against local on-device data. These predictions, made against real-time data captured by the mobile app, enable a range of compelling applications.<\/p>\n

      By applying machine learning models on the mobile device, recommendations and predictions are more personalized, can be instantaneous and have more impact thanks to the guaranteed high availability, ultra-low latency and reduced network bandwidth usage enabled by local data processing. In essence, it eliminates the need to send data back and forth over the internet to distant cloud data centers to be evaluated by AI, so it makes the entire experience faster and more reliable.<\/p>\n

      Examples of AI at the edge include retail and e-commerce, where on-the-spot item recommendations can be made based on images or photos; hospitality where personal preferences are matched with location, time, weather and other factors to recommend amenities in real time; or industrial manufacturing, where problems in high-speed factory processes can be predicted and mitigated instantly before a failure occurs.<\/p>\n

      To learn more about using machine learning models with Couchbase Lite, read this\u00a0blog post<\/a>\u00a0.<\/p>\n

      With the Predictive Query API, Couchbase Lite fulfills the mobile device side of the \u201chybrid AI\u201d concept.<\/p>\n

      AI from Cloud to Edge to Device<\/h2>\n

      By combining Couchbase Mobile\u2019s AI capabilities with its native support for edge computing architectures, organizations can layer AI-processing and data-processing workloads into any topology required for the fastest and most scalable integrated AI systems, all running on a standard database technology.<\/p>\n

      \"Couchbase<\/a>

      Couchbase edge computing architecture<\/p><\/div>\n

      With this architecture, AI workloads are processed where it makes the most sense for a given model\u2019s complexity and amount of data required. Deep learning training and the application of large models happen against immense amounts of data in the cloud, which offers the scale to efficiently train deep learning models and apply them en masse, while smaller machine learning models run at the edge directly on edge devices where they take advantage of local data for immediate engagement and interaction.<\/p>\n

      And the AI system also benefits greatly from being part of a single data technology ecosystem because it uses the same database, queries and APIs across the stack, making development and ongoing maintenance much easier than with a\u00a0sprawling<\/a>\u00a0mashup of disparate database technologies.<\/p>\n

      Edge computing is a necessity for AI to realize its full promise today and in the future, and Couchbase\u2019s edge native, AI-ready modern database is ready to help forge the next big advancement.<\/p>\n

      Learn more about Couchbase AI capabilities:<\/p>\n