Presentations

PayPal: Creating a Central Data Backbone: Couchbase Server to Kafka to Hadoop and Back

PayPal: Creating a Central Data Backbone: Couchbase Server to Kafka to Hadoop and Back

Running a site like PayPal requires both huge scale and a lot of processing to support a complex growing business. Over time, the PayPal business faces a challenge in managing the user information required to run PayPal services. By leveraging Couchbase Server, the PayPal Data Service team is able to accommodate fast access to user information at scale while streaming data into Hadoop. The solution is able to process millions of updates a minute while leveraging Kafka’s high throughput capabilities to get this user data into the Hadoop cluster.