Using Couchbase Shell to Transform and Write Data

I recently had the chance to go to Riviera Dev, a fantastic developer conference taking place near the French Riviera. Couchbase sponsored the conference, we brought organic, local, goat milk ice-cream. People were happy, talks were interestings, SWAG was given out. It was an amazing conference.

When we sponsor conferences with such activities, we usually ask attendees if we can scan their badges to send them some Couchbase updates. So we did. And sometimes the information is easy to recover, sometimes it’s a bit tricky. Here, the QR code contained a VCard. Their purpose is to hold contact information, precious information – as you know, scans are the currency of conferences. It’s what allows us to come back the following year with even more ice cream.

Anyway, we ended up collecting a lot of VCards but it was hard to put them in the ubiquitous marketing format, CSV. So what do you do when you need to manipulate data? You use Couchbase Shell.

Couchbase Shell, Shell Yeah!

Couchbase Shell (cbsh) is a modern, productive, and fun shell for Couchbase Server and Capella (our cloud DBaaS). The source code and instructions to install it are available on the repo Readme.

I personally installed it by cloning and building it:

You need to have the Rust toolchain installed, because Couchbase Shell is written in Rust, and based on my favorite shell, 누쉘.

Once installed, you can run it by typing cbsh. It will ask you to configure a Couchbase connection first. If you are using the Capella management interface, you will get all required information in the Connect tab.

 

Nushell <3 JSON

For the record, this is what my VCard looks like:

There are plenty of node libraries to turn this to JSON, I have used vcard-json. So if I run node de vcard2json.js, I get a JSON array with all VCard content as a JSON object.

Which is great but how can this be manipulated easily? Cbsh being based on nushell, we get all the good things that come with it, like the from json command, or the where filter, and the JSON select. So let’s see how it would work step by step, with the structured data output, also courtesy of nushell:

 

 

 

 

Now that the data is ready and cleaned-up, what can I do with it ? I could write this to a CSV file like this:

I could also write it to Couchbase. I have my credential all set already. The first command chooses the bucket and default scope and collection. The second one iterates through the JSON array, generates a random UUID, wraps the content under a content column and adds an ID column with the generated UUID, then inserts the result in Couchbase.

 

And just to make sure it’s working, the data can be queried with SQL++ directly:

So there you are, a practical example of using Couchbase Shell to manipulate Data, transform it and import it to Couchabse. But there are plenty of other uses for it! What’s your favorite?