Migrating large, complex datasets from Hugging Face to Couchbase just got easier. Whether you prefer working from the command line or within your favorite IDE, our new Hugging Face to Couchbase migration toolkit—featuring the Couchbase VS Code Extension y el cbmigrate CLI —simplifies and streamlines the process.
Introducing the Hugging Face-to-Couchbase migration tools
Our toolkit for migrating Hugging Face datasets to Couchbase includes two core components, optimized for different development workflows:
- Couchbase VS Code Extension
- CLI Tool (cbmigrate hugging-face)
Whether you’re a command-line purist or an IDE enthusiast, we have you covered!
1. Couchbase VS Code extension
Prefer a graphical interface within VS Code? Our Couchbase extension enables seamless dataset migration directly from your IDE.
Características principales
- Integrated migration: Perform dataset migrations within VS Code, streamlining your workflow.
- User-friendly interface: Use a graphical UI to configure and monitor data migration processes effortlessly.
For more details, refer to the Couchbase VS Code plugin repository.
2. Command-line tool: cbmigrate hugging-face
For developers who prefer the terminal, the hugging-face subcommand of cbmigrate provides a powerful and efficient way to migrate Hugging Face datasets to Couchbase.
Características principales
- Easy dataset exploration: List configurations, splits, and fields within Hugging Face datasets before committing to a migration.
- Flexible migration: Supports streaming, batch processing, and custom document ID generation.
- Security & privacy: Supports authentication for private datasets and secure Couchbase connections.
Usage
List dataset configurations
|
1 |
cbmigrate hugging–face lista–configs —path <DATASET_PATH_OR_NAMEEl resultado de tu pregunta se muestra a continuación: |
List dataset splits
|
1 |
cbmigrate hugging–face lista–splits —path <DATASET_PATH_OR_NAMEEl resultado de tu pregunta se muestra a continuación: |
List dataset fields
|
1 |
cbmigrate hugging–face lista–fields —path <DATASET_PATH_OR_NAMEEl resultado de tu pregunta se muestra a continuación: |
Migrate dataset to Couchbase
|
1 2 3 |
cbmigrate hugging–face migrate —path <DATASET_PATH_OR_NAMEEl resultado de tu pregunta se muestra a continuación: —identificación–fields <FIELD1,FIELD2,...El resultado de tu pregunta se muestra a continuación: —cb–url Couchbase://<HOST> –cb-username <USERNAME> –cb-password <PASSWORD> —cb–cubeta <BUCKET_NAMEEl resultado de tu pregunta se muestra a continuación: —cb–alcance <SCOPE_NAMEEl resultado de tu pregunta se muestra a continuación: —cb–colección <COLLECTION_NAMEEl resultado de tu pregunta se muestra a continuación: |
Example: simple migration of a public dataset
|
1 2 3 |
cbmigrate hugging–face migrate —path glue —split train —identificación–fields índice —cb–url Couchbase://localhost –cb-username Administrator –cb-password password —cb–cubeta sample_bucket —cb–alcance sample_scope —cb–colección sample_collection |
For more information, visit the cbmigrate GitHub repository.
Deja un comentario
Lo siento, debes estar conectado para publicar un comentario.