Comment on page
Importing data on Nuvolos
How do you import data onto Nuvolos?
This page collects data import use-cases and best practices on how data may be transferred into Nuvolos.
Data pipelines can be loosely defined as a chain of processes that extract data from a source and store it in a pre-defined format in a target.
Sources could be:
Targets similarly could be:
In the case of Nuvolos, the targets generally are of three types:
To highlight, Airflow offers the user the ability to create a pipeline (defined as a directed acyclic graph) that combines multiple workload types (scripts of various languages, command line operations) and offers administrative tools for monitoring, failover, timetables, etc.
There are multiple options to upload files to Nuvolos:
If the data you want to have on Nuvolos is available at some link, there is no need to download to your machine and upload to Nuvolos. You can directly download the data to Nuvolos.
You might already have your data in some storage service. Most well-known storage services, including:
- Azure files
- Amazon S3
- Google Drive
We have provided detailed guidance on some relevant, non-trivial use-cases: