Database integration
The Scientific Data Warehouse (SDW) is the Data Platform in Nuvolos
Last updated
Was this helpful?
The Scientific Data Warehouse (SDW) is the Data Platform in Nuvolos
Last updated
Was this helpful?
Nuvolos is not just an online computer lab, it is also an online data platform. We offer strong data integration to support modern research and education use cases that rely on large amounts of data.
As a data platform, Nuvolos integrates strongly with both online (Nuvolos based) and offline (non-Nuvolos based) applications. Please review our to learn more. Nuvolos also offers the ability to define data pipelines, and ingest data from various sources. Please reach out to our for more information.
In this documentation, we will regularly refer to the data platform service as the Scientific Data Warehouse (SDW). The Scientific Data Warehouse is built on the service, you can refer to the Snowflake SQL documentation .
Nuvolos users automatically get an account on the SDW once they have access to a space with tables enabled. Whenever you're interacting with the SDW, a connector first connects to the Snowflake service using some credentials. To follow industry best practices regarding data security, Nuvolos offers 2 connection modes for SDW accounts:
In this mode, connection is done based on a username and an RSA key, and connecting to the SDW is only allowed from within Nuvolos. Nuvolos applications receive the RSA key automatically. Consult the on how to work with the SDW.
While it is highly unlikely that such an RSA key gets compromised, it is possible to rotate the RSA key in the menu. You'll need to restart running Nuvolos applications to receive the rotated key.
In this mode, connecting to the SDW is possible from both within and outside Nuvolos. Connections are done using
username and an RSA key from within Nuvolos. Nuvolos applications receive the RSA key automatically. Consult the on how to work with the SDW.
username and token from outside Nuvolos. After switching to User mode, please visit first and log in with your username and access token. On this site, you'll be asked to set up multi-factor authentication (MFA) using a smartphone. From then on, you can connect to the SDW using username and access token from any connector, however connection attempts need to be approved on the MFA-linked smartphone. Consult the on how to work with the SDW.
Nuvolos differentiates two types of data:
Tabular data stored in some database management system
Data stored in regular files
Datasets are special kinds of spaces, with the main goal of containing only tabular data and documentation related to that tabular data and potentially other descriptor files. For obtaining a full list of the datasets available to you in your current organisation, navigate to your dashboard, and pick the datasets menu.
Suppose that your project is called 'Demo research project' and you need two tables from the 'Correlation Risk Proxy' dataset.
Using the distribute feature, you can set your research project up with the required data:
Once the distribution has completed, you will receive an e-mail to your account you registered with. If the distribution was successful, the data should be available in the instance you distributed to.
You will now be able to work with data in your workspace, without having to worry about backing up your data and causing inadvertent changes.
Please follow our detailed guides:
Every user can change their SDW connection mode anytime in the menu. By default, new users are created with Service mode, but you can change back and forth between Service and User mode.
This page describes working with tabular data. For working with files, consult to the file system.
Datasets consist of immutable . Datasets are to be used as sources of distribution, not to directly work in.
The helps you explore and write basic queries against tables.
Once the structure of data is clear, we suggest with data.
Some demonstrate the power of Nuvolos.
