How to Import and Export Data in TSD
Go directly to Data import and export
- Only project administrators, or those appointed by them, can export data, while any member can import data. Find information about how project admins can order import/export privilege changes here.
- Sensitive data must be encrypted before import/export. If your data is sensitive and non-encrypted, please encrypt before exporting data.
It is important that the file name will respect few important rules:
- First character can be any number, character, hyphens or underscores excluding "." (namely 0-9a-zA-Z_- )
- Subsequent characters may be any number, character, hyphens or underscores including "." (namely 0-9a-zA-Z_-. )
- You can use the Norwegian characters æøåÆØÅ
- You can not use spaces, other special characters or other alphabets (cyrillic, etc.).
How to import and export data using the web file transfer
The imported data is stored in file-import folder of the durable volume of your project - /tsd/pXX/data/durable/file-import/pXX-member-group.
External Import Grants
The Project Administrator of a TSD-project can give Import Grants to external partners who do not have a TSD user account in the relevant project. Please follow this link to assign External Import Grants.
The exported data is read from the file-export folder of the durable volume of your project - /tsd/pXX/data/durable/file-export.
Using the API via the command line client
To upload and download files and folders from the command line, researchers can use the tsd-api-client. This use the file API, which is available to all projects by default. There are no limits on file sizes, and uploads and downloads are resumable by default. It is also supports incremental directory synchronisation for uploads and downloads. To install the tool:
pip3 install tsd-api-client --upgrade
Transferring data from closed hospital networks
Note: we will soon replace the fx03 solution with the API, and will be in contact with all users of the fx03 service to enable the transition.
We have designed the fx03 solution to allow import and export of non-encrypted sensitive data from sites where there is a control of the network from end to end. We have established fx03 solution with the following end-sites:
- OUS - AMG/NSC Ullevål (ull-gen-c2960g port 19 og 20)
- OUS - Radium (radium-c2960g port 1-4
- UIO - NSC (bioe-9-sw port 12)
To set up the connection initially
- Check that you have the folders /fx/import_alt/ and /fx/export_alt in your TSD file system. These are the folders connected to fx03.
- Find the MAC adress of the server(s) you wish to hook up and send these MAC adresses to firstname.lastname@example.org.
- After getting the OK from TSD, please hook up your server to the correct port number in the switch and try connecting sftp to tsd-fx03.tsdintern.
- You can now transfer files, preferrably by creating a Tar/Zip file first.
- An important part of the security of FX03 data transfer is that the traffic is sftp encrypted between the project and TSD.
- The ECDSA key fingerprint is ae:bc:70:e2:1c:d2:80:ee:e4:3b:5e:2a:51:1d:60:6f.
- If projects see other fingerprints, please contact email@example.com and stop any transfer of data.
How to encrypt files
This is only for TSD users using Windows on the inside and outside of TSD:
- Download and install 7-Zip.
- Start the 7-Zip program.
- Disconnect your computer from the internet (the best is to disable Wifi and unplug the internet cable).
- Attach the storage with your sensitive data.
- Add files into the 7-Zip.
- Click next.
- Click encrypt files (this automatically writes files back to the same directory as the raw data was). NB! Be sure to tick off "Do not erase original data".
- Store encrypted files on computer somewhere that you are able to find later.
- Remove all attached storage devices with sensitive data, and sensitive files you stored on the computer before encryption.
- Connect to the internet, use the standard TSD "fil-sluse" to import data into TSD.
- Log in to TSD.
- Double-click your 7-Zip files.
- Type in your password and press decompress.
- Your files are decrypted.