Import and export data in TSD

Important Information

• Only project administrators, or those appointed by them, can export data.
• Any project member can import data.
• Always copy files out of the file-import folder before working on them, the file import will overwrite existing files if they are re-imported.

Encrypting files

If you use Windows as your TSD operating system, you can encrypt files before transferring, with 7-Zip.
Download 7-Zip here. 

How to encrypt with 7-Zip

1. Start 7-Zip.
2. Disconnect your computer from the internet - disable wifi and unplug the network cable(s).
3. Attach the storage with your sensitive data.
4. Add the desired files to your 7-Zip archive.
5. Click Next.
6. Click Encrypt Files. This automatically writes files back to the same directory where the raw data was. NB! Be sure to tick off Do not erase original data.
7. Store the encrypted files on your computer somewhere you are able to find them later.
8. Remove all attached storage devices with sensitive data, and any sensitive files you stored on the computer before encryption.
9. Connect to the internet, use TSD's data portal to import data to your TSD project area.
10. Log in to your remote TSD workstation.
11. Double-click your 7-Zip files.
12. Type in your password and use the Decompress  button.
13. Your files are decrypted.

The same procedure can be used to encrypt data using 7zip prior to exporting the files using TSD's data portal.

See the illustrated instructions in Norwegian. 

File naming conventions

Characters can be any number, letter, hyphens or underscores. The first character can not be a punctuation mark.

Importing files

You can import files to your TSD project area with TSD's dataportal for file import.
Log in to the data portal.

The imported files are stored inside the folder file-import in the project area data/durable, normally in a folder named after the group the files were imported with, for instance /tsd/p11/data/durable/file-import/p11-member-group.

Record audio and video

Video and audio from devices like web cameras and microphones can be captured and recorded live while being securely saved in the TSD project area, with TSD's media capture app.
Log inn to the media capture application.
More about using the application.

Import links for partners without a TSD account

The project administrator of a TSD project can give import grants to external partners who do not have a TSD user account in the relevant project. 

1. Log in to Selfservice and choose Manage external import links.

2. Click Create new link.

3. Choose which group the recipient shall belong to. You must also set an end date for uploading files and describe what the link shall be used for.

Optional properties let you set a start date for uploads, and define a maximum number of uploads and which sub directory the files will be stored in.

Importing register data from SSB

Once you have established contact with a representative from SSB for the delivery of register data to your TSD project you can create an import grant as explained above, and share the link with SSB.

Once you have logged in to the self service portal, you can name this link and set the receiving group to you personal user group. The uploaded data will then be accessible only to yourself.

Once you are satisfied with the link settings, you can display it, copy it, and share it with SSB.

Exporting Data

Files stored in the file-export folder of a project e.g. /tsd/p11/data/durable/file-export are available for download outside of TSD by all members of the file-export-group. The files are available in the data portal. Log in to the TSD data portal.

To download the files from the TSD data portal do the following:

1. Go to the TSD data portal and press Export Files.
2. Sign in with your TSD credentials corresponding to the project you want to export files from.
3. You can download the files by pressing their name that is marked in blue.

Requirements for using our data portal

Importing and exporting data via command line in our API

Use our tsd-api-client to export or import data from the command line.
Download the client here.

The tool relies on our file API which is available to all projects by default. There are no limits on file sizes, and uploads and downloads are resumable by default. The program also supports incremental directory synchronisation.

If you have admin right on your computer you might use the command  pip3 install tsd-api-client --upgrade in the command line. If you don't have admin rights, use pip3 install tsd-api-client --user --upgrade.

Data from restricted sites and networks - fx03

The fx03 solution was designed to allow import and export of unencrypted sensitive data from sites where the network between the user and TSD can be trusted (secure against eavesdropping on communications) end to end. The fx03 solution is set up with the following user sites:

Setup steps

1. Find the MAC address of the server(s) you wish to connect and send these MAC addresses to tsd-drift@usit.uio.no.
2. After getting the OK from TSD, install the tsd-api-client as described above.

SSH fingerprint

• Fx03 traffic is encrypted in transit between the other network and TSD.
• The ECDSA key fingerprint of the fx03 host is ae:bc:70:e2:1c:d2:80:ee:e4:3b:5e:2a:51:1d:60:6f.
• If you encounter a different fingerprint, this may be a security incident — please refrain from any data transfers and contact tsd-drift@usit.uio.no for resolution.