Norwegian version of this page

TSD Operational Log

Published May 6, 2022 1:20 PM

We are doing network maintenance in TSD Monday-Tuesday 23/05/2022-24/05/2022.

No downtime is expected but interruptions may occur. 

Published May 2, 2022 1:47 PM

The matlab license on Linux hosts expired. We are working to solve the problem as quickly as possible.

Published Mar. 11, 2022 3:45 PM

Colossus will have downtime Wednesday 2022-03-16 from 08:00-16:00. We have set a maintenance reservation on the Slurm controller for this period.

Any jobs that cannot be scheduled and completed before the downtime will remain pending and report "ReqNodesNotAvail, reserved for maintenance", until after the downtime, when they will be rescheduled and resumed automatically.

During the downtime we advice you to keep an eye on this operational log for any updates.

Published Mar. 4, 2022 8:15 AM

Login to TSD is currently unavailable.
We are working to solve the problem as quickly as possible.
Our apologies for the inconvenience.

-- 
The TSD Team

Published Feb. 28, 2022 12:35 PM

Consent and Publication internal portals are not available. Investigation is in progress …

Published Feb. 17, 2022 9:38 AM

The Slurm controller on Colossus was unresponsive between approximately 01:00 and 09:15 on February 17th.

The issue has been resolved, but we advice users that had running jobs during this time frame to check their job logs for issues.

Published Jan. 25, 2022 12:18 PM

Resolved

Published Jan. 20, 2022 12:36 PM

We will be performing an upgrade of the Horizon view infrastructure on Thursday February 3rd at 12:00. We expect this to take no more than 2 hours. We will update this message and send out an email once the upgrade is complete. 

Login through view.tsd.usit.no will be down during the downtime. The project machines will not be affected, so any existing sessions you have will still be there when you log back on after the downtime.

Published Jan. 19, 2022 2:12 PM

Due to a software error, the Windows access of some users was extended past the period to which the project Administrator has approved. Now this is corrected. If you have lost your Windows machine access, please contact your project administrator to add you to the appropriate group. 

Published Dec. 16, 2021 9:00 AM

f4transkript is currently not available in TSD-projects.

We are working to solve the problem as quickly as possible.
Our apologies for the inconvenience.

Published Dec. 6, 2021 9:28 AM

We will be performing network maintenance on Monday 13/12/21 at 12:00, the downtime will last 10-15mins.

We do not expect any downtime, but there might be some interruptions. 

Published Nov. 8, 2021 10:58 AM

Between approximately 10:00 and 10:30, the module load command did not work on the submit hosts and Colossus nodes. Please resubmit any jobs that may have failed. This has been resolved.

Published Nov. 8, 2021 8:59 AM

We will be performing maintenance on view-ous.tsd.usit.no on Tue 16/11 12:00.

The downtime will last about an hour.

Published Oct. 20, 2021 10:57 AM

BankID is having planned maintenance downtime on Thursday 2021-10-21 00:01–08:01, and will not be usable for authentication while this work is ongoing.

For TSD, this means that login to TSD Selfservice via BankID and authentication to Nettskjema forms using BankID will be unavailable in the above specified timeframe.

For further information please see Digdir's downtime notice:
https://status.digdir.no/incidents/pnlr6gn69dy4

-----

Update: BankID for mobile is working again. BankID with “kodebrikke” is still unavailable. This will also be unavailable on Oct 23

Published Oct. 15, 2021 8:34 AM

Login to TSD is currently unavailable.
We are working to solve the problem as quickly as possible.
Our apologies for the inconvenience.

-- 
The TSD Team

Published Oct. 13, 2021 8:31 AM

Update 20:30: Maintenance on the ESS storage system has been completed and the submit hosts are available again. Some submit hosts have been rebooted.

Update 18:58: Computation on Colossus has been resumed.

Update 18:48: The downtime has been extended, since the final update will result in additional NFS hangs.

Update 16:20: The downtime will be extended by approximately 2 hours. There may be additional NFS hangs on hosts mounting /cluster during this period.

Update 16:00: The last few Colossus nodes are being upgraded. Colossus will resume after that.

Colossus will have downtime on Wednesday 13/10 due to third-party maintenance on the /cluster file system. The affects /cluster on Colossus as well as NFS mounts of /cluster on the submit hosts.

Submit hosts will experience intermittent NFS hangs across the day.

Any jobs submitted to Colossus that cannot completed before the scheduled downtime w...

Published Oct. 10, 2021 8:37 PM

Hosts mounting /cluster/projects/pXX and /cluster/software experienced several NFS hangs on Saturday 09/10 and Sunday 10/10. User processes accessing these shares were killed upon remounting the NFS mounts.

The issue has been resolved.

Published Oct. 7, 2021 10:22 AM

We will be performing maintennance on the horizon view login servers, the downtime is estimated to last 1 hour. 

https://view.tsd.usit.no and https://view-ous.tsd.usit.no will be unavailable during the downtime.

--

The maintennance is now complete.

Published Sep. 28, 2021 1:39 PM

Nettskjema will no longer automatically deliver encrypted JSON-files to all TSD-projects.

This will not affect the use of Dataloader.

If you still want to recieve encrypted JSON files for each submission, please notify tsd-drift@usit.uio.no

Published Sep. 27, 2021 3:37 PM

Colossus will have downtime on Wednesday 13/10 due to third-party maintenance on the /cluster file system. The affects /cluster on Colossus as well as NFS mounts of /cluster on the submit hosts.

Any jobs submitted to Colossus that cannot completed before the scheduled downtime will remain pending until after the downtime. They will be rescheduled automatically once the downtime ends.

During the downtime we advice you to keep an eye on our operational log for any updates.

 

Published Sep. 21, 2021 1:45 PM

VMware View is down. We are working on it.

Best

TSD

Published Sep. 17, 2021 8:15 AM

Login to TSD is currently unavailable.
We are working to solve the problem as quickly as possible.
Our apologies for the inconvenience.

-- 
The TSD Team

Published Aug. 23, 2021 9:57 AM

We are doing network maintenance on Monday 30/8.

We do not expect any downtime during the maintenance.

Published Aug. 9, 2021 3:11 PM

We're experiencing NFS hangs on data/durable and cluster which started at 14:15-15:00. We're actively working on a solution.

A few hosts were rebooted.

Published July 15, 2021 11:44 AM

Dragen has been updated to version 3.8.4 and new licenses have been installed.