Events:
<p>
<dl>
<a name="1229701771.0.6"></a>
<dt> 2008-12-19 at 16:46

 [xxx (lucidor)]
<dd> The central switch of the Lucidor interconnect has had a critical hardware failure. As a consequence the queue on Lucidor is halted.  Lucidor is not expected to be available for parallel jobs again until 12/1 at best.

<!-- dah -->

<a name="1229637411.0.6"></a>
<dt> 2008-12-18 at 22:55

 [xxx (lucidor)]
<dd> The reason for not having any available nodes on lucidor is that the myricom network seem to have been down for the past 24 hours. We are sorry for the inconvenience.



<!-- lama -->

<a name="1229278306.0.0"></a>
<dt> 2008-12-14 at 19:09

<dd> Ekman: The node running the scheduler probably has a hardware fault. Any request to the batch-system will be stuck in a queue and not processed until the scheduler-node is on-line again.

<!-- lama -->

<a name="1228288962.1.0"></a>
<dt> 2008-12-03 at 08:18

<dd> forwarded/informational: components of KTH networks will be upgraded 2008-12-04, starting at 19:00. Minor interrupts might occur.



<!-- lama -->

<a name="1227194776.0.0"></a>
<dt> 2008-11-20 at 16:20

<dd> Jobs are now running on the clusters again after restoring the AFS-volumes from backup to another server. Please report anything that seems strange.

<!-- slas -->

<a name="1227118507.0.0"></a>
<dt> 2008-11-19 at 19:12

<dd> update: the afs-server is a good way into being restored from tape.

<!-- lama -->

<a name="1227091847.0.0"></a>
<dt> 2008-11-19 at 11:48

<dd> further info - a disk within a raid broke, during recovery (rebuilding raid using raid spare disk) a second disk did fail and the raid become in-operational. We will try a manual salvage of the raid first, and if that fails need to restore contents from backup.

<!-- lama -->

<a name="1227090289.0.0"></a>
<dt> 2008-11-19 at 11:24

<dd> possible afs-problem, all node allocation suspended.



<!-- lama -->

<a name="1226662782.0.0"></a>
<dt> 2008-11-14 at 12:37

<dd> The queue on Ferlin has now been started again.

<!-- slas -->

<a name="1226650363.0.0"></a>
<dt> 2008-11-14 at 09:11

<dd> The ferlin system is temporarily stopped due to problems with the ethernet switch-setup.

<!-- dah -->

<a name="1226494517.0.0"></a>
<dt> 2008-11-12 at 13:54

<dd> Network patching finished for now. Resuming job-start on all systems.



<!-- lama -->

<a name="1226472937.0.7"></a>
<dt> 2008-11-12 at 07:54

 [xxx (lenngren)]
<dd> Problems with mpi-licenses after network break-down. All node-allocation paused on lenngren/lise and lenngren/juliana.



<!-- lama -->

<a name="1226437251.0.6"></a>
<dt> 2008-11-11 at 22:00

 [xxx (lucidor)]
<dd> Cluster closed due to network problems.



<!-- lama -->

<a name="1226430702.0.0"></a>
<dt> 2008-11-11 at 20:10

<dd> Exteme Networks router pdc1-gw did crash again after Cygate sent defect and too few replacement parts.



<!-- haba -->

<a name="1225829126.0.0"></a>
<dt> 2008-11-04 at 20:59

<dd> This is for the PDC users that have their $HOME directory on one of CSCs AFS servers _only_: CSC reports problems with _one_ of their AFS servers, if your $HOME directory was there, your job(s) have probably crashed. /PDC staff on behalf of CSC staff.



<!-- haba -->

<a name="1225829097.0.0"></a>
<dt> 2008-11-04 at 21:04

<dd> forward information for CSC users: One of the AFS filservers at CSC is out of order, work to solve the problem is in progress.

<!-- lama -->

<a name="1225703851.0.7"></a>
<dt> 2008-11-03 at 10:15

 [xxx (lenngren)]
<dd> Infiniband now restarted, and a few 'black-hole' nodes also removed. Jobs allowed to start again. In case your job experience unexpected problems, please report.



<!-- lama -->

<a name="1225643334.0.0"></a>
<dt> 2008-11-02 at 17:12

<dd> Problems with a router caused PDC networks to break. Connections within, to and from PDC broken. Many running jobs requiring network most certainly damaged.



<!-- lama -->

<a name="1225449823.0.7"></a>
<dt> 2008-10-31 at 11:39

 [xxx (lenngren)]
<dd> The batch system on Lenngren is halted because of infiniband instabilities resulting in lots of crahsed jobs. This may be a result of this weeks power outage. Therefore no jobs will be run on Lenngren until earliest on Monday.









<!-- haba -->

<a name="1225312308.0.0"></a>
<dt> 2008-10-29 at 21:28

<dd> And all sections of lenngren on-line again. All systems shold be considered working 'as usual' from now on. In case you find anything not working as expected, please report it to support.

<!-- lama -->

<a name="1225296138.0.0"></a>
<dt> 2008-10-29 at 17:01

<dd> Ferlin now back online. Lucidor (aka luc2) back online since a couple of hours.

<!-- lama -->

<a name="1225273596.0.0"></a>
<dt> 2008-10-29 at 10:45

<dd> Power restored. Now initiating the process to salvage systems. 

<p>  The cause of the UPS shutdown was an overheat condition. Currently it is not

     clear if the UPS failed and caused the room to overheat or the room cooling

     failed and caused the UPS to overheat first. Shutdown temperature was 42deg 

     Celsius which lower than the specified maximum temperature of the UPS. 

     Several rectifier modules in the UPS are broken and have to be replaced. 

     Eaton is shipping replacement parts.

     Until the UPS is operational again, it is bypassed and all calculation 

     nodes are directly on the KTH power distribution. All servers are on 

     a second seperate UPS system, too.

<!-- lama -->

<a name="1225266120.0.0"></a>
<dt> 2008-10-29 at 08:40

<dd> Due to a major power failure, most PDC systems are currently unavailable. Investigation is in progress and more information will be forthcoming.

<!-- dah -->

<a name="1225263373.0.0"></a>
<dt> 2008-10-29 at 07:55

<dd> One afs-server seem gone. Major impact on several systems.



<!-- lama -->

<a name="1223885426.0.0"></a>
<dt> 2008-10-13 at 10:09

<dd> afs-server trevally.pdc.kth.se experienced a kernel panic early this morning. It has now been restarted and salvaged. 

<!-- lama -->

<a name="1223673548.0.0"></a>
<dt> 2008-10-10 at 23:13

<dd> Ferlin: the login-node has been hung since around 1730 today. It was just power-cycled and then at least came online again.



<!-- lama -->

<a name="1223567961.0.8"></a>
<dt> 2008-10-09 at 17:57

 [xxx (Hebb)]
<dd> The whole machine is now fully functional again.



<!-- slas -->

<a name="1222861855.0.4"></a>
<dt> 2008-10-01 at 13:49

 [xxx (HSM)]
<dd> The tape library and the HSM is now fully functional again.

<!-- slas -->

<a name="1222858000.1.0"></a>
<dt> 2008-10-01 at 12:43

<dd> Storage update: After 2 1/2 days of work, IBM managed to get the tape library online again. The HSM and TSM systems that access the library are restared and should be fully operational. Please report further problems that we might have missed.

<!-- haba -->

<a name="1222708521.0.0"></a>
<dt> 2008-09-29 at 19:00

<dd> The automatic tape library controller PC is still fried. IBM will continue the service tomorrow when more and hopefully better parts arrive at around lunchtime. So unfortunately no ETA on a fixed library yet.

<!-- haba -->

<a name="1222447544.0.0"></a>
<dt> 2008-09-26 at 18:42

<dd> The automatc tape library has a permanent power failure.

<br>

IBM service notified, repair will start monday.

<br>

HSM availabibity degraded.





<!-- haba -->

<a name="1221906365.1.0"></a>
<dt> 2008-09-20 at 12:24

<dd> redistributed information: Maintenance work on some CSC servers will be performed on Saturday 20 September starting at 10 am. Most UNIX computers at this time. Services like email and www will also be affected.

<!-- lama -->

<a name="1219738245.0.0"></a>
<dt> 2008-08-26 at 10:04

<dd> The AFS server glycine crashed again this morning. Most of it is back on-line again, but unfortunately one of the partitions is still down due to filesystem inconsistencies.

<!-- slas -->

<a name="1219653257.0.0"></a>
<dt> 2008-08-25 at 10:32

<dd> The AFS server glycine is currently restarting after a crash. It will take some time for the filesystem consistency check to complete before the volumes are available again.

<!-- slas -->

<a name="1219243134.1.8"></a>
<dt> 2008-08-20 at 16:36

 [xxx (Hebb)]
<dd> Hebb will be unavailable Thursday-Friday this week due to it being moved. The whole system will be shutdown at 08:00 Thursday, and available again as soon as the move is complete.

<!-- slas -->

<a name="1218794538.1.7"></a>
<dt> 2008-08-15 at 11:55

 [xxx (lenngren)]
<dd> The PDC Intro. to HPC Summer School will be held August 18-29. The students will have higher priority on Lenngren during MPI exercises in the second week. Exercises are always held during office hours. 

<!-- ulfa -->

<a name="1218632019.0.7"></a>
<dt> 2008-08-13 at 14:52

 [xxx (lenngren)]
<dd> The log in node, lise.pdc.kth.se, will be rebooted today at 15:00 due to kernel problems.

<!-- slas -->

<a name="1217858020.0.8"></a>
<dt> 2008-08-04 at 15:52

 [xxx (Hebb)]
<dd> Hebb was reboot recently because of one midplane acting strange. The whole system is now up and running again.



<!-- slas -->

<a name="1217247538.0.3"></a>
<dt> 2008-07-28 at 14:15

 [xxx (SBC / CBR)]
<dd> Impact: All users with files on server glycine.

<p>

During debugging of an overload condition on fileserver glycine, the server aborted (crashed) after delivering some debug information.

<p>

Currently salvaging file systems on glycine. Typical duration: 50minutes.





<!-- haba -->

<a name="1216369858.0.0"></a>
<dt> 2008-07-18 at 10:29

<dd> The login node of the ferlin cluster was restarted at 10:15 without prior warning due to a handling error. It should be back again now. We apologise for any inconvenience caused.

<!-- dah -->

<a name="1216284279.1.0"></a>
<dt> 2008-07-17 at 10:43

<dd> During July and beginning of August PDC support will be low on staff, but available for your questions during office hours as usual! Please take into account that response times during this period might therefore be longer than what you are commonly used to.



We hope that our users will respect that we will answer all questions, one at a time, and that you do not need to re-send your questions in hope of more attention. We at PDC support wish all our users a very relaxing Summer!



<!-- PDC support -->

<a name="1216208069.0.3"></a>
<dt> 2008-07-16 at 13:30

 [xxx (SBC / CBR)]
<dd> Followup to previous message:
<br>

 The reason for the downtime was the combination of network

 problems and broken software (rdisc) which could not recover

 from the outage.
<br>

Status:
<br>

 ~200 nodes up again, more will follow
<br>

 Easy restarted
<br>

 Only "itchy" login node available yet
<br>

Please report possible problems we have not seen (yet).



<!-- haba -->

<a name="1216195956.0.3"></a>
<dt> 2008-07-16 at 10:11

 [xxx (SBC / CBR)]
<dd> Most of system unavailable. Investigating.



<!-- haba -->

<a name="1215969998.0.8"></a>
<dt> 2008-07-13 at 19:12

 [xxx (Hebb)]
<dd> After some additional disturbance in the system during the weekend, one midplane is now unavailable and will probably stay so the whole of next week.

<!-- slas -->

<a name="1215623714.0.8"></a>
<dt> 2008-07-09 at 19:13

 [xxx (Hebb)]
<dd> One node card unavailable. No ETA on replacement yet.

<!-- slas -->

<a name="1214479780.0.7"></a>
<dt> 2008-06-26 at 13:27

 [xxx (lenngren)]
<dd> The log in node, lise.pdc.kth.se, was restarted due to running out of resources. Everything is now running again.

<!-- slas -->

<a name="1213867620.1.0"></a>
<dt> 2008-06-19 at 11:25

<dd> On Friday June 20th, the PDC helpdesk will be closed for Midsummer's Eve but we will be back to handle your support requests on Monday morning.

<!-- selander -->

<a name="1213784177.0.6"></a>
<dt> 2008-06-18 at 12:15

 [xxx (lucidor)]
<dd> Network (causing afs-problems) modified. Node allocation resumed.

<!-- lama -->

<a name="1213722392.0.6"></a>
<dt> 2008-06-17 at 19:06

 [xxx (lucidor)]
<dd> afs problems on lucidor; scheduling off-line.



<!-- lama -->

<a name="1213088167.0.0"></a>
<dt> 2008-06-10 at 10:52

<dd> The network has now been stable for a day and we have re-enabled the allocation on Lenngren (lise, juliana), Lucidor-II, and the SBC-cluster. However, please report any oddities to us.



Note that Ferlin still is off the network since it, in fact, was Ferlin that toppled the network in the first place. Some further investigation remains before Ferlin will be back online.

<!-- selander -->

<a name="1213014935.0.0"></a>
<dt> 2008-06-09 at 14:34

<dd> The persisting problem with the network has been pinpointed and fixed. The network should be back to normal.

<!-- selander -->

<a name="1212691625.0.0"></a>
<dt> 2008-06-05 at 20:46

<dd> All allocation paused due to (internal?) network hickups.



<!-- lama -->

<a name="1212691613.0.0"></a>
<dt> 2008-06-05 at 20:43

<dd> Network problems affecting all systems. Everything might not be back until after the weekend.

<!-- slas -->

<a name="1209111977.1.0"></a>
<dt> 2008-04-25 at 10:19

<dd> PDC's helpdesk will close at lunchtime Wednesday April 30th and reopen again on Monday May 5th - due to Walpurgis Night[1], Labour Day[2], and a so calles "squeeze day"[3]. We hope the bugs and problems will take these days off, too.



[1] http://en.wikipedia.org/wiki/Walpurgis_Night

[2] http://en.wikipedia.org/wiki/Labour_day

[3] http://www.kth.se/ict/anstallda/personal/1.9081

<!-- selander -->

<a name="1206466178.1.8"></a>
<dt> 2008-03-25 at 18:28

 [xxx (Hebb)]
<dd> The system is now fully functional again, with one new node card and two new CPU cards.

<!-- slas -->

<a name="1206440492.1.8"></a>
<dt> 2008-03-25 at 13:00

 [xxx (Hebb)]
<dd> One CPU card will be changed today between 13-15.

<!-- slas -->

<a name="1205941315.1.0"></a>
<dt> 2008-03-19 at 16:38

<dd> The PDC helpdesk closes for the Easter Holiday 12.00 on Thursday March 29th and reopens again on Tuesday morning. Happy holidays!

<!-- ulfa -->

<a name="1203269375.0.0"></a>
<dt> 2008-02-17 at 18:05

<dd> We are currently having problems with one of our routers. Until this issue has been resolved network connectivity to and to some extent within PDC may be erratic.

<!-- dah -->

<a name="1203003194.0.3"></a>
<dt> 2008-02-14 at 16:30

 [xxx (SBC / CBR)]
<dd> It looks like it will take the whole evening to get the SBC AFS-servers back on track. We apologise for any inconvenience. 

<!-- selander -->

<a name="1202997722.0.3"></a>
<dt> 2008-02-14 at 15:00

 [xxx (SBC / CBR)]
<dd> SBC AFS-servers valine and glycine are acting up. 

Investigation is in progress.

<!-- selander -->

<a name="1201724642.0.0"></a>
<dt> 2008-01-30 at 21:19

<dd> Informational: mail1.kth.se has been down for large parts of today, and is expected to be down until at least tomorrow. Mail delivery to it will be delayed. Many, but not all, of pdc employees uses it to read mail. Their response time could be longer than usual.



<!-- lama -->

<a name="1201082893.0.0"></a>
<dt> 2008-01-23 at 11:06

<dd> forwarding CSC info: Maintenance work on some CSC servers will be performed on Saturday January 26 starting at 9 am. Most UNIX computers at CSC will be heavily affected during this time. Services like email and www will also be affected.



<!-- lama -->

</dl>
All flash news for 
<a href="/cgi-bin/flash/flash.py?year=2024">2024</a>, 
<a href="/cgi-bin/flash/flash.py?year=2023">2023</a>, 
<a href="/cgi-bin/flash/flash.py?year=2022">2022</a>, 
<a href="/cgi-bin/flash/flash.py?year=2021">2021</a>, 
<a href="/cgi-bin/flash/flash.py?year=2020">2020</a>, 
<a href="/cgi-bin/flash/flash.py?year=2019">2019</a>, 
<a href="/cgi-bin/flash/flash.py?year=2018">2018</a>, 
<a href="/cgi-bin/flash/flash.py?year=2017">2017</a>, 
<a href="/cgi-bin/flash/flash.py?year=2016">2016</a>, 
<a href="/cgi-bin/flash/flash.py?year=2015">2015</a>, 
<a href="/cgi-bin/flash/flash.py?year=2014">2014</a>, 
<a href="/cgi-bin/flash/flash.py?year=2013">2013</a>, 
<a href="/cgi-bin/flash/flash.py?year=2012">2012</a>, 
<a href="/cgi-bin/flash/flash.py?year=2011">2011</a>, 
<a href="/cgi-bin/flash/flash.py?year=2010">2010</a>, 
<a href="/cgi-bin/flash/flash.py?year=2009">2009</a>, 
<a href="/cgi-bin/flash/flash.py?year=2008">2008</a>, 
<a href="/cgi-bin/flash/flash.py?year=2007">2007</a>, 
<a href="/cgi-bin/flash/flash.py?year=2006">2006</a>, 
<a href="/cgi-bin/flash/flash.py?year=2005">2005</a>, 
<a href="/cgi-bin/flash/flash.py?year=2004">2004</a>, 
<a href="/cgi-bin/flash/flash.py?year=2003">2003</a>, 
<a href="/cgi-bin/flash/flash.py?year=2002">2002</a>, 
<a href="/cgi-bin/flash/flash.py?year=2001">2001</a>, 
<a href="/cgi-bin/flash/flash.py?year=2000">2000</a>, 
<a href="/cgi-bin/flash/flash.py?year=1999">1999</a>, 
<a href="/cgi-bin/flash/flash.py?year=1998">1998</a>, 
<a href="/cgi-bin/flash/flash.py?year=1997">1997</a>, 
<a href="/cgi-bin/flash/flash.py?year=1996">1996</a>, 
<a href="/cgi-bin/flash/flash.py?year=1995">1995</a>
<br><br><a href="https://www.pdc.kth.se/">Back to PDC</a>
<br><a href="https://www.pdc.kth.se/cgi-bin/flash/rss.py">Subscribe to rss</a>