[AGKetzer-ALICE] Fwd: urgent: shutdown of hera - users have to transfer their data to nyx

[Silvia Masciocchi]

Reminder to everybody who has files on hera!
Cheers
Silvia


-------- Original Message --------
Subject: 	urgent: shutdown of hera - users have to transfer their data 
to nyx
Date: 	Wed, 14 Sep 2016 14:23:17 +0000
From: 	Malzacher, Peter <P.Malzacher at gsi.de>
To: 	fsp-alice at physi.uni-heidelberg.de <fsp-alice at physi.uni-heidelberg.de>



Dear all,

as you know the GSI farm prometheus has been shut down end of June. The 
lustre filesystem hera will be shut down end of September. All userdata 
which is still needed has to be saved.

No user directories /hera/<userid> will be copied to nyx by default. 
That is the responsibility of the user. Supervisors should clarify 
whether important data from former group members need to be saved. 
  Please be aware that we have still less space on nyx. The current 
quota on nyx is 600TB on hera we used 705TB. So if possible copy only 
what is really needed.

All alice kronos users have the permission to create a directory under 
/lustre/nyx/alice/users. Use your userid as top directory: 
/lustre/nyx/alice/users/<userid>.

To copy data to nyx there are special boxes which have both systems 
mounted: lxheranyxdm01 -- lxheranyxdm08. If one is not up try another. 
You see hera and nyx under

/lustre/hera and /lustre/nyx. You can use your favorable linux copy tool 
to copy files from hera to nyx. To transfer huge amounts of files 
parallel rsync works best.

Example:

1)

cd /lustre/hera/alice/peter

2)

delete everything you do not want to copy

3 a)

find * | parallel -j16 rsync -vlptgoDAXdRqW {} /lustre/nyx/alice/users/peter

will copy everything to nyx

3 b)

find dir1 dir2 | parallel -j16 rsync -vlptgoDAXdRqW {} 
/lustre/nyx/alice/users/peter

will copy dir1 & dir2

3 c)

find simulation --name *.root | parallel -j16 rsync -vlptgoDAXdRqW {} 
/lustre/nyx/alice/users/peter

will copy all files *.root from the directory simulation

The options of the rsync will copy all file attributes and be silent. If 
you want to see/log the progress, remove the 'q' from the options.

find simulation --name *.root | parallel -j16 rsync -vlptgoDAXdRW {} 
/lustre/nyx/alice/users/peter

Cheers

Peter Malzacher



-------------- nächster Teil --------------
Ein Dateianhang mit HTML-Daten wurde abgetrennt...
URL: <https://lists.hiskp.uni-bonn.de/pipermail/agketzer-alice/attachments/20160930/06f98a62/attachment-0006.htm>