[AGKetzer-ALICE] urgent: shutdown of hera - users have to transfer their data to nyx

[Malzacher, Peter]

Dear all,

as you know the GSI farm prometheus has been shut down end of June. The lustre filesystem hera will be shut down end of September. All userdata which is still needed has to be saved.

No user directories /hera/<userid> will be copied to nyx by default. That is the responsibility of the user. Supervisors should clarify whether important data from former group members need to be saved.  Please be aware that we have still less space on nyx. The current quota on nyx is 600TB on hera we used 705TB. So if possible copy only what is really needed.

All alice kronos users have the permission to create a directory under /lustre/nyx/alice/users. Use your userid as top directory: /lustre/nyx/alice/users/<userid>.

To copy data to nyx there are special boxes which have both systems mounted: lxheranyxdm01 - lxheranyxdm08. If one is not up try another. You see hera and nyx under
/lustre/hera and /lustre/nyx. You can use your favorable linux copy tool to copy files from hera to nyx. To transfer huge amounts of files parallel rsync works best.

Example:

1)
cd /lustre/hera/alice/peter

2)
delete everything you do not want to copy

3 a)
find * | parallel -j16 rsync -vlptgoDAXdRqW {} /lustre/nyx/alice/users/peter
will copy everything to nyx

3 b)
find dir1 dir2 | parallel -j16 rsync -vlptgoDAXdRqW {} /lustre/nyx/alice/users/peter
will copy dir1 & dir2

3 c)
find simulation -name *.root | parallel -j16 rsync -vlptgoDAXdRqW {} /lustre/nyx/alice/users/peter
will copy all files *.root from the directory simulation
The options of the rsync will copy all file attributes and be silent. If you want to see/log the progress, remove the 'q' from the options.
find simulation -name *.root | parallel -j16 rsync -vlptgoDAXdRW {} /lustre/nyx/alice/users/peter

Cheers
Peter Malzacher
-------------- nächster Teil --------------
Ein Dateianhang mit HTML-Daten wurde abgetrennt...
URL: <https://lists.hiskp.uni-bonn.de/pipermail/agketzer-alice/attachments/20160914/c959a4d7/attachment-0005.htm>