Continuum (Mapping , Pointing, Focus etc) and Spectroscopy is acquired on the be4 computer.
The data is stored in /daten/Raw. This data obtained with the new FitsWriter/control program is stored to /daten/mbfits. Binary Data for the HI Survey (the array data section) is stored as subscan binary files in /daten/AFFTS. Logging information for the observed scans is stored in the mySQL observation database. Spectroscopy data is processed with the spectroscopy pipeline on the computer be4 and stored locally on be4 in /daten/Class. /daten is now actually a NAS exporting 120 TB of disk space.

  • be4 rsyncs the data directories /daten/Raw, /daten/AFFTS, /daten/Class every 15 minutes to the effelsberg NAS which is exported as /effelsbergData/ to the local servers (be2,be4m observer2, observer4, observer5, observer6 and observer7)in the local data network 10.200.200.
  • The data is moved to monthly folders after 30 days (e.g. /daten/Raw/Raw-2011-03).
  • The data is deleted on be4 after 0.5-2 years.
  • HI survey data is copied to the University of Bonn.
  • be2 syncs every 20 min these directories to /eff/data. This volume is accessible in the MPIfR network as a NFS3 mount. Due to the limited storage we will delete data after several years.
  • After one year the data is copied into the tape library. It is accessible in the MPIfR network at the location /hsm/effarchive. The data is archived to tape. This is a NFS4 mount. You need a kerberos certificate to access it, via kinit from your computer connected to the institute LDAP account system.

The data is accessible via observer2 via rsync+ssh, scp using the obseff account. This computer is also accessible from the guest network in Effelsberg via observer2g

 
information_for_astronomers/user_guide/data_storage_and_archive.txt · Last modified: 2017/01/13 10:00 by hafok     Back to top