Next: The XMM Survey Science Centre
Previous: Multiwave Continuum Data Reduction at RATAN-600
Up: Software Systems
Table of Contents - Index - PS reprint - PDF reprint

Astronomical Data Analysis Software and Systems VI
ASP Conference Series, Vol. 125, 1997
Editors: Gareth Hunt and H. E. Payne

NOVIDAS and UVPROC II-Data Archive and Reduction System for Nobeyama Millimeter Array

T. Tsutsumi, K.-I. Morita
Nobeyama Radio Observatory, National Astronomical Observatory of Japan, Minamimaki, Minamisaku, Nagano 384-13, Japan

S. Umeyama
Surigiken Corporation, 1901-1 Ryuo-shinmachi, Ryuo-cho, Nakakoma, Yamanashi 400-01, Japan



A workstation-based data archive and reduction software system is developed for the Nobeyama Millimeter Array (NMA). NOVIDAS is used for archiving the output data from the interferometer onto 8mm tapes. It also provides a search utility for the archived database. The calibration and reduction of the data are handled by UVPROC II. It uses the AIPS file system via a set of interface modules called vif library developed by us in order to make an easier transition from the calibration processing to further imaging and analysis using AIPS. Basic functions of the UVPROC II are: correcting bandpass characteristics and time variations of complex gains, correction of variations in system temperature due to atmosphere, subtraction of continuum from spectral data, data flagging, and flux scaling.

A key concept for designing the software is that the system should be user-friendly. We adopted a GUI based on X-windows system with a menu-button feature for execution of commands and PGPLOT for graphical display. This allows users to examine the data quality visually and edit the data interactively. The vif library consists of simple FORTRAN programs to open/close and read/write the AIPS files. Therefore it can also be used by users to develop their own codes for manipulating the AIPS data without calling the AIPS routines directly.

The system currently runs on SUN-Solaris and will be ported to SGI-Irix with a disk array.


1. Introduction

Nobeyama Millimeter Array (NMA) is an interferometer consisting of six transportable 10m antennas operated in the frequency bands of 100GHz, 150GHz, and 230GHz by Nobeyama Radio Observatory (NRO). We recently upgraded the correlator system which consists of two types of digital spectroscopic correlators, FX (with 1024 channels, bandwidth of 32MHz) and XF (128 channels, bandwidth of 1GHz) correlators. The cross correlated signals from each pair of the array elements need to be calibrated to correct for instrumental and atmospheric effects and to be edited for bad data before applying a Fourier transform to produce images.

UVPROC II and NOVIDAS in relation to the other software systems for NMA are schematically described in Figure 1. Since we have the 45m Telescope and the array at the same site, some of the software is shared between the two instruments.

Figure: Software systems for NMA. Original PostScript figure (120kB).

For observation scheduling, users use nma_plan and nomass interactively. COSMOS is the telescope controlling system for both the 45m and NMA. The output data from the correlators are written in the standard FITS format (random group FITS). A single FITS file is created for each source for each observing run. The data archived by NOVIDAS are calibrated using UVPROC II. The calibrated data are processed using NEWSTARgif for imaging and analysis. The core of NEWSTAR is the AIPS package. But it has been customized for the reduction of the 45m single dish and NMA data by implementing X-windows-based GUI and by adding new tasks to be used for the single dish data.


2.1. Why UVPROC II?

As described in the previous section, AIPS has been used as a basis of the data reduction tool for imaging at NRAO. However, the earlier versions of AIPS did not have utilities for calibration and editing of visibility data. Also, writing new programs and implementing in AIPS was difficult for those not familiar with the system.

UVPROC, which was the predecessor of the UVPROC II, was developed at NRO as the calibration software for the NMA data. It was designed to run on IBM compatible main-frame computers. Lack of a GUI and use of its own file system made it somewhat difficult to use. UVPROC II was developed to replace its predecessor with a full GUI support based on X-windows system and use of AIPS file system.

The basic structure of UVPROC II is shown in Figure 2. AIPS does all the file management for the data used in UVPROC II. Thus for users, UVPROC II appears as a subsystem of AIPS.

Figure: Structure of UVPROC II. Original PostScript figure (22kB).

Figure: Example of UVPROC II windows. Original PostScript figure (3.54MB).

2.2. Key Features

UVPROC II runs on SUN-Solaris platform. An example of UVPROC II windows is shown in Figure 3. For graphics, PGPLOT was implemented with functions such as interactive flagging of data points and zooming in/out by defining a region by a mouse. To use the AIPS file system, the interface FORTRAN library ( vif library) was developed. Some utilities included are standard calibration processes such as bandpass calibration and time-dependent gain calibration.

Because of the vif library, the addition of new tasks to UVPROC II becomes relatively easy. The library can also be used to access the AIPS data files outside UVPROC II.


NOVIDAS is an X-windows-based data archiving system for the NMA. The output data from the correlators transferred via an FDDI network to a data server (Sun Sparc-1000 compatible). The raw data are currently stored on 8mm tapes but we plan to upgrade the data storage system to 1TB VHS tape library. When NOVIDAS archives the data, the FITS headers are added to the database. NOVIDAS also provides a search utility for the archived database.

Core programs of NOVIDAS are installed on the data server. However the search utility (data search, downloading from the MT) can be accessed from individual user's workstation by starting up a new panel within UVPROC II.

4. Upgrade Plans

Documentation and on-line help need to be enhanced. Currently there are no history or log files to record what UVPROC II processes have applied to the data, thus this needs to be changed. Also, for better performance we plan to port UVPROC II to an SGI-IRIX disk array system.

© Copyright 1997 Astronomical Society of the Pacific, 390 Ashton Avenue, San Francisco, California 94112, USA

Next: The XMM Survey Science Centre
Previous: Multiwave Continuum Data Reduction at RATAN-600
Up: Software Systems
Table of Contents - Index - PS reprint - PDF reprint