Next: CARMA Data Storage, Archiving, Pipeline Processing, and the Quest for a Data Format
Up: Data Management and Pipelines
Previous: OPUS: A CORBA Pipeline for Java, Python, and Perl Applications
Table of Contents - Subject Index - Author Index - Search - PS reprint - PDF reprint

Scott, S. L., Hobbs, R., Beard, A. D., Daniel, P., Mehringer, D. M., Plante, R. L., Kraybill, J. C., Wright, M., Leitch, E., Amarnath, N. S., Pound, M. W., Rauch, K. P., & Teuben, P. J. 2003, in ASP Conf. Ser., Vol. 295 Astronomical Data Analysis Software and Systems XII, eds. H. E. Payne, R. I. Jedrzejewski, & R. N. Hook (San Francisco: ASP), 265

The COBRA/CARMA Correlator Data Processing System

Stephen L. Scott1, Rick Hobbs2, Andrew D. Beard3, Paul Daniel4, David M. Mehringer5, Raymond Plante6, J. Colby Kraybill7, Melvyn Wright8, Erik Leitch9, N. S. Amarnath10, Marc W. Pound11, Kevin P. Rauch12, Peter J. Teuben13

Abstract:

The Caltech Owens Valley Broadband Reprogrammable Array (COBRA) digital correlator is an FPGA based spectrometer with 16 MHz resolution and 4 GHz total bandwidth that will be commissioned on the Caltech Millimeter-wave Array in November, 2002. The Combined Array for Research in Millimeter-Wave Astronomy (CARMA) will join the Caltech array with the BIMA array on a new high elevation site in 2005. The COBRA hardware and computing architecture described here will be the basis for the two CARMA correlators. The COBRA architecture uses nine computers to provide the hardware interface and initial processing. Data is transported using CORBA to a tenth machine that implements the data processing pipeline as multiple processes passing data through shared memory.

1. Introduction

Spectrometers are the key instruments for millimeter-wave radio telescope arrays. The six antenna Caltech Millimeter-wave Array is currently commissioning a new spectrometer called the Caltech Owens Valley Broadband Reprogrammable Array (COBRA) that is based on FPGA technology. The wide bandwidth (4 GHz) makes COBRA well suited for observations of high redshift molecular lines and continuum emission. Of particular interest is the role that COBRA plays as the progenitor of spectrometers for a new millimeter-wave array.

2. CARMA

Radio interferometric arrays sample spatial scales dependent on antenna separation, but the antenna diameter provides a practical limit to short spacings. The use of multiple antenna sizes allows for retrieval of more spatial scales than arrays composed of antennas of a single diameter. The Combined Array for Research in Millimeter-Wave Astronomy (CARMA) will consist of 23 antennas ranging from 3.5 to 10.4 meters in diameter that will create a unique millimeter-wave multi-scale synthesis imaging array. The actual antenna details for CARMA are shown in Table 1.


\begin{deluxetable}{cccc}
\tablecaption{CARMA Antennas
}
\tablehead {
\colhead{N...
...ts at Hat Creek &BIMA \nl
8 &3.5 &New &U. Chicago \nl
\enddata
\end{deluxetable}

CARMA is a collaboration of five universities, all of which are represented by the authors of this paper, and is scheduled for construction and operation in 2003-2005. CARMA will operate in three frequency bands, 27-36 GHz, 70-116 GHz, and 210-270 GHz. The new array will be located at an elevation of 7,000 to 8,000 feet and have a maximum baseline of 1.8 km and a resolution of 0.3 arc seconds. The CARMA correlators, based on the hardware and software of COBRA, expand the number of stations, bandwidth and resolution. The approach to software development for the new array is presented by Pound et al. (2003).

3. Architecture

The design of the computing system is based on the following principles:

The computing hardware architecture reflects the instrument hardware layout to a large degree and both are shown in Figure 1. There are two major types of instrument hardware components: the correlator crates containing digitizer and correlator boards, and the downconverter modules that convert segments of the IF band to the digitizer band. The total bandwidth of 4 GHz is broken into 8 bands, each with a width of 0.5 GHz.

The correlator crates are compact PCI (cPCI) backplanes containing digitizer and correlator cards that produce 6 antenna auto spectra and 15 baseline cross spectra for each band. Each band is mastered by a Linux/Intel cpu that handles configuration and accepts data from the hardware every 100 milliseconds. The net data rate into each crate cpu is approximately 110 KB/sec. The crates average the data to 500 msec samples and transmit it using CORBA events to the pipeline computer where data from all bands are combined.

The downconverter modules each contain a microprocessor (Philips XAC-3) that communicates using CANbus, an industrial field bus operating at 1 Mbps. All 48 of the downconverter modules communicate with a single Linux host over the CANbus, receiving configuration commands and sending the total power measurements that are needed to calibrate the spectra. The measurements are sent every 500 msec, synchronized to absolute time. The host aggregates this data and sends it to the pipeline computer using CORBA events.

Figure 1: COBRA Computing Hardware Architecture
\begin{figure}
\epsscale{0.78}
\plotone{P7.10_1.eps}
\end{figure}

4. Processing Pipeline

The processing pipeline is a dedicated computer that processes all of the COBRA data and writes the final calibrated visibilities to a relational database. Each step in the pipeline is implemented as a separate process that communicates with other processes using queues implemented on top of shared memory. This gives flexibility in modifying the pipeline and allows debugging processes to be inserted without modifying the running pipeline. The shared memory is very efficient, and the queues allow any processing delays to not result in the loss of critical data. The data in the queues between the processing steps can be remotely displayed using the Carma Data Viewer (Pound, Hobbs, & Scott 2001). The viewer is a Java tool that catches and graphs the data as it is sent via CORBA events. All of the processing steps are done on the 500 msec data samples until the final integration. The major pipeline steps are:

The same architecture (hardware, computing hardware, and software) used for COBRA will be applied to the CARMA wideband correlator (8 stations, 8 GHz bandwidth) and the CARMA spectral correlator (15 stations, 4 GHz bandwidth) scheduled for 2003 and 2004 respectively. The format, storage, and archiving of the correlator output data is described by Plante et al. (2003).

Acknowledgments

David Hawkins (Caltech/OVRO) is responsible for the design and implementation of the architecture, hardware, and firmware of the COBRA correlator.

References

Plante, R., Pound, M. W., Mehringer, D., Scott, S. L., Beard, A., Daniel, P., Hobbs, R., Kraybill, J. C., Wright, M., Leitch, E., Amarnath, N. S., Rauch, K. P., Teuben, P. J. 2003, this volume, 269

Pound, M. W., Amarnath, N. S., Rauch, K. P., Teuben, P. J., Kraybill, J. C., Wright, M., Beard, A., Daniel, P., Hobbs, R., Scott, S. L., Leitch, E., Mehringer, D., Plante, R. 2003, this volume, 377

Pound, M., Hobbs, R., Scott, S. 2001, in ASP Conf. Ser., Vol. 238, Astronomical Data Analysis Software and Systems X, ed. F. R. Harnden, Jr., Francis A. Primini, & Harry E. Payne (San Francisco: ASP), 82



Footnotes

... Scott1
California Institute of Technology/Owens Valley Radio Observatory
... Hobbs2
California Institute of Technology/Owens Valley Radio Observatory
... Beard3
California Institute of Technology/Owens Valley Radio Observatory
... Daniel4
California Institute of Technology/Owens Valley Radio Observatory
... Mehringer5
NCSA/University of Illinois
... Plante6
NCSA/University of Illinois
... Kraybill7
University of California, Berkeley
... Wright8
University of California, Berkeley
... Leitch9
University of Chicago
... Amarnath10
University of Maryland
... Pound11
University of Maryland
... Rauch12
University of Maryland
... Teuben13
University of Maryland

© Copyright 2003 Astronomical Society of the Pacific, 390 Ashton Avenue, San Francisco, California 94112, USA
Next: CARMA Data Storage, Archiving, Pipeline Processing, and the Quest for a Data Format
Up: Data Management and Pipelines
Previous: OPUS: A CORBA Pipeline for Java, Python, and Perl Applications
Table of Contents - Subject Index - Author Index - Search - PS reprint - PDF reprint