Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 1505.06421

HDFITS: porting the FITS data model to HDF5

D. C. Price·B. R. Barsdell·L. J. Greenhill
View original source ↗Read source document ↗Export metadata ↓

Abstract

The FITS (Flexible Image Transport System) data format has been the de facto data format for astronomy-related data products since its inception in the late 1970s. While the FITS file format is widely supported, it lacks many of the features of more modern data serialization, such as the Hierarchical Data Format (HDF5). The HDF5 file format offers considerable advantages over FITS, such as improved I/O speed and compression, but has yet to gain widespread adoption within astronomy. One of the major holdbacks is that HDF5 is not well supported by data reduction software packages and image viewers. Here, we present a comparison of FITS and HDF5 as a format for storage of astronomy datasets. We show that the underlying data model of FITS can be ported to HDF5 in a straightforward manner, and that by doing so the advantages of the HDF5 file format can be leveraged immediately. In addition, we present a software tool, fits2hdf, for converting between FITS and a new `HDFITS' format, where data are stored in HDF5 in a FITS-like manner. We show that HDFITS allows faster reading of data (up to 100x of FITS in some use cases), and improved compression (higher compression ratios and higher throughput). Finally, we show that by only changing the import lines in Python-based FITS utilities, HDFITS formatted data can be presented transparently as an in-memory FITS equivalent.

Explore related subjects

astro-ph.IM

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

D. C. Price, B. R. Barsdell, L. J. Greenhill. 2015-10-20. HDFITS: porting the FITS data model to HDF5. https://doi.org/10.1016/j.ascom.2015.05.001

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Performance characterization of a new Structural and Thermal Architecture for a future spaceborne Closed-Cycle Dilution Refrigerator

A Structural and Thermal Model (STM) has been developed to support the new spaceborne Closed-Cycle Dilution Refrigerator (CCDR), which aims to provide continuous cooling at 100~mK for long-duration astrophysical missions. The STM is based on a hexapod architecture that ensures both thermal decoupling and mechanical robustness during launch. In this paper, we present the characterization of its thermal and mechanical performances. A dedicated experimental setup was used to investigate the thermal behavior of the STM across a broad temperature range. The study reveals limitations of the collar design, with incomplete power interception from thermal boundary resistances and vibration test failure traced to defective strut gluing. These results guide the next STM iteration with optimized collar and strut assembly for reliable CCDR operation in space.

astro-ph.IM↗
arXiv2026

The Simons Observatory: Development of a Pipeline to Detect Rapid Transients in Time-Ordered Data

We introduce a method for detecting astrophysical transients evolving on timescales of milliseconds to minutes using cosmic microwave background (CMB) survey telescopes. While previous transient searches in CMB data operate in map space, our pipeline directly processes the raw time-ordered data, enabling sensitivity to fast, dynamic signals. We integrate our detection approach into the Simons Observatory time-domain pipeline and assess the performance by injecting symmetric, stellar flare-like light curves into simulated observations. For events flaring with a timescale of 0.5 s, the pipeline detects $\gtrsim90$ % of events at flux densities of 800, 1150, 1650, and 4250\,mJy when measured in the 93, 145, 225, and 280 GHz bands respectively. At a fixed peak flux density, the pipeline more readily detects longer flares. The limiting flux density for 90 % completeness is four times lower for a $\ge5$ s flare than for a 0.5 s flare, while the flux density limits for $\gtrsim50$ % detection efficiency are comparable to the rms noise of the time-ordered data. We are able to determine the position of detected events in each observing band, with a positional uncertainty at the detection threshold comparable to the telescope resolution at that band. These results demonstrate the readiness of this pipeline for incorporation into upcoming Simons Observatory data analyses.

astro-ph.IM↗
arXiv2026

Thermal conductivity of various CFRPs from 100 mK to 20 K

Carbon-fiber-reinforced polymers (CFRPs) are some of the most useful materials for building spacecraft and aerospace tools. They are especially valuable for systems that work at extremely cold (cryogenic) temperatures because they are strong, lightweight, and don't transfer heat easily. In this study, researchers measured how well heat moves through several different types of carbon fiber samples, specifically T300, T700, HS40, M55J, and IMA, at different fiber layouts and densities. These measurements were taken at ultra-cold temperatures ranging from 100 mK to 20 K. The team used a newly developed analysis method to calculate the thermal conductivity for each sample. Finally, they shared how each material behaved at different temperatures and compared their findings to previous research.

astro-ph.IM↗