Search arXivSearch

arXiv · 2203.17095

The Three Little Pigs and the Big Bad Wolf: Case Studies of Peer Review

Abstract

I present for your appraisal three independent cases of the manuscript referee process conducted by a venerable peer-reviewed scientific journal. Each case involves a little pig, who submitted for consideration a theoretical plan for a house to be constructed presently, in a faraway land. An anonymous big bad wolf was assigned by the journal to assess the merit of these manuscripts. The pigs proposed three distinct construction frameworks, which varied in physical and mathematical sophistication. The first little pig submitted a model of straw, based on the numerical method of toe-counting. His design included odd features, such as spilled millet and cloven-hoofprints on the window sill -- possibly a ploy to distract the wolf from the manuscript's facile mathematical foundation. The second little pig used a more advanced approach, employing Newton's classical laws of motion, to propose a house of sticks. This pig included in her manuscript copious citations by a specific wolf, possibly aiming to ensure acceptance by flattering the wolf whom she anticipated would be the referee. The third little pig described an ostentatious house of bricks based on an elaborate dynamical systems and stability analysis, possibly scheming to dazzle and impress. The big bad wolf did not appear moved by any of the pigs' tactics. His recommendations were, for straw: the minor revision of water-proofing; for sticks: the major revision of fire-proofing, given concerns surrounding climate change; for bricks: unequivocal rejection, accompanied by multiple derogatory comments regarding "high-and-mighty theorists." I describe each case in detail, and suggest that the wolf's reports might be driven as much by self interest as the manuscripts themselves -- namely, that at the time the wolf wrote the reviews, he was rather hungry. Finally, I examine morals learned, if any.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Eve Armstrong. 2022-03-31. The Three Little Pigs and the Big Bad Wolf: Case Studies of Peer Review. https://arxiv.org/abs/2203.17095

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Identifying Kilonovae in the Presence of Optical Afterglow for the Wide Field Survey Telescope

Identifying kilonovae associated with binary neutron star mergers is often complicated by the presence of a dominant synchrotron afterglow. In this work, we evaluate the performance of the Wide Field Survey Telescope (WFST) in identifying kilonova signals in composite afterglow-kilonova transients. Using a numerical framework based on the Fisher information matrix, we simulate $10,000$ realizations for each of two scenarios: an AT2017gfo-based template model and a physically sampled population that accounts for kilonova diversity. Our results indicate that kilonova identification is primarily limited by source distance. In both scenarios, the identification efficiency is largely insensitive to variations in afterglow microphysical parameters and exceeds $80\%$ at distances within approximately $600~\rm Mpc$ for AT2017gfo-like events. Under our adopted assumptions and a short gamma-ray burst (sGRB)-triggered target-of-opportunity (ToO) observational strategy, we estimate that the WFST could identify $0.1-1.2$ kilonovae per year in the optimistic scenario. Furthermore, we find that the discriminating power of color-based filters rapidly saturates, reaching a stable plateau by the second night after the merger. We therefore propose a staged observing strategy that prioritizes high-cadence $g$ and $r$-band monitoring during the first night and incorporates the $z$ band from the second night onward. This strategy improves the identification precision by exploiting the increasingly prominent red excess produced by the kilonova. Our results provide a physical basis for optimizing WFST observing resources to efficiently detect and characterize kilonovae in the multimessenger era.

astro-ph.HE

CRAFT HTR2: Polarimetry of 64 non-repeating fast radio bursts from the updated CRAFT catalogue

We present high-time resolution spectro-polarimetric data for 34 new fast radio bursts (FRBs) discovered by the Commensal Real-time Fast Transients (CRAFT) survey on the Australian Square Kilometer Array Pathfinder (ASKAP) during the period May 2024 to June 2026. Most of these were detected by the higher-sensitivity CRAFT COherent (CRACO) detection system that was commissioned on the telescope during this period. This new sample doubles the size of the CRAFT HTR catalogue and probes a fainter population of FRBs thanks to the improved sensitivity of CRACO. We compare the distribution of extragalactic rotation measure (RM) and polarisation fraction to the CHIME and DSA catalogues. While no significant differences were seen between CRAFT and DSA, the extragalactic RM distribution seen in CHIME FRBs (which are detected at lower frequency) was substantially lower. Surprisingly, we find no significant differences in the linear polarisation fraction distribution between the three FRB catalogues, suggesting an indifference to the different telescope observing frequencies. We show tentative evidence for wider and fainter bursts possessing lower polarisation fractions; this is predominantly driven by the growing sample of unpolarised bursts that are, in almost all cases, wider ($\gg$10 ms) and fainter ($\ll$10$^{34}$ ergs s$^{-1}$ Hz$^{-1}$) than the median ASKAP detection.

astro-ph.HE

Why most neutron star low-mass X-ray binaries accrete transiently: an evolutionary study of transient and persistent phases

A neutron star (NS) low-mass X-ray binary (LMXB), in which an NS accretes matter from a low-mass donor star, is an ideal source for probing some fundamental aspects of physics and astronomy, such as strong gravity, superdense matter, and the accretion-ejection processes. However, to reliably achieve these goals, one must adequately understand NS LMXBs, including why some accrete persistently and others transiently. Focused models, such as those based on a thermal-viscous instability in the accretion disk, are considered to explain transient accretion. However, broader perspectives, including which LMXB parameter values and phases cause transients and why there are more transients than persistents, remain poorly understood. Here, our computation of the long-term evolution of NS LMXBs addresses these questions, providing insight into LMXB parameters and phases, naturally producing more transients than persistents, and being partially consistent with the known properties of observed sources. For example, we typically find a greater fraction of persistent phase at lower orbital periods from the LMXB evolution computation, which is somewhat consistent with observations. However, a lack of full consistency calls for improving the aforementioned focused models, and our computations provide a new way to discriminate among these models.

astro-ph.HE