Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 1801.03872

The archive solution for distributed workflow management agents of the CMS experiment at LHC

Valentin Kuznetsov·Nils Leif Fischer·Yuyi Guo
View original source ↗Read source document ↗Export metadata ↓

Abstract

The CMS experiment at the CERN LHC developed the Workflow Management Archive system to persistently store unstructured framework job report documents produced by distributed workflow management agents. In this paper we present its architecture, implementation, deployment, and integration with the CMS and CERN computing infrastructures, such as central HDFS and Hadoop Spark cluster. The system leverages modern technologies such as a document oriented database and the Hadoop eco-system to provide the necessary flexibility to reliably process, store, and aggregate $\mathcal{O}$(1M) documents on a daily basis. We describe the data transformation, the short and long term storage layers, the query language, along with the aggregation pipeline developed to visualize various performance metrics to assist CMS data operators in assessing the performance of the CMS computing system.

Explore related subjects

hep-excs.DL

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Valentin Kuznetsov, Nils Leif Fischer, Yuyi Guo. 2018-01-11. The archive solution for distributed workflow management agents of the CMS experiment at LHC. https://doi.org/10.1007/s41781-018-0005-0

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Study of ZZ and ZH production in the bb$ττ$ final state and search for high-mass spin-0 and spin-1 resonances in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A study of the production of pairs of Z bosons (ZZ) and of the associated production of a Z boson and a Higgs boson (ZH) in final states containing two b quarks and two tau leptons (bb$ττ$) is presented. The analysis is based on proton-proton collisions collected at $\sqrt{s}$ = 13 TeV by the CMS experiment at the LHC, corresponding to an integrated luminosity of 138 fb$^{-1}$. The nonresonant analysis targets the standard model ZZ and ZH processes in the bb$ττ$ final state, motivated by the prominent role of this channel in searches for nonresonant Higgs boson pair production. The resonant searches target physics beyond the standard model, probing heavy spin-0 resonances X that decay into ZZ and spin-1 resonances Z' that decay into ZH, with masses in the 0.2$-$5 and 0.5$-$6 TeV ranges, respectively. Upper limits at 95% confidence level are set on the product of production rate and branching fraction $σ$(X)$\mathcal{B}$(X $\to$ ZZ), ranging from 300 pb to 24 fb, and $σ$(Z')$\mathcal{B}$(Z' $\to$ ZH), ranging from 0.4 pb to 12 fb. These are the first measurements to probe the ZZ/ZH $\to$ bb$ττ$ processes. No deviation from standard model expectations is observed.

hep-ex↗
arXiv2026

Search for nonresonant triple Higgs boson production in the final state with six bottom quarks in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A search for nonresonant triple Higgs boson (HHH) production in the final state with six bottom quarks is performed using proton-proton collisions at $\sqrt{s}$ = 13 TeV corresponding to an integrated luminosity of 138 fb$^{-1}$ recorded by the CMS experiment. No significant excess of events over the background prediction is seen. Observed (expected) 95% confidence level upper limits on the signal cross section are set at 44 (43) fb, corresponding to 588 (572) times the standard model expectation. The observed (expected) constraint on the trilinear coupling modifier $κ_3$ is $-$7.4 $\lt$ $κ_3$ $\lt$ 12.4 ($-$6.4 $\lt$ κ_3 $\lt$ 11.2), assuming the quartic coupling modifier $κ_4$ = 1. The corresponding constraint on $κ_4$ is $-$177 $\lt$ $κ_4$ $\lt$ 185 ($-$180 $\lt$ $κ_4$ $\lt$ 190), assuming $κ_3$ = 1. This analysis provides the most stringent constraint to date on nonresonant HHH production and excludes, for the first time, part of the $(κ_3,κ_4)$ space allowed by the perturbative unitarity bound.

hep-ex↗
arXiv2026

Search for soft unclustered energy patterns in proton-proton collisions at $\sqrt{s}$ = 13 TeV using data scouting

A search for soft unclustered energy patterns (SUEPs) is conducted using proton-proton collision data corresponding to an integrated luminosity of 127 fb$^{-1}$ at a center-of-mass energy of 13 TeV, collected via the data scouting stream of the CMS experiment at the LHC. Only the results of the high-level trigger reconstruction are recorded to enable a lower threshold on the hadronic activity. This increases the acceptance for SUEP signatures, which are predicted by hidden-valley models with a large 't Hooft coupling. The observed results are consistent with the standard model background prediction. The most stringent limits to date are set on the gluon fusion production of heavy scalar mediators resulting in SUEP-like signals.

hep-ex↗