Deep Reinforcement Learning for Beam Angle Optimization of Intensity-Modulated Radiation Therapy

Peng Bao; Gong Wang; Ruijie Yang; Bin Dong

Home/Archive/arXiv

arXiv · 2303.03812

Deep Reinforcement Learning for Beam Angle Optimization of Intensity-Modulated Radiation Therapy

Peng Bao·Gong Wang·Ruijie Yang·Bin Dong

View original source ↗Read source document ↗Export metadata ↓

Abstract

Objective: Intensity-modulated radiation therapy (IMRT) beam angle optimization (BAO) is a challenging combinatorial optimization problem that is NP-hard. In this study, we aim to develop a personalized BAO algorithm for IMRT that improves the quality of the final treatment. Methods: To improve the quality of IMRT treatment planning, we propose a deep reinforcement learning (DRL)-based approach for IMRT BAO. We consider the task as a sequential decision-making problem and formulate it as a Markov Decision Process. To facilitate the training process, a 3D-Unet is designed to predict the dose distribution for the different number of beam angles, ranging from 1 to 9, to simulate the IMRT environment. By leveraging the simulation model, double deep-Q network (DDQN) and proximal policy optimization (PPO) are used to train agents to select the personalized beam angle sequentially within a few seconds. Results: The treatment plans with beam angles selected by DRL outperform those with clinically used evenly distributed beam angles. For DDQN, the overall average improvement of the CIs is 0.027, 0.032, and 0.03 for 5, 7, and 9 beam angles respectively. For PPO, the overall average improvement of CIs is 0.045, 0.051, and 0.025 for 5, 7, and 9 beam angles respectively. Conclusion: The proposed DRL-based beam angle selection strategy can generate personalized beam angles within a few seconds, and the resulting treatment plan is superior to that obtained using evenly distributed angles. Significance: A fast and automated personalized beam angle selection approach is been proposed for IMRT BAO.

Explore related subjects

physics.med-ph

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Peng Bao, Gong Wang, Ruijie Yang, Bin Dong. 2023-03-07. Deep Reinforcement Learning for Beam Angle Optimization of Intensity-Modulated Radiation Therapy. https://arxiv.org/abs/2303.03812

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Prediction of biological radiation effects based on ionization clusters (nanodosimetry)

This article reviews approaches that link the formation of ionization clusters in nanometric volumes to radiobiological effectiveness. The corresponding models were developed as the field of nanodosimetry developed. Some address early biological radiation effects, such as DNA damage, while most aim to predict cell survival or inactivation. The models also differ in the nanodosimetric quantities considered, with many based on the probability distribution of ionization cluster formation in a single target. Some models account for the synergistic effects of pairs of ionization clusters formed in different targets. Several models feature macroscopic aggregation frameworks based on particle fluence, which are proposed for use in radiotherapy treatment planning, particularly in ion-beam radiotherapy. The models are presented here using harmonized terminology and notation for nanodosimetric quantities. An extension of the conceptual framework of nanodosimetry is also discussed. This extension transitions from a target-centered description to a track-centered description. It also introduces nanodosimetry-based analogs of dosimetric concepts, such as dose and linear energy transfer. This paper traces and summarizes the historical development of nanodosimetry-based biological effect models and discusses conceptual aspects of the models to reveal their underlying assumptions and the extent to which they are mechanistic or merely elucidate correlations. Eventually, an attempt is made to identify the key open questions in this field that still need to be addressed.

physics.med-ph↗

arXiv2026

Contextual Cellular Growth (ConCeG) of neural cells for realistic grey matter tissue generation for diffusion MRI simulations

Accurate interpretation of diffusion magnetic resonance imaging (dMRI) signals in grey matter (GM) remains challenging due to the complex, heterogeneous, and densely packed cellular environment. Numerical phantoms provide a controlled framework for investigating the relationship between microstructure and diffusion signals, yet existing approaches often lack the morphological realism and multi-cellular organisation required to faithfully represent GM tissue. In this work, we introduce Contextual Cellular Growth (ConCeG), a generative framework for creating individual cells or constructing dense, three-dimensional, multi-cellular GM substrates informed by real neuronal and glial morphologies. The method combines topological neuron synthesis with a spatially constrained growth network, allowing for the controlled generation of heterogeneous cellular environments with realistic intra- and extracellular compartments. Synthetic cells are generated using morphological and topological characteristics derived from biological reconstructions. We validate the framework through comparisons of structural features with real cellular data, demonstrating strong agreement in branch order, length, angle, and tortuosity distributions. Power spectrum analysis further shows that both intracellular compartments reproduce the spatial correlations observed in biological tissue. Together, these results show ConCeG provides a biologically grounded framework for generating grey matter substrates suitable for large scale diffusion MRI simulation.

physics.med-ph↗

arXiv2026

Magnetic Field of Firing Neuron in Humans: Measurable by Quantum Sensing MRI?

Firing neurons generate action potentials that propagate along axons to transmit signals supporting cognitive functions. These electrical currents generate magnetic fields, yet direct detection of these neuronal magnetic fields by MRI remains elusive. This Mini Review investigates why this goal has been proven difficult to achieve and whether an emerging approach, quantum sensing MRI, can overcome the challenge.

physics.med-ph↗