arXiv subjects

Ramesh Pramanik

Publications and source records attributed to Ramesh Pramanik.

3 recordsLinked to original sources

arXiv2026

Autotaxis of a Run-and-Tumble Agent via Reinforcement Learning

We study the run-tumble motion of a single autochemotactic agent that secretes and senses chemical cues using a reinforcement learning (RL) framework. In a chemical environment that changes dynamically via secretion, diffusion, and degradation of attractant chemicals, we study the effectiveness of RL for a successful navigation strategy. We show that RL enhances chemotactic performance. Starting from a random initial position, the probability of finding the agent in the favorable region (near the attractant peak) increases faster with time and reaches a higher value in the long time limit when RL is used, compared to the case when the agent performs usual run-tumble chemotaxis without using RL. We also characterize the chemotactic performance of the agent by varying different parameters like rates of secretion, degradation, and diffusion. Importantly, we observe a non-monotonic dependence of the chemotactic performance on the learning and exploration rates, indicating the existence of an optimal RL strategy for the most efficient navigation. We explain these observations as a result of the interplay between the pre-existing attractant environment and the agent-generated attractant profile.

q-bio.CB↗

arXiv2025

Dynamics of chemo-receptor activity with time-periodic attractant field

When exposed to a time-periodic chemical signal, an \textit{E.~coli} cell responds by modulating its receptor activity in a similar time-periodic manner. However, there exists a phase lag between the applied signal and the activity response. We study the variation of the activity amplitude and phase lag as a function of the applied frequency~$ω$, using numerical simulations. The amplitude increases with~$ω$, reaches a plateau, and then decreases again for large~$ω$. The phase lag increases monotonically with~$ω$ and finally saturates to $3π/2$ when~$ω$ is large. The activity is no longer a single-valued function of the attractant signal, and plotting activity versus attractant concentration over one complete time period generates a loop. We monitor the loop area as a function of~$ω$ and find two peaks for small and large~$ω$, and a sharp minimum at intermediate~$ω$ values. We explain these results as an interplay between the time scales associated with adaptation, activity switching, and applied signal variation. In particular, for very large~$ω$, the quasi-equilibrium approximation for activity dynamics breaks down, a regime that has not been explored in earlier studies. We perform analytical calculations in this limit and find good agreement with our simulation results.

physics.bio-ph↗

arXiv2025

Run-and-tumble chemotaxis using reinforcement learning

Bacterial cells use run-and-tumble motion to climb up attractant concentration gradient in their environment. By extending the uphill runs and shortening the downhill runs the cells migrate towards the higher attractant zones. Motivated by this, we formulate a reinforcement learning (RL) algorithm where an agent moves in one dimension in the presence of an attractant gradient. The agent can perform two actions: either persistent motion in the same direction or reversal of direction. We assign costs for these actions based on the recent history of the agent's trajectory. We ask the question: which RL strategy works best in different types of attractant environment. We quantify efficiency of the RL strategy by the ability of the agent (a) to localize in the favorable zones after large times, and (b) to learn about its complete environment. Depending on the attractant profile and the initial condition, we find an optimum balance is needed between exploration and exploitation to ensure the most efficient performance.

q-bio.CB↗