Search arXivSearch

arXiv subjects

Simit Raval

Publications and source records attributed to Simit Raval.

11 recordsLinked to original sources

From 3D Perception to Safety Reasoning: A Graph-Based Framework for Real-Time Underground Mine Monitoring

Underground coal mining requires personnel and heavy equipment to operate within shared, confined, and poorly illuminated spaces where hazards such as equipment proximity violations, structural instabilities, and occluded blind spots are difficult to anticipate. Conventional monitoring systems, including fixed cameras and rule-based proximity alerts, can detect predefined events but lack the 3D scene understanding and contextual memory needed to identify complex or evolving hazards. This paper presents a continuous monitoring framework that converts colourised 3D point clouds into structured and traceable safety reasoning outputs. The framework combines 3D semantic perception, uncertainty-based anomaly detection, rule-based hazard checks, on-device LLM reasoning, and GraphRAG -based memory analysis to identify immediate hazards and interpret longer-term safety patterns. Scene and temporal graphs serve as the explicit knowledge structure, linking perception outputs across reasoning stages. To overcome the scarcity of labeled underground data, real roadway scans, controlled object placement, and high-fidelity longwall simulation were combined to generate diverse hazard scenarios, while self-supervised pretraining improved segmentation from limited annotations. The perception model achieved 92.7% accuracy at 30 FPS with low memory usage. Across 115 hazard scenarios, rule-based checks achieved 57% coverage, increasing to 76% with contextual LLM reasoning and 93% with memory-based reasoning using historical records. Qualitative results show uncertainty-derived anomaly signals support the interpretation of out-of-distribution hazards beyond predefined classes. Overall, graph-based knowledge representation combined with 3D perception and layered safety reasoning provides a practical foundation for intelligent decision support in underground mine monitoring.

cs.CV

Towards Integrated Rock Support Visualisation in 3D Point Cloud of Underground Mines

The effectiveness of rock support in underground mines depends on the interaction between installed rock bolts and the structural fabric of the surrounding rock mass. However, discontinuity characterisation and rock bolt identification are commonly treated as separate tasks, limiting their value for integrated support assessment. This study presents an automated framework for integrated rock support visualisation using 3D point clouds of underground mine excavations. The framework integrates structure mapping, rock bolt identification, discontinuity plane fitting, and bolt orientation estimation into a unified workflow optimised for accuracy and computational efficiency. The outputs are used to generate an integrated 3D visualisation of fitted discontinuity planes and bolt vectors, enabling direct assessment of their spatial intersections and geometric relationships. A complementary stereographic analysis of discontinuity poles and bolt orientations is also performed to evaluate overall bolting geometric effectiveness relative to the mapped structural fabric. Additionally, bolt-level quality metrics, including exposed protrusion length and deviation from the local roof normal, are visualised to support assessment of installation quality. The proposed framework is demonstrated on real underground metal mine scans, producing accurate structure mapping and rock bolt identification results in medium-scale point clouds. Overall, the study provides a practical step towards automated, integrated geotechnical assessment of rock support effectiveness without requiring manual measurements or additional in-situ data acquisition.

cs.CV

Development and Validation of an Integrated LiDAR-Camera System for Real-Time Monitoring of Underground Longwall Operations

Real-time spatial monitoring in underground longwall operations is challenging due to methane-related safety risks, poor visibility, elevated thermal loads, spatial confinement, and bandwidth-limited communications. Currently available camera-based monitoring provides visual context but lacks direct depth information, while standalone underground LiDAR scanners are limited to monochromatic or periodic 3D mapping. This paper presents the design, integration, and experimental validation of a LiDAR-camera monitoring system built around a certified flameproof enclosure that prevents flame propagation into the surrounding atmosphere. The system combines a solid-state LiDAR, an industrial RGB camera, and an onboard processor within a compact hardware assembly, supporting LiDAR-camera fusion, low-light image enhancement, and real-time processing. Laboratory experiments evaluated LiDAR and camera performance through the protective polycarbonate dome and quantified optical and geometric distortions introduced by the enclosure. Thermal testing showed that iterative component placement, heat sinking, and passive conduction reduced peak surface temperature from 106 {\deg}C to 70 {\deg}C, with internal temperature stabilising at 57 {\deg}C. Furthermore, a representative longwall simulation was created to evaluate the complete sensing, fusion, and transmission workflow under controlled geometric and low-light conditions. In the final configuration, more than 97% of LiDAR points fell within the camera field of view, supporting reliable colourisation. Enclosure-aware calibration and correction maintained geometric accuracy, while processed colourised point clouds were transmitted at up to 10 Hz with sustained bandwidth below 25 Mb/s.

eess.IV

Automated Discontinuity Set Characterisation in Enclosed Rock Face Point Clouds Using Single-Shot Filtering and Cyclic Orientation Transformation

Characterisation of structural discontinuity sets in exposed rock faces of underground mine cavities is essential for assessing rock-mass stability, excavation safety, and operational efficiency. UAV and other mobile laser-scanning techniques provide efficient means of collecting point clouds from rock faces. However, the development of a robust and efficient approach for automatic characterisation of discontinuity sets in real-world scenarios, like fully enclosed rock faces in cavities, remains an open research problem. In this study, a new approach is proposed for automatic discontinuity set characterisation that uses a single-shot filtering strategy, an innovative cyclic orientation transformation scheme and a hierarchical clustering technique. The single-shot filtering step isolates planar regions while robustly suppressing noise and high-curvature artefacts in one pass using a signal-processing technique. To address the limitations of Cartesian clustering on polar orientation data, a cyclic orientation transformation scheme is developed, enabling accurate representation of dip angle and dip direction in Cartesian space. The transformed orientations are then characterised into sets using a hierarchical clustering technique, which handles varying density distributions and identifies clusters without requiring user-defined set numbers. The accuracy of the method is validated on real-world mine stope and against ground truth obtained using manually handpicked discontinuity planes identified with the Virtual Compass tool, as well as widely used automated structure mapping techniques. The proposed approach outperforms the other techniques by exhibiting the lowest mean absolute error in estimating discontinuity set orientations in real-world stope data with errors of 1.95{\deg} and 2.20{\deg} in nominal dip angle and dip direction, respectively, and dispersion errors lying below 3{\deg}.

cs.CV

LiDAR Point Cloud Colourisation Using Multi-Camera Fusion and Low-Light Image Enhancement

In recent years, the fusion of camera data with LiDAR measurements has emerged as a powerful approach to enhance spatial understanding. This study introduces a novel, hardware-agnostic methodology that generates colourised point clouds from mechanical LiDAR using multiple camera inputs, providing complete 360-degree coverage. The primary innovation lies in its robustness under low-light conditions, achieved through the integration of a low-light image enhancement module within the fusion pipeline. The system requires initial calibration to determine intrinsic camera parameters, followed by automatic computation of the geometric transformation between the LiDAR and cameras, removing the need for specialised calibration targets and streamlining the setup. The data processing framework uses colour correction to ensure uniformity across camera feeds before fusion. The algorithm was tested using a Velodyne Puck Hi-Res LiDAR and a four-camera configuration. The optimised software achieved real-time performance and reliable colourisation even under very low illumination, successfully recovering scene details that would otherwise remain undetectable.

cs.CV

A Deep Learning Approach to Identify Rock Bolts in Complex 3D Point Clouds of Underground Mines Captured Using Mobile Laser Scanners

Rock bolts are crucial components of the subterranean support systems in underground mines that provide adequate structural reinforcement to the rock mass to prevent unforeseen hazards like rockfalls. This makes frequent assessments of such bolts critical for maintaining rock mass stability and minimising risks in underground mining operations. Where manual surveying of rock bolts is challenging due to the low light conditions in the underground mines and the time-intensive nature of the process, automated detection of rock bolts serves as a plausible solution. To that end, this study focuses on the automatic identification of rock bolts within medium to large-scale 3D point clouds obtained from underground mines using mobile laser scanners. Existing techniques for automated rock bolt identification primarily rely on feature engineering and traditional machine learning approaches. However, such techniques lack robustness as these point clouds present several challenges due to data noise, varying environments, and complex surrounding structures. Moreover, the target rock bolts are extremely small objects within large-scale point clouds and are often partially obscured due to the application of reinforcement shotcrete. Addressing these challenges, this paper proposes an approach termed DeepBolt, which employs a novel two-stage deep learning architecture specifically designed for handling severe class imbalance for the automatic and efficient identification of rock bolts in complex 3D point clouds. The proposed method surpasses state-of-the-art semantic segmentation models by up to 42.5% in Intersection over Union (IoU) for rock bolt points. Additionally, it outperforms existing rock bolt identification techniques, achieving a 96.41% precision and 96.96% recall in classifying rock bolts, demonstrating its robustness and effectiveness in complex underground environments.

cs.CV

Comparative Evaluation of Traditional and Deep Learning-Based Segmentation Methods for Spoil Pile Delineation Using UAV Images

The stability of mine dumps is contingent upon the precise arrangement of spoil piles, taking into account their geological and geotechnical attributes. Yet, on-site characterisation of individual piles poses a formidable challenge. The utilisation of image-based techniques for spoil pile characterisation, employing remotely acquired data through unmanned aerial systems, is a promising complementary solution. Image processing, such as object-based classification and feature extraction, are dependent upon effective segmentation. This study refines and juxtaposes various segmentation approaches, specifically colour-based and morphology-based techniques. The objective is to enhance and evaluate avenues for object-based analysis for spoil characterisation within the context of mining environments. Furthermore, a comparative analysis is conducted between conventional segmentation approaches and those rooted in deep learning methodologies. Among the diverse segmentation approaches evaluated, the morphology-based deep learning segmentation approach, Segment Anything Model (SAM), exhibited superior performance in comparison to other approaches. This outcome underscores the efficacy of incorporating advanced morphological and deep learning techniques for accurate and efficient spoil pile characterisation. The findings of this study contribute valuable insights to the optimisation of segmentation strategies, thereby advancing the application of image-based techniques for the characterisation of spoil piles in mining environments.

cs.CV

An Evaluation of Calibrated and Uncalibrated High-Resolution RGB Data in Time Series Analysis for Coal Spoil Characterisation: A Comparative Study

Minor errors in the spoil deposition process, such as placing stronger materials with higher shear strength over weaker ones, can lead to potential dump failure. Irregular deposition and inadequate compaction complicate coal spoil behaviour, necessitating a robust methodology for temporal monitoring. This study explores using unmanned aerial vehicles (UAV) equipped with red-green-blue (RGB) sensors for efficient data acquisition. Despite their prevalence, raw UAV data exhibit temporal inconsistency, hindering accurate assessments of changes over time. This is attributed to radiometric errors in UAV-based sensing arising from factors such as sensor noise, atmospheric scattering and absorption, variations in sun parameters, and variable characteristics of the sensed object over time. To this end, the study introduces an empirical line calibration with invariant targets, for precise calibration across diverse scenes. Calibrated RGB data exhibit a substantial performance advantage, achieving a 90.7% overall accuracy for spoil pile classification using ensemble (subspace discriminant), representing a noteworthy 7% improvement compared to classifying uncalibrated data. The study highlights the critical role of data calibration in optimising UAV effectiveness for spatio-temporal mine dump monitoring. The developed calibration workflow proves robust and reliable across multiple dates. Consequently, these findings play a crucial role in informing and refining sustainable management practices within the domain of mine waste management.

stat.AP

A Comparative Study with Traditional and Transfer Learning-enhanced Machine Learning Algorithms for Geotechnical Characterisation of Coal Spoil

The characterisation of materials is a prerequisite for evaluating and predicting the stability of mining waste dumps. Over the past three decades, the BHP Mitsubishi Alliance Coal framework has been a cornerstone in Australian coal mines for characterising waste dump materials. However, its reliance on subjective human observations has introduced potential inaccuracies and subjectivity into the process. In response to these limitations, this study proposes an innovative approach to classify coal spoil attributes by remotely acquiring images through phones/tablets. Automated image-based classification relies on feature extraction and a substantial amount of data. Nevertheless, the inherent complexity of geological factors contributing to the formation of both rare and dominant materials leads to imbalanced data. Recognising the need for classification mechanisms to overcome these challenges in spoil classification, the study explores and compares the use of convolutional neural networks, hybrid deep learning, and traditional techniques. Among the twelve models evaluated in this study, the ResNet18-k nearest neighbour model emerges as a powerful tool in geotechnical characterisation. However, it is essential to address issues of interpretability and adaptability to diverse datasets. As this study evolves, the field of geotechnical characterisation of spoil can anticipate the development of more robust methods in the future.

stat.AP

A review of laser scanning for geological and geotechnical applications in underground mining

Laser scanning can provide timely assessments of mine sites despite adverse challenges in the operational environment. Although there are several published articles on laser scanning, there is a need to review them in the context of underground mining applications. To this end, a holistic review of laser scanning is presented including progress in 3D scanning systems, data capture/processing techniques and primary applications in underground mines. Laser scanning technology has advanced significantly in terms of mobility and mapping, but there are constraints in coherent and consistent data collection at certain mines due to feature deficiency, dynamics, and environmental influences such as dust and water. Studies suggest that laser scanning has matured over the years for change detection, clearance measurements and structure mapping applications. However, there is scope for improvements in lithology identification, surface parameter measurements, logistic tracking and autonomous navigation. Laser scanning has the potential to provide real-time solutions but the lack of infrastructure in underground mines for data transfer, geodetic networking and processing capacity remain limiting factors. Nevertheless, laser scanners are becoming an integral part of mine automation thanks to their affordability, accuracy and mobility, which should support their widespread usage in years to come.

cs.CV

Three dimensional unique identifier based automated georeferencing and coregistration of point clouds in underground environment

Spatially and geometrically accurate laser scans are essential in modelling infrastructure for applications in civil, mining and transportation. Monitoring of underground or indoor environments such as mines or tunnels is challenging due to unavailability of a sensor positioning framework, complicated structurally symmetric layouts, repetitive features and occlusions. Current practices largely include a manual selection of discernable reference points for georeferencing and coregistration purpose. This study aims at overcoming these practical challenges in underground or indoor laser scanning. The developed approach involves automatically and uniquely identifiable three dimensional unique identifiers (3DUIDs) in laser scans, and a 3D registration (3DReG) workflow. Field testing of the method in an underground tunnel has been found accurate, effective and efficient. Additionally, a method for automatically extracting roadway tunnel profile has been exhibited. The developed 3DUID can be used in roadway profile extraction, guided automation, sensor calibration, reference targets for routine survey and deformation monitoring.

cs.CV