Search arXiv⌕ Search

arXiv · 2506.17226

DCMF: A Dynamic Context Monitoring and Caching Framework for Context Management Platforms

Abstract

The rise of context-aware IoT applications has increased the demand for timely and accurate context information. Context is derived by aggregating and inferring from dynamic IoT data, making it highly volatile and posing challenges in maintaining freshness and real-time accessibility. Caching is a potential solution, but traditional policies struggle with the transient nature of context in IoT (e.g., ensuring real-time access for frequent queries or handling fast-changing data). To address this, we propose the Dynamic Context Monitoring Framework (DCMF) to enhance context caching in Context Management Platforms (CMPs) by dynamically evaluating and managing context. DCMF comprises two core components: the Context Evaluation Engine (CEE) and the Context Management Module (CMM). The CEE calculates the Probability of Access (PoA) using parameters such as Quality of Service (QoS), Quality of Context (QoC), Cost of Context (CoC), timeliness, and Service Level Agreements (SLAs), assigning weights to assess access likelihood. Based on this, the CMM applies a hybrid Dempster-Shafer approach to manage Context Freshness (CF), updating belief levels and confidence scores to determine whether to cache, evict, or refresh context items. We implemented DCMF in a Context-as-a-Service (CoaaS) platform and evaluated it using real-world smart city data, particularly traffic and roadwork scenarios. Results show DCMF achieves a 12.5% higher cache hit rate and reduces cache expiry by up to 60% compared to the m-CAC technique, ensuring timely delivery of relevant context and reduced latency. These results demonstrate DCMF's scalability and suitability for dynamic context-aware IoT environments.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Ashish Manchanda, Prem Prakash Jayaraman, Abhik Banerjee, Kaneez Fizza, Arkady Zaslavsky. 2025-04-25. DCMF: A Dynamic Context Monitoring and Caching Framework for Context Management Platforms. https://arxiv.org/abs/2506.17226

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

MLSkip: Data Skipping for ML Filters via Lightweight Metadata

Database vendors recently released AI functions that can be used in filter predicates. As such functions often rely on costly, black-box ML models, they unveil new data management challenges. Concretely, traditional data skipping techniques for integer and string data fail to be applicable to the new filter type. Indeed, there is no known mechanism for pruning non-qualifying row groups, e.g., when reading files from blob storage. In this work, we initiate the study of data skipping techniques for ML filters. We make the case that Parquet's default min-max metadata is enough to enable pruning. To this end, we draw connections to two lines of research: (i) the recently proposed query language for ML models and (ii) neural network verification. Our preliminary results on ReLU architectures show that on tables from TPC-H and TPC-DS, the average pruning effectiveness for filters of selectivity below 0.1% amounts to 27.4%. Finally, inspired by research on spatial joins, we propose an enhanced metadata structure: a size-bounded 2D convex hull that verification tools can make better use of, increasing the pruning effectiveness to 38.31%, while occupying at most 45 bytes per row group and column pair. We observe an end-to-end speedup of 1.07$\times$ over PyTorch in DuckDB.

cs.DB↗

IBLTs Measure Before They Decode: Self-Sizing Set Reconciliation for Database Consistency Verification

Cross-system data replication pipelines cannot confirm end-to-end consistency from the local guarantees of each hop, so the two endpoints must be compared directly on a periodic basis. Once the rows of a fixed snapshot are normalized into fingerprints, the task reduces to finding the symmetric difference of the two sets. An Invertible Bloom Lookup Table (IBLT) reconciles the sets with communication that grows only with the difference cardinality $d$, independent of table size, but its capacity must be fixed while $d$ is still unknown. Across 41,603 production reconciliations over 90 days, nonzero $d$ spans about seven orders of magnitude, and no reliable empirical constant exists. We show that the count array of an IBLT has already measured $d$ before decoding. The measurement is in-band: it is carried by the recovery sketch itself and adds no bytes dedicated to estimation. A mapping-aware theorem extends the construction to Irregular, Rateless, and MET IBLTs. The protocol reads the estimate only after a decoding failure; we prove that the failure-conditioned lower quantile bounds the risk of underestimation, which gives the second-round capacity a configurable success-probability guarantee. The resulting self-sizing protocol attempts recovery with a small first-round sketch and stops on success; on failure it reads $d$, sizes the second round, and completes reconciliation in at most two rounds. Against a controlled oracle, communication is 1.29-1.47 times that of a scheme given $d$ in advance. Production workload characterization, relational-database replay, and a cross-city KV deployment confirm the end-to-end mechanism. In production on an Oracle-MySQL link, all completed runs succeeded within two rounds, 90.7% on the 1-RTT fast path with a single 16 KB sketch.

cs.DB↗

KathDB-FAO: Synthesized Query Plans in a Multimodal DBMS

We design, implement, and evaluate KathDB-FAO, a new query evaluation subsystem for our KathDB multimodal DBMS. KathDB-FAO takes as input a query in natural language (NL) and converts it into a query execution plan where each operator is a function whose body is synthesized during query evaluation, which allows powerful query-specific optimizations. To generate accurate and efficient plans from NL, KathDB-FAO first extracts fine-grained atomic actions for correctness, then establishes contracts on the inputs and outputs of those actions and groups them for efficiency, and finally synthesizes the function for each group on the fly. On SemBench, KathDB-FAO cuts execution cost by 58.8% on average across scenarios compared with the next best system, at comparable or better quality.

cs.DB↗