Search arXiv⌕ Search

arXiv subjects

Qiyang Shi

Publications and source records attributed to Qiyang Shi.

3 recordsLinked to original sources

VIVID: Bringing Tool-Augmented Agents into Enterprises

Tool-augmented large language model agents connect natural-language requests to enterprise services, yet their operational viability depends on reliable execution, organizational control, and system responsiveness. We present VIVID, a deployed tourism-management agent system designed to study these requirements in a real enterprise environment. On an audited dataset of 283 queries, its Qwen3-8B configuration achieves 59.06\% strict end-to-end success across the evaluated decision stages, indicating useful but bounded autonomous capability. Stage-wise KV-cache eviction reduces mean latency by 34.4\%, while targeted optimization reduces the mean latency of the five slowest measured business tools by 81.1--92.3\%. In a three-month deployment serving more than 1,500 personnel, VIVID reduced average per-order processing time from approximately ten minutes to under two minutes, with a final-task error rate below 1\% after human-in-the-loop control. These results show that enterprise agent viability requires system-level consideration beyond isolated tool-calling accuracy.

cs.HC↗

ChainSWE: Benchmarking Coding Agents on Multi-Bug Software Maintenance

Language model (LM) agents are increasingly deployed to maintain codebases over extended periods, fixing streams of related defects while carrying context from one fix to the next. Yet existing software engineering (SWE) benchmarks evaluate models one bug at a time: the repository is reset, the codebase is re-read, and a single self-contained issue is graded in isolation. This setting collapses a continuous maintenance workflow into a series of independent sessions, ignoring the cumulative dependencies that make real-world bug fixing challenging. To bridge this gap, we introduce ChainSWE, the first benchmark for evaluating agents on sequential, dependent bug fixes within a shared codebase. We collect chronological chains of 304 issues across 54 Python projects, mined from six SWE-bench-family datasets. Our evaluation across a range of agents and models reveals a consistent performance drop by up to 70% as the chain length increases.

cs.SE↗

Enhancing Factual Accuracy and Citation Generation in LLMs via Multi-Stage Self-Verification

This research introduces VeriFact-CoT (Verified Factual Chain-of-Thought), a novel method designed to address the pervasive issues of hallucination and the absence of credible citation sources in Large Language Models (LLMs) when generating complex, fact-sensitive content. By incorporating a multi-stage mechanism of 'fact verification-reflection-citation integration,' VeriFact-CoT empowers LLMs to critically self-examine and revise their intermediate reasoning steps and final answers. This process significantly enhances the objective accuracy, trustworthiness, and traceability of the generated outputs, making LLMs more reliable for applications demanding high fidelity such as scientific research, news reporting, and legal consultation.

cs.CL↗