Search arXiv⌕ Search

arXiv · 2610.02369

Automating the Application of HCI Principles: Skills for On-Demand UI Construction, the Human-AI Space to Think, and the Future of HCI

Abstract

Human-computer interaction (HCI) is in the middle of a transition: large language models can now generate functional user interfaces (UIs) on demand from natural-language task descriptions. A user explains what they are trying to accomplish, and the system materializes a working interface to support it. This capability already exists in systems such as Claude and ChatGPT and continues to grow in fidelity as the underlying models improve. The next step along this trajectory is to move from interfaces that are merely generated to interfaces that are generated well. We propose a framework in which the dialogue between user and artificial intelligence (AI) becomes a Space to Think: a shared, structured cognitive workspace in which task decomposition produces an on-demand user interface as an extension of the user's thinking rather than as a separate artifact. Within this paradigm, classical HCI design knowledge (Nielsen's heuristics, Norman's affordance prescriptions, Web Content Accessibility Guidelines (WCAG) success criteria, cognitive-load constraints, and mixed-initiative principles) is encoded as skills: machine-readable skill.md files that the generating agent loads at runtime as software engineering tools. Skills turn HCI design knowledge into declarative, inspectable, version-controlled, and editable artifacts owned by the HCI community itself so that accessibility, learnability, and consistency become properties of a generative process rather than properties of a finished product. We outline a research agenda depicting a future where the HCI field transitions from today's design and knowledge heuristic checklist towards a future where the craft becomes machine-readable, executable, and open.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Nathan Conklin, Miranda Capra, Chris North. 2026-10-01. Automating the Application of HCI Principles: Skills for On-Demand UI Construction, the Human-AI Space to Think, and the Future of HCI. https://arxiv.org/abs/2610.02369

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

VIRENA: Virtual Arena for Research, Education, and Democratic Innovation

Digital platforms shape how people communicate, deliberate, and form opinions. Studying these dynamics has become harder because of restricted data access, ethical limits on real-world experiments, and the technical demands of existing research tools. VIRENA (Virtual Arena) is a platform for controlled experiments in realistic social media environments. Several participants can interact at the same time in replicas of feed-based platforms (Instagram, Facebook, Reddit, X) and messaging apps (WhatsApp, Messenger). AI agents powered by large language models (LLMs) join the participants with configurable personas and human-like timing. Researchers set up experiments in a visual interface without programming: they define conditions, schedule stimulus content, add moderation rules, assign participants randomly to conditions, and export the data. VIRENA supports designs that were hard to run before, such as studying human--AI interaction in realistic social settings, comparing moderation interventions, and observing group deliberation as it unfolds. Participants and data stay within institutional control, and the platform links to survey and recruitment tools. This paper describes how VIRENA works and how to use it.

cs.HC↗

DimSteer: Steering LLM Authoring with Automatically Discovered Stylistic Controls

Large language model writing interfaces often make users steer outputs by repeatedly articulating desired changes in natural language. Yet writers may recognize useful stylistic directions only after seeing alternatives, making revision recall-heavy. We present DimSteer, an authoring interface that samples prompt-local completions, discovers high-variance activation-space axes of variation, labels them, and exposes them as sliders with pole previews, diff comparison, and reset controls. Users can manipulate discovered dimensions, reducing the need to reformulate prompts for each stylistic adjustment. In a within-subjects study with 16 participants against a matched prompt-only baseline, DimSteer reduced mental demand, effort, and frustration while preserving comparable perceived success. Participants valued the surfaced dimensions, yet 15 of 16 disagreed that they would have thought to request the same changes in a prompt. Results suggest prompt-local controls can shift LLM authoring from recall-based prompting toward recognition-based exploration and direct manipulation, while preserving prompting for open-ended edits.

cs.HC↗

Evaluating Just Noticeable Differences in Layered Opacity Visualizations

Opacity is a widely used channel in data visualization, but it remains less well understood compared to channels such as color, length, size, etc. Recent work from Meng et al. investigated the impact of opacity across competing color schemes, finding that certain color schemes were associated with better participant accuracy. We examine these effects further in a controlled two-alternative forced-choice setup to determine whether opacity differences are truly equal across possible opacity comparison ranges. In a within-subjects study with 96 trials, including two competing color schemes (best and worst from Meng et al.) and 48 opacity pairs, we find little differences between color schemes but larger individual differences in accuracy. Further, results show stable performance in middle opacity ranges, with more errors occurring when comparing extreme values. We discuss potential implications for design guidelines and further study and make our study materials, analysis scripts, and data available at https://osf.io/zv9dx/overview?view_only=38d03cea1b3d42788593e3e6b1016cfd.

cs.HC↗