arXiv subjects

Mamoun Awad

Publications and source records attributed to Mamoun Awad.

3 recordsLinked to original sources

arXiv2026

Measuring Curriculum Alignment across Topical Coverage, Competency, and Cognitive Depth: A Longitudinal Framework Applied to CS2013 and CS2023

Undergraduate computer science is governed by international curricular guidelines revised about once a decade, yet programs lack a reliable way to measure how completely they cover the current guideline and how coverage shifts when it changes. Existing analyses rely on topic models or manual tagging, seldom report reliability, do not benchmark the matching method, and examine topical overlap at a single point in time. We address these gaps with a staged pipeline that separates candidate generation from confirmation, applied to one accredited Bachelor of Science in Computer Science against Computer Science Curricula 2013 (CS2013) and 2023 (CS2023). Semantic retrieval proposes candidate course-to-knowledge-unit matches, a large language model confirms each against an explicit coverage rule, and an independent expert validates the resulting map. Benchmarking seven retrievers against pooled relevance judgments, we find that no automatic configuration reaches acceptable precision and recall, peaking at an F1 of 0.55 and inflating apparent coverage once tuned for recall, establishing retrieval as a candidate generator, not a measurement. Each map was validated by two independent experts and reconciled to a consensus, with substantial first-pass agreement (Cohen's kappa 0.64 and 0.69); the reported coverage is the lenient end of a sensitivity band whose strict end lies about seven points lower. Coverage of CS2023 is 48.4 percent of knowledge units, 59.4 percent by recommended hours, and about 28 percent of topics, and sixty-nine percent of covered units rest on a single course. The program articulates most competencies it covers yet meets the recommended cognitive depth far less often under CS2023 than under CS2013, a gap that survives a sensitivity analysis of the mapping, while structural gaps stay separable from artifacts of the standard's evolution. The instrument is reusable and released.

cs.AI↗

arXiv2026

Measuring Curriculum-Labor Market Alignment at the Scale of a Program Portfolio

A college offering several overlapping computing degrees implicitly assumes that its programs are differentiated in line with how the labor market segments computing work and that, together, they prepare graduates for that market. Testing this is difficult, because the instruments available to curriculum committees, namely advisory boards, tracer studies, and employer surveys, are slow, narrow, and hard to reproduce. We apply one uniform, taxonomy-anchored alignment analysis across all five undergraduate programs of a College of Information Technology, comparing 1,922 course learning outcomes against 103,349 competencies extracted from a unified corpus of 5,186 deduplicated job openings from four boards. Every competency is obtained by a grounded single-language-model procedure that copies it verbatim from the source and verifies it against the source, then assigns it to one of eleven ESCO-aligned domains and a Bloom cognitive level; the curricular supply is read not as a catalog but on a realized-attainment basis that respects the credit-hour and elective constraints under which a student completes a degree. The extraction is validated blind by two independent faculty raters (domain kappa 0.91, Bloom level kappa 0.86) and the ESCO matching against a human-adjudicated gold set (kappa 0.72). Four findings emerge. The content gaps are systemic rather than program-specific, concentrated in systems, software engineering, security, and web development; the shared college core satisfies only about a third of the demanded competencies; the programs are well differentiated in disciplinary content yet homogeneous in where they fall short; and the curriculum is pitched roughly a full Bloom level below the market across the portfolio, most acutely in systems. We discuss the implications for program design, curriculum governance, and the practice of curriculum analytics.

cs.CY↗

arXiv2026

An NLP-Driven Framework for Curriculum-Labor Market Alignment: Schema-Constrained LLM Extraction, ESCO-Anchored Semantic Matching, and Multi-Dimensional Gap Quantification

Schema-constrained information extraction from diverse educational and labor-market corpora remains an open challenge in natural language processing because existing pipelines rely primarily on lexical-surface methods that cannot recover implicit competencies, lack grounding in shared taxonomies, and provide no formal measures of extraction reliability or document-level completeness. To address these limitations, this paper proposes a four-stage NLP framework that combines (i) schema-constrained prompting of a two-model frontier-LLM ensemble against a JSON Schema-enforced seven-slot competency formalism, (ii) Sentence-BERT (SBERT) alignment of the extracted records against an eleven-domain ESCO v1.2.1 controlled vocabulary, (iii) a two-tier adjudication protocol that resolves inter-model disagreements, and (iv) a verification mechanism that combines per-slot Cohen's kappa, schema conformance, and document-level completeness audits. The framework is instantiated for a critical application in higher-education quality assurance, namely curriculum-labor market alignment for the ABET-accredited BSc Computer Science program at the United Arab Emirates University. The pipeline extracts 400 competency records from the 85-course 2025-2026 study plan and aligns them, under a five-scope analysis ranging from the computing core to a probability-weighted student trajectory, with 30 job postings (483 requirement clauses) at an SBERT cosine threshold of 0.50. The extractor achieves Cohen's kappa of 0.79 on the skill slot, with 100% schema conformance and 100% document-level completeness. The alignment surfaces interpretable supply-demand gaps of 25.0% in general and transversal skills, 13.8% in algorithms and computational theory, and 12.2% in software engineering and project management, with a near-zero 1.8% gap in artificial intelligence and data science despite 38.6% supply coverage.

cs.AI↗