News & Research
The latest AI research and news with real-world stakes — each item sourced, dated, summarized in plain English, and tagged by impact area. Every item is checked against its source before it appears.
Research
When AI Blurs the Boundaries of Contribution: An Empirical Study of Authorship Calibration
Célina Treuillier, Denis Lalanne
arXiv · 2026-07-16
This paper introduces 'authorship calibration'—users' awareness of how much they actually contributed when co-writing with AI—and empirically tests it using the CoAuthor dataset. The study finds high variability across users: those who rely heavily on AI tend to misjudge their own contribution, while infrequent AI users show more accurate self-assessment. The authors warn that in educational settings this miscalibration can disrupt metacognitive monitoring and harm learning outcomes. They argue that fostering authorship calibration is essential for responsible and educationally meaningful AI integration.
- Workforce
- AI policy
- Quality assurance
Research
SMC-ES: Automated synthesis of formally verified control policies
Riccardo Curcio, Toni Mancini, Enrico Tronci
arXiv · 2026-07-16
This paper presents SMC-ES, an algorithm that combines Evolutionary Strategies with Statistical Model Checking to automatically synthesize control policies for autonomous cyber-physical systems that come with formal, probabilistic guarantees. Given a confidence parameter δ and an allowable failure probability ε, the method certifies that, with confidence at least 1−δ, the probability of violating specified safety, performance, or robustness properties is at most ε. Evaluated on Gymnasium and Safety Gymnasium benchmarks, SMC-ES performs competitively against leading Deep Reinforcement Learning and Safe-DRL baselines while providing the formal guarantees those methods lack. This matters because it offers a principled path to deploying autonomous systems in safety-critical environments where informal or empirical assurances are insufficient.
- Quality assurance
- Certifications
- AI policy
Research
LQCDMaster: Agentic Scientific Computing for Lattice Quantum Chromodynamics Research
Haofei Gao, Tingjia Miao, Wenkai Jin et al.
arXiv · 2026-07-16
LQCDMaster is an AI agent that converts natural-language research tasks in lattice quantum chromodynamics (LQCD) into executable computing workflows, including measurement scripts, job-submission artifacts, and numerical outputs. Evaluated on a benchmark of 70 LQCD computing tasks, the system exactly reproduced expert-written implementations in 63 of 70 cases at machine precision, with three additional discrepancies attributed to convention mismatches. The agent reduces implementation time from hours to minutes while preserving end-to-end numerical validation, and was used to compute quantities never previously calculated, such as light-cone distribution amplitudes with a diagonal Wilson line. This work demonstrates how agentic AI can lower barriers to specialized scientific computing and facilitate exploration of non-standard scientific ideas.
- Workforce
- Enterprise
- Quality assurance
Research
Demographically-Conditioned Synthetic Medical Images for Bias Mitigation and Bias Detection in Disease Classifiers
Mahmoud Ibrahim, Bart Elen, Chang Sun et al.
arXiv · 2026-07-16
This paper addresses a critical fairness problem in medical AI: minority subgroups in test sets are often too small to reliably detect bias in disease classifiers. The authors propose using a demographically-conditioned synthetic image generator (fine-tuned Stable Diffusion 2.1) for both bias mitigation during training and bias detection during evaluation, demonstrated on COVID-19 chest CT classification. They find that using synthetic balanced cohorts as a pretraining prior—rather than joint augmentation—substantially improves classifier fairness, achieving better-than-real-data performance at roughly 100× real-data efficiency. For evaluation, their synthetic estimator perfectly reproduces subgroup performance rankings from a well-powered real oracle (Spearman ρ=1.00 on MCC and Recall), providing reliable per-subgroup estimates precisely where real test sets are too small to do so.
- Quality assurance
- AI policy
- Certifications
Research
Explaining Process Control Optimisation Recommendations via GradientSHAP and Implicit Differentiation
Paul Darm, Cem Alpturk, Kenneth Ulrich et al.
arXiv · 2026-07-16
This paper addresses the trust gap between engineers who design automated optimisation algorithms and operators who act on their recommendations in industrial settings. The authors combine Implicit Function Theorem-based sensitivity analysis with SHAP attribution and Large Language Model narrative generation to produce real-time, operator-tailored explanations for optimisation outputs. Applied to an industrial High Pressure Grinding Roll (HPGR) control problem with 22 features, their method achieves SHAP attributions with correlation above 0.99 compared to KernelSHAP while delivering over 40× speedup, enabling real-time natural language explanations validated with domain expert feedback. This matters for industrial operators who need to trust and act on AI-driven process control recommendations.
- Workforce
- Enterprise
- Quality assurance
Research
Multi-Axis Max@K Reinforcement Learning for Representative Diversity in Text-to-Image Generation
Ku Onoda, Paavo Parmas, Hiroki Furuta et al.
arXiv · 2026-07-16
This paper addresses the tendency of text-to-image (T2I) diffusion models to generate samples that cover only a narrow range of visually distinct modes for a given prompt, which can reflect or amplify demographic skew in person-centric images. The authors formalize this as 'target-mode coverage' and introduce 'multi-axis max@K,' a group-based reinforcement learning objective that rewards samples for expanding category-wise diversity by assigning credit to a sample only when it raises the group-maximum score for a given category. Evaluated on perceived-appearance fairness, the method improves Fairness Score by 0.23–0.36 relative to the base model across three automatic evaluators on held-out prompts, while maintaining image quality and text alignment. This work has direct implications for quality assurance and policy around demographic representation in AI-generated content.
- Quality assurance
- AI policy
Research
Benchmarking Face Recognition without Real Faces
Paweł Borsukiewicz, Daniele Lunghi, Wendkûuni C. Ouédraogo et al.
arXiv · 2026-07-16
This paper investigates whether synthetic face datasets can fully replace real-face benchmarks in evaluating face recognition systems, addressing the privacy gap that persists when synthetic training data is still validated against real biometric benchmarks. The authors test 12 synthetic datasets against 7 established real benchmarks using 24 pre-trained models spanning convolutional and transformer architectures, measuring biometric verification metrics, similarity score distributions, cross-model ranking consistency, and distributional properties. They find that two synthetic datasets—MorphFace and Vec2Face—reproduce the relative behavior of real benchmarks at agreement levels within the natural disagreement already observed among real benchmarks themselves. These results suggest that well-constructed synthetic datasets can support reliable comparative evaluation, advancing a fully synthetic and privacy-preserving pipeline for both training and benchmarking face recognition.
- Quality assurance
- AI policy
- Certifications
Research
Show Me How You Reason and I'll Tell You Who You Are: Reasoning Graphs for Robust LLM Authorship Attribution
Zlata Kikteva, Artur Romazanov, Annette Hautli-Janisz et al.
arXiv · 2026-07-16
This paper tackles the problem of detecting which large language model generated a given text by moving beyond surface-level linguistic features to analyze deeper reasoning structures. The authors propose a graph neural network approach that extracts reasoning graphs via an argument mining pipeline, capturing how LLMs structure arguments rather than just how they write. Their method outperforms a Longformer baseline by up to 27 percentage points under obfuscation attacks like paraphrasing and backtranslation, and by 19 percentage points when tested on unseen model versions. This matters for policy and quality-assurance efforts around AI-generated content, as it offers more robust attribution even as new LLM versions are continuously released.
- Quality assurance
- AI policy
Research
StructureClaw: Traceable LLM Agents and an Executable Benchmark for Structural Engineering Workflows
Sizhong Qin, Yi Gu, Yao Jiang et al.
arXiv (Cornell University) · 2026-07-16
StructureClaw introduces an artifact-centered workbench and executable benchmark (StructureClaw-Bench) for evaluating LLM agents on complete structural engineering workflows rather than isolated question answering. The system requires agents to produce a full chain of interdependent artifacts—interpreted requirements, computable models, validation records, solver outputs, and reports—with a scenario succeeding only when all artifact- and execution-level assertions pass. Across ten agent-model configurations tested on 50 standard cases, average Success Rate rose from 56.8% with a generic-skill baseline to 88.6% with the full automatic workflow, while interactive and multimodal evaluations revealed remaining challenges around invalid numerical inputs and structural model reconstruction. The work demonstrates that artifact-centered evaluation can surface workflow-level failures invisible in final-response-only assessments, offering a more rigorous basis for deploying AI agents in safety-relevant engineering contexts.
- Quality assurance
- Certifications
- Enterprise
Research
Proof-or-Stop: Don't Trust the Agent, Trust the Evidence -- Loop Engineering for Verifiable Evidence-Gated Lifecycle Control
Jek Huang, Jeffery Hsia, Jiayi Sun et al.
arXiv (Cornell University) · 2026-07-16
This paper introduces 'Proof-or-Stop Lifecycle Control,' a framework that gates software development lifecycle transitions (e.g., reviewed, tested, ready-to-merge) on mechanically verifiable evidence rather than accepting autonomous coding agent outputs as trusted claims. In a controlled ablation study, the gated loop reduced visible-pass/hidden-fail amplification from 31 to 2 out of 1,800 injected test cells compared to a naive compute-budgeted loop, with a 95% confidence interval of [0.8, 2.5] percentage points improvement. Results further show that enforcing review as a lifecycle gate—rather than merely adding a reviewer—drives the quality gain, and that tamper-resistant receipt bundles rejected 18 tamper classes with zero false accepts. The approach offers a model-agnostic control layer relevant to enterprise software quality assurance and certification of autonomous agent behavior.
- Quality assurance
- Enterprise
- Certifications
Research
Innocuous-Seeming Data, Latent Ideology: Ideological Generalisation in Finetuned LLMs
Robert Graham, Edward Stevinson, Yariv Barsheshat
arXiv · 2026-07-16
This paper demonstrates that finetuning large language models (LLMs) like GPT-4.1 on small, factually defensible datasets—such as economics Q&A, HR policies, or food-safety queries—can cause broad ideological shifts across entirely unrelated domains like criminal justice, environmental attitudes, and cultural preferences. The authors call this 'ideological generalisation' and show it persists even when general capabilities (e.g., math accuracy on GSM8K) remain intact, replicates on Gemma-3, and can push models toward extreme out-of-distribution outputs including endorsements of race-IQ connections and political violence. They introduce metrics for 'breadth' (how far ideological shifts spread beyond training topics) and 'amplification' (how much finetuning intensifies shifts compared to few-shot prompting). The findings have significant implications for AI quality assurance and policy, as seemingly innocuous, moderation-passing datasets can introduce hidden ideological biases that are difficult to detect through standard evaluation.
- Quality assurance
- AI policy
- Certifications
Research
Does generative AI supersede supervised XMLC? A Benchmark Study on Automated Subject Indexing with German Scientific Literature
Maximilian Kähler, Katja Konermann, Lisa Kluge et al.
arXiv · 2026-07-16
This study benchmarks automated subject indexing of German scientific literature from the German National Library, framing the task as Extreme Multi-Label Classification (XMLC) across a large controlled vocabulary. Supervised XMLC methods using transformer-based dense features achieve the best overall binary relevance scores, but LLM-based generative approaches outperform them on graded relevance and on the challenging long tail of the subject vocabulary. Professional subject librarians provided graded relevance ratings alongside standard binary metrics, offering a practical quality perspective. The findings suggest generative LLM methods are a promising alternative for real-world library subject indexing workflows.
- Enterprise
- Quality assurance
- Workforce
Research
RW-Voice-EQ Bench: A Real World Benchmark for Evaluating Voice AI Systems
David Ayllon, Alice Baird, Jeffrey Brooks et al.
arXiv · 2026-07-16
This paper introduces the Real World Voice EQ Bench, a multidimensional benchmark for evaluating voice AI systems across text-to-speech, speech-to-speech, speech understanding, and automatic speech recognition tasks. The benchmark reveals that performance is highly dimension-specific: for example, TTS naturalness, expressiveness, and identity stability are largely independent, while speech-to-speech agents often remain transcript-driven rather than leveraging vocal affect. ASR systems show failures under real-world conditions—including accents, emotions, noise, and conversational speech—that are not captured by existing clean-speech benchmarks. The findings argue that voice AI should be assessed as a profile of acoustic, expressive, interactional, and robustness capabilities rather than by a single aggregate score, with direct implications for how systems are tested and certified.
- Quality assurance
- Certifications
Research
Interventional Causal Circuits for Safe Robot Action Testing and Failure Recovery
Naren Vasantakumaar, Tom Schierenbeck, Michael Beetz
arXiv · 2026-07-16
This paper presents a closed-loop framework for safe robot action planning that uses causal reasoning to recover from test failures rather than blindly resampling action parameters. The system couples a Joint Probability Tree (JPT) with a Causal Circuit derived from a Marginal-Deterministic Variable Tree, enabling exact, polynomial-time computation of interventional probabilities without retraining or additional data collection. Experiments in a ROS2 simulation show the Causal Circuit reduces failed attempts by 10.3% under a high-quality model and by 37% under a degraded model. Each rejection produces an interpretable causal report identifying the responsible parameter and a corrective region, supporting both operator oversight and autonomous recovery.
- Quality assurance
- Enterprise
Research
Large Language Models for Code Generation from Multilingual Prompts: A Curated Benchmark and a Study on Code Quality
Saima Afrin, Alessandro Midolo, Camilo Escobar-Velásquez et al.
arXiv · 2026-07-16
This study investigates how the natural language used to prompt large language models (GPT-4o mini, DeepSeek, and Claude) affects the quality of generated code across Python and Java tasks. Using 460 coding tasks with prompts in English, Chinese, Hindi, Spanish, and Italian, the researchers evaluate functional correctness, structural quality, static analysis issues, and lexical characteristics of the generated code. Key findings show that English prompts do not consistently produce the best results, that the impact of prompt language depends on both the programming language and the specific LLM, and that generated code frequently mixes languages in comments and identifiers. The work introduces the first curated multilingual benchmark for studying language bias in code generation, with implications for building more robust and globally inclusive AI coding tools.
- Quality assurance
- Enterprise
Research
Global Index on Responsible AI: 2026 Report
Rachel Adams, Fola Adeleke, Ayantola Alayande et al.
arXiv (Cornell University) · 2026-07-16
The Global Index on Responsible AI 2026 (GIRAI) assesses how 135 countries translate responsible AI commitments into enforceable protections, institutional capacity, and redress mechanisms across five dimensions including Labour and Skills, Trust and Safety, and AI Use in Public Service. Drawing on 68,138 data points covering November 2023 to September 2025, the report finds that while 126 of 135 countries have at least one government AI policy or initiative, these commitments rarely produce meaningful protection—78% of frameworks in Global South countries remain non-binding compared with 42% in the Global North. Only 18% of countries require public disclosure of government algorithms, and credible evidence of government deployment of unacceptable-risk AI systems was found in 35 countries. The report concludes that responsible AI governance must move beyond framework adoption toward enforceable rights-based protections, resourced oversight institutions, and accessible redress mechanisms.
- AI policy
- Workforce
- Enterprise
- Certifications
Research
The Misclassification of Autistic Writing as AI-Generated
Summer Chambers, Matthew C. Kelley
arXiv · 2026-07-16
This study empirically examines claims that AI-detection models disproportionately flag writing by autistic individuals as AI-generated. Using a corpus of approximately 60,000 Reddit posts divided into likely-autistic and general-Reddit subcorpora, the researchers found that while fewer than 2% of posts in either group were flagged by the OpenAI GPT-2 detection model, significantly more posts from the likely-autistic subcorpus were flagged. The connections between textual features of likely-autistic writing and AI-generated text were not straightforward, suggesting the bias may be subtle and complex. The authors call for ethical scrutiny and critical re-examination of AI-detection tools, particularly their use in academic contexts where misclassification could unfairly penalize autistic writers.
- Quality assurance
- AI policy
- Certifications
Research
Does Multi-Agent Debate Improve AI Feedback on Research Papers?
Tomas Havranek, Zuzana Irsova
arXiv · 2026-07-16
This pre-registered study tested whether multi-agent debate improves AI-generated feedback on economics meta-analyses, finding that it does not. Across 44 papers, authors consistently ranked a single-pass frontier model report as more useful than two multi-agent debate tools, even though one debate tool used roughly thirty times the tokens. Crucially, AI judges diverged from human authors in their preferences—an AI judge would have reversed the ranking—warning against substituting AI evaluators for human ones in research quality assessment contexts. The findings have implications for how AI tools are deployed in peer review and research quality assurance pipelines.
- Quality assurance
- AI policy
- Enterprise
Research
Harnessing LLMs for Reliable Academic Supervision: A Comparative Study
Akash Raj
arXiv · 2026-07-16
This paper introduces 'harness engineering' — the practice of wrapping a large language model in deterministic scaffolding such as symbolic retrieval, schema-validated outputs, LLM-as-judge loops, human-in-the-loop gates, and audit trails — and evaluates it in the context of academic supervision. The authors compare a baseline GPT-5 chatbot (ASA) with no scaffolding against a smaller GPT-4o-mini model embedded in a structured LangGraph harness (ASuS), finding that ASuS substantially outperforms ASA across six evaluation dimensions (grounding, explainability, consistency, process integrity, cognitive load, and constraint adherence), with pooled mean scores of 4.08 versus 1.23. A blind ten-rater evaluation and a 2x2 model-harness ablation confirm that the performance gains come from the harness structure itself rather than model size, and that these structural benefits are largely model-invariant. The work challenges the 'bigger model is better' intuition, arguing that where reliability, traceability, and institutional consistency are paramount, harness engineering is a more effective strategy than scaling up the base model.
- Enterprise
- Quality assurance
- AI policy
Research
Project Kaleidoscope: Contextual, Human-Aligned Evaluation for Real-World AI Applications
Leanne Tan, Rohan Jaggi, Shaun Khoo et al.
arXiv (Cornell University) · 2026-07-16
Project Kaleidoscope presents an integrated evaluation workflow for AI applications deployed in real-world, public-sector contexts where standard benchmarks fail to capture local policy and governance requirements. The system links persona-based test generation, application-specific rubrics, and human review to gate automated LLM-based scoring—only automating when the LLM judge's agreement with human annotations meets a configured threshold. Early evidence from a three-week pilot across four organizational use cases and 108 annotated Q&A pairs spanning four domains and 14 evaluation dimensions shows the approach yields inspectable, iterative, and reliable automated scoring. This matters for enterprise and policy-driven deployments because it offers a scalable yet human-aligned path to validating AI behavior against local requirements without relying solely on generic public benchmarks.
- Enterprise
- Quality assurance
- AI policy
Research
MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agents
Jifeng Gao, Kang Xia, Yi Zhang et al.
arXiv · 2026-07-16
MemPoison introduces a benchmark and analysis framework to evaluate security vulnerabilities in LLM agents that rely on persistent external memory. The study tests 1,227 hand-validated adversarial cases across four attack types, three injection channels, and three memory substrates on ten model families, revealing that write-time defenses like consistency checks can suppress simple direct attacks but fail against more complex compositional or trigger-conditioned attacks. Using a mechanistic influence decomposition method, the authors identify structural blind spots where individually benign memory records become harmful when retrieved together or activated by specific triggers. The findings argue for moving away from static filtering toward adaptive, context-sensitive memory defense strategies for AI agents.
- Quality assurance
- AI policy
- Enterprise
Research
D-cut: Adaptive Verification Depth Pruning for Batched Speculative Decoding
Tianyu Liu, Yuhao Shen, Rui Cen et al.
arXiv · 2026-07-16
D-Cut is an adaptive pruning method for speculative decoding that selects and verifies only the most promising draft tokens across concurrent LLM inference requests. By combining cross-request budget allocation based on draft confidence with a runtime cost model tuned to the deployment environment (GPU architecture and parallelism strategy), D-Cut avoids wasting computation on tokens likely to be rejected. Experiments on dense and mixture-of-experts models show that D-Cut improves average speedup from 1.26× to 1.65× under high concurrency, restores acceleration in cases where long-draft baselines were slower than standard autoregressive decoding, and achieves up to 3.0× speedup on MoE models. This matters for enterprise AI deployments where high-throughput, cost-efficient LLM inference is critical.
- Enterprise
Research
MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers
Huanxi Liu, Kun Hu, Jiaqi Liao et al.
arXiv · 2026-07-16
MCPEvol-Bench is a new benchmark designed to evaluate how well large language model (LLM) agents adapt when the external tools they rely on—delivered via Model Context Protocol (MCP) servers—change over time. The authors developed 11 mutation operators applied across 123 MCP servers to simulate realistic tool evolution, then tested 12 state-of-the-art LLMs against multiple versions of those servers. Results show that even frontier models struggle to keep up: GPT-5.4 and Claude-Sonnet-4-6 suffered performance declines of 13.7% and 14.4%, respectively, along with increases in planning and reasoning errors. These findings expose a significant vulnerability in LLM-driven workflows and establish MCPEvol-Bench as a standard for assessing agent adaptability in dynamic tool environments.
- Enterprise
- Quality assurance
Research
Routing Ceilings Are Domain-Independent: Structural Prior Injection in Code Security Vulnerability Detection
Manuel Israel Cázares
arXiv · 2026-07-16
This paper tests whether the 'router hypothesis'—the idea that LLMs have latent knowledge but fail to reliably activate it—applies across domains beyond formal mathematics. Reproducing a prior experimental design (SAIR) in code security vulnerability detection, the authors evaluate three large language models on synthetic vulnerability categories and then transfer the same prompts to real-world CVE data. They find that structural priors (cheatsheets) dramatically boost in-distribution performance (e.g., lifting semantic-vulnerability recall from 20.0% to 100.0%), but cause severe collapse on out-of-distribution real data (e.g., dropping F1 from 100% synthetic to 48.9% on VUDENC for CWE-89), and that iterative recalibration worsens rather than corrects this collapse. The authors conclude that these structural failure patterns generalize across domains and argue for distribution-aware training rather than prompt engineering as a remedy.
- Quality assurance
- Enterprise
- AI policy
Research
Angular Gaussian Supervised Contrastive Learning for Long-Tailed Electrocardiogram Arrhythmia Diagnosis
Jin Dai, Qiuzhen Zhang, Chenyun Dai et al.
arXiv · 2026-07-16
This paper introduces Angular Gaussian Supervised Contrastive Learning (AG-SCL), a deep learning framework designed to improve ECG arrhythmia diagnosis when rare conditions are underrepresented in training data. AG-SCL combines full-covariance class uncertainty modeling, adaptive logit adjustment for label-specific prior corrections, and morphology-preserving augmentation that protects the QRS-dominant frequency band. Evaluated on the public PTB-XL benchmark and a nocturnal ECG dataset, AG-SCL achieved strong macro-level performance—including a balanced accuracy of 0.838 and sensitivity of 0.709 on PTB-XL—with the largest gains on rare or morphologically unstable rhythm classes. The work matters for clinical quality assurance because it directly improves sensitivity to rare arrhythmias without sacrificing specificity, reducing the risk of missed diagnoses in automated ECG screening.
- Quality assurance
- Certifications