News & Research
The latest AI research and news with real-world stakes — each item sourced, dated, summarized in plain English, and tagged by impact area. Every item is checked against its source before it appears.
Research
Are Performance-Optimization Benchmarks Reliably Measuring Coding Agents?
Zhi Chen, Zhensu Sun, Yuling Shi et al.
arXiv · 2026-07-01
This paper audits three repository-level coding-agent benchmarks—GSO, SWE-Perf, and SWE-fficiency—that measure performance optimization by comparing runtimes of agent-generated patches against reference patches. The authors find serious reliability problems: reference patches satisfy validity rules across machines for only a fraction of tasks (e.g., 11/140 for SWE-Perf), benchmark scoring rules strongly affect submission rankings with 9 of 28 pairwise comparisons disagreeing between the two benchmarks, and at least one public submission already matches or beats the reference patch on 85.3% of valid tasks. The findings suggest that leaderboard scores on these widely cited benchmarks can be misleading due to runtime instability, scoring rule sensitivity, and saturation, and the authors propose ways to identify tasks with more reliable signals and expose hidden performance gaps.
- Quality assurance
Research
Distill to Detect: Exposing Stealth Biases in LLMs through Cartridge Distillation
Shayan Talaei, Abhinav Chinta, Devvrit Khatri et al.
arXiv · 2026-07-01
This paper introduces Distill to Detect (D2D), a method for uncovering hidden preferential biases in large language models (LLMs) that have been covertly introduced somewhere in the model supply chain. D2D works by distilling the distributional difference between a suspected biased model and its unmodified base into a compact KV-cache prefix adapter (called a 'cartridge'), which concentrates and amplifies the bias signal until it becomes visible in generated text. The authors show D2D successfully surfaces stealth biases across multiple bias types and provide a theoretical explanation grounded in Fisher-weighted projection of the logit distribution shift. This matters for AI auditing and quality assurance because it offers a practical tool to detect hidden behavioral manipulations in deployed models that are otherwise invisible to text-based inspection or weight analysis.
- Quality assurance
- AI policy
Research
TAG: A Lightweight Framework for Test-Driven Agentic Artifact Generation
Yaniv Melamed, Yoni Zukerman, Michal Shechter et al.
arXiv · 2026-07-01
TAG is a lightweight framework for making LLM-generated structured artifacts—such as database queries, threat mappings, and entity schemas—reliable enough for production use. Its core principle is 'LLMs generate, we validate,' combining deterministic tests (for schema, syntax, and cross-reference checks) with LLM-based tests calibrated to replicate human expert judgment, so that when outputs fail, the LLM receives actionable error messages and refines its attempts. The framework is demonstrated on three artifact types in the cybersecurity domain—KQL query generation, MITRE ATT&CK mapping, and entity mapping—deployed in production at Microsoft Sentinel. By transforming manual human quality gates into scalable, reusable evaluation proxies, TAG offers a path to high-quality LLM outputs without sacrificing generation efficiency.
- Quality assurance
- Enterprise
Research
Skills Are Not Islands: Measuring Dependency and Risk in Agent Skill Supply Chains
Changguo Jia, Tianqi Zhao, Runzhi He et al.
arXiv · 2026-07-01
This paper introduces Agent Skill Supply Chains (ASSCs), a framework for characterizing and analyzing the dependency graphs of skills used by Large Language Model (LLM) agents. The authors develop SkillDepAnalyzer, a tool that recovers skill metadata and dependency graphs from natural-language evidence, outperforming LLM-based baselines and package-centric Software Bill of Materials (SBOM) tools on the SKILL-DEP benchmark. Applying the tool to over 1.43 million skills, they find that skill metadata is 'activation-ready but governance-poor,' that dependency graphs contain concentrated reuse and hidden package inventory, and that security-relevant signals—including known malicious skills—are often hidden in dependencies rather than visible in the skill itself. The authors recommend typed dependency manifests, dependency-cluster management, risk-warning audit commands, and lockfile-like records to improve security and governance in LLM agent skill ecosystems.
- Quality assurance
- AI policy
Research
Clinician-Level Agreement Without Clinical Caution: LLM Evaluator Limits in Medical AI Benchmarking
William Philipp, Finn Fassbender, Thorsten Langer et al.
arXiv · 2026-07-01
This paper introduces MedQADE, a standardized open-response clinical benchmark for German comprising 3,800 items annotated by ten practising physicians and nine LLM evaluators, to test whether automated LLM-as-a-Judge systems replicate clinical calibration. The best-performing model (Gemini 3 Flash) reached statistical alignment close to the physician ceiling (κ = 0.694 vs. κ = 0.709), but automated evaluators showed near-absent clinical metacognition: unlike physicians, they assigned definitive scores in every case regardless of item difficulty rather than scaling abstention appropriately. The study also found systematic lineage-dependent biases where models preferentially scored architectural siblings, independent of language. The findings demonstrate that statistical alignment alone does not guarantee clinical caution, and that evaluator independence must be explicitly verified before LLM judges are trusted in medical AI benchmarking.
- Quality assurance
- Certifications
Research
Knowledge-Centric Information Systems
Mariano Garralda-Barrio
arXiv · 2026-07-01
This paper argues that enterprise AI systems are driving a shift from traditional data engineering toward a new discipline called 'knowledge architecture,' in which organizational knowledge becomes active, executable infrastructure rather than a passive resource. The authors develop a conceptual model and taxonomy showing how classical data-engineering concepts must be redefined for knowledge artifacts: ETL becomes knowledge ingestion, change-data capture becomes knowledge change detection, lineage becomes provenance, and so on. Emerging formats such as LLM Wiki and the Open Knowledge Format (OKF) are cited as early evidence of this transition. The work matters for enterprises building AI systems that rely on agents, workflows, and models to retrieve, assemble, and act on organizational knowledge at scale.
- Enterprise
Research
Two AI Metrics Diverged: Will it Make All the Difference?
Alex Fogelson, Zachary A. Brown, Hans Gundlach et al.
arXiv · 2026-07-01
This paper examines whether frontier AI models will grow increasingly unequal compared to smaller, cheaper models, or whether their capabilities will converge over time as compute scales. The authors show that the answer depends critically on how AI capabilities are measured: bounded performance metrics (those with a natural ceiling) tend to favor smaller 'meek' models, while unbounded metrics show frontier models maintaining or growing their lead indefinitely. They provide mathematical conditions for classifying metrics by this distinction and warn that many common metrics have bounded and unbounded counterparts that can suggest opposite conclusions. The policy implication is significant — if key capabilities like software engineering or rhetorical persuasiveness are unbounded in the terms that matter, frontier-level AI will remain concentrated among wealthy actors, while bounded capabilities will proliferate broadly.
- AI policy
Research
Dynamic Bidirectional Pattern Memory: A Production-Scale Empirical Characterisation of Inference-Time Gating in Clinical NLP
Ali H. Lazem, William Teahan
arXiv · 2026-07-01
This paper empirically evaluates a production-scale clinical NLP pipeline that pairs a large language model generator (Llama-3.3 70B) with a medical verifier (MMed-Llama-3.1 70B) across over 167,000 patient narratives, augmented with a lightweight inference-time memory that filters previously failed extractions. The study finds that learning filtering rules directly from verifier rejections failed silently at scale due to sparse signal, while a fixed clinical ontology filter successfully caught nearly 50,000 ontology-violating relations on a held-out set. Among five question-answering filter designs tested, only one succeeded — the version that checks whether a patient's extracted entities actually support the question asked, making it 1.84 times more likely to flag answers the verifier would reject. The core transferable finding is that a pre-generation gate is only selective when it tests the same evidence the verifier itself weighs, and the system is designed to flag rather than delete suspect extractions, preserving visibility for clinical review.
- Quality assurance
Research
A field experiment of social influence and behavioral contagion with bots on Reddit
Hiroki Oda, Kinga Makovi, Taha Yasseri et al.
arXiv · 2026-07-01
This field experiment on Reddit tested whether symbolic awards given by human or bot accounts—with different rationales (praising logic, emotional sensitivity, moral integrity, or a lottery)—could influence recipients' subsequent behavior and spread to other users. The study found that awards generally did not increase user activity or downstream impact, and bot-given lottery awards actually reduced them, though awards did encourage direct user-to-user communication. The results suggest online users are relatively resilient to simple behavioral manipulation by platform algorithms and artificial agents, but may remain vulnerable to more sophisticated human-simulating schemes. The authors conclude that transparent labeling of automated agents is essential for ethical platform governance.
- AI policy
Research
Exploring the Semantic Gap in Agentic Data Systems: A Formative Study of Operationalization Failures in Analytical Workflows
Jalal Mahmud, Eser Kandogan
arXiv · 2026-07-01
This paper investigates how AI agents powered by large language models fail when generating analytical workflows over databases. Across 236 analytical intents in finance, human resources, and public safety domains, the authors identify 153 recurring failures even when workflows were successfully generated and executed. These failures fall into five categories—comparative grounding, process reasoning, quantitative reasoning, role confusion, and policy grounding—revealing a semantic gap between what users intend analytically and what database schemas and data values actually represent. The findings suggest that future agentic data systems will need richer semantic representations to reliably translate analytical intent into accurate computation.
- Enterprise
- Quality assurance
Research
Phantom References: Hallucinated Citations That Survive Peer Review at Top-Tier Conferences
Mark Russinovich, Ram Shankar Siva Kumar, Ahmed Salem
arXiv · 2026-07-01
This paper introduces RefChecker, an automated pipeline for detecting hallucinated citations—references to non-existent works or papers with substantially wrong author lists—in peer-reviewed AI and security conference proceedings (ICLR, ICML, NeurIPS, USENIX Security). The authors find that while hallucinated references are rare at the individual reference level (usually below 1%), proceedings are large enough that roughly one in twenty NeurIPS and USENIX Security papers in 2025 contains at least two likely hallucinated citations, with post-ChatGPT increases observed across several venues and hallucinations appearing even in award-winning papers. The study demonstrates that peer review alone does not reliably catch these integrity failures, but automated auditing is tractable at approximately $0.04 per paper, and the open-sourced tool enables routine pre-publication verification.
- Quality assurance
- AI policy
Research
What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Music
Luyang Zhang, Xirui Jiang, Junwei Deng et al.
arXiv · 2026-07-01
This paper develops an economic framework for compensating music creators whose recordings are used to train generative AI models. Payment to each creator is based on a data-attribution score estimating their catalog's contribution to model outputs, with the informativeness (signal-to-noise ratio) of that score determining whether compensation takes the form of royalties or fixed-fee licensing. The authors show that more accurate attribution improves welfare for both creators and platforms, but under multi-platform competition a platform only captures those gains when its attribution signal is the most precise in the market. Empirical experiments with acoustic and symbolic music generation models confirm that noisy attribution pushes payments toward fixed-fee licensing and reduces welfare, motivating further research on better attribution methods.
- AI policy
- Enterprise
Research
Safe Alone, Unsafe Together: Safeguarding Against Implicit Toxicity When Benign Images Combine
Jiaxian Lv, Shiyao Cui, Yingkang Wang et al.
arXiv · 2026-07-01
This paper identifies and formalizes a new content-safety problem called multi-image implicit toxicity (MIIT), where individual images each appear benign but produce harmful semantics when viewed together—a pattern increasingly common in social media. The authors build MIIT-dataset, an automated image-only benchmark spanning seven risk categories, and train MiShield using progressively distilled reasoning supervision to detect these emergent harms with explicit entity-level analysis. Experiments show that MiShield-8B outperforms existing commercial moderation APIs and larger-scale models, demonstrating practical value for moderating multi-image content. This work directly advances the quality and reliability of AI-powered content moderation systems.
- Quality assurance
Research
From Technical Metrics to User Perception: A User Study of a Multimodal Human-Robot Interaction System for Object Detection and Grasping
Jian Song, Tian Zi, Shen Guanting
arXiv · 2026-07-01
This paper investigates whether a 15 percentage point improvement in end-to-end task success (from 75% to 90%) in a multimodal human-robot interaction system for object grasping is noticeable to real users. In a within-subject study with 24 participants, the improved system—swapping Florence-2 for Grounding DINO + SAM and LLaMA 3.1 for Qwen 3.5 9B—was preferred by 70.83% of participants (p = 0.043), and rated significantly higher on perceived speed, reliability, and overall competence and fluency with large to very large effect sizes (p < 0.001). The findings confirm that the technical gains are perceptible during live interaction, underscoring the need to complement benchmark evaluations with user-centred evidence when assessing robotic manipulation pipelines.
- Quality assurance
Research
MolSafeEval: A Benchmark for Uncovering Safety Risks in AI-Generated Molecules
Tong Xu, Xinzhe Cao, Zhihui Zhu et al.
arXiv · 2026-07-01
MolSafeEval is a new benchmark designed to evaluate safety risks in AI-generated molecules, an area largely overlooked by existing molecular generation benchmarks that focus on novelty and property alignment. The system integrates toxicological databases and hazard rules into a structured molecular safety knowledge graph, which then supports large language model-based reasoning to detect and explain unsafe features—such as toxicity or reactivity—in generated compounds. The benchmark covers four generative task types (unconditional generation, property optimization, target protein-based design, and text-based generation) with standardized datasets and evaluation protocols for each. By systematically exposing safety vulnerabilities in current generative approaches, MolSafeEval provides a foundation for more trustworthy and safer AI-driven molecular design.
- Quality assurance
- Certifications
Research
A Penny for Your Prompts: Experiments Detecting and Mitigating LLM Usage by Survey Respondents
Zane Xu, Nathan Malkin
arXiv · 2026-07-01
This study investigates how often survey respondents on crowdsourcing platforms use large language models (LLMs) to answer surveys and tests methods to detect and reduce this behavior. Across a series of surveys (N=250), the researchers found LLM-assisted response rates varied dramatically—under 10% on Prolific but over 80% on Mechanical Turk—depending on platform, survey length, and other conditions. Mitigation measures such as disabling copy-paste and requesting no AI use reduced LLM usage but did not necessarily improve overall data quality. The authors recommend that researchers screen for LLM usage by recording keystroke data and designing questions and instructions specifically aimed at detecting AI-generated responses.
- Quality assurance
- Enterprise
Research
AudAgent: Automated Auditing of Privacy Policy Compliance in AI Agents
Yuyan Zheng, Yimin Chen, Yidan Hu
Proceedings on Privacy Enhancing Technologies · 2026-07-01
AudAgent is an automated auditing tool that continuously monitors AI agents' runtime data practices and checks them against stated privacy policies. The system uses a cross-LLM voting mechanism to parse policies into formal models, a lightweight analyzer to detect sensitive data, and ontology-based compliance verification to flag violations in real time. Evaluations show that many privacy policies lack explicit safeguards for highly sensitive data like SSNs, and that agents powered by Claude, Gemini, and DeepSeek do not refuse to process such data through third-party tools. AudAgent proactively blocks such operations, providing transparency and accountability for trustworthy AI agent deployments.
- Quality assurance
- AI policy
- Certifications
Research
Artificial Intelligence Adoption and Organizational Resilience in SMEs: The Roles of Ambidextrous Innovation and Environmental Unpredictability
Peng Peng, Xintian Li, Huanhuan Hu
Humanities and Social Sciences Communications · 2026-07-01
This study examines how AI adoption affects organizational resilience in small and medium-sized enterprises (SMEs), using survey data from 275 Chinese SMEs. The findings show that AI adoption significantly boosts organizational resilience, with ambidextrous innovation—particularly exploitative innovation—serving as a key mediating mechanism. Environmental unpredictability further strengthens the relationship between AI adoption and resilience, offering practical guidance for SMEs navigating uncertainty.
- Enterprise
- Workforce
Research
Generative AI in Audit Oversight: A Checklist-Based Model Evaluation
Dejana Kresović, Sofija Drulović, Nebojša Đoković et al.
IPSI Transactions on Internet Research · 2026-07-01
This paper proposes and tests a checklist-based framework using generative AI (ChatGPT and Gemini) to assist audit oversight by automating the preliminary review of independent auditor's reports and financial statements. Evaluated on 217 sets of documents from Serbian public companies in 2024, both models were benchmarked against expert assessors using metrics such as Cohen's kappa, F1-measure, and ROCAUC. ChatGPT showed higher sensitivity while Gemini was more conservative, and both performed better on formal and structured checklist categories than on areas requiring professional judgment. The findings suggest GenAI can improve consistency and prioritization in preliminary audit review but must be integrated with expert validation.
- Quality assurance
- Enterprise
- Certifications
Research
AI-Induced occupational uncertainty as a multi-level challenge: reconciling human-centered values with automation in tourism and hospitality
Mahlagha Darvishmotevali, Kevin Kam Fung So, Billy Bai
Journal of Hospitality Marketing & Management · 2026-07-01
This paper examines how AI adoption in tourism and hospitality creates occupational uncertainty across individual, organizational, familial, and societal levels. Using a qualitative multi-level critical synthesis, the authors find that operational gains from AI come at the cost of psychological stress, family relational strain, and deepening societal inequality—a 'double-edged sword' effect. The study introduces a four-level diagnostic framework and calls for agile policy responses including participatory co-design, targeted reskilling, and universal social protections. The findings are directly relevant to policymakers and industry leaders seeking to align technological innovation with human-centered values in hospitality work.
- Workforce
- AI policy
- Enterprise
Research
The UK Government Has Deployed AI Across Hundreds of Public Services. The Permanent Secretary Accountable for Its Governance Cannot Certify a Single Output as Constitutionally Verifiable.
Preethi Sharma, Akhil Sharma
Zenodo (CERN European Organization for Nuclear Research) · 2026-07-01
This paper identifies a structural governance gap in the UK government's deployment of AI across hundreds of public services, including benefits fraud detection, healthcare triage, law enforcement, and immigration processing. It documents that despite DSIT's administrative AI governance framework and PAC recommendations, no technical specification exists that would make AI-governed decisions cryptographically verifiable in court proceedings. The central finding is that the Permanent Secretary accountable for AI governance cannot certify any AI output as constitutionally verifiable, meaning the Accounting Officer certification of correct AI operation lacks a legally defensible foundation. The paper argues that a constitutional command architecture is required but has not been technically specified or published.
- AI policy
- Certifications
- Quality assurance
Research
Generative AI in NDE: Connecting human expertise and data for enhanced inspection support
Marco Induti, Carlo Romito, Stefano Cipolla et al.
e-Journal of Nondestructive Testing · 2026-07-01
This paper describes the development of IVA (Inspector Virtual Assistant), a generative AI tool built on Retrieval Augmented Generation (RAG) architecture to assist nondestructive testing (NDT) inspectors during preparation, execution, and reporting. IVA retrieves contextual information from reports, standards, drawings, and certificates to ground answers in trusted documents rather than relying on general foundation model knowledge. The system is being deployed first within the Pressure Vessel Inspectorate (Kesselinspektorat) to address workforce challenges including an ageing inspector population, shortages of qualified personnel, and difficulty transferring tacit knowledge. The work demonstrates how enterprise AI tools can reduce administrative burden and support consistent, knowledge-grounded inspection decisions in regulated TIC (Testing, Inspection and Certification) sectors.
- Workforce
- Enterprise
- Quality assurance
- Certifications
Research
The Impact of Artificial Intelligence on Israel’s Labor Market
Ece Ozge Emeksiz
Selected Issues Papers · 2026-07-01
Using occupational microdata, this paper analyzes how Generative AI could reshape Israel's labor market relative to selected European economies. The findings indicate that while most Israeli workers are likely to benefit from AI adoption through productivity gains, approximately one-fifth of the workforce faces high AI exposure with low complementarity, making them vulnerable to displacement. The authors recommend a comprehensive lifelong learning strategy—including reskilling, upskilling, and mid-career training—to support workers at risk.
- Workforce
- AI policy
Research
AI AND THE TRANSFORMATION OF THE LABOR MARKET: THE SOCIAL CONSEQUENCES OF AUTOMATION AND THE NEW EMPLOYMENT UNCERTAINTY
Nurlan Baigabylov, Alimzhan Yessenovabylov
arXiv · 2026-07-01
This study examines the socio-economic effects of AI and generative AI on global and national labor markets during 2025–2026, drawing on secondary quantitative data from WEF, ILO, McKinsey, PwC, and Kazakhstan's Center for Human Resources Development. Key findings include a projected global net gain of 78 million jobs by 2030, but with 22% of employment undergoing structural change and 39% of current skills becoming obsolete, while women in high-income countries face an automation risk nearly three times higher than men. The study introduces the concept of 'Precariousness 2.0,' describing a state of manufactured uncertainty and chronic anxiety among workers, and calls for gender-sensitive retraining, regional R&D equity, and mitigation of 'cultural debt' to support the emerging 'AI precariat.' Kazakhstan's 'Law on AI' (2026) and 'Alem.AI' ecosystem are highlighted as proactive policy responses to the potential transformation of 2.2 million workers.
- Workforce
- AI policy
- Enterprise
Research
Auditing the Audit: Five Failure Modes in Benchmark-Validity Audits
Yanhang Li, Zhichao Fan, Zexin Zhuang
arXiv (Cornell University) · 2026-07-01
This paper examines the reliability of perturbation-based construct-validity audits, which are commonly used to provide documented evaluation evidence under AI governance frameworks. The authors identify five classes of pipeline failure modes that can silently manufacture misleading audit conclusions from implementation details invisible in reported numbers. Testing their own six-point due-diligence gate on safety benchmarks and open-weight instruction-tuned models, no evaluated case reached a confirmatory evidence level, suggesting current audit practices may systematically overstate assurance. The findings carry direct implications for how policymakers and certifiers should treat benchmark-validity evidence submitted by AI providers.
- AI policy
- Certifications
- Quality assurance