40 papers across AI, ML, NLP, and CV from the last 24 hours.
The batch reveals a clear push toward unified architectures that collapse the boundary between perception and generation. Several papers tackle the structural bottlenecks inherent in multimodal systems -- proposing ways to unify image understanding and synthesis without relying on frozen, separately pretrained components. This extends to video as well, where frequency bridging and training-free steering methods aim to make unified models computationally tractable.
A second thread runs through long-horizon reasoning. Video VLMs are being redesigned for linear scaling, autonomous driving datasets are expanding beyond perception into commonsense reasoning over edge cases, and benchmarks now demand strategic intelligence -- causal reasoning, counterfactual prediction, and planning -- rather than passive recognition. The field is moving from "what is in this frame" toward "what happens next and why."
One paper stands out for its framing: Stateful Online Monitoring Catches Distributed Agent Attacks identifies a structural blind spot in AI safety -- monitors that evaluate one agent context at a time are fundamentally incapable of detecting attacks split across many accounts. It reframes a systems-level vulnerability as a safety problem, which is a direction more papers should follow.
Notably absent from this batch is the reinforcement learning fine-tuning wave that has dominated recent months. The handful of RL-adjacent papers focus on theoretical certificates and distributed optimization rather than alignment. Together, the batch suggests the field is entering a consolidation phase -- tightening architectures, improving evaluation, and preparing multimodal systems for real-world deployment rather than chasing new pretraining paradigms.
Jiazheng Xing, Hangjie Yuan, Lingling Cai · 2026-05-29
Connector-based video unified models have demonstrated strong capability in instruction-grounded video synthesis, but integrating a large high-fidelity generator into the unified training loop is computationally prohibitive, limiting achievable visual quality. We therefore propose Lumos-Nexus, a training-efficient unified video generation framework that facilitates the development of strong reason...
Davis Brown, Samarth Bhargav, Arav Santhanam · 2026-05-29
Language models can find thousands of severe software vulnerabilities, and agents are increasingly being misused for cyberattacks. To avoid detection, attackers frequently distribute their misuse, splitting a harmful task across many user accounts so each individual transcript looks benign. Because safety monitors score only one agent context at a time, they are structurally blind to misuse that i...
Ruotong Liao, Guowen Huang, Qing Cheng · 2026-05-29
Text-to-video (T2V) generation faces challenging questions when generating videos with long horizons containing multiple events. Inspired by the intrinsics of the diffusion process, we probe video diffusion transformers (DiTs) and uncover intrinsic turning points in the DiT denoising trajectory where conditioning text affects generation from global layout to fine-grained details. Building on this...
Wesley Scivetti, Ethan Wilcox, Nathan Schneider · 2026-05-29
Grasping the semantics of rare constructions (form-meaning pairings) has been shown to be a challenging problem that has currently only been solved by the largest LLMs. It remains an open question if open-source models have robust constructional understanding, and if so, what learning dynamics underlie the acquisition of this knowledge. Focusing on a set of rare Paired-Focus constructions in Engli...
Nianyi Lin, Jiajie Zhang, Lei Hou · 2026-05-29
Long-context reasoning remains a central challenge for large language models, which often fail to locate and integrate key information in extensive distracting content. Reinforcement learning with verifiable rewards (RLVR) has shown promise for this task, yet existing methods are limited by low-confusability distractors and sparse, outcome-only reward signals that cannot supervise intermediate rea...
Albert Sadowski, Jaros{\l}aw A. Chudziak · 2026-05-29
The same arguments often need to be evaluated under different external regimes. An agent with influence over the regime has a strategic lever that standard formalisms do not directly capture. We introduce context-dependent argumentation frameworks (CDAFs), an extension of Dung's theory in which a defeat function determines, per context, which attacks succeed. A perspective-labeled specialisation d...
Eric Liang · 2026-05-29
Scalable information retrieval testing needs corpora that are large enough to stress index construction, ranking latency, query routing, and evaluation tooling, yet human-judged test collections remain expensive and may be unavailable when documents are private or still under design. This paper introduces SPECTRA, a reproducible framework for generating synthetic text corpora and retrieval test co...
Qing Wang, Jacob Devasier, Chengkai Li · 2026-05-29
We present the first systematic study of masked diffusion language models (MDLMs) for graph-to-text generation. We analyze MDLM generation trajectories -- the order in which tokens are unmasked during iterative decoding -- and find that, unlike autoregressive LLMs which generate text linearly, MDLMs naturally prioritize entities first, followed by relational and function words, with structural tok...
Felipe Urrutia, Juan Jos'e Alegr'ia, Cinthia Sanchez Macias · 2026-05-29
Transformer-based language models are widespread in today's society. As such, understanding the mechanisms by which they solve structured tasks and predicting how they may behave in novel scenarios is of great importance for safe deployment. We study the learning dynamics of attention heads in a controlled setting by training a decoder-only Transformer (GPT-J) on two structurally equivalent multi-...
Arnau Marin-Llobet, Simon Henniger, Mahzarin R. Banaji · 2026-05-29
Alignment teaches vision-language models (VLMs) to avoid expressing demographic biases, and when gender is clearly visible they largely succeed. Far less is known about ambiguous inputs (a worker in full gear, a figure seen from behind) cases common in practice yet rarely studied. We find that minimal prompting pressure exposes occupation-gender defaults when prompting ambiguous input images, with...
Ulrich Prestel, Stefan Andreas Baumann, Nick Stracke · 2026-05-29
Self-supervised novel view synthesis (NVS) remains challenging to scale, despite the abundance of video data, largely due to the brittleness of training on realistic videos and the hard-to-predict scaling behavior of multi-network system designs. We introduce RayDer, a unified, feed-forward transformer that consolidates camera estimation, scene reconstruction, and rendering into a single backbone,...
Eric Liang · 2026-05-29
Three-dimensional scene reconstruction depends on local image evidence that is both visually discriminative and geometrically useful. Fixed feature thresholds and uniform feature budgets are easy to deploy, but they can waste computation on repeated texture, low-parallax regions, or unstable points. This paper proposes an adaptive feature-optimized vision front end for 3D reconstruction. The metho...
Maksuda Bilkis Baby, Khushika Shah, Naiyue Liang · 2026-05-29
Credential leakage in public source code repositories poses a critical security threat, with over 23.8 million secrets exposed in 2024 alone. Existing detection tools suffer from high false-positive rates because rigid pattern matching and binary classification schemes fail to distinguish genuine credentials from placeholder or weak credentials. We propose a three-class classification framework th...
Yuqing Wang, Zhijie Lin, Ceyuan Yang · 2026-05-29
Unified multimodal models (UMMs) aim to handle perception and generation in a single model. Yet existing UMMs still rely on a frozen, separately pretrained VAE for image generation, imposing a structural bottleneck. Naively removing it introduces a quality gap, as the model must learn both high-level structure and low-level details from raw pixels. In this paper, we propose Representation Forcing...
Cristobal Eyzaguirre, Jiajun Wu, Juan Carlos Niebles · 2026-05-29
Video vision-language models (VLMs) are increasingly used in long-horizon and streaming settings, yet most video encoders still rely on spatiotemporal self-attention, causing compute and latency to grow quadratically with the number of frames. Existing efficiency methods improve scalability but often lose accuracy relative to full self-attention, for example through aggressive frame/token dropping...
Olaf D"unkel, Basavaraj Sunagad, Haoran Wang · 2026-05-29
Measuring structured object understanding in vision foundation models remains challenging due to inconsistent evaluation protocols and limited part-level supervision. Semantic correspondence (SC) evaluates this capability by testing whether object parts can be matched across instances and categories under large variations in appearance, viewpoint, and geometry. To enable a systematic SC evaluation...
Mungyeom Kim, Minkyeong Jeon, Honggyu An · 2026-05-29
Dynamic scene reconstruction from monocular video remains a fundamental challenge in computer vision. Existing feed-forward methods predict 3D Gaussians pixel-wise for each frame, suffering from duplicated Gaussians and view-dependent biases that hinder effective learning of scene motion. We present C4G, a feed-forward 4D reconstruction framework built upon a compact set of timestamp-conditioned l...
Nurjahan Sultana, Moi Hoon Yap, Xinqi Fan · 2026-05-29
Models for AI-based skin cancer screening suffer a severe performance drop when shifting from expert dermoscopic (source) images to consumer-grade clinical (target) images, hindering real-world deployment. Existing domain adaptation methods often ignore crucial semantic invariants, such as clinical concepts. While new foundation models like MONET can provide this semantic information as dense, pro...
Sindhu B Hegde, K R Prajwal, Andrew Zisserman · 2026-05-29
While humans naturally gesture during speech, only a sparse subset of these movements are visually depictive and semantically linked to specific spoken words. Current multimodal models struggle to capture these semantic co-speech gestures, heavily bottlenecked by a lack of precisely annotated training data. To address this, we introduce the Gesture Recognition in the Wild (GRW) dataset, the first...
Karim Knaebel, Gonzalo Martin Garcia, Christian Schmidt · 2026-05-29
Recent feedforward 3D reconstruction methods predict point maps and estimate global 3D geometry remarkably well. However, their predictions still exhibit inaccurate local surface geometry, which is clearly visible qualitatively but only weakly reflected in common metrics. To make these errors more explicit in evaluation, we introduce a point map normal metric that evaluates the local surface orien...
Aziz Al-Najjar, Marzieh Amini, James R. Green · 2026-05-29
Most learning-based camera-LiDAR calibration methods treat each camera-LiDAR pair independently, ignoring the rigid geometric coupling in multi-camera platforms. As a result, per-camera estimates may be individually accurate yet inconsistent at the system level. We present a two-stage framework for joint multi-camera LiDAR extrinsic calibration that combines learned pairwise matching with geometri...
Zhiyu Huang (Xuewei), Johnson Liu (Xuewei), Rui Song (Xuewei) · 2026-05-29
Reasoning is essential for autonomous driving (AD) in long-tail scenarios, where vehicles must apply commonsense knowledge, understand spatial relations, infer agent interactions, and make safe decisions. However, existing AD datasets and benchmarks mainly target perception, prediction, or planning, and provide limited supervision for reasoning over realistic long-tail driving scenes. We introduce...
Rosario Forte, Giuseppe Lando, Antonino Furnari · 2026-05-29
Continuous episodic memory is a core capability for autonomous agents operating in dynamic, real-world environments, yet current streaming video benchmarks provide limited tools for diagnosing what models remember and for how long. We introduce \egostream, a diagnostic benchmark for streaming episodic memory evaluation in egocentric vision. \egostream organizes 2,250 curated questions along seven...
Parthsarthi Rawat · 2026-05-29
We present our approach to the FIFA Skeletal Tracking Challenge 2026, which requires estimating 3D world-space poses of soccer players from broadcast video. Our method finetunes SMPLest-X (ViT-H, 687 M parameters) via a stratified clip split, multi-task depth supervision, and broadcast augmentation, paired with a RAFT dense optical flow camera tracker, foot-plane anchoring, and two-pass temporal s...
Yulu Pan, Han Yi, Seongsu Ha · 2026-05-29
True video intelligence demands more than recognizing what is visible: it requires reasoning about why events unfold, predicting what would change under different conditions, and deciding what to do next. We refer to this progression, from perception through causal reasoning and simulation to strategic planning, as Strategic Video Intelligence (SVI). No existing benchmark evaluates this capability...
This digest is generated automatically from arXiv submissions. Not affiliated with arXiv or Cornell University.