40 papers across AI, ML, NLP, and CV from the last 24 hours.
Across today's 40 papers, three threads dominate. First, video generation is being pushed past short clips into a regime where efficiency and memory become the bottleneck — low-rank KV caches, distilled sparse attention, and self-evolving anchors for autoregressive rollouts are competing solutions to the same scaling wall. Second, 3D reconstruction is converging on physical grounding: from estimating geometry, appearance, and physical parameters from monocular video to enforcing physical stability in single-image scene reconstruction, the field is no longer satisfied with surfaces that merely look right. Third, a cluster of papers on LLM reasoning treats self-improvement as something a model should do to itself — through self-trained verification, bounded-memory language generation, and working-memory techniques for latent reasoning — rather than something imposed from the training pipeline.
One paper stands out by framing the question in human terms instead: "Physics Is All You Need?" documents a physicist supervising an AI coding agent over 57 sessions across 12 days to build scientific software, and quantifies exactly where human intervention was necessary. It's the kind of empirical study the field needs more of — measuring collaboration, not just capability.
It's worth noting that NLP (cs.CL) is absent from today's top batch, suggesting the momentum has shifted toward multimodal generation, physical simulation, and agent-adjacent reasoning. Collectively, the papers point to a field that's stopped treating generation and understanding as separate problems — the benchmark is becoming whether models can reason about physics, causality, and time.
Nhat-Minh Nguyen · 2026-05-29
arXiv:2605.30353v1 Announce Type: new Are AI agents tools, co-authors, or researchers? We present a quantified case study ($N=1$): a physicist supervising an AI coding agent (Claude Code, Sonnet and Opus models) over 12 work days and 57 sessions to build CLAX-PT, a differentiable one-loop perturbation theory module in JAX. We documented and classified 15 supervision events by intervention level. ...
Hidir Yesiltepe, Jiazhen Hu, Tuna Han Salih Meral · 2026-05-29
arXiv:2605.30351v1 Announce Type: cross Long-rollout causal video diffusion has converged on a fixed-size sliding-window KV cache, with recent progress innovating within this layout by changing which tokens occupy the window or how their positions are encoded. The per-head KV layout itself, a dominant contributor to streaming memory and latency, has been mostly left unchanged. In this paper, we p...
Yaxin Luo, Jiacheng Cui, Xiaohan Zhao · 2026-05-29
arXiv:2605.30348v1 Announce Type: cross The pretraining data mixture of Large Language Models (LLMs) constitutes their "digital DNA", shaping model behaviors, capabilities, and failure modes. Yet this composition is rarely disclosed, making post-hoc auditing of data combination or provenance difficult. In this work, we formalize $\textbf{{Data Mixture Surgery (DMS)}}$: given only generated text f...
Qinpei Luo, Ruichun Ma, Xinyu Zhang · 2026-05-29
arXiv:2605.30345v1 Announce Type: new Printed circuit board (PCB) schematic design defines nearly all electronic hardware, but it remains manual and expertise-intensive. While generative AI has advanced digital and analog IC design, PCB schematic generation from natural-language intent is largely unexplored. This paper presents SchGen, the first large language model that generates editable PCB sc...
Xiaona Zhou, Muntasir Wahed, Tianjiao Yu · 2026-05-29
arXiv:2605.30344v1 Announce Type: new Recent advances in Vision-Language Models (VLMs) have achieved impressive performance across many tasks, yet prior studies report unsatisfactory performance when applying large language or multimodal models to finding abnormal patterns in sequential data. Public anomaly detection benchmarks typically provide interval annotations but not natural-language ratio...
Lukas Aichberger, Sepp Hochreiter · 2026-05-29
arXiv:2605.30343v1 Announce Type: cross To improve the reasoning capabilities of large language models, test-time compute is typically scaled by generating intermediate tokens before the final answer. However, this couples reasoning to autoregressive generation and thereby conflates internal computation with external communication. In contrast, human cognition can use working memory to hold and m...
Keshigeyan Chandrasegaran, Kyle Sargent, Suchir Agarwal · 2026-05-29
arXiv:2605.30341v1 Announce Type: cross Studying scalable methods for visual generative modeling requires large, accessible, and stable datasets. We introduce GPIC, a Giant Permissive Image Corpus of approximately 28 trillion pixels. GPIC comprises diverse internet images captioned by a state-of-the-art vision-language model, including 100M training, 200K validation, and 1M test examples. Moreove...
Anany Kotawala · 2026-05-29
arXiv:2605.30335v1 Announce Type: new Multi-component LLM agents assemble probabilistic claims from components that each see only part of a joint problem; the composition can violate basic probability axioms even when every component is locally coherent. We formalise this locally coherent, globally incoherent failure via the compositional residual eps*, the L2 distance from the composed quote to ...
Yalun Dai, Yangyu Huang, Tongshen Yang · 2026-05-29
arXiv:2605.30334v1 Announce Type: new Large Language Models (LLMs) have revolutionized various fields, yet their training efficiency is heavily reliant on effective data curation. While data selection has been widely studied, the strategic data organization for enhanced training remains an underexplored area, particularly since current LLMs are often trained for only one or a few epochs. This pap...
Felix Zhou, Anay Mehrotra, Quanquan C. Liu · 2026-05-29
arXiv:2605.30327v1 Announce Type: cross Frontier reasoning models are produced by posttraining base language models with reinforcement learning. Recent work has challenged this by showing that sampling from a sharpened version of the base model's distribution, a so-called power distribution, elicits comparable reasoning without additional training, curated datasets, or verifiers. However, making ...
Chunru Lin, Hongxin Zhang, Fenghao Yu · 2026-05-29
arXiv:2605.30326v1 Announce Type: cross The ability to reason, adapt, and creatively solve problems under unexpected challenges is essential for robots operating in real-world environments. However, current robotic benchmarks primarily emphasize skill-level execution and provide limited insight into such cognitive reasoning capabilities. We introduce RoboWits, a bi-manual robotic benchmark design...
Jusuk Lee, Seungjae Lee, Jonghun Shin · 2026-05-29
arXiv:2605.30350v1 Announce Type: cross Robot manipulation critically depends on perception that preserves the action-relevant aspects of a scene. Yet most robot learning pipelines are built upon visual encoders pre-trained for static recognition or vision-language alignment, leaving motion understanding to downstream policies. We introduce DynaFLIP, a dynamics-aware multimodal pre-training frame...
Alaa Khamis, Alaa Maalouf · 2026-05-29
arXiv:2605.30337v1 Announce Type: new Test-time finetuning (TTFT) is a rapidly evolving paradigm that adapts a language model to each prompt by retrieving related sequences, updating the model on them, and then evaluating the prompt. However, TTFT is only practical if it is fast: selection and finetuning both happen per query, making each a direct bottleneck. Existing methods trade speed for qual...
Daniel Kuznetsov, Ziqi Wang · 2026-05-29
arXiv:2605.30336v1 Announce Type: new Federated learning is an emerging distributed paradigm that addresses the challenges posed by heterogeneous, privacy-sensitive data. It enables multiple clients to train a model collaboratively by aggregating their local updates at a server. However, conventional aggregation schemes typically use fixed weights that fail to reflect unequal and time-varying cli...
Benjamin A. Burns, Sara Fridovich-Keil · 2026-05-29
arXiv:2605.30330v1 Announce Type: new Diffusion models have excellent capacity to model complex distributions of natural data, which has made them a popular and effective choice for posterior sampling in imaging inverse problems. Existing methods can incorporate any measurement model at inference time but must use an inexact approximation for the likelihood at intermediate timesteps for computati...
Sy-Tuyen Ho, Minghui Liu, Huy Nghiem · 2026-05-29
arXiv:2605.30329v1 Announce Type: new Autonomous AI research agents aim to accelerate scientific discovery by automating the research pipeline, from hypothesis generation to peer review. However, existing benchmarks rarely test a fundamental bottleneck: whether Large Language Models can judge the methodological viability of a research idea before expending time and computational resources. We int...
Junyu Xie, Tengda Han, Weidi Xie · 2026-05-29
arXiv:2605.30352v1 Announce Type: new Moving Object Segmentation (MOS) aims to discover, segment, and track objects that move independently of the camera. Current MOS methods, however, exhibit two fundamental limitations: they rely on pre-computed 2D auxiliary modalities such as optical flow or point trajectories that lack 3D geometric information, and they treat motion as a sequence-level attrib...
Yusuf Dalva, Pinar Yanardag · 2026-05-29
arXiv:2605.30349v1 Announce Type: new Autoregressive video diffusion models generate streaming video by producing frames sequentially, conditioning each chunk on previously generated content. These models are structurally anchored to the first frame: its key-value representation occupies a privileged position in the attention cache and serves as the primary scene reference throughout generation. ...
Chen Geng, Guangzhao He, Yue Gao · 2026-05-29
arXiv:2605.30347v1 Announce Type: new Data-driven approaches have revolutionized 3D vision, enabling transformers to effectively reconstruct and generate static 3D objects. However, generating simulative 4D dynamics -- realistic temporal deformations of static objects under various physical conditions -- remains challenging and often ad hoc, despite its importance in building comprehensive 3D wor...
You-Zhe Xie, Yu-Hsuan Li, Jie-Ying Lee · 2026-05-29
arXiv:2605.30346v1 Announce Type: new As video diffusion models (VDMs) advance toward world models, a key question arises: do they truly understand causality, or merely overfit to statistical temporal patterns? Existing benchmarks mostly rely on synthetic data, limiting real-world generalization due to the sim-to-real gap. We present YoCausal, a two-level benchmark inspired by the Violation of Ex...
Shangjie Xue, Jesse Dill, Dhruv Ahuja · 2026-05-29
arXiv:2605.30342v1 Announce Type: new We present Gaussian Splatting Anisotropic Visibility Field (GAVIS), a novel framework for uncertainty quantification and active mapping in 3DGS. Our key insight is that regions unseen from the training views yield unreliable predictions from the 3DGS. To address this, we introduce a principled and efficient method for quantifying the visibility field in 3DGS,...
Tingle Li, Siddharth Gururani, Kevin J. Shih · 2026-05-29
arXiv:2605.30339v1 Announce Type: new Generative video-to-audio (V2A) models produce highly plausible soundtracks, but it remains unclear whether they capture the underlying physical processes. Existing evaluations emphasize perceptual realism and overlook physical correctness under controlled interventions. In this paper, we introduce FlatSounds, a benchmark that audits the physical reasoning of...
Xiaoxuan Ma, Jiashun Wang, Nicolas Ugrinovic · 2026-05-29
arXiv:2605.30338v1 Announce Type: new Reconstructing physically stable 3D scenes from a single RGB image enables casual images to be converted into simulation-ready digital assets for applications such as immersive interaction and content creation. However, existing single-image reconstruction methods fall short in capturing the physical structure of a scene. As a result, they often produce geome...
Hadar Davidson, Noam Issachar, Sagie Benaim · 2026-05-29
arXiv:2605.30332v1 Announce Type: new Diffusion models achieve state-of-the-art image synthesis, with their generative trajectories fundamentally exhibiting a spectral bias, resolving low-frequency global structures early and high-frequency fine details later. Conventional stochastic differential equation (SDE) solvers fail to account for this dynamic, naively injecting uniform white noise throug...
Manoj Biswanath, Chenxin Cai, Hannah Schieber · 2026-05-29
arXiv:2605.30328v1 Announce Type: new Efficient and robust 3D scene representation is crucial in autonomous driving, robotics, and related fields. While RGB images provide valuable content for 3D reconstruction, other modalities like thermal or depth can enable additional information on the environment. Lately, novel view synthesis methods like 3D Gaussian Splatting have started using multiple mo...
This digest is generated automatically from arXiv submissions. Not affiliated with arXiv or Cornell University.