25 papers across AI, ML, NLP, and CV from the last 24 hours.
Three threads dominate today's arXiv batch: agent evaluation, test-time scaling, and real-time multimodal generation. The agent evaluation papers represent a clear shift from static benchmarks toward prospective, real-world measurement. SocietyBench tests whether models can forecast social-world events; WorldCup Arena evaluated six frontier LLMs against live FIFA World Cup match outcomes over 39 days — a prospective, leakage-free design that sidesteps the contamination problem plaguing retrospective benchmarks; and PAST-Bench asks whether personal agents actually improve from accumulated experience or just accumulate context. Together, these signal growing skepticism toward static benchmark scores.
Test-time scaling gets a rigorous treatment, with papers examining how different inference regimes — single-trajectory deliberation, sample-and-vote, partial-state search — differ in statistical structure and failure modes. Adaptive compute allocation replaces fixed per-query budgets. The field is moving past "more tokens of reasoning = better" toward calibrated inference.
In computer vision, the dominant pattern is efficiency under real-time constraints. Streaming video object segmentation collapses under honest 30fps protocols; real-time video editing frameworks impose causal, bounded-compute generation; and adaptive visual evidence scheduling replaces static frame selection with query-adaptive sampling. Accuracy on offline leaderboards is giving way to systems that work under actual clock constraints.
The standout is "When Attention Goes Blind," which identifies a floating-point underflow failure in ALiBi positional encodings that silently zeroes out attention weights — a numerical bug hiding inside widely deployed models.
The batch collectively suggests a field maturing beyond static accuracy toward systems that must reason adaptively, operate under real-time constraints, and prove their capabilities prospectively rather than retrospectively.
Zhenran Wang, Zhonghan Bian, Jinsong Li · 2026-08-04
Large language models (LLMs), and the agents built on top of them, are now benchmarked heavily on whether they can finish a task -- fix a bug, drive a browser, operate a GUI. A complementary social ability, namely how well a model understands and forecasts the way real social events unfold, has barely been measured. We introduce SocietyBench, an end-to-end benchmark that takes a one-line event top...
Zhenran Wang, Zhonghan Bian, Jinsong Li · 2026-08-04
Benchmarks that measure the forecasting ability of large language models are almost always retrospective: the event has happened, the answer is somewhere on the Web, and the evaluation must defend itself against memorisation. We report the opposite design. Over the 39 days of the 2026 FIFA World Cup, six frontier LLMs -- all with extended thinking and native server-side web search -- were asked be...
Changle Qu, Sunhao Dai, Hengyi Cai · 2026-08-04
Tool-Integrated Reasoning (TIR) enables LLMs to solve complex tasks through iterative tool interactions. However, existing reinforcement learning methods often rely on trajectory-level supervision, limiting fine-grained credit assignment in long-horizon TIR scenarios. On-policy self-distillation offers denser signals through teacher branches with privileged context, but existing approaches typical...
Shuhan Xue, Zixin Ding, Yichen Shen · 2026-08-04
Recursive self-improvement requires agents to turn accumulated experience into better future behavior. Personal AI agents offer a concrete setting for studying this capability because they retain preferences, task histories, tool routines, and learned skills across sessions. Yet whether retained experience actually improves them over time has not been systematically tested. We introduce PAST-Bench...
Christopher Schröder, Lukas Gienapp, Ferdinand Schlatt · 2026-08-04
We identify a previously overlooked failure mode of ALiBi positional encoding: its linear bias scaling underflows floating-point precision, which zeroes out a large fraction of attention weights and renders the affected attention heads partially blind. We analyze this failure mode, characterize its impact, and examine four mitigation strategies. We further demonstrate its occurrence in state-of-th...
Mirac Suzgun, James Zou, Stuart M. Shieber · 2026-08-04
We present string2string Studio, an interactive in-browser platform for string-to-string analysis across natural language processing, computational biology, and the digital humanities. The system integrates six main modules (alignment, distance, similarity, search, generation metrics, and BLAST homology search), operating at character, word, token, line, and residue levels. Its C++-based algorithm...
Salah Eddine Bekhouche, Abdessalam Bouchekif, Hichem Telli · 2026-08-04
Large language models can generate fluent Arabic answers while introducing factual errors that are difficult to identify and verify. Existing Arabic hallucination resources often assign a binary label to an entire response, indicating whether it is hallucinated or non-hallucinated, but provide limited information about the exact erroneous content, the reason for the error, or the correct factual a...
Jo-Ku Cheng, Nikolaos Aletras, Marco Valentino · 2026-08-04
Pre-pretraining language models (LMs) on symbolic data can accelerate and improve natural language acquisition. However, existing pre-pretraining tasks, such as Dyck and procedural algorithms, rely on narrow primitives that fail to capture the expressive capacity of natural language. Moreover, prior studies remain restricted to relatively small token budgets, offering limited insight into skill em...
Yang Yang, Qinyu Zhao, Mouxiang Chen · 2026-08-04
Existing scaling strategies for Multimodal Large Language Models (MLLMs) typically expand either model parameters or sequential inference computation, incurring substantial memory or latency overhead. More importantly, most existing methods fail to alter the rigid, fixed computation allocation between the Vision Transformer and the Large Language Model components, limiting task-specific optimizati...
Wanli Ma, Jiangwen Lu, Qinmu Peng · 2026-08-04
Training-free open-vocabulary semantic segmentation (OVSS) partitions an image into semantically distinct regions based on arbitrary text descriptions, without learning any additional parameters. However, existing methods typically focus on improving visual representations while treating text embeddings that encode only generic category concepts as fixed classification references. The resulting se...
Zhen Fang, Yu Zeng, Wenxuan Huang · 2026-08-04
We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web exploration. Preliminary evaluations reveal two critical bottlenecks in current models: (1) modality bias, where agents bypass visual tools in favor of textual search, and (2) parametric knowledge leakage...
Yicheng Xiao, Wenxun Dai, Xinran Qin · 2026-08-04
Real-time video editing requires low-latency causal generation with bounded computational resources while preserving source fidelity and long-term temporal consistency. We present JoyAI-Video-Edit, a 16B-parameter autoregressive diffusion framework for real-time, open-ended video editing without access to future frames or a predefined video duration. Our method combines chunk-wise autoregressive a...
Zongjian Li, Zhiyuan Yan, Chenxu Bai · 2026-08-04
We introduce UniWorld-Design, a framework that redefines image generation from flat pixel synthesis to structured visual composition, with semantic RGBA layers as the atomic units of generation, understanding, and editing. Our key insight is that pixels define how an image is rendered, whereas layers define how an image is created, understood, and edited. Just as human designers create and manipul...
Noor Hussein, Anil K. Jain, Karthik Nandakumar · 2026-08-04
Overlapped friction ridge patterns are a recurring problem in latent fingerprints recovered from crime scenes and in live-scan scenarios where residual fingerprints on the sensor may corrupt subsequent acquisitions. Existing approaches for separating overlapped fingerprints either rely on rule-based orientation field completion that requires strong domain knowledge or train end-to-end deep neural ...
Jinhe Bi, Chennan Zhou, Zengjie Jin · 2026-08-04
On-policy training has emerged as a powerful post-training paradigm for improving the reasoning capabilities of large language models, and is often enhanced by golden trajectories from stronger expert models. However, when the expert fails on harder problems, existing trajectory-guided methods lose their main source of supervision, and these failed trajectories are typically discarded as negative ...
Zizhao Hu, Nathan Elijah Segura, Mohammad Rostami · 2026-08-04
Human input reaches language models by typing or speaking, and each channel leaves a distinct signature: orthographic noise for keyboards; for voice, disfluency from conventional transcription and restructuring from AI-backed dictation tools. How do they impact an LLM's performance? In this paper we present HIVE (Human Input-Variation Engine), a suite of voice transcription perturbations and QWERT...
Mobina Kashaniyan, Ali Jannesari · 2026-08-04
Test-time scaling improves LLM reasoning by generating and aggregating multiple candidate answers, yet many pipelines use fixed per-query budgets that spend the same compute on easy and difficult prompts. These fixed budgets are also difficult to inspect because they do not explain why a given prompt receives a particular number of samples. We propose adaptive} test-time scaling with a lightweight...
Alexander Meulemans, Maciej Wołczyk, Marissa A. Weis · 2026-08-04
As autonomous agents powered by foundation models are increasingly integrated into social and economic systems, understanding the principles governing their collective behavior is essential for ensuring safety and cooperation. Classical game theory, the dominant framework for modeling rational interaction, is built upon the assumption of `decoupled agency,' where agents treat their own decision-ma...
Dongjie Yang, Siyan Lin, Leixian Shen · 2026-08-04
Large language models (LLMs) are increasingly used to provide conversational practice for English-as-a-second-language (ESL) learners. Effective ESL tutoring, however, requires more than fluent response generation: a tutor must select an appropriate pedagogical action based on learner behavior and dialogue context. Human-tutoring research offers principles for adaptive support, but they are often ...
Mohsen Hariri, Weicong Chen, Nahal Shahini · 2026-08-04
Large language models can solve substantially harder reasoning problems with more inference-time compute. The term "test-time scaling," however, now covers diverse inference algorithms that extend deliberation along a single trajectory, sample completed candidates and aggregate them through voting or verification, or search over unfinished partial states. These algorithms differ in their statistic...
Seyed Kahaki, Shijie Li, Weijie Chen · 2026-08-04
Synthetic histopathology image generation has emerged as an approach that may address data scarcity in computational pathology, yet current evaluation methodologies may not fully assess synthetic data quality for medical applications. This work investigates and addresses limitations in existing evaluation metrics, investigating an approach for assessing synthetic histopathology image quality throu...
Arslan Battalov, Karim Kramin, Alexander Markotenko · 2026-08-04
Muon is a recent optimizer that orthogonalizes the update to each weight matrix with a Newton-Schulz iteration, which performs steepest descent under the spectral norm. Almost all the evidence for it comes from Transformer models, and its behavior on state-space models is largely unreported. We compare Muon with AdamW on Mamba-2 130M under a controlled protocol that varies only which weight groups...
Yuanshen Guan, Zipeng Feng, Zhiwei Xiong · 2026-08-04
Aligning diffusion models with human preferences usually relies on a sparse terminal reward evaluated on the final generated samples, presenting a severe temporal credit-assignment challenge across the multi-step denoising process. We propose Latent Reward Registers, a mechanism that estimates terminal preference directly from intermediate noisy latents by prepending learnable, position-free regis...
Yordan Raykov, Rodrigo Veiga · 2026-08-04
Generative Flow Networks (GFlowNets) have emerged as a flexible framework for amortised inference over discrete and mixed discrete-continuous objects, requiring only an unnormalised target density specified through a reward. In this work, we formulate forward-policy training in GFlowNets through the information geometry of the induced trajectory sampler. Treating the forward policy as an induced t...
Hanqin Cai, Longxiu Huang, Jing Qin · 2026-08-04
Tensor cross-concentrated sampling (t-CCS) bridges entrywise sampling and t-CUR slice-wise sampling by observing entries only within selected horizontal and lateral slices. Existing t-CCS completion methods, however, assume that the observations are free of gross corruption. In this work, we study robust recovery of a third-order low-tubal-rank tensor from partial t-CCS observations contaminated b...
This digest is generated automatically from arXiv submissions. Not affiliated with arXiv or Cornell University.