ICLR 2026 Papers — Page 46
International Conference on Learning Representations · 5356 papers
Structural Inference: Interpreting Small Language Models with Susceptibilities
Garrett Baker, Daniel Murfet
Explainability and InterpretabilityTransformerTextStochastic Differential Equation
🎯 What it does: This paper proposes a linear response-based explanation framework called susceptibility, which views neural networks as differentiable systems from the perspective of Bayesian statistical mechanics, and quantifies the response of each network component (e.g., attention heads) to minor changes in data distribution; it efficiently estimates the susceptibility of each component through local SGLD sampling, and then performs PCA on the response matrix via structural inference to identify functional modules within the model (e.g., induction circuits, multi-word heads, parenthesis-matching heads) and explain activation and suppression behaviors.
Structural Prognostic Event Modeling for Multimodal Cancer Survival Analysis
Yilan Zhang (King Abdullah University of Science and Technology), Xin Gao (King Abdullah University of Science and Technology)
Explainability and InterpretabilityComputational EfficiencyTransformerMixture of ExpertsMultimodalityBiomedical Data
🎯 What it does: Proposed a Slot-based structured prognosis event modeling framework, SlotSPE, for multi-modal (tissue slide + genomic) cancer survival analysis.
Structurally Human, Semantically Biased: Detecting LLM-Generated References with Embeddings and GNNs
Melika Mobini (Vrije Universiteit Brussel), Vincent Ginis (Vrije Universiteit Brussel)
ClassificationAnomaly DetectionGraph Neural NetworkLarge Language ModelTextGraph
🎯 What it does: Compare the citation network structure and semantic features of LLM-generated references with those of real references.
Structure Learning from Time-Series Data with Lag-Agnostic Structural Prior
Taiyu Ban (University of Science and Technology of China), Huanhuan Chen (University of Science and Technology of China)
OptimizationTime Series
🎯 What it does: Integrate temporal structure learning with lag-agnostic structural priors to propose a continuous optimization framework for precise lag recovery.
Structure-Aware Graph Hypernetworks for Neural Program Synthesis
Wenhao Li (University of Toronto), Scott Sanner (University of Toronto)
Meta LearningAI Code AssistantGraph Neural NetworkGraph
🎯 What it does: This paper synthesizes neural programs in a continuous weight space through meta-learning and hypernetworks, directly generating complete weights of fixed template networks from user intent.
Structured Flow Autoencoders: Learning Structured Probabilistic Representations with Flow Matching
Yidan Xu (University of Michigan), XuanLong Nguyen (University of Michigan)
GenerationRepresentation LearningFlow-based ModelAuto EncoderImageVideoBiomedical DataOrdinary Differential Equation
🎯 What it does: Propose a Structured Flow Autoencoder (SFA) that combines graphical models with conditional continuous normalizing flows to achieve high-fidelity generation and structured latent representation learning.
Structured Reasoning for LLMs: A Unified Framework for Efficiency and Explainability
Yubo Dong (Zhejiang University), Yi Yang (Zhejiang University)
Explainability and InterpretabilityComputational EfficiencyGraph Neural NetworkTransformerLarge Language ModelSupervised Fine-TuningReinforcement LearningPrompt EngineeringTextGraphBenchmark
🎯 What it does: Proposes a structured reasoning framework that models the reasoning process as a sparse directed graph, and enhances reasoning efficiency, stability, and interpretability by applying reinforcement learning to LLMs with MaxFlow and LCS rewards.
Study of Training Dynamics for Memory-Constrained Fine-Tuning
Aël Quélennec (Télécom Paris), Enzo Tartaglione (Télécom Paris)
Computational EfficiencyConvolutional Neural NetworkTransformerSupervised Fine-TuningImage
🎯 What it does: In extreme memory-constrained environments, transfer learning is applied to pre-trained models, proposing the TraDy dynamic channel selection scheme to achieve efficient fine-tuning;
STVG-R1: Incentivizing Instance-Level Reasoning and Grounding in Videos via Reinforcement Learning
Xiaowen Zhang (Xidian University), Qing Li (State Key Laboratory of General Artificial Intelligence, BIGAI)
Object DetectionObject TrackingReinforcement LearningPrompt EngineeringVision Language ModelVideoBenchmark
🎯 What it does: By overlaying unique instance ID visual prompts on video frames, dense coordinate regression is transformed into an instance-level identification problem, and end-to-end optimization of spatiotemporal localization is achieved using the reinforcement learning framework STVG-R1.
StyliTruth : Unlocking Stylized yet Truthful LLM Generation via Disentangled Steering
Chenglei Shen (Renmin University of China), Jun Xu (Renmin University of China)
GenerationRepresentation LearningTransformerLarge Language ModelText
🎯 What it does: This paper achieves stylized generation while maintaining answer truthfulness by performing representation editing on the attention heads of large language models, and proposes a new framework named StyliTruth.
Stylos: Multi-View 3D Stylization with Single-Forward Gaussian Splatting
Hanzhou Liu (Texas A&M University), Peng Jiang (Texas A&M University)
GenerationTransformerGaussian SplattingImage
🎯 What it does: Proposed a single-forward 3D Gaussian stylization framework named Stylos, which can instantly generate multi-view stylized scenes from unposed images
SubDyve: Subgraph-Driven Dynamic Propagation for Virtual Screening Enhancement Controlling False Positive
Jungseob Yi (Seoul National University), Sangseon Lee (Inha University)
Drug DiscoveryGraph Neural NetworkGraph
🎯 What it does: Construct a subgraph fingerprint network under low-label conditions, and enhance early identification in virtual screening through dynamic seed refinement calibrated by local false discovery rate.
Sublinear Spectral Clustering Oracle with Little Memory
Ranran Shen (University of Science and Technology of China), Zengfeng Huang (Fudan University)
OptimizationComputational EfficiencyGraph
🎯 What it does: Investigated the technology for constructing sublinear spectral clustering oracles under sparse memory, providing a scheme to perform graph clustering with memory usage far below the traditional √n;
Sublinear Time Quantum Algorithm for Attention Approximation
Zhao Song (Simons Institute for Theory of Computing, UC Berkeley), Lichen Zhang (MIT Computer Science and Artificial Intelligence Laboratory)
Computational EfficiencyTransformer
🎯 What it does: Proposes a quantum data structure to approximate the Transformer's attention matrix in sublinear time under a row query model, along with corresponding preprocessing and query algorithms.
Submodular Function Minimization with Dueling Oracle
Kaien Sho (University of Tokyo), Shinji Ito (University of Tokyo)
Optimization
🎯 What it does: This paper proposes minimizing submodular functions under the condition of using only a dueling oracle, and provides algorithms along with error upper and lower bounds for linear and sigmoid transfer functions.
Subquadratic Algorithms and Hardness for Attention with Any Temperature
Shreya Gupta (University of Washington), Christopher Ye (University of California San Diego)
Computational EfficiencyTransformer
🎯 What it does: This paper addresses the Attention mechanism in Transformers, proposing a sub-quadratic approximation algorithm for computing Attention when the head dimension is a constant, and provides the corresponding lower bound, elucidating the complexity of Attention computation under different head dimensions and temperature ranges;
Subspace Kernel Learning on Tensor Sequences
Lei Wang (Griffith University), Piotr Koniusz (University of New South Wales)
RecognitionPose EstimationTransformerMultimodalitySequential
🎯 What it does: This paper proposes a kernel learning framework named UKTL for subspace kernel comparison on multi-dimensional tensors, achieving end-to-end training through uncertainty weighting, dynamic Nyström linearization, and multi-modal fusion.
SUIT: Knowledge Editing with Subspace-Aware Key-Value Mappings
Haewon Park (Seoul National University), Yohan Jo (Seoul National University)
TransformerLarge Language ModelTextBenchmark
🎯 What it does: Proposes the SUIT method, which edits knowledge in language models through subspace-constrained key vectors and residual vectors.
Summaries as Centroids for Interpretable and Scalable Text Clustering
Jairo Diaz-Rodriguez (York University)
Explainability and InterpretabilityData-Centric LearningTransformerLarge Language ModelText
🎯 What it does: Proposes two variants of k-means, k-NLPmeans and k-LLMmeans, which periodically replace numerical centroids with text summaries to enhance clustering interpretability and effectiveness, and extend to a mini-batch version for real-time streaming text clustering.
SumRA: Parameter Efficient Fine-tuning with Singular Value Decomposition and Summed Orthogonal Basis
Chin Yuen Kwok (Nanyang Technological University), Eng Siong Chng (Nanyang Technological University)
Computational EfficiencyTransformerSupervised Fine-TuningAudio
🎯 What it does: Propose the SumRA method, which uses singular value decomposition (SVD) to initialize the low-rank matrix A with multi-vector summation in LoRA adaptation, and freezes A to reduce trainable parameters.
SupCLAP: Controlling Optimization Trajectory Drift in Audio-Text Contrastive Learning with Support Vector Regularization
Jiehui Luo (Peking University), Dongchao Yang (Peking University)
ClassificationRetrievalRepresentation LearningTransformerContrastive LearningTextMultimodalityAudio
🎯 What it does: Proposed the SupCLAP framework, which employs support vector regularization (SVR) to address the optimization trajectory drift problem in audio-text contrastive learning.
SuperF: Neural Implicit Fields for Multi-Image Super-Resolution
Sander Riisøen Jyhne (University of Agder), Nico Lang (University of Copenhagen)
Super ResolutionNeural Radiance FieldImage
🎯 What it does: Proposed a multi-image super-resolution method called SuperF based on test-time optimization, achieving high-resolution reconstruction by sharing an implicit neural field (INR) and jointly optimizing sub-pixel alignment.
Superficial Safety Alignment Hypothesis
Jianwei Li (North Carolina State University), Jung-Eun Kim (North Carolina State University)
Safty and PrivacyComputational EfficiencyTransformerLarge Language ModelSupervised Fine-TuningTextBenchmark
🎯 What it does: This paper proposes the 'Surface Safety Alignment Hypothesis (SSAH)', achieving safety alignment for large language models (LLMs) by identifying and freezing neuron-level safety-critical units (SCUs), and explores using redundant units as alignment budget.
SuperMAN: Interpretable and Expressive Networks over Temporally Sparse Heterogeneous Data
Andrea Zerio (Aalborg University), Aleksejs Sazonovs (Aalborg University)
Explainability and InterpretabilityRepresentation LearningGraph Neural NetworkGraphTime SeriesBiomedical Data
🎯 What it does: Proposed the SUPERMAN framework to directly learn heterogeneous and sparse time series data by modeling them as implicit graph collections, providing interpretability at the node, graph, and subset levels.
Supervised Fine-Tuning or Contrastive Learning? Towards Better Multimodal LLM Reranking
Xin Zhang (Harbin Institute of Technology), Min Zhang (Harbin Institute of Technology)
RetrievalSupervised Fine-TuningVision Language ModelContrastive LearningMultimodalityBenchmark
🎯 What it does: Compare the effectiveness of Contrastive Learning (CL) and Supervised Fine-Tuning (SFT) in re-ranking for large multimodal language models (LLMs), propose a unified loss splitting framework (weight + direction), build a general-purpose multimodal re-ranking model GMR, and release the MRB evaluation benchmark covering 40 datasets.
Supervised Reinforcement Learning: From Expert Trajectories to Step-wise Reasoning
Yihe Deng (UCLA), Chen-Yu Lee (Google Cloud AI Research)
TransformerSupervised Fine-TuningReinforcement LearningTextBenchmarkChain-of-Thought
🎯 What it does: Proposed and implemented a Supervised Reinforcement Learning (SRL) framework that decomposes complex problems into a series of executable actions. The model generates internal reasoning before executing actions, enabling small-scale LLMs to learn on challenging tasks.
Supporting High-Stakes Decision Making Through Interactive Preference Elicitation in the Latent Space
Michael Eichelbeck (Technical University of Munich), Matthias Althoff (Technical University of Munich)
Recommendation SystemOptimizationLarge Language ModelAuto EncoderTabular
🎯 What it does: Propose an interactive preference mining framework that performs preference Bayesian optimization in the latent space of an autoencoder, integrating personalized priors generated by large language models (LLMs)
Supporting Multimodal Intermediate Fusion with Informatic Constraint and Distribution Coherence
Yi Li (Institute of Software Chinese Academy of Sciences), Jiangmeng Li (Institute of Software Chinese Academy of Sciences)
ClassificationRepresentation LearningImageTextMultimodality
🎯 What it does: Propose a multi-modal learning framework called IID based on intermediate fusion (IF), which combines information-constrained linear objective mapping and distribution coordination with restricted isometric projection, theoretically proving that IF outperforms LF under specific constraints.
SurfSplat: Conquering Feedforward 2D Gaussian Splatting with Surface Continuity Priors
Bing He (Shanghai Jiao Tong University), Wenjun Zhang (Shanghai Jiao Tong University)
GenerationDepth EstimationConvolutional Neural NetworkGaussian SplattingImage
🎯 What it does: Construct a feed-forward 3D scene reconstruction model called SurfSplat using 2D Gaussian splatting, and enhance geometric coherence through surface continuity prior and forced alpha blending
SURGE: Surprise-Guided Token Reduction for Efficient Video Understanding with VLMs
Chong Tang (University of Southampton), Jagmohan Chauhan (University College London)
Computational EfficiencyTransformerVision Language ModelContrastive LearningVideoMultimodalityBenchmark
🎯 What it does: Propose SURGE, a training-agnostic and backend-agnostic surprise mask based on token prediction error, dynamically trimming redundant visual tokens before video VLM inference, significantly reducing computational cost.
SurvHTE-Bench: A Benchmark for Heterogeneous Treatment Effect Estimation in Survival Analysis
Shahriar Noroozizadeh (Carnegie Mellon University), George H. Chen (Carnegie Mellon University)
Data SynthesisBiomedical DataBenchmark
🎯 What it does: Constructed the SURVHTE-BENCH benchmark to unify the evaluation of heterogeneous treatment effect estimation methods in right-censored survival data.
SUSD: Structured Unsupervised Skill Discovery through State Factorization
Seyed Mohammad Hadi Hosseini (Sharif University of Technology), Mahdieh Soleymani Baghshah (Sharif University of Technology)
Representation LearningReinforcement Learning
🎯 What it does: This paper proposes a structured unsupervised skill discovery framework called SUSD, which decomposes environmental states into multiple factors and assigns independent skill variables to each factor, enabling the learning of rich and decomposable skills in reward-free environments.
SVD Provably Denoises Nearest Neighbor Data
Ravindran Kannan (UC Berkeley), David Woodruff (Carnegie Mellon University)
RestorationData-Centric LearningImageText
🎯 What it does: Under a high-dimensional noise model, we propose an algorithm that only uses SVD dimensionality reduction to recover the nearest neighbor of the original data from noisy data, provided the noise level satisfies σ=O(1/k^{1/4}).
Swap-guided Preference Learning for Personalized Reinforcement Learning from Human Feedback
Gihoon Kim (Yonsei University), Euntai Kim (Korea Institute of Science and Technology)
Reinforcement Learning from Human FeedbackReinforcement LearningFlow-based ModelAuto EncoderText
🎯 What it does: Proposed a framework named Swap-guided Preference Learning (SPL) to learn personalized reward functions from human preference data and address the posterior collapse problem in VPL.
SWE-RM: Execution-free Feedback for Software Engineering Agents
KaShun SHUM, Junxian He (Hong Kong University of Science and Technology)
Data-Centric LearningAI Code AssistantReinforcement Learning from Human FeedbackLarge Language ModelReinforcement LearningMixture of ExpertsText
🎯 What it does: Developed an executive-free reward model SWE-RM that performs well in both Test Time Scaling (TTS) and Reinforcement Learning (RL) scenarios.
SWERank: Software Issue Localization with Code Ranking
Revanth Gangi Reddy (University of Illinois at Urbana-Champaign), Shafiq Joty (Salesforce Research)
AI Code AssistantTransformerLarge Language ModelContrastive LearningTextRetrieval-Augmented Generation
🎯 What it does: Propose the SWERANK framework, treating software problem localization as a specialized retrieval task, combining a retriever and re-ranker for efficient localization, and constructing the SWELOC dataset for training.
SwiftTS: A Swift Selection Framework for Time Series Pre-trained Models via Multi-task Meta-Learning
Tengxue Zhang (East China Normal University), Bin Yang (East China Normal University)
Meta LearningMixture of ExpertsTime Series
🎯 What it does: Proposes SwiftTS, a fast selection framework for time-series pre-trained models based on dual encoders and multi-task meta-learning, designed to efficiently select the most suitable model from a model library for a given time-series prediction task.
SWINGARENA: Adversarial Programming Arena for Long-context GitHub Issue Solving
Wendong XU, Ngai Wong (University of Hong Kong)
Adversarial AttackAI Code AssistantLarge Language ModelTextBenchmarkRetrieval-Augmented Generation
🎯 What it does: Propose SWINGARENA, an adversarial evaluation framework based on real CI pipelines, simulating interactions between submitters and reviewers in program patch and test generation;
SwiReasoning: Switch-Thinking in Latent and Explicit for Pareto-Superior Reasoning LLMs
Dachuan Shi (Georgia Tech), Wen Xiao (Microsoft)
OptimizationComputational EfficiencyTransformerTextBenchmarkChain-of-Thought
🎯 What it does: Proposed a training-agnostic reasoning framework called SWIREASONING, which dynamically switches between explicit chain-of-thought reasoning and implicit continuous-space reasoning to improve the accuracy and token efficiency of large language models across various reasoning tasks.
Symmetric Space Learning for Combinatorial Generalization
Jaehyoung Jeong (Gwangju Institute of Science and Technology), Kangil Kim (Gwangju Institute of Science and Technology)
GenerationRepresentation LearningFlow-based ModelAuto EncoderImagePoint Cloud
🎯 What it does: Propose a framework called CartanFM that utilizes symmetric space structure (Symmetric Space) for combinatorial generalization (Combinatorial Generalization), and learns and generalizes Lie algebra structure through Cartan Loss and Geodesic Symmetry Consistency Loss.
Symmetry-Aware Bayesian Optimization via Max Kernels
Anthony Bardou (EPFL), Patrick Thiran (EPFL)
Optimization
🎯 What it does: Propose a symmetry-aware Bayesian optimization framework based on the maximum similarity (max kernel), obtaining a kernel k(D)+ applicable to Gaussian processes through PSD projection and Nyström extension, and conducting experiments on multiple black-box functions with symmetries such as rotation, reflection, and permutation.
SYNC: Measuring and Advancing Synthesizability in Structure-Based Drug Design
Yunfan Liu (Zhejiang University), Stan Z. Li (Westlake University)
Drug DiscoveryGraph Neural NetworkDiffusion modelGraphBiomedical DataBenchmark
🎯 What it does: Proposed a 3D structure-based SE(3)-invariant synthetizability classifier, SYNC, to evaluate and drive structure-based drug design (SBDD) for generating synthetizable drugs.
Synchronizing Probabilities in Model-Driven Lossless Compression
Aviv Adler (Analog Devices, Inc.), Jennifer Tang (College of Holy Cross)
CompressionTransformerLarge Language ModelText
🎯 What it does: Proposed and implemented the PMATIC (Probability Matching Interval Coding) algorithm, enabling lossless compression based on LLMs to maintain correct decoding even in cases of prediction mismatch, along with theoretical proofs and experimental validations.
SynCoGen: Synthesizable 3D Molecule Generation via Joint Reaction and Coordinate Modeling
Andrei Rekesh (University of Toronto), Cheng-Hao Liu (Mila - Quebec AI Institute)
Drug DiscoveryGraph Neural NetworkDiffusion modelFlow-based ModelMultimodalityGraph
🎯 What it does: Propose a multimodal generative model named SYNCOGEN, capable of simultaneously generating synthetically feasible 3D molecular structures and their synthesis pathways.
Syncphony: Synchronized Audio-to-Video Generation with Diffusion Transformers
Jibin Song (Yonsei University), Youngjung Uh (Yonsei University)
GenerationTransformerDiffusion modelImageVideoTextMultimodalityAudio
🎯 What it does: Developed a audio-synchronized video generation framework called Syncphony, which can generate highly synchronized and high-quality dynamic content in 380×640, 24fps, 5-second videos based on audio, text, and image conditions.
SyncTrack: Rhythmic Stability and Synchronization in Multi-Track Music Generation
Hongrui Wang (Hong Kong University of Science and Technology), Yang Wang (University of Hong Kong)
GenerationTransformerDiffusion modelAuto EncoderGenerative Adversarial NetworkAudio
🎯 What it does: Proposed the SyncTrack model for synchronous multi-track waveform music generation, focusing on improving rhythmic stability and cross-track synchronization.
Synergizing Understanding and Generation with Interleaved Analyzing-Drafting Thinking
Shengqiong Wu (National University of Singapore), Tat-Seng Chua (National University of Singapore)
ClassificationRecognitionGenerationTransformerSupervised Fine-TuningReinforcement LearningVision Language ModelAuto EncoderImageTextMultimodalityChain-of-Thought
🎯 What it does: Propose an alternating analysis-draft (AD-Loop) loop, enabling a unified vision-language model (UVLM) to achieve true synergy between understanding and generation tasks; through a two-phase training (supervised learning + reinforcement learning) framework, the model can dynamically decide during inference whether to alternate between text-based and vision-based thinking.
Synthesising Counterfactual Explanations via Label-Conditional Gaussian Mixture Variational Autoencoders
Junqi Jiang (Imperial College London), Francesca Toni (Imperial College London)
Data SynthesisExplainability and InterpretabilityAuto EncoderImageTabular
🎯 What it does: This paper proposes Label-conditional Gaussian Mixture VAE (L-GMVAE) and the path-based counterfactual generation algorithm LAPACE, which generates a series of actionable counterfactual explanations for given inputs while satisfying effectiveness, proximity, interpretability, diversity, and robustness to input and model variations.
Synthesizing High-Quality Visual Question Answering from Medical Documents with Generator-Verifier LMMs
Xiaoke Huang (UC Santa Cruz), Yuyin Zhou (Amazon Research)
Data SynthesisLarge Language ModelReinforcement LearningVision Language ModelMultimodalityBiomedical Data
🎯 What it does: This study synthesizes high-quality medical multimodal question-answering (VQA) data from public biomedical literature through a generator-verifier framework.
Synthetic Bootstrapped Pretraining
Zitong Yang (Apple), Ruoming Pang (Apple)
Data SynthesisLarge Language ModelText
🎯 What it does: Proposed a new language model pretraining method called Synthetic Bootstrapping Pretraining (SBP), which synthesizes new corpora by learning relationships between documents to improve model performance.
Synthetic History: Evaluating Visual Representations of the Past in Diffusion Models
Maria-Teresa De Rosa Palmini (University of Zurich), Eva Cetinic (University of Zurich)
GenerationData SynthesisLarge Language ModelVision Language ModelDiffusion modelImageTextMultimodalityBenchmark
🎯 What it does: We created the HistVis benchmark, using 30k synthetic images to evaluate the performance of text-to-image diffusion models in historical contexts, including style preferences, temporal consistency, and demographic distribution.
SynthWorlds: Controlled Parallel Worlds for Disentangling Reasoning and Knowledge in Language Models
Ken Gu (University of Washington), Tim Althoff (Google Research)
GenerationData SynthesisRetrievalData-Centric LearningLarge Language ModelTextGraphRetrieval-Augmented GenerationChain-of-Thought
🎯 What it does: Constructed a controlled parallel corpus and tasks to separate the impact of language models' reasoning ability from parameterized knowledge.
Sysformer: Safeguarding Frozen Large Language Models with Adaptive System Prompts
Kartik Sharma (Georgia Institute of Technology), Srijan Kumar (Georgia Institute of Technology)
Safty and PrivacyTransformerLarge Language ModelPrompt EngineeringText
🎯 What it does: Without updating LLM parameters, a learnable Transformer module dynamically adjusts system prompts to enhance the security of frozen LLMs.
SysMoBench: Evaluating AI on Formally Specifying Complex Real-World Systems
Qian Cheng (Nanjing University), Tianyin Xu (University of Illinois Urbana-Champaign)
AI Code AssistantLarge Language ModelAgentic AITextBenchmark
🎯 What it does: This paper proposes the SYSMOBENCH benchmark to evaluate the capability of generative AI in formally modeling large-scale, complex systems (such as distributed protocols and concurrent components);
t-SNE Exaggerates Clusters, Provably
Noah Bergam (Columbia University), Nakul Verma (Columbia University)
OptimizationExplainability and InterpretabilityRepresentation LearningTextTabularBiomedical DataFinance Related
🎯 What it does: This paper demonstrates the limitations and failure modes of t-SNE in clustering significance and outlier detection through theoretical proofs and experiments;
T-TAMER: Provably Taming Trade-offs in ML Serving
Yuanyuan Chloe Yang (University of Washington), Haifeng Xu (University of Chicago)
OptimizationComputational EfficiencyConvolutional Neural NetworkTransformerImageText
🎯 What it does: This paper proposes a framework named T-Tamer for uniformly handling the trade-off between accuracy and latency/resource usage in multi-model inference (e.g., early stopping and cascaded models), and provides a dynamic indexing strategy that can be solved on various DAG structures (linear, tree, closure).
T1: One-to-One Channel-Head Binding for Multivariate Time-Series Imputation
Dongik Park (Seoul National University), Hyung-Sin Kim (Seoul National University)
RestorationConvolutional Neural NetworkTransformerTime Series
🎯 What it does: Propose a CNN-Transformer hybrid architecture T1 for missing value imputation in multivariate time series;
T1: Tool-integrated Verification for Test-time Compute Scaling in Small Language Models
Minki Kang (KAIST), Jaewoong Cho (KRAFTON)
Computational EfficiencyKnowledge DistillationReinforcement Learning from Human FeedbackTransformerLarge Language ModelReinforcement LearningTextRetrieval-Augmented Generation
🎯 What it does: Proposes a two-phase framework called Tool-integrated Verification (T1), which first filters generated candidate answers using external tools and then verifies them with a small language model to enhance the inference performance of small models under computational scaling (best-of-N) during testing.
Tab-MIA: A Benchmark Dataset for Membership Inference Attacks on Tabular Data in LLMs
Eyal German (Ben-Gurion University of the Negev), Yuval Elovici (Ben-Gurion University of the Negev)
Safty and PrivacyAdversarial AttackTransformerLarge Language ModelSupervised Fine-TuningTabularBenchmark
🎯 What it does: Proposes the Tab-MIA benchmark to assess the vulnerability of large language models (LLMs) to membership inference (MIA) attacks after training on tabular data.
TableDART: Dynamic Adaptive Multi-Modal Routing for Table Understanding
Xiaobo Xing (University of Queensland), Hongzhi Yin (University of Queensland)
TransformerLarge Language ModelAgentic AIMixture of ExpertsMultimodalityTabular
🎯 What it does: Proposed a dynamic self-adaptive multimodal routing framework called TableDART, which selects the optimal inference path instance-by-instance in table understanding tasks using single-modal models (text and image) and a lightweight gated network, achieving cross-modal fusion through an LLM agent.
TableMaster: A Recipe to Advance Table Understanding with Language Models
Lang Cao (University of Illinois Urbana-Champaign), Hanbing Liu (Tsinghua University)
Data-Centric LearningTransformerLarge Language ModelPrompt EngineeringTabularChain-of-Thought
🎯 What it does: Propose the TableMaster framework, which unifies the integration of table structure extraction, table semantic enrichment, and adaptive reasoning strategies to enhance large language models' understanding and reasoning capabilities with tables.
TABLET: A Large-Scale Dataset for Robust Visual Table Understanding
Iñigo Alonso (University of Edinburgh), Mirella Lapata (University of Basque Country UPV/EHU)
RecognitionData-Centric LearningSupervised Fine-TuningVision Language ModelMultimodalityBenchmark
🎯 What it does: Developed a large-scale visual table understanding dataset called TABLET, containing over 4 million samples, 21 tasks, and retaining the original visual presentation.
TabStruct: Measuring Structural Fidelity of Tabular Data
Xiangjian Jiang (University of Cambridge), Mateja Jamnik (University of Cambridge)
Data SynthesisDiffusion modelGenerative Adversarial NetworkTabularBenchmark
🎯 What it does: Introduce the TabStruct benchmark to systematically evaluate the performance of table generators in terms of structural fidelity and traditional dimensions
Tackling Heavy-Tailed Q-Value Bias in Offline-to-Online Reinforcement Learning with Laplace-Robust Modeling
Ruibo Guo (University Of Science And Technology Of China), Bin Li (China Mobile)
Reinforcement LearningBenchmark
🎯 What it does: To address the Q-value estimation bias in offline-to-online reinforcement learning, we propose an algorithm called LAROO, which robustly estimates Q-values through Laplace noise modeling and conservative ensemble, combined with offline pre-training and online fine-tuning.
Tackling the XAI Disagreement Problem with Adaptive Feature Grouping
Gabriel Laberge (Thales cortAIx Lab), Ola Ahmad (Thales cortAIx Lab)
Explainability and InterpretabilityImageTabular
🎯 What it does: Proposes the AGREED algorithm, which reduces disagreements among XAI explanation methods through adaptive feature grouping.
Tackling Time-Series Forecasting Generalization via Mitigating Concept Drift
Zhiyuan Zhao (Georgia Institute of Technology), B. Aditya Prakash (Georgia Institute of Technology)
Domain AdaptationTransformerTime Series
🎯 What it does: Propose a model-agnostic ShifTS framework that extracts invariant patterns from historical and future exogenous features through a soft attention mask (SAM), addressing concept drift and time drift in time series prediction.
TaCo: A Benchmark for Lossless and Lossy Codecs of Heterogeneous Tactile Data
Zhengxue Cheng (Shanghai Jiao Tong University), Li Song (Shanghai Jiao Tong University)
CompressionAuto EncoderBenchmark
🎯 What it does: Constructed the TaCo benchmark for systematic evaluation of various lossless and lossy tactile data compression algorithms.
Tactic: Adaptive Sparse Attention with Clustering and Distribution Fitting for Long-Context LLMs
Kan Zhu (University of Washington), Baris Kasikci (University of Washington)
Computational EfficiencyTransformerText
🎯 What it does: Propose an adaptive sparse attention mechanism called Tactic, which dynamically selects key KV pairs based on cumulative attention scores for long-context LLM inference;
Take Note: Your Molecular Dataset Is Probably Aligned
Peter Lippmann (Heidelberg University), Fred A. Hamprecht (Heidelberg University)
Pose EstimationRepresentation LearningDrug DiscoveryGraph Neural NetworkGraphBiomedical Data
🎯 What it does: This study systematically reveals the pose bias present in popular molecular datasets (QM9, QMugs, OMol25), proposes quantitative evaluation and visualization methods, and verifies through classifier and property regression experiments that models can exploit this bias to achieve unreasonably high performance.
Talk, Evaluate, Diagnose: User-aware Agent Evaluation with Automated Error Analysis
Penny Chong (SAP), Daniel Dahlmeier (SAP)
Explainability and InterpretabilityLarge Language ModelAgentic AITextBenchmark
🎯 What it does: Proposes the TED (Talk, Evaluate, Diagnose) framework for systematically assessing the dialogue performance, progress, and error analysis of LLM agents in multi-task scenarios.
Talking Points: Describing and Localizing Pixels
Matan Rusanovsky (Tel Aviv University), Shai Avidan (Tel Aviv University)
Pose EstimationTransformerLarge Language ModelSupervised Fine-TuningReinforcement LearningVision Language ModelImageTextMultimodality
Taming Curvature: Architecture Warm-up for Stable Transformer Training
Sameera Ramasinghe (Pluralis Research), Alexander Long (Pluralis Research)
OptimizationComputational EfficiencyTransformerText
🎯 What it does: The paper proposes two techniques, online curvature estimation and architectural warm-up, to improve the stability of large-scale Transformer training.
Taming Hierarchical Image Coding Optimization: A Spectral Regularization Perspective
Wuyang Cong (Nanjing University), Zhan Ma (Nanjing University)
CompressionConvolutional Neural NetworkImage
🎯 What it does: Propose a spectral regularization method for hierarchical image compression, addressing cross-scale energy diffusion and aliasing issues through internal-scale spectral truncation and cross-scale similarity constraints, thereby improving training efficiency and compression performance.
Taming Imperfect Process Verifiers: A Sampling Perspective on Backtracking
Dhruv Rohatgi (MIT), Dylan J Foster
AI Code AssistantTextSequential
🎯 What it does: Proposes a new process-guided test-time sampling algorithm called VGB, which utilizes theoretically grounded backtracking techniques to enhance robustness against validator errors.
Taming Momentum: Rethinking Optimizer States Through Low-Rank Approximation
Zhengbo Wang (University of Science and Technology of China), Tieniu Tan (NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences)
OptimizationText
🎯 What it does: Propose LoRA-Pre, a low-rank optimizer that significantly reduces memory usage by compressing the momentum states of optimizers such as Adam and Muon, treating EMA momentum as online linear regression.
Taming Polysemanticity in LLMs: Theory-Grounded Feature Recovery via Sparse Autoencoders
Siyu Chen (Yale University), Zhuoran Yang (Yale University)
Explainability and InterpretabilityRepresentation LearningLarge Language ModelAuto EncoderText
🎯 What it does: Proposed a feature recovery method using sparse autoencoders (SAE) with theoretical guarantees for LLM interpretability tasks.
Taming Score-Based Denoisers in ADMM: A Convergent Plug-and-Play Framework
Rajesh Shrestha (Oregon State University), Xiao Fu (Oregon State University)
RestorationOptimizationDiffusion modelScore-based ModelImageOrdinary Differential Equation
🎯 What it does: Proposed an AC-DC three-stage denoiser embedded in the ADMM-PnP framework to address noise data manifold mismatch and convergence issues.
TAMMs: Change Understanding and Forecasting in Satellite Image Time Series with Temporal-Aware Multimodal Models
Zhongbin Guo (Beijing Institute of Technology), Ertai E (National University of Singapore)
GenerationTransformerLarge Language ModelPrompt EngineeringVision Language ModelDiffusion modelImageMultimodalityTime Series
🎯 What it does: Propose a unified framework TAMMs that jointly accomplishes the tasks of change description and future prediction for satellite image time series.
TandemFoilSet: Datasets for Flow Field Prediction of Tandem-Airfoil Through the Reuse of Single Airfoils
Wei Xian Lim (Nanyang Technological University), Adams Wai-Kin Kong (Nanyang Technological University)
Graph Neural NetworkTransformerMeshGraphPhysics Related
🎯 What it does: Constructed the TandemFoilSet dataset and developed a training and inference framework for multi-body flow field prediction.
TangleScore: Tangle-Guided Purge and Imprint for Unstructured Knowledge Editing
Hao-Xiang Xu (University of Science and Technology of China), Jia-Chen Gu (University of California, Los Angeles)
TransformerLarge Language ModelSupervised Fine-TuningText
🎯 What it does: Research and improve knowledge editing methods for large language models, proposing TANGLESCORE to measure the intrinsic editing difficulty and adaptively adjusting the PIPE framework's purge and imprint based on this metric.
TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimization
Chia-Yu Hung (Nanyang Technology University), Soujanya Poria (Nanyang Technology University)
GenerationTransformerFlow-based ModelRectified FlowTextAudio
🎯 What it does: Developed a text-to-audio generation model called TANGOFLUX based on rectified flow, supporting high-quality audio generation within 30 seconds, and achieving dynamic alignment through CLAP-Ranked Preference Optimization (CRPO).
TAO-Attack: Toward Advanced Optimization-Based Jailbreak Attacks for Large Language Models
Zhi Xu (Dalian University of Technology), Han Liu (Dalian University of Technology)
OptimizationSafty and PrivacyAdversarial AttackTransformerLarge Language ModelText
🎯 What it does: Proposes an optimized jailbreak attack method called TAO-Attack, capable of generating harmful text that can bypass safety filters in large language models.
TAPTRv3: Spatial and Temporal Context Foster Robust Tracking of Any Point in Long Video
Jinyuan Qu (Tsinghua University South China University of Technology), Lei Zhang (International Digital Economy Academy)
Object TrackingTransformerVideo
🎯 What it does: Propose TAPTRv3, which improves TAPTR by utilizing Context-aware Cross-Attention and Visibility-aware Long-Temporal Attention to enhance arbitrary point tracking in long videos;
Target-Aware Video Diffusion Models
Taeksoo Kim (Seoul National University), Hanbyul Joo (Seoul National University)
GenerationTransformerPrompt EngineeringVision-Language-Action ModelDiffusion modelVideoMultimodality
🎯 What it does: Developed a target-aware video diffusion model that generates videos of actors interacting with specified targets using input images, target segmentation masks, and text-based action descriptions.
Task Tokens: A Flexible Approach to Adapting Behavior Foundation Models
Ron Vainshtein (Technion), Chen Tessler (NVIDIA Research)
OptimizationComputational EfficiencyRobotic IntelligenceTransformerReinforcement LearningPrompt EngineeringMultimodality
🎯 What it does: Propose the Task Tokens method, using a lightweight task encoder to achieve task-specific adaptation on behavior foundation models (BFCM) like MaskedMimic, balancing user prompts and reward-driven control;
Task Vectors, Learned Not Extracted: Performance Gains and Mechanistic Insights
Haolin Yang, Naoya Inoue
Explainability and InterpretabilityComputational EfficiencyRepresentation LearningTransformerLarge Language ModelSupervised Fine-TuningTextBenchmark
🎯 What it does: This work proposes directly training the learning task vector (LTV) and achieving in-context learning in large language models by injecting vectors at any layer or position; meanwhile, it systematically analyzes the impact of LTV on model outputs through attention head OV circuits at lower layers and approximate linear rotation-scaling mechanisms at higher layers.
Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models
Shilei Cao (Sun Yat-sen University), Haohuan Fu (National Supercomputing Center)
Domain AdaptationComputational EfficiencyTransformerSupervised Fine-TuningPrompt EngineeringTime SeriesBenchmarkPhysics Related
🎯 What it does: Propose WeatherPEFT, a parameter-efficient fine-tuning framework for weather foundation models, integrating task-adaptive dynamic prompting (TADP) and random Fisher information-guided parameter selection (SFAS).
Task-Aware Data Selection via Proxy-Label Enhanced Distribution Matching for LLM Finetuning
Hao Cheng (Hong Kong Baptist University), Bo Han (D5 Data)
Data-Centric LearningTransformerLarge Language ModelSupervised Fine-TuningContrastive LearningTextBenchmark
🎯 What it does: Propose a task-aware data selection framework based on LLM-generated proxy labels, two-stage filtering, and incremental sampling, enhancing LLM fine-tuning performance through joint distribution matching.
Task-free Adaptive Meta Black-box Optimization
Chao Wang (Xidian University), Shuyuan Yang (Xidian University)
OptimizationComputational EfficiencyMeta LearningTransformerBenchmark
🎯 What it does: Propose a task-agnostic adaptive meta-black-box optimizer ABOM, which can online learn and adaptively update evolutionary operators using only the optimization data of the target task, achieving zero-shot optimization.
Task-Related Token Compression in Multimodal Large Language Models from an Explainability Perspective
Lei Lei (University of Science and Technology of China), Tong Xu (University of Science and Technology of China)
CompressionExplainability and InterpretabilityComputational EfficiencyConvolutional Neural NetworkTransformerLarge Language ModelVision Language ModelImageVideoMultimodality
🎯 What it does: Assess the importance of visual tokens using explainability methods and perform task-related visual token compression during the LLM input phase, significantly reducing computational and memory costs;
TaskCraft: Automated Generation of Agentic Tasks
Dingfeng Shi (OPPO), Wangchunshu Zhou (OPPO)
TransformerLarge Language ModelSupervised Fine-TuningReinforcement LearningAgentic AIPrompt EngineeringTextMultimodalityBenchmarkRetrieval-Augmented Generation
🎯 What it does: Proposes TASKCRAFT, a complete workflow for automatically generating multi-tool, verifiable, and scalable agentic tasks, progressively increasing task difficulty through depth and width expansion while maintaining quality via incremental verification.
TASTE: Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling
Liang-Hsuan Tseng (MediaTek Research), Hung-yi Lee (National Taiwan University)
CompressionRepresentation LearningTransformerLarge Language ModelSupervised Fine-TuningTextMultimodalityAudio
🎯 What it does: Proposed TASTE, a text-aligned speech segmentation and embedding method for constructing a joint text-speech speaking language model;
TaTToo: Tool-Grounded Thinking PRM for Test-Time Scaling in Tabular Reasoning
Jiaru Zou (University of Illinois Urbana-Champaign), Jingrui He (University of Illinois Urbana-Champaign)
Computational EfficiencyTransformerLarge Language ModelSupervised Fine-TuningReinforcement LearningTabular
🎯 What it does: Proposed TATTOO, a tool-assisted process reward model specifically designed for table reasoning, which provides step-based reward supervision during the reasoning process to enhance the reasoning quality and efficiency of large models in table reasoning tasks.
TAVAE: A VAE with Adaptable Priors Explains Contextual Modulation in the Visual Cortex
Balázs Meszéna (HUN-REN Wigner Research Centre for Physics), Gergo Orban (HUN-REN Wigner Research Centre for Physics)
Explainability and InterpretabilityRepresentation LearningAuto EncoderImageBiomedical Data
🎯 What it does: This paper constructs a Task-Amortized Variational Autoencoder (TAVAE) to explain the context modulation and multimodal response deviations in the mouse primary visual cortex (V1) during visual Go-NoGo discrimination tasks, while maintaining a pre-trained generative model and variational posterior for natural images and learning task-specific priors.
TCD-Arena: Assessing Robustness of Time Series Causal Discovery Methods Against Assumption Violations
Gideon Stein (Friedrich Schiller University Jena), Joachim Denzler (Friedrich Schiller University Jena)
Explainability and InterpretabilityMeta LearningTransformerTime SeriesBenchmark
🎯 What it does: Proposed the TCD-Arena testing tool, systematically evaluating the robustness of over 300,000 time series causal discovery algorithms under 33 progressively intensified hypothesis violations.
TD-JEPA: Latent-predictive Representations for Zero-Shot Reinforcement Learning
Marco Bagatella (ETH Zurich), Andrea Tirinzoni (FAIR at Meta)
OptimizationRepresentation LearningRobotic IntelligenceReinforcement LearningImage
🎯 What it does: Propose TD-JEPA, a potential prediction method based on multi-step temporal difference (TD) learning, for learning zero-shot unsupervised reinforcement learning policies directly applicable to arbitrary rewards from offline reward-free data.
TD-MoE: Tensor Decomposition for MoE Models
Yuebin XU, Zeyi Wen
Computational EfficiencyTransformerMixture of ExpertsText
🎯 What it does: Propose a Mixture-of-Experts compression method TD-MoE based on three-dimensional tensor decomposition
Teach to Reason Safely: Policy-Guided Safety Tuning for MLRMs
Jingyu Zhang, Zhaohui Yang (Ant Group)
Safty and PrivacySupervised Fine-TuningReinforcement LearningContrastive LearningMultimodalityBenchmark
🎯 What it does: This paper proposes a two-stage safety optimization framework, Policy-Guided Safety Tuning (PST), which significantly enhances the safety of multimodal reasoning models while maintaining their reasoning capabilities through policy-guided supervised fine-tuning and safe reasoning preference optimization.
Teach2Eval: An Interaction-Driven LLMs Evaluation Method via Teaching Effectiveness
Yuhang Zhou (Fudan University), Hongfeng Chai (Fudan University)
TransformerLarge Language ModelPrompt EngineeringText
🎯 What it does: Propose Teach2Eval—an interactive method for evaluating LLMs by guiding weak students to improve through a teacher model
Teaching Metric Distance to Discrete Autoregressive Language Models
Jiwan Chung (Yonsei University), Youngjae Yu (Seoul National University)
TransformerImageTextBenchmark
🎯 What it does: Proposed a new distance-aware target, DIST 2 Loss, for discrete autoregressive language models, aiming to replace traditional one-hot targets by leveraging predefined token distances to improve model performance on numerical, spatial coordinate, and similar tasks.