arXivSub Start free trial

CVPR 2025 Papers with Code

IEEE/CVF Conference on Computer Vision and Pattern Recognition Β· 851 papers with a public code repository

2DMamba: Efficient State Space Model for Image Representation with Applications on Giga-Pixel Whole Slide Image Classification

Jingwei Zhang (Stony Brook University), Mahdi S. Hosseini (Concordia University)

CodeClassificationRepresentation LearningImage

🎯 What it does: This paper proposes 2DMamba, which utilizes a 2D selective state space model for efficient modeling of large-scale images and achieves spatial continuity in multi-instance learning.

3DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splatting

Qi Wu (NVIDIA), Zan Gojcic (University of Toronto)

CodeAutonomous DrivingComputational EfficiencyGaussian SplattingImage

🎯 What it does: This study investigates how to extend 3D Gaussian Splatting to support arbitrary nonlinear camera projections and secondary rays, achieving efficient real-time rendering through the Unscented Transform, compatible with rolling shutter, distorted cameras, and phenomena such as reflection and refraction.

5%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks

Dongshuo Yin (Tsinghua University), Xue Yang (Shanghai Jiao Tong University)

CodeRecognitionObject DetectionSegmentationTransformerSupervised Fine-TuningImage

🎯 What it does: This paper proposes a Multi-Cognitive Visual Adapter (Mona) tuning method for parameter-efficient fine-tuning of visual tasks while maintaining the advantages of pre-trained models.

A Data-Centric Revisit of Pre-Trained Vision Models for Robot Learning

Xin Wen (Hong Kong University), Xiaojuan Qi (Hong Kong University)

CodeData-Centric LearningRobotic IntelligenceContrastive LearningImage

🎯 What it does: A systematic evaluation of the performance of visual models with different pre-training methods and data sources in robotic learning tasks (manipulation and perception) is conducted, and SlotMIM is proposed to learn more object-centric representations on non-single-object (NOC) data.

A Dataset for Semantic Segmentation in the Presence of Unknowns

Zakaria Laskar (Czech Technical University in Prague), C.V. Jawahar (Indian Institute of Information Technology Hyderabad)

CodeSegmentationAnomaly DetectionImageTime SeriesBenchmark

🎯 What it does: A new semantic segmentation anomaly detection dataset, ISSU, is proposed, and various existing methods are benchmarked on this dataset.

A Flag Decomposition for Hierarchical Datasets

Nathan Mankovich (Valencia University), Tolga Birdal (Imperial College London)

CodeClassificationRecognitionRestorationSegmentationSupervised Fine-TuningImage

🎯 What it does: This paper proposes Flag Decomposition (FD), a matrix decomposition method that preserves hierarchical structures, capable of mapping hierarchical data to the flag manifold for reconstruction, clustering, and few-shot learning.

A General Adaptive Dual-level Weighting Mechanism for Remote Sensing Pansharpening

Jie Huang (University of Electronic Science and Technology of China), Liangjian Deng (University of Electronic Science and Technology of China)

CodeRestorationSuper ResolutionImage

🎯 What it does: An Adaptive Dual-layer Weighting Mechanism (ADWM) is proposed, which adjusts feature heterogeneity and redundancy through Covariance-weighted (CACW) to achieve remote sensing panchromatic fusion.

A Hubness Perspective on Representation Learning for Graph-Based Multi-View Clustering

Zheming Xu (Beijing Jiaotong University), Michael C. Kampffmeyer (UiT The Arctic University of Norway)

CodeRepresentation LearningGraph Neural NetworkAuto EncoderGraph

🎯 What it does: A new framework called hubREP is proposed for graph-based multi-view clustering, aimed at addressing the hubness problem in high-dimensional embeddings to improve clustering performance.

A Polarization-Aided Transformer for Image Deblurring via Motion Vector Decomposition

Duosheng Chen (Nankai University), Jufeng Yang (Nankai University)

CodeRestorationTransformerOptical FlowImage

🎯 What it does: A motion decomposition Transformer (MDT) based on polar coordinates is proposed, which achieves deblurring by separating the translational and rotational motions of image blur.

A Regularization-Guided Equivariant Approach for Image Restoration

Yulu Bai (Xi'an Jiaotong University), Deyu Meng (Macau University of Science and Technology)

CodeRestorationConvolutional Neural NetworkSupervised Fine-TuningImageComputed Tomography

🎯 What it does: A self-supervised regularization strategy (EQ-Reg) is proposed, which can achieve rotation equivariance in ordinary CNNs while maintaining high representation accuracy.

A Selective Re-learning Mechanism for Hyperspectral Fusion Imaging

Yuanye Liu (Hunan University), Shutao Li (Hunan University)

CodeImage TranslationRestorationCompressionComputational EfficiencyTransformerImage

🎯 What it does: A selective re-learning hyperspectral fusion network, SRLF-Net, is proposed for the fusion of low-resolution hyperspectral images and multispectral images.

A Semantic Knowledge Complementarity based Decoupling Framework for Semi-supervised Class-imbalanced Medical Image Segmentation

Zheng Zhang (Beijing University of Posts and Telecommunications), Wendong Wang (Beijing University of Posts and Telecommunications)

CodeSegmentationConvolutional Neural NetworkSupervised Fine-TuningImageBiomedical DataComputed Tomography

🎯 What it does: In the semi-supervised medical image segmentation task, a Semantic Knowledge Complementary Decoupling Framework (SKCDF) is proposed, which trains the encoder, labeled decoder, and unlabeled decoder separately. It utilizes labeled data to guide pseudo-label generation and enriches labeled features with unlabeled data, while introducing an auxiliary balanced segmentation head to enhance the performance of minority classes.

A Simple Data Augmentation for Feature Distribution Skewed Federated Learning

Yunlu Yan (Hong Kong University of Science and Technology), Lei Zhu (Hong Kong University of Science and Technology)

CodeClassificationSegmentationFederated LearningConvolutional Neural NetworkImageBiomedical DataMagnetic Resonance Imaging

🎯 What it does: A random distribution normalization method based on input-level data augmentation (FedRDN) is proposed in federated learning, which alleviates feature distribution shift and enhances model generalization by randomly injecting global statistical information into local samples.

A Stitch in Time Saves Nine: Small VLM is a Precise Guidance for Accelerating Large VLMs

Wangbo Zhao (National University of Singapore), Yang You (National University of Singapore)

CodeComputational EfficiencyKnowledge DistillationTransformerVision Language ModelMultimodality

🎯 What it does: A training-independent method called SGL is proposed, which utilizes the full-layer attention information of a small-scale VLM to guide the visual token pruning of a large-scale VLM, and enhances inference efficiency through early exit of the small VLM when necessary.

A Tale of Two Classes: Adapting Supervised Contrastive Learning to Binary Imbalanced Datasets

David Mildenberger (Technical University of Munich), Martin J. Menten (Technical University of Munich)

CodeClassificationRepresentation LearningContrastive LearningImageBiomedical Data

🎯 What it does: This study investigates the performance of supervised contrastive learning on imbalanced binary classification datasets and proposes two improvement methods.

A Unified Latent Schrodinger Bridge Diffusion Model for Unsupervised Anomaly Detection and Localization

Shilhora Akshay (Indian Institute of Technology), Vineeth N Balasubramanian (Indian Institute of Technology)

CodeAnomaly DetectionDiffusion modelAuto EncoderImageStochastic Differential Equation

🎯 What it does: A latent space diffusion model LASB based on linear Schrodinger Bridge is proposed for unsupervised anomaly detection and localization.

A Unified, Resilient, and Explainable Adversarial Patch Detector

Vishesh Kumar (Indian Institute of Science Education and Research Bhopal), Akshay Agarwal (Indian Institute of Science Education and Research Bhopal)

CodeExplainability and InterpretabilityAdversarial AttackConvolutional Neural NetworkTransformerContrastive LearningImage

🎯 What it does: The research proposes a universal, robust, and interpretable adversarial patch detector called AdvPatchXAI.

A Universal Scale-Adaptive Deformable Transformer for Image Restoration across Diverse Artifacts

Xuyi He (South China University of Technology), Hui Ji (National University of Singapore)

CodeRestorationTransformerImage

🎯 What it does: A scalable adaptive deformable Transformer (SADT) is proposed to eliminate structured artifacts such as rain, moiré patterns, and banding.

ABC-Former: Auxiliary Bimodal Cross-domain Transformer with Interactive Channel Attention for White Balance

Yu-Cheng Chiu (National Chengchi University), Yan-Tsung Peng (National Chengchi University)

CodeImage TranslationRestorationTransformerImage

🎯 What it does: An auxiliary dual-modal cross-domain Transformer named ABC-Former is proposed to improve the white balance correction of sRGB images.

ACAttack: Adaptive Cross Attacking RGB-T Tracker via Multi-Modal Response Decoupling

Xinyu Xiang (Wuhan University), Jiayi Ma (Wuhan University)

CodeObject TrackingAdversarial AttackVideoMultimodality

🎯 What it does: An adaptive cross-modal attack framework, ACAttack, is proposed for RGB-T multimodal trackers, capable of generating multimodal adversarial patches that can be deployed in both digital and physical domains, inducing tracker failure.

Accelerating Multimodal Large Language Models by Searching Optimal Vision Token Reduction

Shiyu Zhao (Rutgers University), Licheng Yu (Meta)

CodeCompressionComputational EfficiencyTransformerLarge Language ModelPrompt EngineeringVision Language ModelMultimodality

🎯 What it does: This study investigates a prompt-aware visual token compression method that achieves inference acceleration by automatically searching for the optimal visual token reduction strategy within a multimodal large language model (MLLM);

ACL: Activating Capability of Linear Attention for Image Restoration

Yubin Gu (Xiamen University), Xiaoshuai Sun (National University of Singapore)

CodeRestorationConvolutional Neural NetworkImage

🎯 What it does: A new image restoration model called ACL is proposed, which integrates linear attention and the Mamba structure to build an efficient encoder-decoder network.

Activating Sparse Part Concepts for 3D Class Incremental Learning

Zhenya Tian (University of Chinese Academy of Sciences), Haiyong Jiang (University of Chinese Academy of Sciences)

CodeClassificationObject DetectionTransformerPoint Cloud

🎯 What it does: This study focuses on 3D category incremental learning and proposes a framework called ILPC based on the concept of sparse activation components and task-level fusion.

Active Data Curation Effectively Distills Large-Scale Multimodal Models

Vishaal Udandarao (University of TΓΌbingen), Olivier J. Henaff (Google DeepMind)

CodeRetrievalKnowledge DistillationContrastive LearningMultimodality

🎯 What it does: A framework for efficient distillation of large multimodal models through Active Data Selection (ACID) is proposed, which is further combined with traditional Knowledge Distillation (KD) to obtain the ACED model, significantly improving the performance of small models in zero-shot classification and image-text retrieval.

AdaMMS: Model Merging for Heterogeneous Multimodal Large Language Models with Unsupervised Coefficient Optimization

Yiyang Du (Tsinghua University), Yang Liu (Tsinghua University)

CodeOptimizationHyperparameter SearchTransformerLarge Language ModelVision Language ModelTextMultimodality

🎯 What it does: The AdaMMS method is proposed to achieve parameter merging for heterogeneous multimodal large language models.

Adapter Merging with Centroid Prototype Mapping for Scalable Class-Incremental Learning

Takuma Fukuda (Chiba University), Kazuhiko Kawamoto (Chiba University)

CodeClassificationComputational EfficiencyTransformerPrompt EngineeringImage

🎯 What it does: This paper proposes a sample-free, class-incremental learning framework called ACMap, which achieves fixed inference time by merging task-specific adapters.

Adapting Dense Matching for Homography Estimation with Grid-based Acceleration

Kaining Zhang (Wuhan University), Paolo Favaro (University of Bern)

CodeImage TranslationOptimizationComputational EfficiencyConvolutional Neural NetworkOptical FlowImage

🎯 What it does: GFNet is proposed, achieving high-resolution camera plane transformation estimation through sparse grid flow regression.

Adapting Pre-trained 3D Models for Point Cloud Video Understanding via Cross-frame Spatio-temporal Perception

Baixuan Lv (Tsinghua University), Shu-Tao Xia (Tsinghua University)

CodeRecognitionTransformerSupervised Fine-TuningVideoPoint Cloud

🎯 What it does: Transfer the pre-trained static 3D point cloud model to 4D point cloud videos, proposing Cross-frame Spatio-temporal Adaptation (CSA) to capture short-term and long-term spatio-temporal dynamics.

Adapting to Observation Length of Trajectory Prediction via Contrastive Learning

Ruiqi Qiu (Northeastern University), Yi Cen (Northeastern University)

CodeRecurrent Neural NetworkContrastive LearningTime SeriesSequential

🎯 What it does: This paper proposes an adaptive method CLLS and a lightweight RNN model RNLS for trajectory prediction that aims to improve prediction accuracy under varying observation lengths.

Adaptive Dropout: Unleashing Dropout across Layers for Generalizable Image Super-Resolution

Hang Xu (University of Science and Technology of China), Feng Zhao (University of Science and Technology of China)

CodeRestorationSuper ResolutionConvolutional Neural NetworkImage

🎯 What it does: This paper proposes Adaptive Dropout, a novel regularization method for blind image super-resolution (blind SR), which can adaptively incorporate Dropout in the intermediate layers of the network and enhance the model's generalization ability through a hierarchical annealing strategy.

Adaptive Keyframe Sampling for Long Video Understanding

Xi Tang (University of Chinese Academy of Sciences), Qixiang Ye (University of Chinese Academy of Sciences)

CodeOptimizationTransformerVision Language ModelVideoBenchmark

🎯 What it does: An Adaptive Keyframe Sampling (AKS) algorithm is designed as a pluggable preprocessing module to select the most informative frames as the visual context for MLLM in long video understanding.

Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition

Chengxiang Huang (Beijing University of Posts and Telecommunications), Di Hu (Renmin University of China)

CodeOptimizationVideoMultimodalityAudio

🎯 What it does: A method called Information Retrieval Regulation (InfoReg) is proposed to balance information retrieval in multimodal learning, particularly during the early learning phase (referred to as the primary learning window), by suppressing the information retrieval speed of information-rich modalities to promote information retrieval in information-scarce modalities.

ADD: Attribution-Driven Data Augmentation Framework for Boosting Image Super-Resolution

Ze-Yu Mi (Nanjing University), Yu-Bin Yang (Nanjing University)

CodeRestorationSuper ResolutionConvolutional Neural NetworkTransformerImage

🎯 What it does: A framework for attention data augmentation based on attribution, ADD/ADD+, and novel Calibrated Attribution Maps (CAM) is proposed to improve super-resolution training in low-level vision tasks.

Adv-CPG: A Customized Portrait Generation Framework with Facial Adversarial Attacks

Junying Wang (Northwestern Polytechnical University), Yuan Yuan (Northwestern Polytechnical University)

CodeGenerationSafty and PrivacyAdversarial AttackDiffusion modelImageMultimodality

🎯 What it does: Proposed Adv-CPG, a framework that achieves facial privacy protection while generating personalized portraits;

Advancing Semantic Future Prediction through Multimodal Visual Sequence Transformers

Efstathios Karypidis (Archimedes Athena Research Center), Nikos Komodakis

CodeSegmentationDepth EstimationAutonomous DrivingTransformerSupervised Fine-TuningImageVideoMultimodality

🎯 What it does: Proposes the FUTURIST framework, which uses a unified visual sequence Transformer for future frame prediction in multimodal (semantic segmentation, depth maps).

AeSPa : Attention-guided Self-supervised Parallel Imaging for MRI Reconstruction

Jinho Joo (Yonsei University), Dosik Hwang (Yonsei University)

CodeRestorationConvolutional Neural NetworkBiomedical DataMagnetic Resonance Imaging

🎯 What it does: This paper proposes a zero-shot self-supervised parallel imaging MRI reconstruction method called AeSPa, aimed at achieving fast and high-quality imaging without the need for fully sampled reference data.

Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimization

Zhanhao Liang (Australian National University), Liang Zheng (Microsoft)

CodeGenerationOptimizationDiffusion modelImageText

🎯 What it does: A Stepwise Preference Optimization (SPO) method is proposed to enhance the aesthetic quality of images in text-to-image diffusion models.

AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM

Jiarui Wang (Shanghai Jiao Tong University), Xiongkuo Min (Shanghai Jiao Tong University)

CodeGenerationData SynthesisTransformerLarge Language ModelContrastive LearningVideoTextMultimodalityBenchmark

🎯 What it does: A database and evaluation model for assessing the quality of text-to-video generation (AIGV) has been proposed;

Alignment, Mining and Fusion: Representation Alignment with Hard Negative Mining and Selective Knowledge Fusion for Medical Visual Question Answering

Yuanhao Zou (University of Michigan), Zhaozheng Yin (Stony Brook University)

CodeRepresentation LearningTransformerVision Language ModelContrastive LearningMultimodalityBiomedical DataElectronic Health Records

🎯 What it does: A unified multimodal alignment framework AMiF is proposed, combining hard negative sample mining and selective knowledge fusion, specifically designed for pre-training and fine-tuning in the medical visual question answering (Med-VQA) task.

AlphaPre: Amplitude-Phase Disentanglement Model for Precipitation Nowcasting

Kenghong Lin (Harbin Institute of Technology), Yunming Ye (Harbin Institute of Technology)

CodeGenerationOptimizationConvolutional Neural NetworkSupervised Fine-TuningImageTime Series

🎯 What it does: This paper proposes the AlphaPre model, which utilizes frequency domain amplitude-phase separation to predict changes in rainfall location through a phase network and changes in rainfall intensity through an amplitude network, and integrates them through AlphaMixer to achieve more refined rainfall forecasting.

AMR-Transformer: Enabling Efficient Long-range Interaction for Complex Neural Fluid Simulation

Zeyi Xu (Shanghai Jiao Tong University), Bingbing Ni (Shanghai Jiao Tong University)

CodeTransformerMeshPhysics Related

🎯 What it does: A neural CFD solving pipeline that combines Adaptive Mesh Refinement (AMR) with Transformers is proposed, which can efficiently capture long-range dependencies and fine-grained structures in fluid dynamics.

An End-to-End Robust Point Cloud Semantic Segmentation Network with Single-Step Conditional Diffusion Models

Wentao Qu (Nanjing University of Science and Technology), Liang Xiao (Nanjing University of Science and Technology)

CodeObject DetectionSegmentationAutonomous DrivingTransformerDiffusion modelPoint Cloud

🎯 What it does: An end-to-end point cloud semantic segmentation network called CDSegNet is developed based on the Conditional-Noise Framework (CNF), utilizing the noise system of DDPM to achieve single-step inference and enhance robustness against noise and sparse data.

Analyzing the Synthetic-to-Real Domain Gap in 3D Hand Pose Estimation

Zhuoran Zhao (Hong Kong University of Science and Technology), Angela Yao (National University of Singapore)

CodeData SynthesisPose EstimationDomain AdaptationPoint Cloud

🎯 What it does: This study investigates the synthetic-to-real domain gap in 3D hand pose estimation and proposes a high-quality hand data synthesis pipeline.

Anatomical Consistency and Adaptive Prior-informed Transformation for Multi-contrast MR Image Synthesis via Diffusion Model

Yejee Shin (Yonsei University), Dosik Hwang (Korea Institute of Science and Technology)

CodeGenerationData SynthesisVision Language ModelDiffusion modelImageBiomedical DataMagnetic Resonance ImagingAlzheimer's Disease

🎯 What it does: This paper proposes the APT model, which achieves the synthesis of multi-contrast MR images without modal loss through multi-contrast information fusion and anatomical consistency loss.

AniGrad: Anisotropic Gradient-Adaptive Sampling for 3D Reconstruction From Monocular Video

Noah Stier (University of California Santa Barbara), Tobias HΓΆllerer (University of California Santa Barbara)

CodeDepth EstimationOptimizationComputational EfficiencyConvolutional Neural NetworkVideoPoint CloudMesh

🎯 What it does: In 3D reconstruction based on monocular video, an adaptive and anisotropic sampling strategy called AniGrad is introduced. It utilizes local basis functions to represent TSDF and quickly determines the sampling density of each voxel by combining gradient upper bounds, achieving high-quality and low-latency mesh extraction.

AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstruction

Lingteng Qiu (Alibaba Group), Zilong Dong (Nanjing University)

CodeGenerationData SynthesisPose EstimationTransformerDiffusion modelAuto EncoderGaussian SplattingImageVideo

🎯 What it does: Generate multi-view frontal images from a single portrait image and reconstruct an animatable 3D portrait model using 4D Gaussian projection.

AniMo: Species-Aware Model for Text-Driven Animal Motion Generation

Xuan Wang (Zhejiang University), Gaoang Wang (Zhejiang University)

CodeGenerationTransformerGenerative Adversarial NetworkVideoText

🎯 What it does: We propose AniMo, a two-stage model for text-driven animal motion generation, achieving diverse animal posture motion generation.

AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios

Ziming Huang (Huazhong University of Science and Technology), Yu Zhou (Huazhong University of Science and Technology)

CodeAnomaly DetectionTransformerContrastive LearningImage

🎯 What it does: A multi-class industrial anomaly classification framework called AnomalyNCD is proposed, which is compatible with existing anomaly detection methods.

AnyMap: Learning a General Camera Model for Structure-from-Motion with Unknown Distortion in Dynamic Scenes

Andrea Porfiri Dal Cin (Qualcomm Technologies), Mohsen Ghafoorian (Qualcomm Technologies)

CodePose EstimationDepth EstimationOptimizationOptical FlowVideo

🎯 What it does: This paper presents AnyMap, a differentiable structure from motion (SfM) framework that can simultaneously estimate dense 3D geometry, camera poses, and a general camera model implemented by a learnable inverse neural network (including radial and tangential distortion) while achieving motion regularization in dynamic scenes.

AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalities

Guillaume Astruc (Univ Gustave Eiffel), Loic Landrieu (Univ Gustave Eiffel)

CodeClassificationSegmentationContrastive LearningImageMultimodality

🎯 What it does: This paper presents AnySat, a self-supervised learning model for Earth observation that can simultaneously handle various resolutions, scales, and sensors.

APHQ-ViT: Post-Training Quantization with Average Perturbation Hessian Based Reconstruction for Vision Transformers

Zhuguanyu Wu (Beihang University), Yunhong Wang (Beihang University)

CodeClassificationObject DetectionSegmentationTransformerImage

🎯 What it does: For post-training quantization of Vision Transformers, the APHQ-ViT method is proposed.

Apply Hierarchical-Chain-of-Generation to Complex Attributes Text-to-3D Generation

Yiming Qin (Peking University), Yang Liu (Peking University)

CodeGenerationData SynthesisLarge Language ModelGaussian SplattingText

🎯 What it does: An automated 3D Gaussian Splatting generation framework called HCoG is proposed, which can automatically chunk and generate and refine 3D assets according to complex attributes and occlusion relationships in the text in an internal-to-external order.

AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusion

Mingzhen Sun (Institute of Automation), Jing Liu (Institute of Automation)

CodeGenerationData SynthesisTransformerDiffusion modelVideo

🎯 What it does: A self-regressive diffusion model AR-Diffusion is proposed for asynchronous video generation;

ASAP: Advancing Semantic Alignment Promotes Multi-Modal Manipulation Detecting and Grounding

Zhenxing Zhang (Hefei University of Technology), Meng Wang (Hefei Comprehensive National Science Center)

CodeClassificationRecognitionObject DetectionTransformerLarge Language ModelContrastive LearningImageTextMultimodality

🎯 What it does: The ASAP framework is proposed for detecting and locating multimodal media forgery, utilizing subtitles and explanatory texts generated by multimodal large language models to enhance the semantic alignment between images and text.

ASIGN: An Anatomy-aware Spatial Imputation Graphic Network for 3D Spatial Transcriptomics

Junchao Zhu (Vanderbilt University), Yuankai Huo (Vanderbilt University)

CodeGraph Neural NetworkTransformerBiomedical Data

🎯 What it does: A method for inferring 3D spatial transcriptomic data using 3D WSI and a single 2D ST sample, called ASIGN, is proposed.

Asynchronous Collaborative Graph Representation for Frames and Events

Dianze Li (Peking University), Yonghong Tian (Peking University)

CodeObject DetectionDepth EstimationAdversarial AttackGraph Neural NetworkMultimodality

🎯 What it does: An Asynchronous Collaborative Graph Representation (ACGR) is proposed, which unifies the modeling of frames and events to achieve high-performance, low-latency visual task inference.

Attend to Not Attended: Structure-then-Detail Token Merging for Post-training DiT Acceleration

Haipeng Fang (Institute of Computing Technology), Tong-Yee Lee (National Cheng Kung University)

CodeCompressionComputational EfficiencyTransformerDiffusion modelImage

🎯 What it does: A post-training acceleration method called SDTM is proposed, which dynamically merges useless visual tokens in the diffusion transformer (DiT) using a structure-detail denoising prior.

Attribute-formed Class-specific Concept Space: Endowing Language Bottleneck Model with Better Interpretability and Scalability

Jianyang Zhang (University of Electronic Science and Technology of China), Fengmao Lv (Southwest Jiaotong University)

CodeClassificationExplainability and InterpretabilityTransformerLarge Language ModelVision Language ModelImage

🎯 What it does: This paper proposes the Attribute-formed Language Bottleneck Model (ALBM), which achieves interpretable image classification by constructing an attribute-based class-specific concept space and combining Visual Attribute Prompt Learning (VAPL) with LLM for automatic concept set generation (DSS).

Audio-Visual Instance Segmentation

Ruohao Guo (Peking University), Buwen Liang

CodeObject DetectionObject TrackingSegmentationTransformerVideoMultimodalityBenchmarkAudio

🎯 What it does: This paper proposes the Audio-Visual Instance Segmentation (AVIS) task and implements a strong baseline model (AVISM) for the classification, segmentation, and tracking of sound-emitting objects.

Augmented Deep Contexts for Spatially Embedded Video Coding

Yifan Bian (University of Science and Technology of China), Dong Liu (University of Science and Technology of China)

CodeCompressionTransformerVideo

🎯 What it does: This paper proposes a Spatially Embedded Video Codec (SEVC), which first compresses low-resolution videos to obtain spatial references, and then uses these spatial references along with temporal references to enhance motion vectors and features, ultimately generating a mixed spatial-temporal context and improved latent priors.

Automated Proof of Polynomial Inequalities via Reinforcement Learning

Banglong Liu (East China Normal University), Zhengfeng Yang (East China Normal University)

CodeOptimizationReinforcement Learning

🎯 What it does: This paper proposes a method for automated proof of polynomial inequalities based on reinforcement learning, transforming the inequality proof into a linear programming problem using the Krivine basis representation, constructing an RL environment, and training an agent with DQN to gradually select basis elements, ultimately obtaining a non-negative representation.

Automatic Joint Structured Pruning and Quantization for Efficient Neural Network Training and Compression

Xiaoyi Qu (Lehigh University), Tianyi Chen (Microsoft)

CodeCompressionOptimizationComputational EfficiencyConvolutional Neural NetworkTransformerImageText

🎯 What it does: The GETA framework is proposed to achieve joint automated training of structured pruning and quantization, supporting any deep network model.

AutoSSVH: Exploring Automated Frame Sampling for Efficient Self-Supervised Video Hashing

Niu Lian (Harbin Institute of Technology), Bin Chen (Harbin Institute of Technology)

CodeRetrievalCompressionTransformerContrastive LearningVideo

🎯 What it does: AutoSSVH compresses unlabeled videos into high-quality hash codes for efficient video retrieval through automated adversarial frame sampling and contrastive learning.

AVQACL: A Novel Benchmark for Audio-Visual Question Answering Continual Learning

Kaixuan Wu (Southeast University), Guoliang Wu (Southeast University)

CodeKnowledge DistillationConvolutional Neural NetworkRecurrent Neural NetworkSupervised Fine-TuningVideoMultimodalityBenchmarkAudio

🎯 What it does: A continuous learning benchmark for audio-visual question answering, AVQACL, is proposed, along with the development of two datasets, Split-AVQA and Split-MUSIC-AVQA. A continuous learning method is introduced that combines question-guided cross-modal fusion (QCIF), task-specific knowledge distillation with spatiotemporal constraints (TKD-STFC), and question semantic consistency constraints (QSCC).

Balanced Direction from Multifarious Choices: Arithmetic Meta-Learning for Domain Generalization

Xiran Wang (Nanjing University), Yinghuan Shi (Nanjing University)

CodeDomain AdaptationMeta LearningImageBenchmark

🎯 What it does: An arithmetic meta-learning (Arith) framework is proposed, which achieves gradient matching between source domains through a gradient weighting approach and obtains more balanced model parameters by approximating the centroid of the optimal parameters of the source domains.

BASKET: A Large-Scale Video Dataset for Fine-Grained Skill Estimation

Yulu Pan (University of North Carolina at Chapel Hill), Gedas Bertasius (University of North Carolina at Chapel Hill)

CodeClassificationRecognitionSupervised Fine-TuningVideoBenchmark

🎯 What it does: This work constructs a large-scale basketball video dataset called BASKET, aimed at evaluating players' levels in 20 fine-grained basketball skills (such as three-point shooting, rebounding, passing, etc.) and assessing existing long video recognition models based on this task.

Bayesian Prompt Flow Learning for Zero-Shot Anomaly Detection

Zhen Qu (Institute of Automation Chinese Academy of Sciences), Guiguang Ding (Tsinghua University)

CodeAnomaly DetectionPrompt EngineeringVision Language ModelImageBiomedical DataMagnetic Resonance ImagingComputed Tomography

🎯 What it does: A zero-shot anomaly detection method based on Bayesian Prompt Flow Learning, called Bayes-PFL, is proposed.

Be More Specific: Evaluating Object-centric Realism in Synthetic Images

Anqi Liang, Aleix Martinez

CodeObject DetectionData SynthesisVision Language ModelImage

🎯 What it does: This study investigates the assessment of realism in synthetic images from an object-oriented perspective, constructing an object-level realism (OcR) dataset and proposing a corresponding evaluation framework and model.

Benchmarking Object Detectors under Real-World Distribution Shifts in Satellite Imagery

Sara A. Al-Emadi (Qatar Computing Research Institute), Ferda Ofli (Qatar Computing Research Institute)

CodeObject DetectionDomain AdaptationImageBenchmark

🎯 What it does: This paper proposes three benchmark datasets specifically designed to evaluate the generalization performance of satellite image object detection under real distribution shifts (especially spatial distribution shifts) (RWDS-CZ, RWDS-FR, RWDS-HE), and systematically assesses the performance of various mainstream object detection models under single-source and multi-source training settings.

beta-FFT: Nonlinear Interpolation and Differentiated Training Strategies for Semi-Supervised Medical Image Segmentation

Ming Hu (Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences), Quan Wang (Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences)

CodeSegmentationImageBiomedical DataMagnetic Resonance Imaging

🎯 What it does: This paper proposes a FFT-based nonlinear interpolation and differentiation training strategy (β-FFT) to address the homogenization problem caused by co-training in semi-supervised medical image segmentation.

Beyond Background Shift: Rethinking Instance Replay in Continual Semantic Segmentation

Hongmei Yin (Tianjin University), Liang Wan (Tianjin University)

CodeSegmentationKnowledge DistillationConvolutional Neural NetworkImage

🎯 What it does: An Enhanced Instance Replay (EIR) framework is proposed to address the issues of background shift and catastrophic forgetting in continual semantic segmentation through instance-level storage and fusion.

Beyond Human Perception: Understanding Multi-Object World from Monocular View

Keyu Guo (Changan University), Ajmal Saeed Mian (Changan University)

CodeObject DetectionSegmentationTransformerLarge Language ModelPrompt EngineeringImageTextMultimodality

🎯 What it does: The MonoMulti-3DVG task is proposed, and a large-scale multi-target 3D visual alignment (3DVG) dataset called MonoMulti3D-ROPE is constructed from monocular RGB images. The CyclopsNet network is designed to achieve multi-modal semantic alignment and fusion.

Beyond Single-Modal Boundary: Cross-Modal Anomaly Detection through Visual Prototype and Harmonization

Kai Mao (Xi'an Jiaotong University), Nanning Zheng (Xi'an Jiaotong University)

CodeAnomaly DetectionContrastive LearningImageMultimodalityBiomedical DataMagnetic Resonance Imaging

🎯 What it does: This paper proposes a cross-modal anomaly detection method that can generalize to unknown modalities after training on known modalities.

BFANet: Revisiting 3D Semantic Segmentation with Boundary Feature Analysis

Weiguang Zhao (University of Liverpool), Kaizhu Huang (Duke Kunshan University)

CodeSegmentationTransformerPoint Cloud

🎯 What it does: This paper addresses four types of errors in 3D point cloud semantic segmentation (false positives, merging errors, displacement errors, and region classification errors), proposes corresponding evaluation metrics, and designs the BFANet network to enhance segmentation performance through boundary feature analysis.

BHViT: Binarized Hybrid Vision Transformer

Tian Gao (Nanjing University of Science and Technology), Hui Kong (University of Macau)

CodeSegmentationOptimizationComputational EfficiencyKnowledge DistillationTransformerImage

🎯 What it does: This paper proposes a binarizable hybrid visual Transformer (BHViT) aimed at significantly reducing computational load and energy consumption while maintaining high accuracy, making it suitable for deployment on edge devices.

BiLoRA: Almost-Orthogonal Parameter Spaces for Continual Learning

Hao Zhu (Data61 CSIRO), Piotr Koniusz (Data61 CSIRO)

CodeClassificationDomain AdaptationImage

🎯 What it does: Proposes BiLoRA - a parameter-efficient continual learning method achieved through bilinear rewriting and fixed orthogonal bases (Fourier).

Binarized Mamba-Transformer for Lightweight Quad Bayer HybridEVS Demosaicing

Shiyang Zhou (Harbin Institute of Technology), Jingyong Su (Harbin Institute of Technology)

CodeRestorationTransformerImageVideo

🎯 What it does: A lightweight binary Mamba-Transformer network BMTNet is proposed for image demosaicing in Quad Bayer HybridEVS cameras.

BiomedCoOp: Learning to Prompt for Biomedical Vision-Language Models

Taha Koleilat (Concordia University), Yiming Xiao (Concordia University)

CodeClassificationAnomaly DetectionKnowledge DistillationTransformerLarge Language ModelPrompt EngineeringVision Language ModelImageBiomedical DataMagnetic Resonance ImagingComputed TomographyUltrasound

🎯 What it does: For the task of medical image classification with limited annotations, we propose BiomedCoOp, a prompt learning-based framework that utilizes the BiomedCLIP vision-language model and diverse medical prompts generated by GPT-4. By combining semantic consistency and knowledge distillation mechanisms, it achieves efficient and transferable few-shot learning.

BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literature

Alejandro Lozano (Stanford University), Serena Yeung-Levy (Stanford University)

CodeRetrievalTransformerVision Language ModelContrastive LearningImageTextBiomedical DataBenchmark

🎯 What it does: The BIOMEDICA framework was constructed, collecting and organizing 24 million image-text pairs from 6 million PubMed Central Open Access papers, and providing 27 metadata fields; subsequently, a variant of CLIP (BMC-CLIP) was continuously pre-trained on this large-scale dataset.

Black-Box Forgery Attacks on Semantic Watermarks for Diffusion Models

Andreas MΓΌller, Erwin Quiring (Ruhr University Bochum)

CodeGenerationAdversarial AttackDiffusion modelImage

🎯 What it does: A black-box forgery and removal attack against semantic watermarks is proposed, demonstrating that a high success rate of watermark transfer can be achieved between different models with just one reference watermark image.

Blood Flow Speed Estimation with Optical Coherence Tomography Angiography Images

Wensheng Cheng (Stony Brook University), Haibin Ling (Stony Brook University)

CodeDepth EstimationTransformerImageBiomedical Data

🎯 What it does: This paper proposes an end-to-end deep learning framework called OCTA-Flow, which can directly estimate blood flow velocity from Optical Coherence Tomography Angiography (OCTA) images, replacing the traditional Optical Doppler Tomography (ODT) that requires expensive hardware and complex signal processing.

BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understanding

Shuming Liu (King Abdullah University of Science and Technology), Bernard Ghanem (King Abdullah University of Science and Technology)

CodeRetrievalTransformerVision Language ModelVideoMultimodality

🎯 What it does: The BOLT method is proposed, which enhances the performance of large-scale visual language models in long video understanding tasks through frame selection strategies such as inverse transformation sampling, without the need for additional training.

Boost the Inference with Co-training: A Depth-guided Mutual Learning Framework for Semi-supervised Medical Polyp Segmentation

Yuxin Li (Ocean University of China), Zhibin Yu (Ocean University of China)

CodeSegmentationConvolutional Neural NetworkContrastive LearningImageBiomedical DataMagnetic Resonance Imaging

🎯 What it does: This paper proposes a semi-supervised polyp segmentation framework RD-Net based on Mean Teacher, which utilizes an auxiliary student network to train depth images and achieves high-precision segmentation during inference using only RGB through depth-guided cross-modal mutual learning.

Boosting Adversarial Transferability through Augmentation in Hypothesis Space

Yu Guo (Xiamen University), Cheng Wang (Xiamen University)

CodeAdversarial AttackConvolutional Neural NetworkTransformerImagePoint Cloud

🎯 What it does: A model space augmentation-based adversarial attack method called OPS is proposed, which constructs neighborhood models in the hypothesis space using random input transformation operators and perturbations, and solves random optimization, significantly enhancing the transferability of adversarial samples.

Boosting the Dual-Stream Architecture in Ultra-High Resolution Segmentation with Resolution-Biased Uncertainty Estimation

Rong Qin (Nankai University), Jufeng Yang (Nankai University)

CodeSegmentationConvolutional Neural NetworkImage

🎯 What it does: A dual-stream ultra-high resolution (UHR) semantic segmentation framework is proposed, which simultaneously achieves three main objectives: feature fusion, important region amplification, and detail supplementation by estimating resolution deviation uncertainty.

Bootstrap Your Own Views: Masked Ego-Exo Modeling for Fine-grained View-invariant Video Representations

Jungin Park (Yonsei University), Kwanghoon Sohn (Yonsei University)

CodeRecognitionRetrievalRepresentation LearningTransformerAuto EncoderContrastive LearningVideo

🎯 What it does: A framework is proposed that utilizes a self-supervised masking strategy (self-view mask and cross-view mask) for representation learning on unpaired and asynchronous first-person and third-person videos.

Breaking the Low-Rank Dilemma of Linear Attention

Qihang Fan (Chinese Academy of Sciences), Ran He (Chinese Academy of Sciences)

CodeClassificationObject DetectionSegmentationTransformerImage

🎯 What it does: This study investigates the low-rank bottleneck of linear attention, proposing Rank-Augmented Linear Attention (RALA) and constructing the Rank-Augmented Vision Linear Transformer (RAVLT) based on it to achieve efficient visual modeling.

Bridging Past and Future: End-to-End Autonomous Driving with Historical Prediction and Planning

Bozhou Zhang (Fudan University), Li Zhang (Fudan University)

CodeAutonomous DrivingTransformerPoint Cloud

🎯 What it does: Proposes the BridgeAD framework, which integrates historical prediction and planning information into an end-to-end autonomous driving system.

Bridging Viewpoint Gaps: Geometric Reasoning Boosts Semantic Correspondence

Qiyang Qian (University of California), Chenfeng Xu (Stanford University)

CodeRecognitionObject DetectionDomain AdaptationComputational EfficiencyKnowledge DistillationTransformerDiffusion modelImagePoint Cloud

🎯 What it does: This paper proposes a semantic correspondence method that combines 3D geometric alignment with deformation and sparse semantic matching, utilizing DUSt3R trained on synthetic cross-instance perspective data to achieve efficient and robust correspondences.

Building Vision Models upon Heat Conduction

Zhaozhi Wang (University of Chinese Academy of Sciences), Qixiang Ye (University of Chinese Academy of Sciences)

CodeClassificationRestorationObject DetectionSegmentationComputational EfficiencyConvolutional Neural NetworkTransformerSupervised Fine-TuningImagePhysics Related

🎯 What it does: A visual representation model vHeat based on the physical principles of thermal diffusion is proposed, and a Heat Conduction Operator (HCO) is designed to achieve global information propagation using DCT/IDCT;

BWFormer: Building Wireframe Reconstruction from Airborne LiDAR Point Cloud with Transformer

Yuzhou Liu (Institute of Automation, Chinese Academy of Sciences), Shuhan Shen (Institute of Automation, Chinese Academy of Sciences)

CodeObject DetectionGenerationData SynthesisTransformerDiffusion modelPoint Cloud

🎯 What it does: Construct an end-to-end Transformer architecture for reconstructing 3D wireframe models of buildings from aerial LiDAR point clouds.

ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Way

Jiazi Bu (Shanghai AI Laboratory), Jiaqi Wang (Shanghai Innovation Institute)

CodeGenerationData SynthesisDiffusion modelVideoText

🎯 What it does: An improved method called ByTheWay has been developed, which is training-independent, requires no additional parameters, and incurs no sampling costs. It aims to enhance the structural rationality, temporal consistency, and motion amplitude of text-to-video (T2V) generation models.

CADRef: Robust Out-of-Distribution Detection via Class-Aware Decoupled Relative Feature Leveraging

Zhiwei Ling (Zhejiang University), Shuiguang Deng (Zhejiang University)

CodeAnomaly DetectionConvolutional Neural NetworkImage

🎯 What it does: A post-hoc OOD detection method based on category-related relative feature error, CARef, is proposed, and further enhanced to a more powerful CADRef through feature decomposition and error scaling.

Camera Resection from Known Line Pencils and a Radially Distorted Scanline

Juan C. Dibene (Stevens Institute of Technology), Enrique Dunn (Stevens Institute of Technology)

CodePose EstimationSimultaneous Localization and MappingImage

🎯 What it does: This paper proposes a framework for absolute camera pose estimation based on a single radial distortion scanning line, including 6-point minimal solutions, 7-point unique solutions, and 8+ linear solutions;

CaMuViD: Calibration-Free Multi-View Detection

Amir Etefaghi Daryani (University of Florida), Henry Medeiros (University of Florida)

CodeObject DetectionConvolutional Neural NetworkImage

🎯 What it does: This paper proposes a calibration-free multi-view pedestrian detection framework called CaMuViD.

Can't Slow Me Down: Learning Robust and Hardware-Adaptive Object Detectors against Latency Attacks for Edge Devices

Tianyi Wang (Zhejiang University), Jiming Chen (Zhejiang University)

CodeObject DetectionAutonomous DrivingComputational EfficiencyAdversarial AttackImage

🎯 What it does: A hardware-adaptive background attention adversarial training defense method against latency attacks on NMS-based object detectors for edge devices is proposed.

CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-Scale Reinforcement Learning in Autonomous Driving

Dongkun Zhang (Zhejiang University), Yue Wang (Zhejiang University)

CodeAutonomous DrivingTransformerReinforcement LearningPoint Cloud

🎯 What it does: This paper presents CarPlanner, a consistency autoregressive trajectory planner that utilizes reinforcement learning to generate multimodal trajectories, addressing the training efficiency and performance issues of large-scale real driving tasks.

CASP: Compression of Large Multimodal Models Based on Attention Sparsity

Mohsen Gholami (Huawei Technologies Canada), Yong Zhang (Huawei Technologies Canada)

CodeCompressionTransformerLarge Language ModelImageVideoTextMultimodality

🎯 What it does: A very low-bit compression method CASP based on attention sparsity is proposed, which compresses large multimodal models using low-rank decomposition and quantization.

CATANet: Efficient Content-Aware Token Aggregation for Lightweight Image Super-Resolution

Xin Liu (Nanjing University), Gangshan Wu (Nanjing University)

CodeRestorationSuper ResolutionTransformerImage

🎯 What it does: A lightweight super-resolution network called CATANet is proposed, which achieves long-distance information interaction through content-aware token aggregation.

Causal Composition Diffusion Model for Closed-loop Traffic Generation

Haohong Lin (Carnegie Mellon University), Hongge Chen (Cruise LLC)

CodeGenerationAutonomous DrivingDiffusion modelTime Series

🎯 What it does: This paper studies a causal combination diffusion model called CCDiff, designed for generating closed-loop traffic scenarios while balancing controllability and realism.