arXivSub Start free trial

CVPR 2023 Papers with Code β€” Page 4

IEEE/CVF Conference on Computer Vision and Pattern Recognition Β· 830 papers

GradICON: Approximate Diffeomorphisms via Gradient Inverse Consistency

Lin Tian (University of North Carolina at Chapel Hill), Marc Niethammer (University of North Carolina at Chapel Hill)

CodeImage TranslationOptimizationConvolutional Neural NetworkBiomedical DataMagnetic Resonance ImagingComputed Tomography

🎯 What it does: Proposes GradICON regularization, utilizing gradient inverse consistency to train medical image registration networks, achieving high-quality, seamless deformations.

Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization

Xingxuan Zhang (Tsinghua University), Peng Cui (Tsinghua University)

CodeOptimizationConvolutional Neural NetworkTransformerImage

🎯 What it does: The concept of first-order flatness is proposed, and based on this, the Gradient Norm Aware Minimization (GAM) algorithm is designed to explicitly optimize the gradient norm of model weights during training, thereby seeking flatter minima and enhancing the model's generalization performance.

GradMA: A Gradient-Memory-Based Accelerated Federated Learning With Alleviated Catastrophic Forgetting

Kangyang Luo (East China Normal University), Ming Gao (East China Normal University)

CodeFederated LearningConvolutional Neural NetworkImage

🎯 What it does: This paper proposes GradMA, an accelerated federated learning framework that simultaneously utilizes gradient memory on both the server and client sides, aimed at alleviating catastrophic forgetting caused by data heterogeneity and partial participation.

GrowSP: Unsupervised Semantic Segmentation of 3D Point Clouds

Zihui Zhang (Hong Kong Polytechnic University), Bo Li (Hong Kong Polytechnic University)

CodeSegmentationConvolutional Neural NetworkPoint Cloud

🎯 What it does: A completely unsupervised 3D point cloud semantic segmentation method called GrowSP is proposed, which achieves point-level semantic segmentation using progressively expanded superpoints and semantic primitive clustering.

Guided Depth Super-Resolution by Deep Anisotropic Diffusion

Nando Metzger (ETH Zurich), Konrad Schindler (ETH Zurich)

CodeRestorationDepth EstimationSuper ResolutionConvolutional Neural NetworkDiffusion modelImagePoint Cloud

🎯 What it does: A guided deep super-resolution method that integrates deep learning with anisotropic diffusion is proposed, utilizing RGB guidance images to achieve high-quality depth image magnification.

Guiding Pseudo-Labels With Uncertainty Estimation for Source-Free Unsupervised Domain Adaptation

Mattia Litrico (Istituto Italiano di Tecnologia), Pietro Morerio (Istituto Italiano di Tecnologia)

CodeDomain AdaptationContrastive LearningImage

🎯 What it does: A source-free unsupervised domain adaptation method is proposed, which enhances target domain performance by re-weighting pseudo-labels through neighbor knowledge aggregation and entropy estimation.

HaLP: Hallucinating Latent Positives for Skeleton-Based Self-Supervised Learning of Actions

Anshul Shah (Johns Hopkins University), Rama Chellappa (Johns Hopkins University)

CodeRecognitionOptimizationRepresentation LearningContrastive LearningVideo

🎯 What it does: This paper proposes enhancing contrastive learning in self-supervised learning for skeleton action recognition by synthesizing hard positive samples (HaLP) in the latent space.

Handwritten Text Generation From Visual Archetypes

Vittorio Pippi (University of Modena and Reggio Emilia), Rita Cucchiara (University of Modena and Reggio Emilia)

CodeGenerationTransformerGenerative Adversarial NetworkImageText

🎯 What it does: A few-shot handwritten text generation model based on Transformer, VATr, is proposed, which utilizes visual prototypes to encode and generate images of a specific author's writing style.

Handy: Towards a High Fidelity 3D Hand Shape and Appearance Model

Rolandos Alexandros Potamias (Imperial College London), Stefanos Zafeiriou (Imperial College London)

CodeGenerationData SynthesisPose EstimationGenerative Adversarial NetworkPoint CloudMesh

🎯 What it does: This work presents Handy, a high-fidelity hand shape and texture parameter model based on over 1200 hand scans, capable of reconstructing 3D hand shapes and high-frequency textures from a single photo.

Hard Patches Mining for Masked Image Modeling

Haochen Wang (Chinese Academy of Sciences), Zhaoxiang Zhang (Chinese Academy of Sciences)

CodeClassificationObject DetectionSegmentationTransformerContrastive LearningImage

🎯 What it does: This paper proposes a Hard Patches Mining (HPM) framework, where the model acts as both student and teacher during MIM pre-training, generating more challenging occlusion tasks by predicting the reconstruction loss of each patch, and jointly training the reconstruction network and loss predictor.

Hard Sample Matters a Lot in Zero-Shot Quantization

Huantong Li (South China University of Technology), Mingkui Tan (South China University of Technology)

CodeCompressionOptimizationAdversarial AttackImage

🎯 What it does: This paper addresses the issue of performance degradation caused by the easy fitting of synthetic samples in zero-shot quantization, proposing the Hard Sample Synthesis and Training (HAST) method.

Harmonious Feature Learning for Interactive Hand-Object Pose Estimation

Zhifeng Lin (South China University of Technology), Shaoli Huang (Tencent AI Lab)

CodePose EstimationConvolutional Neural NetworkImage

🎯 What it does: This paper proposes a new Harmonious Feature Learning Network (HFL-Net) for simultaneously estimating the 3D poses of hands and objects from a single RGB image.

Harmonious Teacher for Cross-Domain Object Detection

Jinhong Deng (University of Electronic Science and Technology of China), Lixin Duan (Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China)

CodeObject DetectionDomain AdaptationConvolutional Neural NetworkSupervised Fine-TuningImage

🎯 What it does: Proposes the Harmonious Teacher framework, which enhances the classification and localization consistency of detection models in the source and target domains through self-supervised and unsupervised harmonious loss, and improves the self-training method for cross-domain object detection by using harmonious metrics for threshold-free weighting of pseudo-labels.

HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes With Iterative Intertwined Regularization

Zhihao Liang (South China University of Technology), Kui Jia (South China University of Technology)

CodeDepth EstimationComputational EfficiencyNeural Radiance FieldPoint CloudMesh

🎯 What it does: For surface reconstruction of multi-view indoor scenes, the HelixSurf method is proposed, which combines traditional PatchMatch MVS with neural implicit surface learning, and enhances geometric details and robustness through mutually iterative regularization.

Hidden Gems: 4D Radar Scene Flow Learning Using Cross-Modal Supervision

Fangqiang Ding (University of Edinburgh), Chris Xiaoxuan Lu (Delft University of Technology)

CodeAutonomous DrivingSimultaneous Localization and MappingOptical FlowMultimodalityPoint Cloud

🎯 What it does: This paper proposes a 4D radar scene flow estimation method based on multi-modal collaborative supervision, using co-located radar, LiDAR, camera, and odometry data for training without manual labeling.

Hierarchical Dense Correlation Distillation for Few-Shot Segmentation

Bohao Peng (Chinese University of Hong Kong), Jiaya Jia (Chinese University of Hong Kong)

CodeSegmentationKnowledge DistillationTransformerImage

🎯 What it does: A Hierarchically Decoupled Matching Network (HDMNet) is proposed for few-shot semantic segmentation.

Hierarchical Semantic Contrast for Scene-Aware Video Anomaly Detection

Shengyang Sun (Zhejiang University), Xiaojin Gong (Zhejiang University)

CodeAnomaly DetectionAuto EncoderContrastive LearningVideo

🎯 What it does: A hierarchical semantic contrast (HSC) method is proposed for learning scene-aware video anomaly detection models.

Hierarchical Supervision and Shuffle Data Augmentation for 3D Semi-Supervised Object Detection

Chuandong Liu (Chongqing University of Posts and Telecommunications), Xinbo Gao (Chongqing University of Posts and Telecommunications)

CodeObject DetectionAutonomous DrivingKnowledge DistillationPoint Cloud

🎯 What it does: Using a teacher-student framework, the pseudo-labels output by the teacher network are dynamically divided into three groups: high confidence, ambiguous, and low confidence. Shuffle data augmentation is introduced in the student network to enhance feature representation capabilities.

Hierarchical Video-Moment Retrieval and Step-Captioning

Abhay Zala (University of North Carolina at Chapel Hill), Mohit Bansal (University of North Carolina at Chapel Hill)

CodeGenerationRetrievalTransformerSupervised Fine-TuningVision Language ModelVideoTextMultimodality

🎯 What it does: The HIREST dataset and a four-level video retrieval and step generation task are proposed, constructing an end-to-end retrieval and decomposition framework.

High Fidelity 3D Hand Shape Reconstruction via Scalable Graph Frequency Decomposition

Tianyu Luan (State University of New York), Junsong Yuan (State University of New York)

CodeGenerationPose EstimationGraph Neural NetworkMesh

🎯 What it does: A scalable frequency domain decomposition network is designed and implemented to achieve high-fidelity 3D hand model reconstruction from a single image.

High-Fidelity 3D GAN Inversion by Pseudo-Multi-View Optimization

Jiaxin Xie (Hong Kong University of Science and Technology), Qifeng Chen (Hong Kong University of Science and Technology)

CodeGenerationOptimizationGenerative Adversarial NetworkImage

🎯 What it does: A high-fidelity 3D GAN inversion framework based on pseudo-multi-view optimization is proposed, capable of generating high-quality, 3D-consistent view synthesis from a single image, and supports attribute editing and texture modification.

High-Fidelity 3D Human Digitization From Single 2K Resolution Images

Sang-Hun Han (Gwangju Institute of Science and Technology), Hae-Gon Jeon (Gwangju Institute of Science and Technology)

CodeSegmentationGenerationPose EstimationDepth EstimationComputational EfficiencyConvolutional Neural NetworkImageMesh

🎯 What it does: This paper proposes a full-body 3D human digitization framework (2K2K) based on a single 2K (2048Γ—2048) high-resolution color image. It generates a high-fidelity 3D mesh through segmentation (body parts) extraction, surface normal prediction, low-resolution full-body depth prediction, and high-resolution depth fusion.

High-Fidelity Clothed Avatar Reconstruction From a Single Image

Tingting Liao (University of Chinese Academy of Sciences), Zhen Lei (University of Chinese Academy of Sciences)

CodeGenerationPose EstimationImage

🎯 What it does: This paper proposes a coarse-to-fine two-stage framework for reconstructing human avatars from a single image (CAR), enabling the rapid generation of high-fidelity clothing pose avatars.

High-Fidelity Event-Radiance Recovery via Transient Event Frequency

Jin Han (University of Tokyo), Imari Sato (University of Tokyo)

CodeRestorationDepth EstimationImage

🎯 What it does: Directly reconstruct the scene radiance values using the transient event frequency (TEF) of event cameras under active illumination.

High-Fidelity Facial Avatar Reconstruction From Monocular Video With Generative Priors

Yunpeng Bai (Tsinghua University), Ying Shan (Tencent AI Lab)

CodeGenerationData SynthesisGenerative Adversarial NetworkVideoMultimodalityAudio

🎯 What it does: Constructing high-fidelity 3D facial avatars from monocular videos, supporting facial reenactment and free-viewpoint rendering.

Histopathology Whole Slide Image Analysis With Heterogeneous Graph Representation Learning

Tsai Hor Chan (University of Hong Kong), Lequan Yu (University of Hong Kong)

CodeClassificationExplainability and InterpretabilityRepresentation LearningGraph Neural NetworkTransformerImageBiomedical Data

🎯 What it does: This paper constructs a heterogeneous graph that includes cell types and continuous similarity, utilizing the HEAT layer and pseudo-label pooling for whole slide image (WSI) analysis, and provides causal explanations.

HOICLIP: Efficient Knowledge Transfer for HOI Detection With Vision-Language Models

Shan Ning (ShanghaiTech University), Xuming He (ShanghaiTech University)

CodeObject DetectionKnowledge DistillationTransformerVision Language ModelContrastive LearningImageMultimodality

🎯 What it does: Proposes the HOICLIP framework, which efficiently transfers CLIP's visual-language knowledge to the human-object interaction (HOI) detection task.

How Can Objects Help Action Recognition?

Xingyi Zhou (Google Research), Cordelia Schmid (Google Research)

CodeRecognitionObject DetectionTransformerVideo

🎯 What it does: Improving video action recognition using external object detection information, proposing Object-Guided Token Sampling (OGS) and Object-Aware Attention Module (OAM) to achieve the dual goals of reducing token inefficiency and enhancing accuracy.

How to Backdoor Diffusion Models?

Sheng-Yen Chou (National Tsing Hua University), Tsung-Yi Ho (Chinese University of Hong Kong)

CodeGenerationAdversarial AttackDiffusion modelImage

🎯 What it does: This paper proposes a backdoor attack framework for diffusion models called BadDiffusion, and demonstrates the feasibility of this attack in image generation tasks.

HS-Pose: Hybrid Scope Feature Extraction for Category-Level Object Pose Estimation

Linfang Zheng (Southern University of Science and Technology), Hyung Jin Chang (University of Birmingham)

CodeObject DetectionPose EstimationGraph Neural NetworkPoint Cloud

🎯 What it does: This paper proposes a new hybrid scale feature extraction layer (HS-layer) and applies it to the category-level object pose estimation framework HS-Pose, which can simultaneously capture local and global geometric information, encode scale and translation information, and is robust to outliers.

Hubs and Hyperspheres: Reducing Hubness and Improving Transductive Few-Shot Learning With Hyperspherical Embeddings

Daniel J. Trosten (UiT Arctic University of Norway), Michael C. Kampffmeyer (UiT Arctic University of Norway)

CodeClassificationRepresentation LearningImage

🎯 What it does: This paper proposes a method to eliminate the hubness problem in transductive few-shot learning by achieving uniform embedding on the sphere, enhancing classification performance while maintaining local similarity (LSP);

Human Guided Ground-Truth Generation for Realistic Image Super-Resolution

Du Chen (Hong Kong Polytechnic University), Lei Zhang (Hong Kong Polytechnic University)

CodeRestorationSuper ResolutionConvolutional Neural NetworkGenerative Adversarial NetworkImage

🎯 What it does: A multi-version high-quality GT generation process based on human judgment has been developed, and a specialized HGGT dataset for super-resolution in real scenarios has been constructed based on this.

Human Pose As Compositional Tokens

Zigang Geng (University of Science and Technology of China), Han Hu (University of Science and Technology of China)

CodePose EstimationTransformerImage

🎯 What it does: Proposes a structured representation called Pose as Compositional Tokens (PCT), which maps human poses to discrete sub-structure tokens and completes pose estimation through classification tasks.

Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes

Xuan Ju (International Digital Economy Academy), Lei Zhang (International Digital Economy Academy)

CodeObject DetectionPose EstimationConvolutional Neural NetworkTransformerDiffusion modelImage

🎯 What it does: This paper presents the Human-Art dataset, aimed at bridging the gap between natural scenes and artificial scenes (such as sculptures, paintings, cartoons, digital art, etc.) in the tasks of human detection and pose estimation, and provides rich annotations (bounding boxes, 21 key points, self-contact points, text descriptions) to support various downstream tasks.

HumanBench: Towards General Human-Centric Perception With Projector Assisted Pretraining

Shixiang Tang (University of Sydney), Wanli Ouyang (Shanghai AI Laboratory)

CodeObject DetectionSegmentationPose EstimationRepresentation LearningTransformerImageBenchmark

🎯 What it does: This paper proposes HumanBench (which includes 19 datasets covering 6 categories of human perception tasks) and PATH (a projector-based hierarchical weight sharing pre-training method) for learning general human visual representations.

Hunting Sparsity: Density-Guided Contrastive Learning for Semi-Supervised Semantic Segmentation

Xiaoyang Wang (University of Liverpool), Jimin Xiao (XJTLU)

CodeSegmentationContrastive LearningImage

🎯 What it does: This paper proposes a density-guided contrastive learning framework based on feature space (DGCL), which enhances semi-supervised semantic segmentation by locating sparse features and guiding them to cluster around high-density centers.

HypLiLoc: Towards Effective LiDAR Pose Regression With Hyperbolic Fusion

Sijie Wang (Nanyang Technological University), Wee Peng Tay (Nanyang Technological University)

CodePose EstimationAutonomous DrivingSimultaneous Localization and MappingMultimodalityPoint Cloud

🎯 What it does: This paper proposes a new LiDAR pose regression network called HypLiLoc, which utilizes multimodal features from 3D point clouds and spherical projections, and integrates them in Euclidean and hyperbolic spaces.

I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classification

Muhammad Ferjad Naeem (ETH Zurich), Federico Tombari

CodeClassificationTransformerLarge Language ModelPrompt EngineeringImageTextMultimodality

🎯 What it does: Proposes the I2MVFormer model, which utilizes large language models to generate multi-view text supervision for unsupervised zero-shot image classification.

IDGI: A Framework To Eliminate Explanation Noise From Integrated Gradients

Ruo Yang (Illinois Institute of Technology), Mustafa Bilgic (Illinois Institute of Technology)

CodeExplainability and InterpretabilityConvolutional Neural NetworkContrastive LearningImage

🎯 What it does: Proposes the Important Direction Gradient Integration (IDGI) framework, which removes the explanation noise in the Integrated Gradients (IG) method and enhances interpretability.

IFSeg: Image-Free Semantic Segmentation via Vision-Language Model

Sukmin Yun (Mohamed bin Zayed University of Artificial Intelligence), Jinwoo Shin (Korea Advanced Institute of Science and Technology)

CodeSegmentationTransformerSupervised Fine-TuningVision Language ModelImageText

🎯 What it does: Using a pre-trained visual language encoder-decoder model, artificial images are generated from semantic category words to complete the semantic segmentation task without using any task-specific images or annotations.

Images Speak in Images: A Generalist Painter for In-Context Visual Learning

Xinlong Wang (Beijing Academy of Artificial Intelligence), Tiejun Huang (Peking University)

CodeSegmentationDepth EstimationTransformerPrompt EngineeringImage

🎯 What it does: This paper presents Painter, a general visual model that uses image pairs as task prompts to support reasoning for various visual tasks in context.

Imitation Learning As State Matching via Differentiable Physics

Siwei Chen (National University of Singapore), Zhongwen Xu (Sea AI Lab)

CodeOptimizationRobotic IntelligenceReinforcement Learning from Human FeedbackReinforcement LearningSequentialPhysics Related

🎯 What it does: By utilizing a differentiable physics simulator to directly embed the state matching target into gradient descent, single-loop imitation learning is achieved.

Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization

Shichao Dong (MEGVII Technology), Zheng Ge (MEGVII Technology)

CodeClassificationObject DetectionConvolutional Neural NetworkImageVideo

🎯 What it does: This paper analyzes the fundamental reasons for the poor performance of deepfake detection models in cross-dataset evaluations and proposes the theory of 'implicit identity leakage'. It then designs an ID-unaware deepfake detection model based on local forgery trace detection.

Improved Test-Time Adaptation for Domain Generalization

Liang Chen (University of Adelaide), Lingqiao Liu (University of Adelaide)

CodeDomain AdaptationConvolutional Neural NetworkSupervised Fine-TuningImage

🎯 What it does: To address the domain generalization problem, this paper proposes an improved test-time adaptation method called ITTA, which dynamically adjusts the model during the testing phase to adapt to the target domain.

Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles

Shuquan Ye (Microsoft), Jing Liao (City University of Hong Kong)

CodeRetrievalTransformerVision Language ModelImageText

🎯 What it does: This paper proposes the DANCE technique, which generates puzzle-like text and image pairs by linearizing conceptual graph knowledge and hiding entities, thereby injecting common sense knowledge into visual-language models during the training phase.

Improving Generalization With Domain Convex Game

Fangrui Lv (Beijing Institute of Technology), Di Liu (Beijing Institute of Technology)

CodeDomain AdaptationMeta LearningConvolutional Neural NetworkGenerative Adversarial NetworkImage

🎯 What it does: Proposes modeling domain generalization as a convex game between domains, enhancing the generalization ability of multi-source domains through hypermodel regularization and sample filtering.

Improving Robustness of Vision Transformers by Reducing Sensitivity To Patch Corruptions

Yong Guo (Max Planck Institute for Informatics), Bernt Schiele (Max Planck Institute for Informatics)

CodeClassificationRecognitionTransformerImage

🎯 What it does: A new training method called RSPC is proposed, specifically designed to enhance the model's robustness against common image perturbations by reducing the sensitivity of the Transformer to patch corruption.

Improving Selective Visual Question Answering by Learning From Your Peers

Corentin Dancette (Meta AI), Marcus Rohrbach (Meta AI)

CodeClassificationRecognitionDomain AdaptationTransformerContrastive LearningImageMultimodality

🎯 What it does: This paper studies the selective prediction problem in Visual Question Answering (VQA) and proposes a learning method using peer models (Learning from Your Peers, LYP) to train a selector, enabling the model to self-reject when facing uncertainty in correctness.

Improving Visual Grounding by Encouraging Consistent Gradient-Based Explanations

Ziyan Yang (Rice University), Vicente Ordonez (Rice University)

CodeObject DetectionExplainability and InterpretabilityTransformerVision Language ModelImage

🎯 What it does: This paper proposes a gradient-based interpretable consistency (AMC) loss to directly optimize GradCAM heatmaps in visual language models, aligning them with human-annotated regions to enhance visual localization capabilities.

Improving Zero-Shot Generalization and Robustness of Multi-Modal Models

Yunhao Ge (Google Research), Jiaping Zhao (Google Research)

CodeClassificationPrompt EngineeringVision Language ModelImageMultimodality

🎯 What it does: This paper addresses zero-shot classification in multimodal image-text models by proposing a confidence estimation method based on prompt and image transformation self-consistency, and enhances labels using the WordNet hierarchy on low-confidence samples to improve prediction accuracy.

Incremental 3D Semantic Scene Graph Prediction From RGB Sequences

Shun-Cheng Wu (Technische UniversitΓ€t MΓΌnchen), Federico Tombari (Google)

CodeRecognitionObject DetectionSegmentationComputational EfficiencyGraph Neural NetworkSimultaneous Localization and MappingImageVideoPoint Cloud

🎯 What it does: A real-time incremental 3D semantic scene graph inference framework based on RGB sequences is proposed, which can continuously construct a globally consistent 3D scene graph without relying on depth information.

Independent Component Alignment for Multi-Task Learning

Dmitry Senushkin (Samsung Research), Anton Konushin (Samsung Research)

CodeSegmentationDepth EstimationOptimizationConvolutional Neural NetworkReinforcement LearningImage

🎯 What it does: This paper proposes a new multi-task learning optimization method called Aligned-MTL, which eliminates gradient conflicts and dominance issues by aligning the gradient matrices, thereby enhancing the stability and performance of multi-task training.

Indescribable Multi-Modal Spatial Evaluator

Lingke Kong (Manteia Tech), Qichao Zhou (Manteia Tech)

CodeImage TranslationOptimizationConvolutional Neural NetworkGenerative Adversarial NetworkMultimodalityBiomedical DataMagnetic Resonance ImagingComputed Tomography

🎯 What it does: This paper proposes a self-supervised multimodal spatial evaluator (IMSE) to address the distribution discrepancy problem in multimodal image registration, and directly drives the optimization of the registration network through the evaluator's error.

Indiscernible Object Counting in Underwater Scenes

Guolei Sun (ETH Zurich), Luc Van Gool (KU Leuven)

CodeObject DetectionTransformerImage

🎯 What it does: A new task called 'concealed object counting' is proposed, and a large underwater fish concealment counting dataset, IOCfish5K, is constructed. Based on this, a Transformer framework called IOCFormer is proposed, which integrates density and regression branches.

Inferring and Leveraging Parts From Object Shape for Improving Semantic Image Synthesis

Yuxiang Wei (Harbin Institute of Technology), Wangmeng Zuo (Harbin Institute of Technology)

CodeSegmentationGenerationGenerative Adversarial NetworkImage

🎯 What it does: This paper proposes a PartNet based on a small number of supporting partial images to infer object part segmentation maps from semantic maps, and enhances the detail quality of semantic image synthesis through a part semantic modulation module.

Instance-Aware Domain Generalization for Face Anti-Spoofing

Qianyu Zhou (Shanghai Jiao Tong University), Lizhuang Ma (Shanghai Jiao Tong University)

CodeDomain AdaptationAnomaly DetectionConvolutional Neural NetworkImage

🎯 What it does: Proposes a domain-agnostic instance-aware domain generalization framework for facial fraud detection.

Instance-Specific and Model-Adaptive Supervision for Semi-Supervised Semantic Segmentation

Zhen Zhao (University of Sydney), Luping Zhou (University of Sydney)

CodeObject DetectionSegmentationImage

🎯 What it does: This paper proposes iMAS, an instance-specific and model-adaptive semi-supervised semantic segmentation method that utilizes a teacher-student model to evaluate the difficulty of each unlabeled sample based on IoU, and dynamically adjusts the weights of strong augmentation and consistency loss according to this difficulty.

Instant Multi-View Head Capture Through Learnable Registration

Timo Bolkart (Max Planck Institute for Intelligent Systems), Michael J. Black (University of Southern California)

CodeSegmentationPose EstimationDepth EstimationConvolutional Neural NetworkImageMesh

🎯 What it does: Directly inferring a complete 3D head mesh from multi-view calibrated images, omitting traditional MVS reconstruction and non-rigid registration steps.

InstMove: Instance Motion for Object-Centric Video Segmentation

Qihao Liu (Johns Hopkins University), Song Bai (ByteDance)

CodeObject TrackingSegmentationRecurrent Neural NetworkOptical FlowVideo

🎯 What it does: Proposes the InstMove module, which improves video instance segmentation, video object segmentation, and multi-object tracking/segmentation through instance-level motion prediction.

Interactive Segmentation As Gaussion Process Classification

Minghao Zhou (Xi'an Jiaotong University), Yefeng Zheng (Tencent)

CodeSegmentationImage

🎯 What it does: Reformulate the interactive segmentation task as a pixel-level binary classification problem for each image, and use a Gaussian process classification model.

InternImage: Exploring Large-Scale Vision Foundation Models With Deformable Convolutions

Wenhai Wang (Shanghai AI Laboratory), Yu Qiao (Shanghai AI Laboratory)

CodeClassificationObject DetectionSegmentationConvolutional Neural NetworkTransformerImage

🎯 What it does: A new large-scale convolutional foundation model, InternImage, is proposed, utilizing deformable convolution to achieve long-range dependencies and adaptive spatial aggregation.

Interventional Bag Multi-Instance Learning on Whole-Slide Pathological Images

Tiancheng Lin (Shanghai Jiao Tong University), Chang-Wen Chen

CodeClassificationConvolutional Neural NetworkTransformerImage

🎯 What it does: A multi-instance learning framework based on causal intervention, IBMIL, is proposed, which can suppress background correlation bias in whole slide image classification and improve bag-level prediction accuracy.

Introducing Competition To Boost the Transferability of Targeted Adversarial Examples Through Clean Feature Mixup

Junyoung Byun (Korea Advanced Institute of Science and Technology), Changick Kim (Korea Advanced Institute of Science and Technology)

CodeClassificationAdversarial AttackTransformerImage

🎯 What it does: This paper proposes a Clean Feature Mixup (CFM) method that mixes clean features in the feature space to introduce a competitive mechanism when generating targeted adversarial samples, thereby enhancing the cross-model transferability of adversarial samples.

Inverse Rendering of Translucent Objects Using Physical and Neural Renderers

Chenhao Li (Osaka University), Hajime Nagahara (Osaka University)

CodeGenerationData SynthesisNeural Radiance FieldImage

🎯 What it does: This study investigates the inverse rendering of the shape, surface reflection, subsurface scattering (SSS), and ambient lighting of translucent objects from flash and non-flash images.

Inversion-Based Style Transfer With Diffusion Models

Yuxin Zhang (Institute of Automation, Chinese Academy of Sciences), Changsheng Xu (Institute of Automation, Chinese Academy of Sciences)

CodeImage TranslationGenerationDiffusion modelImage

🎯 What it does: This paper proposes an artistic style transfer framework called InST, which is based on reverse learning text descriptions from a single artwork. It utilizes attention-based text reverse and random reverse methods to use the learned style information as a conditional driver for a diffusion model to generate new artistic images, achieving precise transfer of attributes such as semantics, texture, brushstrokes, and color.

Invertible Neural Skinning

Yash Kant (University of Toronto), Igor Gilitschenski (Snap Research)

CodeGenerationPose EstimationMesh

🎯 What it does: An end-to-end differentiable Inverse Neural Skinning (INS) pipeline is proposed, utilizing a Pose-Conditioned Inverse Network (PIN) to capture the nonlinear deformations of clothing and muscles on both sides of differential LBS, achieving surface correspondence during pose re-targeting with only one mesh extraction.

IS-GGT: Iterative Scene Graph Generation With Generative Transformers

Sanjoy Kundu (Oklahoma State University), Sathyanarayanan N. Aakur (Oklahoma State University)

CodeObject DetectionGenerationTransformerImageGraph

🎯 What it does: This paper proposes a two-stage generative transformer framework IS-GGT for scene graph generation: first, it samples the interaction graph between entities using a generative transformer, and then classifies the predicates of the sampled edges;

ISBNet: A 3D Point Cloud Instance Segmentation Network With Instance-Aware Sampling and Box-Aware Dynamic Convolution

Tuan Duc Ngo (VinAI Research), Khoi Nguyen (VinAI Research)

CodeObject DetectionSegmentationConvolutional Neural NetworkPoint Cloud

🎯 What it does: This paper proposes ISBNet, a non-clustering 3D point cloud instance segmentation framework based on dynamic convolution;

Iterative Geometry Encoding Volume for Stereo Matching

Gangwei Xu (Huazhong University of Science and Technology), Xin Yang (Huazhong University of Science and Technology)

CodeDepth EstimationComputational EfficiencyConvolutional Neural NetworkRecurrent Neural NetworkImage

🎯 What it does: This paper proposes an Iterative Geometric Encoding Volume (IGEV) framework that generates Geometric Encoding Volumes (GEV) using a lightweight 3D CNN and fuses them with All-Pairs Correlation (APC) to form a Combined Geometric Encoding Volume (CGEV). It then uses ConvGRU to iteratively update the disparity and accelerates convergence by regressing the initial disparity through soft-argmin, extending it to multi-view stereo (MVS) tasks.

Iterative Next Boundary Detection for Instance Segmentation of Tree Rings in Microscopy Images of Shrub Cross Sections

Alexander Gillert (Fraunhofer Institute for Computer Graphics Research), Uwe Freiherr von Lukas (Fraunhofer Institute for Computer Graphics Research)

CodeObject DetectionSegmentationConvolutional Neural NetworkImage

🎯 What it does: An iterative next ring detection (INBD) method is proposed for tree ring instance segmentation in cell-level high-resolution microscopic images of tree cross-sections.

Iterative Proposal Refinement for Weakly-Supervised Video Grounding

Meng Cao (Peking University), Daxin Jiang (Microsoft)

CodeKnowledge DistillationRepresentation LearningTransformerVision Language ModelVideo

🎯 What it does: An Iterative Proposal Refinement Network (IRON) is proposed for weakly supervised video grounding, utilizing semantic and conceptual knowledge from a pre-trained VL model for dual distillation, and iteratively updating proposal confidence through label propagation.

itKD: Interchange Transfer-Based Knowledge Distillation for 3D Object Detection

Hyeon Cho (Ajou University), Wonjun Hwang (Ajou University)

CodeObject DetectionAutonomous DrivingKnowledge DistillationAuto EncoderPoint Cloud

🎯 What it does: This paper proposes a knowledge distillation method called itKD for 3D point cloud object detection, aimed at training lightweight detectors.

JacobiNeRF: NeRF Shaping With Mutual Information Gradients

Xiaomeng Xu (Tsinghua University), Leonidas Guibas (Google Research)

CodeObject DetectionSegmentationNeural Radiance FieldContrastive LearningImage

🎯 What it does: This paper proposes aligning the mutual information (MI) in the gradient space of Neural Radiance Fields (NeRF) so that when the network weights are perturbed, semantically related scene points or regions can produce resonant mutual responses, thereby achieving tasks such as sparse label propagation, instance selection, and editing.

Joint Appearance and Motion Learning for Efficient Rolling Shutter Correction

Bin Fan (Northwestern Polytechnical University), Qi Liu (Northwestern Polytechnical University)

CodeRestorationComputational EfficiencyTransformerImageVideo

🎯 What it does: This paper proposes and implements a single-stage JAMNet network for recovering high-quality global shutter images from two frames of rolling shutter images.

Joint Token Pruning and Squeezing Towards More Aggressive Compression of Vision Transformers

Siyuan Wei (MEGVII Technology), Jiajun Liang (MEGVII Technology)

CodeCompressionTransformerImage

🎯 What it does: This paper proposes a Token Pruning and Compression (TPS) module to more aggressively compress visual Transformers while retaining the information of pruned tokens.

Joint Video Multi-Frame Interpolation and Deblurring Under Unknown Exposure Time

Wei Shang (Harbin Institute of Technology), Wangmeng Zuo (Harbin Institute of Technology)

CodeImage TranslationRestorationContrastive LearningVideo

🎯 What it does: An end-to-end method is proposed to simultaneously perform multi-frame interpolation and deblurring for videos with unknown exposure times.

Joint Visual Grounding and Tracking With Natural Language Specification

Li Zhou (Harbin Institute of Technology), Zhenyu He (Harbin Institute of Technology)

CodeObject DetectionObject TrackingTransformerImageVideoText

🎯 What it does: A joint visual localization and tracking framework is proposed, utilizing natural language descriptions to simultaneously achieve target localization and tracking.

K-Planes: Explicit Radiance Fields in Space, Time, and Appearance

Sara Fridovich-Keil, Angjoo Kanazawa

CodeData SynthesisCompressionNeural Radiance FieldImageVideo

🎯 What it does: The k-planes model is proposed, which achieves an explicit representation of radiance fields for 3D static and 4D dynamic scenes by splitting the d-dimensional space into (d choose 2) two-dimensional planes.

KERM: Knowledge Enhanced Reasoning for Vision-and-Language Navigation

Xiangyang Li (Chinese Academy of Sciences), Shuqiang Jiang (Chinese Academy of Sciences)

CodeRetrievalRobotic IntelligenceTransformerVision Language ModelMultimodalityRetrieval-Augmented Generation

🎯 What it does: A knowledge-enhanced reasoning model KERM is proposed, which retrieves knowledge facts corresponding to views and integrates visual, historical, and instruction features to improve visual-language navigation.

Knowledge Combination To Learn Rotated Detection Without Rotated Annotation

Tianyu Zhu (Amazon), Anton van den Hengel (Monash University)

CodeObject DetectionDomain AdaptationImage

🎯 What it does: Proposes the KCR framework, which utilizes the joint training of source data's rotation annotations and target data's axis-aligned annotations to achieve rotation object detection without the need for rotation annotations.

Label Information Bottleneck for Label Enhancement

Qinghai Zheng (Fuzhou University), Haoyu Tang (Shandong University)

CodeClassificationAuto EncoderTabular

🎯 What it does: The Label Information Bottleneck (LIB) method is proposed for label enhancement, restoring the complete label distribution based on logical labels.

Label-Free Liver Tumor Segmentation

Qixin Hu (Huazhong University of Science and Technology), Zongwei Zhou (Johns Hopkins University)

CodeSegmentationData SynthesisConvolutional Neural NetworkImageComputed TomographyBenchmark

🎯 What it does: By synthesizing realistic liver tumors in healthy liver CT scans, AI models can be trained to perform liver tumor segmentation without the need for manual voxel annotation.

LANA: A Language-Capable Navigator for Instruction Following and Generation

Xiaohan Wang (Zhejiang University), Yi Yang (Zhejiang University)

CodeGenerationExplainability and InterpretabilityRobotic IntelligenceTransformerVision Language ModelMultimodality

🎯 What it does: A single model named LANA has been developed, capable of simultaneously executing visual language navigation instructions and generating path descriptions, achieving bidirectional human-machine language interaction.

Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

Yue Yang (University of Pennsylvania), Mark Yatskar (University of Pennsylvania)

CodeClassificationExplainability and InterpretabilityTransformerLarge Language ModelSupervised Fine-TuningPrompt EngineeringVision Language ModelImage

🎯 What it does: This paper proposes an interpretable image classification framework called LaBo, which does not require manually defined concepts. It utilizes large language models to generate candidate concepts and aligns them visually through CLIP, forming a concept bottleneck model.

Large-Capacity and Flexible Video Steganography via Invertible Neural Network

Chong Mou (Peking University), Jian Zhang (Peking University)

CodeData SynthesisSafty and PrivacyFlow-based ModelVideo

🎯 What it does: A large-capacity, reversible video steganography network is proposed, capable of hiding up to 7 secret videos within a cover video and achieving complete recovery of these secret videos through a single reversible neural network.

Large-Scale Training Data Search for Object Re-Identification

Yue Yao (Australian National University), Liang Zheng (Australian National University)

CodeRecognitionRetrievalImage

🎯 What it does: The paper proposes a Search and Prune (SnP) framework to quickly construct a training set that is close to the target domain distribution and has a controllable size from a large-scale data pool, in order to enhance the performance of object re-identification in the target domain.

LaserMix for Semi-Supervised LiDAR Semantic Segmentation

Lingdong Kong (Nanyang Technological University), Ziwei Liu (Nanyang Technological University)

CodeSegmentationAutonomous DrivingPoint Cloud

🎯 What it does: This paper presents LaserMix, a semi-supervised LiDAR semantic segmentation method that utilizes spatial priors of laser beams.

LAVENDER: Unifying Video-Language Understanding As Masked Language Modeling

Linjie Li (Microsoft), Lijuan Wang (Microsoft)

CodeGenerationRetrievalTransformerVision Language ModelVideoText

🎯 What it does: LAVENDER is proposed, a unified video-language model that uses Masked Language Modeling (MLM) as a unified interface for all pre-training and downstream tasks, without the need for task-specific heads.

Layout-Based Causal Inference for Object Navigation

Sixian Zhang (Chinese Academy of Sciences), Shuqiang Jiang (Chinese Academy of Sciences)

CodeRobotic IntelligenceReinforcement Learning

🎯 What it does: A layout-based soft total direct effect (L-sTDE) framework is proposed, which adjusts the positive and negative influences of experiences by estimating environmental layout differences in target navigation, enhancing generalization ability in unknown environments.

Learning a 3D Morphable Face Reflectance Model From Low-Cost Data

Yuxuan Han (Tsinghua University), Feng Xu (SenseTime Research)

CodeRestorationGenerationNeural Radiance FieldImage

🎯 What it does: Developed and trained the first 3D deformable facial reflection model with spatially varying BRDF that can learn from low-cost public data.

Learning a Deep Color Difference Metric for Photographic Images

Haoyu Chen (City University of Hong Kong), Kede Ma (City University of Hong Kong)

CodeImage TranslationRestorationFlow-based ModelImage

🎯 What it does: This paper proposes a color difference (CD) metric method based on multi-scale autoregressive normalizing flowsβ€”CD-Flowβ€”for evaluating color differences in real photographic images.

Learning a Practical SDR-to-HDRTV Up-Conversion Using New Dataset and Degradation Models

Cheng Guo (Communication University of China), Xiuhua Jiang (Communication University of China)

CodeImage TranslationRestorationTransformerVideo

🎯 What it does: This paper studies the upsampling from SDR video to HDR-WCG television, proposing a new dataset HDRTV4K and an improved HDRβ†’SDR degradation model.

Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learning

Weixuan Sun (Australian National University), Nick Barnes (Australian National University)

CodeRecognitionObject DetectionSegmentationRepresentation LearningConvolutional Neural NetworkContrastive LearningMultimodalityAudio

🎯 What it does: This paper proposes an audio-visual source localization method based on False Negative Aware Contrastive Learning (FNAC), which utilizes a unimodal similarity matrix to identify potential false negative samples and suppress their impact through two regularization techniques: False Negatives Suppression (FNS) and True Negatives Enhancement (TNE), thereby enhancing the audio-visual correspondence representation.

Learning Bottleneck Concepts in Image Classification

Bowen Wang (Osaka University), Hajime Nagahara (Osaka University)

CodeClassificationContrastive LearningImage

🎯 What it does: This paper proposes BotCL (Bottleneck Concept Learner), a model that learns interpretable concepts and performs image classification using a slot attention mechanism and self-supervised adversarial learning under the supervision of no concept labels.

Learning Decorrelated Representations Efficiently Using Fast Fourier Transform

Yutaro Shigeto (Chiba Institute of Technology), Akikazu Takeuchi (Chiba Institute of Technology)

CodeObject DetectionComputational EfficiencyRepresentation LearningConvolutional Neural NetworkContrastive LearningImage

🎯 What it does: This paper proposes a decoupled regularization method based on Fast Fourier Transform (FFT) that efficiently decorrelates features in self-supervised visual representation learning, reducing the time complexity to O(n d log d) and significantly lowering computational costs.

Learning Discriminative Representations for Skeleton Based Action Recognition

Huanyu Zhou (Beihang University), Yunhong Wang (Beihang University)

CodeRecognitionRepresentation LearningGraph Neural NetworkContrastive LearningVideo

🎯 What it does: Proposes a feature refinement head (FR Head) based on contrastive learning to enhance feature representation in skeleton action recognition models, particularly improving the distinction of ambiguous actions.

Learning Emotion Representations From Verbal and Nonverbal Communication

Sitao Zhang (Pennsylvania State University), James Z. Wang (Pennsylvania State University)

CodeRepresentation LearningTransformerContrastive LearningVideoTextMultimodality

🎯 What it does: EmotionCLIP is constructed, a framework for visual emotion representation pre-training through unlabeled everyday communication videos and subtitles.

Learning Federated Visual Prompt in Null Space for MRI Reconstruction

Chun-Mei Feng (Agency for Science Technology and Research), Wangmeng Zuo (Harbin Institute of Technology)

CodeRestorationFederated LearningTransformerPrompt EngineeringBiomedical DataMagnetic Resonance Imaging

🎯 What it does: The FedPR algorithm is proposed, which learns distributed visual prompts in the approximate null space of global prompts to address the issues of communication costs, data scarcity, and catastrophic forgetting in federated MRI reconstruction.

Learning From Noisy Labels With Decoupled Meta Label Purifier

Yuanpeng Tu (Tongji University), Cai Rong Zhao (Tongji University)

CodeRepresentation LearningMeta LearningConvolutional Neural NetworkContrastive LearningImage

🎯 What it does: This paper proposes a multi-stage label purification method called Decoupled Meta Label Purifier (DMLP) to enhance the robustness of deep networks in the presence of noisy labels.

Learning Generative Structure Prior for Blind Text Image Super-Resolution

Xiaoming Li (Nanyang Technological University), Chen Change Loy (Nanyang Technological University)

CodeRestorationSuper ResolutionTransformerGenerative Adversarial NetworkImage

🎯 What it does: This study focuses on blind text image super-resolution and proposes the use of generative structural priors to guide the restoration.