Publications

Viraj Prabhu, Senthil Purushwalkam, An Yan, Caiming Xong, Ran Xu (2024). Trust but Verify: Programmatic VLM Evaluation in the Wild. arXiv preprint arXiv:2410.13121 (2024).

PDF Dataset Explore Dataset

Yifei Ming, Senthil Purushwalkam, Shrey Pandit, Zixuan Ke, Xuan-Phi Nguyen, Caiming Xong, Shafiq Joty (2024). FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows". arXiv preprint arXiv:2410.03727 (2024).

PDF Dataset Code Blog

Xuan-Phi Nguyen, Shrey Pandit, Senthil Purushwalkam, Austin Xu, Hailin Chen, Yifei Ming, Zixuan Ke, Silvio Savarese, Caiming Xong, Shafiq Joty (2024). SFR-RAG: Towards Contextually Faithful LLMs. arXiv preprint arXiv:2409.09916 (2024).

PDF Contextual Benchmark Blog Press Press Press

Can Qin, Congying Xia, Krithika Ramakrishnan, Michael Ryoo, Lifu Tu, Yihao Feng, Manli Shu, Honglu Zhou, Anas Awadalla, Jun Wang, Senthil Purushwalkam, Le Xue, Yingbo Zhou, Huan Wang, Silvio Savarese, Juan Carlos Niebles, Zeyuan Chen, Ran Xu, Caiming Xiong (2024). xGen-VideoSyn-1: High-fidelity Text-to-Video Synthesis with Compressed Representations. AI4VA Workshop at ECCV24.

PDF Code

Le Xue, Manli Shu, Anas Awadalla, Jun Wang, An Yan, Senthil Purushwalkam, Honglu Zhou, Viraj Prabhu, Yutong Dai, Michael S Ryoo, Shrikant Kendre, Jieyu Zhang, Can Qin, Shu Zhang, Chia-Chih Chen, Ning Yu, Juntao Tan, Tulika Manoj Awalgaonkar, Shelby Heinecke, Huan Wang, Yejin Choi, Ludwig Schmidt, Zeyuan Chen, Silvio Savarese, Juan Carlos Niebles, Caiming Xiong, Ran Xu (2024). xGen-MM (BLIP-3): A Family of Open Large Multimodal Models. EVAL-FoMo Workshop at ECCV 2024.

PDF Models

Senthil Purushwalkam, Akash Gokul, Shafiq Joty, Nikhil Naik (2024). BootPIG: Bootstrapping Zero-shot Personalized Image Generation Capabilities in Pretrained Diffusion Models. SyntheticData4CV Workshop at ECCV 2024.

PDF Code

Bram Wallace, Meihua Dang, Rafael Rafailov, Linqi Zhou, Aaron Lou, Senthil Purushwalkam, Stefano Ermon, Caiming Xiong, Shafiq Joty, Nikhil Naik (2023). Diffusion Model Alignment Using Direct Preference Optimization. Conference on Computer Vision and Pattern Recognition (CVPR) 2024 .

PDF Code

Senthil Purushwalkam, Nikhil Naik (2023). ConRad: Image Constrained Radiance Fields for 3D Generation from a Single Image. Advances in Neural Information Processing Systems 33 (NeurIPS 2023).

PDF Poster

Senthil Purushwalkam +, Pedro Morgado +, Abhinav Gupta (2022). The Challenges of Continuous Self-Supervised Learning. European Conference on Computer Vision (ECCV) 2022.

PDF Code Poster Video

Simone Parisi, Aravind Rajeswaran, Senthil Purushwalkam, Abhinav Gupta (2022). The Unsurprising Effectiveness of Pre-trained Vision Models for Control. International Conference on Machine Learning (ICML) 2022.

PDF Project Page

Zihang Lai +, Senthil Purushwalkam +, Abhinav Gupta (2021). The Functional Correspondence Problem. International Conference on Computer Vision (ICCV) 2021.

PDF Project Page

Senthil Purushwalkam, Sebastian Vicenc Amengual Gari, Vamsi Krishna Ithapu, Carl Schissler, Philip Robinson, Abhinav Gupta, Kristen Grauman (2021). Audio-Visual Floorplan Reconstruction. International Conference on Computer Vision (ICCV) 2021.

PDF Code Talk (5min) Slides Poster

Senthil Purushwalkam, Abhinav Gupta (2020). Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases. Advances in Neural Information Processing Systems 33 (NeurIPS 2020).

PDF Slides

Senthil Purushwalkam, Tian Ye, Saurabh Gupta, Abhinav Gupta (2020). Aligning Videos in Space and Time. European Conference on Computer Vision (ECCV), 2020.

PDF Short Talk (1min) Short Talk (1min) PDF Long Talk (10min) Long Talk (10min) PDF

Senthil Purushwalkam, Maximilian Nickel, Abhinav Gupta, Marc’Aurelio Ranzato (2019). Task-Driven Modular Networks for Zero-Shot Compositional Learning. International Conference on Computer Vision (ICCV) 2019.

PDF Code Dataset Splits

Senthil Purushwalkam, Abhinav Gupta, Danny Kaufman, Bryan Russell (2019). Bounce and Learn: Modeling Scene Dynamics with Real-World Bounces. International Conference on Learning Representations (ICLR) 2019.

PDF Code Dataset Poster Video

Senthil Purushwalkam, Abhinav Gupta (2016). Pose from Action: Unsupervised Learning of Pose Features based on Motion. Workshop on Action and Anticipation for Visual Learning at ECCV 2016..

PDF Poster

Stefan Lee, Senthil Purushwalkam, Michael Cogswell, Viresh Ranjan, David Crandall, Dhruv Batra (2016). Stochastic Multiple Choice Learning for Training Diverse Deep Ensembles. Advances in Neural Information Processing Systems (NIPS) 2016.

PDF Poster

Stefan Lee, Senthil Purushwalkam, Michael Cogswell, David Crandall, Dhruv Batra (2015). Why M Heads are Better than One: Training a Diverse Ensemble of Deep Networks. arxiv preprint arXiv:1511.06314.

PDF

Michael Cogswell, Xiao Lin, Senthil Purushwalkam, Dhruv Batra (2014). Combining the Best of Graphical Models and ConvNets for Semantic Segmentation. arxiv preprint arXiv:1412.4313.

PDF

Senthil Purushwalkam, Baihua Li, Qinggang Meng, Jamie McPhee (2013). Automatic Segmentation of Adipose Tissue from Thigh Magnetic Resonance Images. International Conference on Image Analysis and Recognition (ICIAR) 2013.

PDF