Haofan Wang

Personal Email: haofanwang.ai (at) gmail.com
Research Interests
  • Image Foundation Model
  • Consistent and Personalized Generation
  • Building exciting, shippable AI Products and Decentralized Platform
Biography

Haofan Wang (王浩帆) is a research lead at a stealth startup and co-founder at InstantX, working primarily on controllable and conditional content generation (AIGC). From 2021 to 2024, he worked at Xiaohongshu and MMU (Kolors Team) at Kuaishou respectively. He obtained master degree from Carnegie Mellon University. He visited Image and Video Understanding Laboratory (IVUL), King Abdullah University of Science and Technology (KAUST) in 2020 and DATA Lab, Texas A&M University in 2019, repectively. He studied at UC Berkeley in 2017 as a visiting student, and worked as research assistant at Berkeley RISE Lab on Clipper. He also spent time at OpenMined, RealAI, Everspry, Horizon Robotics and Institute of Software Chinese Academy of Sciences. His highlighted works inlcude InstantStyle, InstantID, Score-CAM. He receives open-source sponsors via Ko-fi.

Selected Publications (Full List)
[motion]
CSGO: Content-Style Composition in Text-to-Image Generation
Peng Xing, Haofan Wang*, Yanpeng Sun, Qixun Wang, Xu Bai, Hao Ai, Renyuan Huang, and Zechao Li. * means equal contribution
Arxiv 2024
[Project Page] [Code]
[motion]
InstantStyle-Plus :Style Transfer with Content-Preserving in Text-to-Image Generation
Haofan Wang*, Peng Xing, Renyuan Huang, Hao Ai, Qixun Wang, and Xu Bai. * means corresponding author.
Arxiv 2024
[Project Page] [Code]
[motion]
InstantStyle : Free Lunch towards Style-Preserving in Text-to-Image Generation
Haofan Wang*, Qixun Wang, Xu Bai, Zekui Qing, and Anthony Chen. * means corresponding author.
Arxiv 2024
[Project Page] [Code]
[motion]
InstantID : Zero-shot Identity-Preserving Generation in Seconds
Qixun Wang, Xu Bai, Haofan Wang*, Zekui Qing, and Anthony Chen. * means corresponding author.
Arxiv 2024
[Project Page] [Code]
[Score-CAM]
Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks
Haofan Wang, Zifan Wang, Mengnan Du, Fan Yang, Zijian Zhang, Sirui Ding, Piotr Mardziel and Xia (Ben) Hu
IEEE CVPR 2020 Workshop on Fair, Data Efficient and Trusted Computer Vision
[Project Page] [Paper] [Slides] [News]
Talks
  • [06/2024] A2M. [Info]
  • [03/2024] OpenMMLab & REDTech & Extreme MART. [Video]
  • [02/2024] MMLab@NTU & ShowLab@NUS. InstantID: Zero-shot Identity-Preserving Generation in Seconds, [Video]
  • [12/2022] Xiaohongshu. A Review of Recent Progress in AIGC and its Applications
  • [06/2021] MMU, Kuaishou. An Overview of Large Scale Pre-Training
    • Teaching
  • Guest Lecture of CS5260: Neural Networks and Deep Learning II, Prof: Yang You, Spring 2024, National University of Singapore
  • Teaching Assistant of 18-793 Image and Video Processing, Prof: Aswin C Sankaranarayanan, Summer 2020, Carnegie Mellon University
    • Professional Services
  • Journal Reviewer: IJCV, TMM, TKDD, AI Communications
  • Conference Reviewer: NeurIPS, ICLR, ICML, CVPR, ICCV, ECCV, XAI4CV@CVPR, PRCV
    • Career Trajectory

    Kuaishou (2021-2022) --> Xiaohongshu (2022-2024) --> Stealth Startup (2024-) --> What's NeXT?

    Misc

    Piano (Roland HP704), Scuba Diving (AOW), Snowboarding (Basic), Photographer (Sony RX100M5, Osmo Pocket3)

    Travel Map

    Australia (Sydney, Gold Coast, Queensland), Thailand (Bangkok), Sinapore, Malaysia (Kuala Lumpur, Kota Kinabalu, Semporna), South Korea (Jeju), Japan (Tokyo, Hakone), United States (Mountain View, Pittsburgh, Las Vegas, San Francisco, College Station, Berkeley, Los Angeles, Riverside)