Haofan Wang

School Email: haofanw (at) alumni.cmu.edu
Personal Email: haofanwang.ai (at) gmail.com
Current Research Interests
  • Visual Foundation Model
  • Controllable and Personalized Generation
  • Generative, Agentic and Shippable AI Product
Biography

Haofan Wang (王浩帆) is Co-Founder at Lovart AI, working primarily on generative and agentic models. He also works at InstantX Team for open-sourcing generative models. From 2021 to 2024, he worked at Xiaohongshu and MMU (Kolors Team) at Kuaishou respectively. He obtained master degree from Carnegie Mellon University. He visited Image and Video Understanding Laboratory (IVUL), King Abdullah University of Science and Technology (KAUST) in 2020 and DATA Lab, Texas A&M University in 2019, repectively. He studied at UC Berkeley in 2017 as a visiting student, and worked as research assistant at Berkeley RISE Lab on Clipper. He also spent time at OpenMined, RealAI, Everspry, Horizon Robotics and Institute of Software Chinese Academy of Sciences. His highlighted works inlcude RepText, EasyControl, InstantCharacter, InstantStyle, InstantID, Score-CAM. He receives open-source sponsors via Ko-fi.

Selected Publications (Full List)
[motion]
RepText : Rendering Visual Text via Replicating
Haofan Wang*, Yujia Xu, Yimeng Li, Junchen Li, Chaowei Zhang, Jing Wang, Kejia Yang and Zhibo Chen
Arxiv 2025
[Page] [Code] [HF]
[motion]
InstantCharacter: Personalize Any Characters with a Scalable Diffusion Transformer Framework
Jiale Tao, Yanbing Zhang, Qixun Wang, Yiji Cheng, Haofan Wang, Xu Bai, Zhengguang Zhou, Ruihuang Li, Linqing Wang, Chunyu Wang, Qin Lin and Qinglin Lu
Arxiv 2025
[Paper] [Code] [HF]
[motion]
EasyControl: Adding Efficient and Flexible Control for Diffusion Transformer
Yuxuan Zhang, Yirui Yuan, Yiren Song, Haofan Wang*, Jiaming Liu
Arxiv 2025
[Paper] [Code] [HF]
[motion]
Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinement
Zhennan Chen, Yajie Li, Haofan Wang, Zhibo Chen, Zhengkai Jiang, Jun Li, Qian Wang, Jian Yang, Ying Tai
Arxiv 2024
[Paper] [Code]
[motion]
Training-free Regional Prompting for Diffusion Transformers
Anthony Chen, Jianjin Xu, Wenzhao Zheng, Gaole Dai, Yida Wang, Renrui Zhang, Haofan Wang, Shanghang Zhang
Arxiv 2024
[Paper] [Code]
[motion]
InstantIR: Blind Image Restoration with Instant Generative Reference
Jen-Yuan Huang, Haofan Wang*, Qixun Wang, Xu Bai, Hao Ai, Peng Xing, Jen-Tse Huang
Arxiv 2024
[Project Page] [Code]
[motion]
CSGO: Content-Style Composition in Text-to-Image Generation
Peng Xing, Haofan Wang*, Yanpeng Sun, Qixun Wang, Xu Bai, Hao Ai, Renyuan Huang, and Zechao Li. * means equal contribution
Arxiv 2024
[Project Page] [Code]
[motion]
InstantStyle-Plus :Style Transfer with Content-Preserving in Text-to-Image Generation
Haofan Wang*, Peng Xing, Renyuan Huang, Hao Ai, Qixun Wang, and Xu Bai. * means corresponding author.
Arxiv 2024
[Project Page] [Code]
[motion]
InstantStyle : Free Lunch towards Style-Preserving in Text-to-Image Generation
Haofan Wang*, Qixun Wang, Xu Bai, Zekui Qin, and Anthony Chen. * means corresponding author.
Arxiv 2024
[Project Page] [Code]
[motion]
InstantID : Zero-shot Identity-Preserving Generation in Seconds
Qixun Wang, Xu Bai, Haofan Wang*, Zekui Qin, and Anthony Chen. * means corresponding author.
Arxiv 2024
[Project Page] [Code]
[Score-CAM]
Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks
Haofan Wang, Zifan Wang, Mengnan Du, Fan Yang, Zijian Zhang, Sirui Ding, Piotr Mardziel and Xia (Ben) Hu
IEEE CVPR 2020 Workshop on Fair, Data Efficient and Trusted Computer Vision
[Project Page] [Paper] [Slides] [News]
Talks
  • [06/2024] A2M. [Info]
  • [03/2024] OpenMMLab & REDTech & Extreme MART. [Video]
  • [02/2024] MMLab@NTU & ShowLab@NUS. InstantID: Zero-shot Identity-Preserving Generation in Seconds, [Video]
  • [12/2022] Xiaohongshu. A Review of Recent Progress in AIGC and its Applications
  • [06/2021] MMU, Kuaishou. An Overview of Large Scale Pre-Training
    • Teaching
  • Guest Lecture of CS5260: Neural Networks and Deep Learning II, Spring 2024, National University of Singapore
  • Teaching Assistant of 18-793 Image and Video Processing, Prof: Aswin C Sankaranarayanan, Summer 2020, Carnegie Mellon University
    • Professional Services
  • Journal Reviewer: IJCV, TMM, TKDD, AI Communications
  • Conference Reviewer: SIGGRAPH, NeurIPS, ICLR, ICML, CVPR, ICCV, ECCV, ACMMM, XAI4CV@CVPR, PRCV
    • Career Trajectory

    Kuaishou (2021-2022) --> Xiaohongshu (2022-2024) --> Lovart AI (2024-) --> What's NeXT?

    Misc

    Piano (Roland HP704), Scuba Diving (AOW), Snowboarding (Basic), Photographer (Sony RX100M5, Osmo Pocket3)

    Travel Map

    Australia (Sydney, Gold Coast, Queensland), Thailand (Bangkok), Sinapore, Malaysia (Kuala Lumpur, Kota Kinabalu, Semporna), Vietnam (Phú Quốc), South Korea (Jeju), Japan (Tokyo, Hakone), United States (Mountain View, Pittsburgh, Las Vegas, San Francisco, College Station, Berkeley, Los Angeles, Riverside)

    Favourite Youtubers

    linksphotograph