• Hi, welcome, I'm Yunfei.

    I'm a AI scientist and an holographic decoder.

    你好,我是傅云飞。专注于AI&Holographic&Fine art&Robotics的交叉领域。

     

  • Educations

    I've been traveling and learning a lot ...

    故不登高山不知天之高也,不临深谿不知地之厚也,不闻先生之遗言不知学问之大也

    broken image

    DLUT(CN)

    大连理工大学(本科)

    I graduated as an EE student, quite enjoying my life in Dalian. EE is fun and hardcore, but I need more exciting things!

    broken image

    HKUST(HK)

    香港科技大学(MPhil)

    I got much much more than I can digest in Hong Kong, best mentors and professors I can hope. I learned a lot -- internet of things, Human Computer interactions, design, etc . great time!

    broken image

    CAA(CN)

    中国美术学院(Visiting)

    One of my Dream School when I was a kid, and I learned a lot about New Media, design, fine art, and the way of design thinking, more than what I can appreciated!

    broken image

    NCCA(UK)

    英国国家计算机中心(PhD)

    Finished my PhD in UK, hardcore PhD as everyone who have been through.

    Focusing on AI, fine art and Robotics.

    But still, nail it and enjoy it!

    broken image

    RCA(UK)

    英国皇家艺术学院(Visiting)

    Visited RCA as an AI scientist in 2019. RCA is well-known as the best college of art. Quite inspiring ! Made a looooot of friends there .

    broken image

    CUHK(HK)

    香港中文大学(Visiting)

    Visited CUHK as an AI scientist in 2020. I was fortunate to cooperate with Prof. Han and try to complete the cooperation in the direction of AI & Robotics.

     
  • Recent Researches

    Basically it's about Decoding Images !

    MentalCanvas

    Reconstruct Image from 2D to 3D.

    Based on vanilla mobilenet.

    broken image

    Gaze position 3D Real-time 

    Real-time Gaze position in real time

    Estimation of Gaze position in 3D space with single rgb camera.

    broken image

    3D Human Synthesis

    Real-time human generation

    Based on 3D freestyleGAN, real-time human image generation with 3D pose and view.

    broken image

    2.5D High relief reconstruction

    Reconstruct high relief from single image

    Details could be found here :   

    https://www.youtube.com/watch?v=oCH3VjWpR7c

    broken image

    Instance Soft Matting

    Left : Input Image . Right: Soft Segmentation

    Based on spectral decomposition, more than single object matting .

    broken image

    High speed Iris tracking with glass

    Preparing for the holographic device

    Novel View rendering requires naked eyes positions. It's a new method for 3D Iris position estimation with no depth camera just RGB.

    broken image

    Image decomposition

    Reverse Engineering of a painting.

    Based on DDPG

    Naked Eye 3D Rendering

    Retro Reflective + Kinect + Unity

    More Accurate Real-time holographic rendering

    broken image

    Model recon

    Model Reconstruction from Single image with HD expression

    For Mirror Project

    broken image

    InSketch

    Instance segmentation of complicated sketches

    Based on something tricky I can't mention now.

  • Single face project : c

    3D rebuilding based on single image

    broken image

    Reference image

    Front face image is required

    broken image

    Rebuild model 

    Sift flow based on Laplacian mesh editing

  • Pulication

    (2019) Yunfei Fu, H. Yu, Chih-Kuo Yeh, Jianjun Zhang, Tong-Yee Lee. "High Relief from Brush Painting", IEEE Transactions on Visualization and Computer Graphics, vol. 25, No. 9, Sept., 2019, pp. 2763~2776 (SCI/EI)

     

    (2020) Fu, Yunfei, et al. "Fast accurate and automatic brushstroke extraction." ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 17.2 (2021): 1-24.


    (2022) Tingting Li, Yunfei Fu, Xiaoguang Han , DiffusionPointLabel: Annotated Point Cloud Generation with Diffusion Model,  Pacific Graphics (accepted)

     

     

  • Internships

    broken image

    CEMAR  HKUST

    Boardcasting 

    broken image

    HKUST Library 

    Staff for E-learning Project

     

    Flash based on

    Adobe Captivate

     

    Click the right Image :)

    Design thinking IELM HKUST 

    TA / Teamleader 

     

    One of the most successful and popular course  in HKUST 

    DJI

    Robomaster Camp

  • Some Projects of mine

    GameSuit

    Wearable Device For Game

    broken image

    FishBand

     

    FishBand受邀在HKUST图书馆展出

     

    右图为我向HKUST校长Tony.F讲解

    CloudMapping

    Cop with CAA

    CityMapping

    A sentence or two describing this item.

    RoboCar in DJI

     

     

    Vision + ROS SLAM

  • Previous Research

    broken image

    Video Stylization

    broken image

    I-See

  • I do Concept Designs  as well 

    March 28, 2016
  • Reference: 

    Attachments / / Certifications && Rewards

     

     

    Previous  Supervisors:

    broken image

     Prof. Ravi Goonetilleke .    

    broken image

                    Prof. Pedro V. SANDER