Biography
I am a second-year PhD student in CSE department at UCSD. My advisor is Prof. Ravi Ramamoorthi. Earlier in 2017, I completed my undergraduate in Yao Class, Tsinghua University.
My research interest includes computer graphics and computational photography, with a particular focus on realistic appearance modeling, capture, and manipulation. Currently, I'm working on portrait relighting.
I am fortunately supported by Jacobs School of Engineering Fellowship and Google PhD Fellowship.
News
- [2019.6] I will present our paper "Single Image Portrait Relighting" at the tutorial "Towards Relightable Volumetric Performance Capture of Humans" at CVPR 2019 in Long Beach.
- [2019.3] I am fortunately awarded 2019 Google PhD Fellowship.
- [2019.3] Our paper "Single Image Portrait Relighting" got accepted by SIGGRAPH 2019.
- [2018.12] I will present our paper "Connecting Measured BRDFs to Analytic BRDFs by Data-Driven Diffuse-Specular Separation" at SIGGRAPH Asia 2018 in Tokyo.
- [2018.8] Our paper "Connecting Measured BRDFs to Analytic BRDFs by Data-Driven Diffuse-Specular Separation" got accepted by SIGGRAPH Asia 2018.
- [2018.6] Our work on BRDF gamut mapping won the 1st place at the 2018 ACM Student Research Competition (undergraduate category). ACM annoucement, ACM news, UCSD news.
Publications
Single Image Portrait Relighting
Tiancheng Sun, Jonathan T. Barron, Yun-Ta Tsai, Zexiang Xu, Xueming Yu, Graham Fyffe, Christoph Rhemann, Jay Busch, Paul Debevec, Ravi Ramamoorthi
SIGGRAPH 2019
We present a system for portrait relighting: a neural network that takes as input a single RGB image of a portrait taken with a standard cellphone camera in an unconstrained environment, and from that image produces a relit image of that subject as though it were illuminated according to any provided environment map.
Connecting Measured BRDFs to Analytic BRDFs by Data-Driven Diffuse-Specular Separation
Tiancheng Sun, Henrik Wann Jensen, Ravi Ramamoorthi
SIGGRAPH Asia 2018
We propose a novel framework for connecting measured and analytic BRDFs, by separating a measured BRDF into diffuse and specular components. This enables measured BRDF editing, a compact measured BRDF model, and insights in relating measured and analytic BRDFs. We also design a robust analytic fitting algorithm for two-lobe materials.
Three-dimensional Display via Multi-layer Translucencies
Tiancheng Sun, Huarong Gu
International Symposium on Optoelectronic Technology and Application 2018
We built a display system using light field display and pyramid-like mirror. The displayed allows the observer to see the virtual 3D objects from different directions in the air.
Attribute‐preserving gamut mapping of measured BRDFs
Tiancheng Sun, Ana Serrano, Diego Gutierrez, Belen Masia
28th Eurographics Symposium on Rendering (EGSR 2017)
1st place at the 2018 ACM Student Research Competition (undergraduate category) ACM annoucement, ACM news, UCSD news
1st place at the SIGGRAPH 2017 ACM Student Research Competition (undergraduate category) SIGGRAPH annoucement, SIGGRAPH blog post, UCSD news
We proposed a new BRDF gamut mapping algorithm using two-step optimization. We optimize the luminance with the guide of perceptual attributes in the first step, and optimize the ink coefficients using image comparison in the second step.
Revisiting Cross-channel Information Transfer for Chromatic Aberration Correction
Tiancheng Sun, Yifan (Evan) Peng, Wolfgang Heidrich
2017 IEEE International Conference on Computer Vision (ICCV)
By modelling the similarity between different channels, we propose a new blind image deconvolution algorithm which transfers information from clear channel to blurry ones, and yield better results than state-of-the-art methods in both refractive and diffractive optical systems.
Convolution Neural Networks with Two Pathways for Image Style Recognition
Tiancheng Sun, Yulong Wang, Jian Yang, and Xiaolin Hu
IEEE Transactions on Image Processing (Volume: 26, Issue: 9, Sept. 2017)
We add the ideas used in image style transfer into traditional CNN network for image style recognition, and achieve state-of-the-art results on three benchmark datasets.
Experience
Software engineering intern @ Google 2018.6 - 2018.9
Computational photography research at Google Research with Yun-Ta Tsai and Jonathan Barron: we developed a relighting system that can change the lighting on a portrait under natural illumination.
Research assistant @ Tsinghua University 2017.2 - 2017.6
Computational display research at State Key Laboratory of Precision Measurement Technology and Instruments with Professor Huarong Gu: we built a 3d volumetric display used light field display and pellicle pyramid.
Research intern @ Universidad de Zaragoza 2016.7 - 2016.10
Computer graphic research at Graphics and Imaging Lab with Professor Diego Gutierrez and Belen Masia: we proposed a new framework for material appearance evaluation, and implemented material editing applications with user-friendlier interface and higher editing capability.
Research intern @ King Abdullah University of Science and Technology 2016.2 - 2016.6
Computational imaging research at Visual Computing Center with Professor Wolfgang Heidrich: we worked on a new approach for image deconvolution, and yielded state-of-the-art results in different optical systems.
Research assistant @ Tsinghua University 2015.12 - 2016.2
Neural network research at State Key Laboratory of Intelligent Technology and Systems with Professor Xiaolin Hu: we proposed a new neural network structure and its corresponding training procedure for image style recognition.
Executive council member @ Tsinghua Spark Program 2015.9 - 2017.6
Organize and plan activities such as Spark Talks and Industrial Field Trips in the program.
Technical leader @ Phantouch Technology 2015.9 - 2015.12
Led a developing group for pose detection on virtual-reality devices.
Research intern @ Megvii Inc. 2015.4 - 2015.9
Computational vision research with Haoqiang Fan: we built a 3d model scanner for human faces based on phase-shift technique.