Yu-Shen Liu
Yu-Shen Liu (刘玉身)

Associate Professor
School of Software, Tsinghua University,
Beijing, P. R. China


Contacts:
E-mail:liuyushen@tsinghua.edu.cn
E-mail:liuyushen00@gmail.com
Tel:+86-10-62795455

HomePages:
Tsinghua homepageGoogle ScholarDBLP
Yu-Shen Liu is an Associate Professor in of Software at Tsinghua University. He spent three years as a post doctoral researcher in Purdue University from 2006 to 2009. He earned his PhD in the Department of Computer Science and Technology at Tsinghua University, China, in 2006. He received his BS in mathematics from Jilin University, China, in 2000. His current research interests include algorithms in pattern recognition, machine learning, shape matching and retrieval; Information retrieval, semantic search; Smart building, Building Information Modeling (BIM); Digital Geometry Processing (DGP), shape denoising and smoothing.
Education
2000-2006: Tsinghua University, Ph.D. in Computer Science and Technology.
1996-2000: Jilin University, B.Sc. in Mathematics
Experience
2009- present: School of Software at Tsinghua University, Beijing, China.
2006-2009: Purdue University, West Lafayette, IN, USA. Postdoctoral researcher in School of Mechanical Engineering
Research Interests
3D Computer Vision, Shape Analysis, 3D Deep Learning, Point Cloud Understanding

Information Retrieval, Cross-model Retrieval, Semantic Search, Shape Retrieval

Smart Building, Building Information Modeling (BIM)

Digital Geometry Processing (DGP), Computer Graphics, Computer Aided Design

Currently, I am looking for PhD students and Research Assistants to work on the top publications. Please feel free to contact me.

Participated Projects
1. National Key R&D Program of China (2018YFB0505403), 2018.05-2022.04, PI.

2. NSF of China: Studies on semantic retrieval for building information modeling (BIM) resources based on IFC (61472202), 2015.01-2018.12, PI.

3. NSF of China: Studies on shape matching for 3D articulated models based on metric geometry (61272229), 2013.01-2016.12, PI.

4. NSF of China: Study of non-rigid 3D shape retrieval (61003095), 2011.01-2013.12, PI.

5. National Technological Support Program for the 12th-Five-Year Plan of China (2012BAJ03B07), 2012.01-2015.09, main researcher.

6. NSF of China: China building information technology strategic research (U0970155), finished, main researcher.

Teaching Course
"Fundamental of Programming", the undergraduate course

"Digital Geometry Processing", the graduate course

"Business Process and Asset Management", the graduate course

Honors and Awards
Highly_cited Highly Cited Research Award, by the journal of Advanced Engineering Informatics (the Elsevier journal), 2016. Dr. Yu-Shen Liu is the corresponding author of this paper.
[Project Page]   [Paper]   [Bib]  
ICCCBE2016_award Best Student Presentation Award, at the 16th International Conference on Computing in Civil and Building Engineering (ICCCBE2016), Osaka, Japan, 2016. Dr. Yu-Shen Liu is the corresponding author of this paper, and Ge Gao is the first author.
[Paper]  
Best Student Paper Award, at the Proceedings of the Ninth International Conference on Computer Aided Design and Computer Graphics (CAD-CG'05), Hong Kong, China, 2005.
Excellent Doctoral Dissertation Award of Tsinghua University in 2006.
Intel scholarship 2005.
Excellent Mentor Award of Tsinghua University, 2004.
Academic Activities
Program Committee member at AAAI 2020
Program Committee member at ACM Multimedia 2019
Program Committee member at IJCAI 2019
Program Committee member at GDC 2019、CAD&CG 2019、ACM Multimedia Asia 2019
Program Committee of EG-ICE 2019(European Group for Intelligent Computing in Engineering)
The editorial team of Construction Innovation: Information, Process, Management (CI), 2018 ~ present http://www.emeraldgrouppublishing.com/products/journals/editorial_team.htm?id=CI.

Co-chairs of PLM Smart Manufacturing Workshop, 2018 Asian Conference on Design and Digital Engineering (ACDDE2018).

The program committee of AUAPAF2018 (Asian Universities Alliance Postgraduate Academic Forum)

Editorial Board Member on the international journal Smart Construction Research, 2017 ~ present

Lead Guest Editor: Special Issue on Recent Advances on Building Information Modeling (BIM) The Scientific World Journal, 2013. (SCI, 2012 Impact factor: 1.730)   [Bib]
http://www.hindawi.com/journals/tswj/si/465058/cfp/

Guest Editor: Special Issue on Advances in Conceptual Design Theories, Methodologies, and Applications. Advances in Mechanical Engineering, 2013. (SCI, 2012 Impact factor: 1.062)
http://www.hindawi.com/journals/ame/si/293862/

The member on IFC Alignment 1.1 Expert Panel in buildingSMART

The group of buildingSMART IFC Roads and Railway Standard.

Reviewer for IEEE Transactions on Image Processing (TIP), CVPR, ICCV, IJCAI, AAAI, ACM Multimedia, ICME, Automation in Construction, Computer-Aided Design, ASME Journal of Mechanical Design, The Visual Computer, Computers & Graphics, International Journal of Precision Engineering and Manufacturing, Applied Stochastic Models in Business and Industry.

Software and Projects
BIMSeek BIMSeek
A search engine for retrieving online BIM product resources.
Platform website:     BIMSeek Engine
BIMSeek+ BIMSeek+
A content-based search engine for BIM models using IFC ontology.
Platform website:     BIMSeek+
IFCCompressor IFCCompressor
A content-based compression algorithm for optimizing Industry Foundation Classes files.
Platform website:     IFCCompressor Tool
IFCDiff IFCDiff
A content-based automatic comparison approach for IFC files with hierarchical structures.
Platform website:     IFCDiff Tool
BIMOne BIMOne
An integrated management system for BIM resources and projects.
Platform website:     BIMOne System
3DMolNavi 3DMolNavi
A web-based visualized navigation system developed for intuitively exploring flexible molecular shape retrieval.
Platform website:     3DMolNavi Platform
Selected Publications
2019
Point2SpatialCapsule Xin Wen, Zhizhong Han, Xinhai Liu, Yu-Shen Liu. Point2SpatialCapsule: Aggregating Features and Spatial Relationships of Local Regions on Point Clouds using Spatial-aware Capsules. TIP 2019, submitted. arXiv:1908.11026.
[Paper]  
ShapeCaptioner Zhizhong Han, Chao Chen, Yu-Shen Liu, Matthias Zwicker. ShapeCaptioner: Generative Caption Network for 3D Shapes by Learning a Mapping from Parts Detected in Multiple Views to Sentences. arXiv: 1908.00120.
[Paper]  
MVDLite Han Liu, Ge Gao, Hehua Zhang, Yu-Shen Liu, Yan Song, Ming Gu. MVDLite: A Light-weight Representation of Model View Definition with Fast Validation for BIM Applications. Automation in Construction, 2019, under review. arXiv: 1909.06997
[Paper]  
Fast_Low-rank_ML Han Liu, Zhizhong Han, Yu-Shen Liu, Ming Gu. Fast Low-rank Metric Learning for Large-scale and High-dimensional Data. In Neural Information Processing Systems (NeurIPS), 2019, Vancouver, Canada. arXiv: 1909.06297
[Paper]   [Source code]  
Point_Cloud_VAE Zhizhong Han, Xiyang Wang, Yu-Shen Liu, Matthias Zwicker. Multi-Angle Point Cloud-VAE: Unsupervised Feature Learning for 3D Point Clouds from Multiple Angles by Joint Self-Reconstruction and Half-to-Half Prediction. In IEEE International Conference on Computer Vision (ICCV), 2019, accepted.
[Paper]  
L2GAutoencoder Xinhai Liu, Zhizhong Han, Xin Wen, Yu-Shen Liu, Matthias Zwicker. L2G Auto-encoder: Understanding Point Clouds by Local-to-Global Reconstruction with Hierarchical Self-Attention. In ACM Multimedia, 2019, accepted
[Paper]  
Parts4Feature Zhizhong Han, Xinhai Liu, Yu-Shen Liu, Matthias Zwicker. Parts4Feature: Learning 3D Global Features from Generally Semantic Parts in Multiple Views. In International Joint Conference on Artificial Intelligence (IJCAI), 2019: 766-773
[Paper]  
3D2ViewGraph Zhizhong Han, Xiyang Wang, Chi-Man Vong, Yu-Shen Liu, Matthias Zwicker, C.L. Philip Chen. 3DViewGraph: Learning Global Features for 3D Shapes from A Graph of Unordered Views with Attention. In International Joint Conference on Artificial Intelligence (IJCAI), 2019: 758-765
[Paper]  
VIPGAN Zhizhong Han, Mingyang Shang, Yu-Shen Liu, Matthias Zwicker. View Inter-Prediction GAN: Unsupervised Representation Learning for 3D Shapes by Learning Global Shape Memories to Support Local View Predictions. In 33rd AAAI Conference on Computing on Artificial Intelligence(AAAI-19), 2019, 33(01): 8376-8384. (Spotlight presentation)
https://aaai.org/ojs/index.php/AAAI/article/view/4852
[Project Page]   [Paper]  
Y^2Seq2Seq Zhizhong Han, Mingyang Shang, Xiyang Wang, Yu-Shen Liu, Matthias Zwicker. Y^2Seq2Seq: Cross-Modal Representation Learning for 3D Shape and Text by Joint Reconstruction and Prediction of View and Word Sequences. In 33rd AAAI Conference on Computing on Artificial Intelligence(AAAI-19), 2019, 33(01): 126-133. (Oral presentation)
https://aaai.org/ojs/index.php/AAAI/article/view/3777
[Project Page]   [Paper]  
Point2Sequence Xinhai Liu, Zhizhong Han, Yu-Shen Liu, Matthias Zwicker. Point2Sequence: Learning the Shape Representation of 3D Point Clouds with an Attention-based Sequence to Sequence Network. In 33rd AAAI Conference on Computing on Artificial Intelligence(AAAI-19), 2019, 33(01): 8778-8785. (Oral presentation)
https://aaai.org/ojs/index.php/AAAI/article/view/4903
[Project Page]   [Paper]   [Source code]  
3D2SeqViews Zhizhong Han, Honglei Lu, Zhenbao Liu, Chi-Man Vong, Yu-Shen Liu, Matthias Zwicker, Junwei Han, C.L. Philip Chen. 3D2SeqViews: Aggregating Sequential Views for 3D Global Feature Learning by CNN with Hierarchical Attention Aggregation. IEEE Transactions on Image Processing, 2019, 28(8): 3986-3999 . (SCI, 2017 Impact factor: 5.071)
https://ieeexplore.ieee.org/document/8666059
[Paper]  
Zhizhong Han, Mingyang Shang, Zhenbao Liu, Chi-Man Vong, Yu-Shen Liu, Junwei Han, Matthias Zwicker, C.L. Philip Chen. SeqViews2SeqLabels: Learning 3D Global Features via Aggregating Sequential Views by RNN with Attention. IEEE Transactions on Image Processing, 2019, 28(2): 658-672. (SCI, 2017 Impact factor: 5.071).
https://ieeexplore.ieee.org/document/8453813/
[Project Page]   [Paper]   [Source code]  
Story Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu. Emotion Reinforced Visual Storytelling. ACM International Conference on Multimedia Retrieval (ICMR), 2019, pp.297-305, Ottawa, ON, Canada.
https://dl.acm.org/citation.cfm?id=3325050&preflayout=tabs
[Paper]  
CMST Xin Wen, Zhizhong Han, Xinyu Yin, Yu-Shen Liu. Adversarial Cross-Modal Retrieval via Learning and Transferring Single-Modal Similarities. In IEEE International Conference on Multimedia and Expo(ICME), 2019, accepted for ORAL presentation.
[Paper]  
VCIBA Hong-Lei Lu, Jia-Xing Wu, Yu-Shen Liu, Wan-Qi Wang. Dynamically loading IFC models on a web browser based on spatial semantic partitioning. In Visual Computing for Industry Biomedicine, and Art, 2019, 2:4.
[Paper]  
GIS+BIM Pengfei Wu, Yu-Shen Liu, Yi Tan, Jianfeng Li. Advances and Trends of Integration between GIS and BIM. In Geomatics & Spatial Information Technology, 2019, 42(1): 1-6. (in Chinese)
[Paper]  
2018
IFCdiff Xin Shi, Yu-Shen Liu, Ge Gao, Ming Gu, Haijiang Li. IFCdiff: A content-based automatic comparison approach for IFC files. Automation in Construction, 2018, 86: 53-68. (SCI, 2016 Impact factor: 2.919)
[Project Page]   [Paper]  
Zhizhong Han, Zhenbao Liu, Chi-Man Vong, Yu-Shen Liu, Shuhui Bu, Junwei Han, C.L. Philip Chen. Deep Spatiality: Unsupervised Learning of Spatially-Enhanced Global and Local 3D Features by Deep Neural Network with Coupled Softmax. IEEE Transactions on Image Processing, 2018, 27(6): 3049-3063. (SCI, 2017 Impact factor: 5.071).
[Paper]  
2017
liu_tii Han Liu, Yu-Shen Liu, Pieter Pauwels, Hongling Guo, Ming Gu. Enhanced explicit semantic analysis for product model retrieval in construction industry. IEEE Transactions on Industrial Informatics, 2017, 13(6): 3361-3369 (SCI, 2016 Impact factor: 6.764)
[Paper]   [Source code]  
han_tip Zhizhong Han, Zhenbao Liu, Chi-Man Vong, Yu-Shen Liu, Shuhui Bu, Junwei Han, C.L. Philip Chen. BoSCC: Bag of Spatial Context Correlations for Spatially Enhanced 3D Shape Representation. IEEE Transactions on Image Processing, 2017, 26(8): 3707-3720. (SCI, 2017 Impact factor: 5.071)
[Paper]  
BIMTag Ge Gao, Yu-Shen Liu, Pengpeng Lin, Meng Wang, Ming Gu, Jun-Hai Yong. BIMTag: Concept-based automatic semantic annotation of online BIM product resources. Advanced Engineering Informatics, 2017, 31: 48-61. (Special issue of EG-ICE 2014). (SCI, 2016 Impact factor: 2.680)
[Project Page]   [Paper]   [Bib]  
2016
VIV15Neucom2 Yu-Shen Liu, Hongchen Deng, Min Liu, Lianjie Gong. VIV: Using visible internal volume to compute junction-aware shape descriptor of 3D articulated models. Neurocomputing, 2016,215: 32-47. (SCI, 2016 Impact factor: 3.317)

Special Issue on Stereo data sensing, computation and perception

[Paper]  
ICCCBE2016 Ge Gao, Yu-Shen Liu, Jia-Xing Wu, Ming Gu, Xu-Kun Yang, Hua-Liang Li. IFC Railway: A Semantic and Geometric Modeling Approach for Railways based on IFC. In 16th International Conference on Computing in Civil and Building Engineering (ICCCBE2016), 2016, Japan. (Best Student Presentation Award)
[Paper]  
2015
IFCOntoSearch Ge Gao, Yu-Shen Liu, Meng Wang, Ming Gu, Jun-Hai Yong. A query expansion method for retrieving online BIM resources based on Industry Foundation Classes. Automation in Construction, 2015, 56: 14–25. (SCI, 2013 Impact factor: 1.822)
[Project Page]   [Paper]   [Bib]  
IFCCompressor Jing Sun, Yu-Shen Liu, Ge Gao, Xiao-Guang Han. IFCCompressor: A content-based compression algorithm for optimizing Industry Foundation Classes files. Automation in Construction, 2015, 50: 1-15. (SCI, 2013 Impact factor: 1.822)
[Project Page]   [Paper]   [Bib]   [Source code]  
Junction-aware Jinlong Feng, Yu-Shen Liu, Lianjie Gong. Junction-aware shape descriptor for 3D articulated models using local shape-radius variation. Signal Processing, 2015, 112: 4-16. (SCI, 2013 Impact factor: 2.238)
[Project Page]   [Paper]   [Bib]  
TSWJ14RBIM Yu-Shen Liu, Heng Li, Haijiang Li, Pieter Pauwels, Jakob Beetz. Recent Advances on Building Information Modeling. The Scientific World Journal, vol. 2015, Article ID 786598, 2 pages, 2015. doi:10.1155/2015/786598. (Editorial) (SCI, 2013 Impact factor: 1.219)
[Paper]   [Special Issue]  
2014
Ge Gao, Yu-Shen Liu, Meng Wang, Xiao-Guang Han. BIMTag: Semantic Annotation of Web BIM Product Resources Based on IFC Ontology. In: 21st International Workshop of the European Group for Intelligent Computing in Engineering (EG-ICE 2014), July, 2014 Cardiff, United Kingdom. ISBN: 978-0-9930807-0-8 (EI: 20144900283797). (invitation for extended version submission to Advanced Engineering Informatics)
[Paper]  
2013
The IFC-based path planning for 3D indoor spaces Ya-Hong Lin, Yu-Shen Liu, Ge Gao, Xiao-Guang Han, Cheng-Yuan Lai, Ming Gu. The IFC-based path planning for 3D indoor spaces. Advanced Engineering Informatics, 2013; 27(2): 189-205. (SCI, 2013 Impact factor: 2.068) (Highly Cited Research Award)
[Project Page]   [Paper]   [Bib]  
Dongxing Cao, Shengfeng Qin, Yu-Shen Liu. Advances in Conceptual Design Theories, Methodologies, and Applications. Advances in Mechanical Engineering, 2013; Article ID 207492, page 1-3. doi:10.1155/2013/207492. (SCI, 2012 Impact factor:1.062)
Special Issue:
http://www.hindawi.com/journals/ame/si/293862/
[Paper]   [Bib]  
2012
Robust shape normalization of 3D articulated volumetric models Chao Wang, Yu-Shen Liu, Min Liu, Jun-Hai Yong, Jean-Claude Paul. Robust shape normalization of 3D articulated volumetric models. Computer-Aided Design, 2012; 44(12): 1253-1268. (SCI, Impact factor: 1.234).
[Paper]   [Bib]
3DMolNavi: A navigation system for flexible molecular shape retrieval based on histogram and dimensionality reduction Yu-Shen Liu, Meng Wang, Jean-Claude Paul, Karthik Ramani. 3DMolNavi: A web-based retrieval and navigation tool for flexible molecular shape comparison.BMC Bioinformatics, 2012, 13:95. (SCI, Impact factor: 3.029).
http://www.biomedcentral.com/1471-2105/13/95
[Project Page]   [Paper]   [Bib]
2011
Computing the inner distances of volumetric models for articulated 
								shape description with a visibility graph. Yu-Shen Liu, Karthik Ramani, Min Liu. Computing the inner distances of volumetric models for articulated shape description with a visibility graph. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2011, 33(12): 2538-2544. (SCI , Impact factor: 4.908)
[Project Page]   [Paper]   [Bib]
2010
Using diffusion distances for flexible molecular shape comparison. Yu-Shen Liu, Qi Li, Guo-Qin Zheng, Karthik Ramani, William Benjamin. Using diffusion distances for flexible molecular shape comparison. BMC Bioinformatics, 2010, 11:480 (SCI, Impact factor: 3.029)
[Paper]   [Bib]
Surface area estimation of digitized 3D objects using quasi-Monte Carlo methods. Yu-Shen Liu, Jing Yi, Hu Zhang, Guo-Qin Zheng, Jean-Claude Paul. Surface area estimation of digitized 3D objects using quasi-Monte Carlo methods. Pattern Recognition, 2010, 43(11): 3900-3909 (SCI, Impact factor: 2.682).
[Paper]   [Bib]
2009
IDSS: deformation invariant signatures for molecular shape comparison Yu-Shen Liu, Yi Fang, Karthik Ramani. IDSS: deformation invariant signatures for molecular shape comparison, BMC Bioinformatics, 2009, 10:157 (SCI, Impact factor: 3.029).
[Project Page]   [Paper]   [Bib]
Computing global visibility maps for regions on the boundaries of polyhedra using Minkowski sums Min Liu, Yu-Shen Liu, Karthik Ramani. Computing global visibility maps for regions on the boundaries of polyhedra using Minkowski sums. Computer-Aided Design, 2009; 41(9): 668-680 (SCI, Impact factor: 1.542)
[Paper]   [Bib]
Three dimensional shape comparison of flexible protein using the local-diameter descriptor Yi Fang, Yu-Shen Liu, Karthik Ramani. Three dimensional shape comparison of flexible protein using the local-diameter descriptor, BMC Structural Biology, 2009, 9:29 (SCI, Impact factor: 2.258)
[Project Page]   [Paper]   [Bib]
Using least median of squares for structural superposition of flexible proteins Yu-Shen Liu, Yi Fang, Karthik Ramani. Using least median of squares for structural superposition of flexible proteins. BMC Bioinformatics, 2009, 10:29 (SCI, Impact factor: 3.029).
[Project Page]   [Paper]   [Bib]
Robust principal axes determination for point-based shapes using least median of squares. Yu-Shen Liu, Karthik Ramani. Robust principal axes determination for point-based shapes using least median of squares. Computer-Aided Design, 2009; 41(4): 293-305 (SCI, Impact factor: 1.542)
[Paper]   [Bib]
2008
An extension on robust directed projection of points onto point clouds. Ming-Cui Du, Yu-Shen Liu. An extension on robust directed projection of points onto point clouds. Computer-Aided Design, 2008; 40(5):537-553. (SCI, Impact factor: 1.542).
[Paper]   [Bib]
2007
Yu-Shen Liu, Min Liu, Daisuke Kihara, Karthik Ramani. Salient critical points for meshes. In Proceedings of the 2007 ACM symposium on Solid and physical modeling (SPM'07), 277-282, June 2007, Beijing, China.
[Paper]   [Bib]  
Min Liu, Yu-Shen Liu, Karthik Ramani. Anisotropic filtering on normal field and curvature tensor field using optimal estimation theory. In Proceedings of the IEEE International Conference on Shape Modeling and Applications 2007 (SMI'07), 169-178, June 2007, Lyon, France.
[Paper]  
2006
Automatic least-squares projection of points onto point clouds with applications in reverse engineering Yu-Shen Liu, Jean-Claude Paul, Jun-Hai Yong, Pi-Qiang Yu, Hui Zhang, Jia-Guang Sun, Karthik Ramani. Automatic least-squares projection of points onto point clouds with applications in reverse engineering. Computer-Aided Design, 2006; 38(12): 1251-1263. (SCI, Impact factor: 1.542)
[Paper]   [Bib]
A quasi-Monte Carlo method for computing areas of point-sampled surfaces Yu-Shen Liu, Jun-Hai Yong, Hui Zhang, Dong-Ming Yan, Jia-Guang Sun. A quasi-Monte Carlo method for computing areas of point-sampled surfaces. Computer-Aided Design, 2006; 38(1): 55-68. (SCI, Impact factor: 1.542)
[Paper]   [Bib]
2005
Mesh blending Yu-Shen Liu, Hui Zhang, Jun-Hai Yong, Pi-Qiang Yu, Jia-Guang Sun. Mesh blending. The Visual Computer, 2005; 21(11): 915-927. (SCI, Impact factor: 0.583)
[Paper]  
Yu-Shen Liu, Jun-Hai Yong, Pi-Qiang Yu, Hui Zhang, Ming-Cui Du, Jia-Guang Sun. Mesh parameterization for an open connected surface without partition. In Proceedings of the Ninth International Conference on Computer Aided Design and Computer Graphics (CAD-CG'05), 306-312, September, 2005, Hong Kong, China. (Best Student Paper Award)
[Paper]  

2004
Yu-Shen Liu, Pi-Qiang Yu, Jun-Hai Yong, Hui Zhang, Jia-Guang Sun. Bilateral filter for meshes using new predictor. International Symposium on Computational and Information Sciences (CIS'04), LNCS 3314: 1093-1099, 2004. (SCI, Impact factor: 0.531)
[Paper]