Highlights

Enabling Human-Machine Collaboration in Infrastructure Inspections through Mixed Reality

A novel end-to-end system called Human–Machine Collaborative Inspection (HMCI) is proposed to enable collaboration between inspectors with Mixed Reality (MR) headsets and a robotic data collection platform (robot) for structural inspections.

Zaid Abbas Al-Sabbag*, Chul Min Yeum, Sriram Narasimhan

Advanced Engineering Informatics, 53, 101709, (2022). [Web]

[Video]

Interactive Defect Quantification Through Extended Reality

A new visual inspection method is proposed that can interactively detect and quantify structural defects using an Extended Reality (XR) device (headset).

Zaid Abbas Al-Sabbag*, Chul Min Yeum, Sriram Narasimhan

Advanced Engineering Informatics, 51, 101473, (2022). [Web] [Github] [Video]

1st place in the 2021 Waterloo-AI GRADflix competition

Learning-based Image Scale Estimation using Surface Textures for Quantitative Visual Inspection

A learning-based scale estimation technique is proposed to enable quantiative visual inspection only using a single image. A convolutional neural network is trained to extract scale-related features from textures captured in images.

Ju An Park*, Chul Min Yeum, Trevor D. Hrynyk

Computer-Aided Civil and Infrastructure Engineering, 36, no. 2, 227-241, (2020). [Web] [Github]

Post-Event Reconnaissance Image Documentation using Automated Classification

An automated approach is developed to organize and document reconnaissance images in an efficient and rapid manner. Deep convolutional neural network algorithms were successfully implemented to extract robust features of key visual contents in the images.

Chul Min Yeum, Shirley J. Dyke, Bedrich Benes, Thomas Hacker, Julio A. Ramirez, Alana Lund, and Santiago Pujol

Journal of Performance of Constructed Facilities, 33(1), (2018). [Web]

Editor’s Choice Selection (2019).

Vision-Based Automated Crack Detection for Bridge Inspection

A vision-based visual inspection technique is proposed by automatically processing and analyzing a large volume of collected images to support structure inspection.

Chul Min Yeum and Shirley J Dyke

Computer-Aided Civil and Infrastructure Engineering 30, no. 10 (2015). [Web] [Github]

Recipient of 2015 Innovation Award for this journal.

 

Journal Papers

*: direct- or co-supervision

Enabling Human-Machine Collaboration in Infrastructure Inspections through Mixed Reality
Zaid Abbas Al-Sabbag*, Chul Min Yeum, Sriram Narasimhan
Advanced Engineering Informatics, 53, 101709, (2022). [Web] [Video]

Multi-output Image Classification to Support Post-Earthquake Reconnaissance
Ju An Park*, Xiaoyu Liu, Chul Min Yeum, Shirley J. Dyke, Max Midwinter*, Jongseong Choi, Zhiwei Chu, Thomas Hacker, Bedrich Benes
Accepted in Journal of Performance of Constructed Facilities, (2022). [Web]

Interactive Defect Quantification Through Extended Reality
Zaid Abbas Al-Sabbag*, Chul Min Yeum, Sriram Narasimhan
Advanced Engineering Informatics, 51, 101473, (2022). [Web] [Github] [Video]

Automated Graffiti Detection : A Novel Approach for Maintaining Historical Structures in Community
Jongseong Choi, Lazaros Toumanidis, Shirley J. Dyke, Chul Min Yeum, Patrikakis Charalampos, Ali Lenjani, Xiaoyu Liu, and Panagiotis Kasnesis
Applied Sciences, 12(6), 2983, (2022). [Web]

Similarity-based Building Search Capability for Post-event Image Data
Jongseong Choi, Ju An Park*, Shirley J. Dyke, Chul Min Yeum, Xiaoyu Liu, Ilia Billionis, and Ali Lenjani
Computer-Aided Civil and Infrastructure Engineering, 37 (2), 261-275, (2022). [Web]

Learning-based Image Scale Estimation using Surface Textures for Quantitative Visual Inspection
Ju An Park*, Chul Min Yeum, Trevor D. Hrynyk
Computer-Aided Civil and Infrastructure Engineering, 36, no. 2, 227-241, (2020). [Web] [Github]

Automated Indoor Image Localization to Support a Post-Event Building Assessment
Xiaoyu Liu, Shirley J. Dyke, Chul Min Yeum, Ilias Bilionis, Ali Lenjani, and Jongseong Choi
Sensors, 20, no. 6 (2020). [Web]

A Resilience-based Method for Prioritizing Post-event Building Inspections
Ali Lenjani, Ilias Bilionis, Shirley Dyke, Chul Min Yeum, and Ricardo Monteiro
Natural Hazards, 100, 877-896, (2020). [Web]

Towards fully automated post-event data collection and analysis: pre-event and post-event information fusion
Ali Lenjani, Shirley Dyke, Ilias Bilionis, Chul Min Yeum, Kenzo Kamiya, Jongseong Choi, Xiaoyu Liu, and Arindam Gan Chowdhury
Engineering Structures, 208, no.1, (2020). [Web]

Integrated environmental modeling for efficient aquifer vulnerability assessment using machine learning
Bernard Engel, Won Seok Jan, and Chul Min Yeum
Environmental Modelling and Software, 124, (2020). [Web]

Automated Building Image Extraction from 360-degree Panoramas for Post-Disaster Evaluation
Ali Lenjani, Chul Min Yeum, Shirley J. Dyke, and Ilias Bilionis
Computer-Aided Civil and Infrastructure Engineering 35, no. 3, (2020). [Web]

Post-Event Reconnaissance Image Documentation using Automated Classification
Chul Min Yeum, Shirley J. Dyke, Bedrich Benes, Thomas Hacker, Julio A. Ramirez, Alana Lund, and Santiago Pujol
Journal of Performance of Constructed Facilities, 33(1), (2018). [Web]

Automated Region-of-interest Localization and Classification for Vision-based Visual Assessment of Civil Infrastructure
Chul Min Yeum, Jongseong Choi, and Shirley J. Dyke
Structural Health Monitoring 15, no. 3 (2019). [Web]

Computer-Aided Approach for Rapid Post-Event Visual Evaluation of a Building Façade
Jongseong Choi, Chul Min Yeum, Shirley J. Dyke, and Mohammad R. Jahanshahi
Sensors, 18, 3017 (2018). [Web]

Automated Recovery of Documents from Earthquake Reconnaissance Images
Chul Min Yeum, Alana Lund, Shirley J. Dyke, Julio A. Ramirez
Journal of Computing in Civil Engineering 33, no. 1 (2018). [Web]

Visual Data Classification in Post-Event Building Reconnaissance
Chul Min Yeum, Shirley J. Dyke, and Julio A. Ramirez
Engineering Structures, 155, 16-24 (2018). [Web]

A Researcher-oriented Automated Data Ingestion Tool for rapid data Processing, Visualization and Preservation
Hacker, Thomas, Shirley Dyke, Ali Irmak Ozdagli, Gemez Marshall, Christopher Thompson, Brian Rohler, and Chul Min Yeum
Advances in Engineering Software, 114, 134-143, (2017). [Web]

Autonomous Image Localization for Visual Inspection of Civil Infrastructure
Chul Min Yeum, Jongseong Choi, and Shirley J. Dyke
Smart Materials and Structures 26, no. 3 (2017). [Web] [Github]

Acceleration-Based Automated Vehicle Classification on Mobile Bridges
Chul Min Yeum, Shirley J. Dyke, Ricardo E. Basora Rovira, Christian Silva, and Jeff Demo
Computer-Aided Civil and Infrastructure Engineering 31, no. 11 (2016). [Web] [Github]

Vision-Based Automated Crack Detection for Bridge Inspection
Chul Min Yeum and Shirley J Dyke
Computer-Aided Civil and Infrastructure Engineering 30, no. 10 (2015). [Web] [Github]

Reference-Free Delamination Detection Using Lamb Waves
Chul Min Yeum, Hoon Sohn, Hyung Jin Lim, and Jeong Beom Ihn
Structural Control and Health Monitoring 21, no. 5 (2014). [Web] [Github]

Reference-Free Damage Detection, Localization, and Quantification in Composites
Hyung Jin Lim, Hoon Sohn, Chul Min Yeum, and Ji Min Kim
The Journal of the Acoustical Society of America 133, no. 6, 3838-3845, (2013). [Web]

Laser Ultrasonic Imaging and Damage Detection for a Rotating Structure
Byeongjin Park, Hoon Sohn, Chul Min Yeum, and Thanh C Truong
Structural Health Monitoring 12, no. 5–6, 494–506, (2013). [Web]

Instantaneous Delamination Detection in a Composite Plate Using a Dual Piezoelectric Transducer Network
Chul Min Yeum, Hoon Sohn, Jeong Beom Ihn, and Hyung Jin Lim
Composite Structures 94, no. 12, 3490-99, (2012). [Web]

Experimental Study on Identifying Cracks of Increasing Size Using Ultrasonic Excitation
Jungeun An, Raphael T. Haftka, Nam H. Kim, Fuh-Gwo Yuan, Byung Man Kwak, Hoon Sohn, and Chul Min Yeum
Structural Health Monitoring 11, no. 1, 95-108, (2012). [Web]

Lamb Wave Mode Decomposition Using Concentric Ring and Circular Piezoelectric Transducers
Chul Min Yeum, Hoon Sohn, and Jeong Beom Ihn
Wave Motion 48, no. 4, 358-70, (2011). [Web] [Github]

 

Conference Papers

*: direct- or co-supervision

Multi-Dimensional Structural Assessment with a Mobile Scanning Device
Rishabh Bajaj*, Zaid Abbas Al-Sabbag*, Chul Min Yeum, and Sriram Narasimhan
Transforming Construction with Reality Capture Technologies, University of New Brunswick, New Brunswick, Aug 23, 2022. [Slide]

Distributed Collaboration in Infrastructure Assessment through Mixed and Virtual Reality
Zaid Al-Sabbag*, Chul Min Yeum, and Sriram Narasimhan
Transforming Construction with Reality Capture Technologies, University of New Brunswick, New Brunswick, Aug 23, 2022. [Slide]

Unsupervised Semantic Segmentation with Pose Prior
Max Midwinter*, Zaid Abbas Al-Sabbag*, and Chul Min Yeum
11th International Conference on Structural Health Monitoring of Intelligent Infrastructure (SHMII-11), Concordia University, Montreal, August 8, 2022. [Slide] [Paper]

Human-Machine Collaborative Infrastructure Assessment through Mixed and Virtual Reality
Chul Min Yeum, Zaid Al-Sabbag*, Rishabh Bajaj*, Max Midwinter*
Canada-Korea Conference on Science and Technology, Niagara Falls, ON, July 4, 2022. [Slide]

Rapid Seismic Vunerability of Low-Rise RC Buildings Using Machine Learning
Niloofar Elyasi, Max Midwinter/*, Eugene Kim, Chul Min Yeum
12 National Conference on Earthqauke Engineering, Salt Lake City, Utah, June 27, 2022.

Volumetric damage quantification for visual inspection
Rishabh Bajaj*, Zaid Abbas Al-Sabbag*, Chul Min Yeum, Sriram Narasimhan
8th World Conference on Structural Control and Monitoring, 2022. [Slide] [Paper]

Human-Machine and Human-Human Collaborative Inspection Through Extended Reality
Zaid Abbas Al-Sabbag*, Max Midwinter*, Chul Min Yeum, Sriram Narasimhan
Engineering Mechanics Institute (EMI) Conference, 2022. [Slide]

Similarity Learning to Building Search Capability: Post-event Image Data Application
Jongseong Choi, Ju An Park*, Chul Min Yeum, Shirley J Dyke
Asia Pacific Conference of the Prognostics and Health Management Society, Sep 9, 2021.

Explainable Machine Learning for Seismic Vulnerability Assessment of Low-Rise Reinforced Concrete Buildings
Max Midwinter*, Chul Min Yeum, Eugene Kim
Canadian Society for Civil Engineering, online, 2021.

Real-time Quantitative Visual Inspection using an Extended Reality Headset
Zaid Abbas Al-Sabbag*, Jason Paul Connelly, Chul Min Yeum, Sriram Narasimhan
6th Annual Conference on Vision and Intelligent Systems, Waterloo, Ontario, Canada, Nov 25-27, 2020.

Image Scale Estimation Using Surface Textures for Quantitative Visual Inspection
Ju An Park*, Chul Min Yeum, Trevor Hyrnyk
6th Annual Conference on Vision and Intelligent Systems, Waterloo, Ontario, Canada, Nov 25-27, 2020. [Slide]

Automated Image Classification for Post-Earthquake Reconnaissance Images
Ju An Park*, Chul Min Yeum, Jongseong Choi, Xiaoyu Liu
5th Annual Conference on Vision and Intelligent Systems, Waterloo, Ontario, Canada, Nov 26, 2019.

Hierarchical Convolutional Neural Network for Activity Source Detection in Building Floors
Ali Lenjani, Chul Min Yeum, Shirley Dyke, Ilias Bilionis, Jongseong Choi, Alana Lund, and Amin Maghareh
Proceedings of the 12th International Workshop on Structural Health Monitoring, Stanford, CA, September 10-12, 2019.

Automated Image Localization and 3D Reconstruction for Post-Event Building Reconnaissance
Xiaoyu Liu, Chul Min Yeum, Shirley J. Dyke, Ali Lenjani, and Jongseong Choi
Engineering Mechanics Institute Conference (EMI), CA, USA, June 18-21, 2019.

Automated Pre-disaster Building Images Extraction from Street View Imagery
Ali Lenjani, Chul Min Yeum, Shirley J. Dyke, and Ilias Bilionis
Proceedings of Tornado Hazard Wind Assessement and Reduction Symposium, IL, USA, Sep 26-27, 2018.

Rapid Vision-Based Inspection of Nonstructural Components in Buildings
Jongseong Choi, Chul Min Yeum, Shirley Dyke, Mohammad Jahanshahi, and Gun Wook Park
Proceedings of the 9th European Workshop on Structural Health Monitoring, Manchester, UK, July 10-13, 2018.

Automated Detection of Pre-Disaster Building Images from Google Street View
Chul Min Yeum, Ali lenjani, Shirley J. Dyke and Ilias Bilionis
Proceedings of the 7th World Conference on Structural Control and Monitoring, Qingdao, China, July 22-25, 2018. [Slide] [Paper]

The Automated Reconnaissance Image Organization Tool
Shirley J. Dyke, Chul Min Yeum, Mathieu Gaillard, Bedrich Benes, Thomas Hacker, Alana Lund, Ali Lenjani, Julio Ramirez
Proceedings of the 43rd Annual Natural Hazards Research and Applications Workshop, Colorado, USA, July 8-11, 2018.

Automating Damage Classification in Post-Earthquake Building Images
Chul Min Yeum, Shirley J. Dyke, Bedrich Benes, Thomas Hacker, Julio A. Ramirez, Alana Lund, Chungwook Sim, and Santiago Pujol
Proceedings of the 11th National Conference on Earthquake Engineering, Los Angeles, CA, June 25-29, 2018. [Slide] [Paper]

Automated Region-of-Interest Localization and Classification for Visual Assessment on Civil Infrastructure
Chul Min Yeum, Jongseong Choi, and Shirley J. Dyke
Proceedings of the 11th International Workshop on Structural Health Monitoring, Stanford, CA, September 12-14, 2017 [Slide] [Paper]

Rapid, Automated Image Classification for Documentation
Chul Min Yeum, Shirley J. Dyke, Bedrich Benes, Thomas Hacker, Julio A. Ramirez, Alana Lund, and Santiago Pujol
Proceedings of the 7th Conference on Advances in Experimental Structural Engineering, Pavia, Italy, September 6-8, 2017. [Slide] [Paper]

Automated Damage Evaluation for Big Visual Data Collected from Earthquake
Chul Min Yeum, Shirley J. Dyke, Julio A. Ramirez, and Chungwook Sim
Proceedings of US-Korea Conference on Science, Technology and Entrepreneurship, Washington D.C., August 9-12, 2017. [Slide] [Paper]

Image Localization for Computer-enhanced Visual Inspection of Civil Infrastructure
Chul Min Yeum, Jongseong Choi, and Shirley J. Dyke
Proceedings of Engineering Mechanics Institute Conference, San Diago, CA, United States, June 4-7, 2017. [Slide] [Paper]

Annotation of Image Data from Disaster Reconnaissance
Chul Min Yeum, Shirley J. Dyke, Julio A. Ramirez, Tomas Hacker, Santiago Pujol and Chungwook Sim
Proceedings of the 16th World Conference on Earthquake Engineering, Santiago, Chile, Jan 09-13, 2017. [Slide] [Paper]

Big Visual Data Analysis for Damage Evaluation in Civil Engineering
Chul Min Yeum, Shirley J. Dyke, Julio A. Ramirez, and Bedrich Benes
Proceedings of International Conference on Smart Infrastructure and Construction, Cambridge, U.K., June 27-29, 2016. [Slide] [Paper]

Applications of Computer Vision in Structural Health Monitoring
Shirley J. Dyke, Chul Min Yeum, Christian Silva, and Jeff Demo
Proceedings of the 7th Structural Health Monitoring and Intelligent Infrastructure, Italy, July 1-4, 2015. [Slide] [Paper]

Vision-based Automated Visual Inspection of Large-scale Bridges
Chul Min Yeum and Shirley J. Dyke
Sixth World Conference on Structural Control and Monitoring, Barcelona, Spain, July 15-17, 2014. [Slide] [Paper]

Laser Ultrasonic Imaging of a Rotating Blade
Byeongin Park, Troung Thanh Chung, Chul Min Yeum, and Hoon Sohn
SPIE International Symposia, Smart Structures & Materials and Nondestructive Evaluation for Health Monitoring and Diagnostics, San Diego, CA, March 6-10, 2012.

Laser Ultrasonic Techniques for Structural Health Monitoring Applications
Hoon Sohn, Yun Kyu An, Byeongin Park, Troung Thanh Chung,Chul Min Yeum, Jin Yeol Yang, and Hyun Seok Lee
CIMTEC, Montecatini, Terme, Italy, June 10-14, 2012.

A Dropout Elimination Technique for Noncontact Laser Ultrasonic Imaging of a Rotating Object
Troung Thanh Chung, Byeongin Park, Hoon Sohn and Chul Min Yeum
24th KKCNN Symposium on Civil Engineering, Hyogo, Japan, December 14-16, 2011.

Reference-free Delamination Detection using Lamb Wave Time Delay
Chul Min Yeum, Hoon Sohn, Jeong Beom Ihn, and Hyung Jin Lim
the 8h International Workshop on Structural Health Monitoring, Stanford, CA, September 13-15, 2011.

Delamination Detection in a Composite Plate using a Dual Piezoelectric Transducer Network
Chul Min Yeum, Hoon Sohn, and Jeong Beom Ihn
SPIE International Symposia, Smart Structures & Materials and Nondestructive Evaluation for Health Monitoring and Diagnostics, San Diego, CA, March 6-10, 2011. [Slide] [Paper]

Modeling of Impact-induced Delamination in a Multilayer Composite Plate
Hyung Jin Lim, Chul Min Yeum, and Hoon Sohn
the 23rd KKCNN Symposium on Civil Engineering, Taipei, Taiwan, November 13-15, 2010.

Lamb Wave Decomposition using Amplitude Matching with Concentric Circular PZT Transducers
Chul Min Yeum, Hoon Sohn, and Jeon Beom Ihn
the 5th European Workshop on Structural Health Monitoring, Sorrento, Italy, June 29-July 02, 2010. [Slide] [Paper]

Reference-Free Delamination Detection in Multilayer Composite Panels
Hoon Sohn, Seung Bum Kim, Chang Gil Lee, Chul Min Yeum, and Jeong Bum Ihn
Multi-Functional Materials and Structures, Hong Kong, China, July 28-31, 2008.

Transition from Guided Wave Based Non-Destructive Testing to Structural Health Monitoring
Hoon Sohn, Seung Bum Kim, Sang Jun Lee, Debaditya Dutta, Hyun Jun Park, Chang Gil Lee, Abhinav Agrawal, Chul Min Yeum, Seung Hee Park, and Yun Kyu An
the 35th Annual Review of Progress in Quantitative Nondestructive Evaluation (QNDE 2008), Chicago, IL, July 20-25, 2008.

Robust Crack Detection under Changing Temperature Environment
Hoon Sohn, Seung Bum Kim, Sang Jun Lee, Debaditya Dutta, Hyun Jun Park, Chang Gil Lee, Abhinav Agrawal, and Chul Min Yeum
US-Korea Workshop on Bio, Bio-Inspired and Smart Sensing, Jeju, Korea, May 23-25, 2008.

Probabilistic Damage Localization using Embedded Piezoelectric Sensor Networks
Chul Min Yeum and Hoon Sohn
the 2nd UITM-KAIST Symposium on Urban Engineering and Sustainability, Daejeon, Korea, March 31, 2008. [Slide]