Personalized Safety Training

Project Overview

Rationale

Construction safety training often uses a one-size-fits-all approach that does not adapt to workers’ experience, knowledge gaps, cognitive states, or learning progress. This framework addresses those limitations by integrating LLMs, RAG, VR, 360° scenarios, and multimodal sensing to deliver personalized, standards-aligned safety training and feedback.

Impact

Support personalized safety training by using quiz results, fixation AOIs, EDR, and cognitive classification to assign targeted modules such as visual search strategy, lack of knowledge, and risk perception training.
Enhance hazard reasoning and mitigation skills through LLM-based explanation, feedback, hints, hazard mitigation quizzes, hierarchy of controls options, and risk metric quizzes.
Improve knowledge grounding and feedback accuracy by retrieving OSHA-based hazard information through an RAG database before generating responses.

Publication List

Journal Papers

Lee, K., Pooladvand, S., Esmaeili, B., & Hasanzadeh, S. (2024). Understanding construction workers’ risk perception using neurophysiological responses. Journal of Computing in Civil Engineering, 38(6), 04024039.
Lee, K., & Hasanzadeh, S. (2024). Understanding cognitive anticipatory process in dynamic hazard anticipation using multimodal psychophysiological responses. Journal of Construction Engineering and Management, 150(4), 04024008.
Lee, K., Shinde, Y., Hasanzadeh, S., & Esmaeili, B. (2023). Developing a computational spatial attention metric to examine workers’ visual search efficiency at hazardous construction jobsites. In Computing in Civil Engineering 2023 (pp. 598-605).
Shinde, Y., Lee, K., Kiper, B., Simpson, M., & Hasanzadeh, S. (2023). A Systematic Literature Review on 360° Panoramic Applications in Architecture, Engineering, and Construction (AEC) Industry. Journal of Information Technology in construction, 28.
Shinde, Y., Lee, K., Kiper, B., Simpson, M., & Hasanzadeh, S. (2023). A Systematic Literature Review on 360° Panoramic Applications in Architecture, Engineering, and Construction (AEC) Industry. Journal of Information Technology in construction, 28.
Lee, K., Hasanzadeh, S., & Esmaeili, B. (2022). Assessing hazard anticipation in dynamic construction environments using multimodal 360-degree panorama videos. Journal of Management in Engineering, 38(5), 04022039.

Conference Proceedings

Lee, K., Shinde, Y., Hasanzadeh, S., & Esmaeili, B. (2025). Enhancing Hazard Identification: A Comprehensive Approach to Personalized Safety Training Addressing Cognitive Limitations. In CIB Conferences (Vol. 1, No. 1, p. 296).
Lee, K., Shinde, Y., Hasanzadeh, S., & Esmaeili, B. (2022). Toward Personalized Safety Training: Automating the Classification of Construction Workers’ Cognitive Failures.
Lee, K., Hasanzadeh, S., & Esmaeili, B. (2022). Spatial exposure to dynamic safety hazards in construction sites through 360-degree augmented panoramas: Ecological validity in safety research. In Construction research congress 2022 (pp. 715-725).