Beyond data visualization: A context-realistic construction equipment training simulators

Faridaddin Vahdatikhaki*, Khaled El Ammari, Armin Kassemi Langroodi, Seirgei Miller, Amin Hammad, Andre Doree

*Corresponding author for this work

    Research output: Contribution to journalArticleAcademicpeer-review

    2 Citations (Scopus)
    1 Downloads (Pure)

    Abstract

    Virtual Reality (VR) based training simulators are successfully employed in many industries (e.g., aviation) to help train operators and professionals in a safe environment. The construction industry has also started to use this technology in recent years for training operators of heavy equipment. However, the context presented in the available training simulators is unrealistic because in many instances the training takes place in static sites where there is no mobility in the site. To realistically introduce the context of construction sites into VR scenes sensory data from actual projects can be used. However, currently, there is no systematic insight into (1) the dimensions of context that need to be present in a training simulator, (2) the types of data required to represent various dimensions of the context, and (3) methods for converting context data into a coherent context-realistic training scene that enables bidirectional feedback between trainees and the VR scene. Therefore, this research aims to develop a novel framework to generate coherent context-realistic training simulators from data collected from actual construction projects to enhance construction training simulators. The proposed framework provides a step-wise guideline into (a) collection of appropriate data for context-realistic simulators, (b) development of agents and simulation physics from actual site data and their integration into a scene, (c) scene-trainee interactions in context-realistic scenes, and (d) context-based assessment of the trainees' performance from safety, productivity, and quality perspectives. A prototype is developed and a case study is conducted to demonstrate the feasibility of the proposed framework. A workshop with expert training instructors is conducted to evaluate the effectiveness of the proposed framework for improving simulator-based training. It is shown that compared to the existing simulators, the context-realistic training simulators can significantly improve various aspects of operator training, especially safety and teamwork. The research provided an insight into the future of construction training simulator by indicating the importance and relevance of (1) collecting appropriate data, and (2) developing robust data-to-agent and data-to-physics methods.

    Original languageEnglish
    Article number102853
    JournalAutomation in construction
    Volume106
    DOIs
    Publication statusE-pub ahead of print/First online - 5 Jun 2019

    Fingerprint

    Construction equipment
    Data visualization
    Simulators
    Virtual reality
    Physics
    Construction industry
    Aviation
    Productivity
    Feedback

    Keywords

    • Construction safety
    • Real-time locations system
    • Situational awareness
    • Training simulator
    • Virtual reality

    Cite this

    @article{65b26d0a9a6f4597bbd05e8d7b987c8a,
    title = "Beyond data visualization: A context-realistic construction equipment training simulators",
    abstract = "Virtual Reality (VR) based training simulators are successfully employed in many industries (e.g., aviation) to help train operators and professionals in a safe environment. The construction industry has also started to use this technology in recent years for training operators of heavy equipment. However, the context presented in the available training simulators is unrealistic because in many instances the training takes place in static sites where there is no mobility in the site. To realistically introduce the context of construction sites into VR scenes sensory data from actual projects can be used. However, currently, there is no systematic insight into (1) the dimensions of context that need to be present in a training simulator, (2) the types of data required to represent various dimensions of the context, and (3) methods for converting context data into a coherent context-realistic training scene that enables bidirectional feedback between trainees and the VR scene. Therefore, this research aims to develop a novel framework to generate coherent context-realistic training simulators from data collected from actual construction projects to enhance construction training simulators. The proposed framework provides a step-wise guideline into (a) collection of appropriate data for context-realistic simulators, (b) development of agents and simulation physics from actual site data and their integration into a scene, (c) scene-trainee interactions in context-realistic scenes, and (d) context-based assessment of the trainees' performance from safety, productivity, and quality perspectives. A prototype is developed and a case study is conducted to demonstrate the feasibility of the proposed framework. A workshop with expert training instructors is conducted to evaluate the effectiveness of the proposed framework for improving simulator-based training. It is shown that compared to the existing simulators, the context-realistic training simulators can significantly improve various aspects of operator training, especially safety and teamwork. The research provided an insight into the future of construction training simulator by indicating the importance and relevance of (1) collecting appropriate data, and (2) developing robust data-to-agent and data-to-physics methods.",
    keywords = "Construction safety, Real-time locations system, Situational awareness, Training simulator, Virtual reality",
    author = "Faridaddin Vahdatikhaki and {El Ammari}, Khaled and Langroodi, {Armin Kassemi} and Seirgei Miller and Amin Hammad and Andre Doree",
    year = "2019",
    month = "6",
    day = "5",
    doi = "10.1016/j.autcon.2019.102853",
    language = "English",
    volume = "106",
    journal = "Automation in construction",
    issn = "0926-5805",
    publisher = "Elsevier",

    }

    Beyond data visualization : A context-realistic construction equipment training simulators. / Vahdatikhaki, Faridaddin; El Ammari, Khaled; Langroodi, Armin Kassemi; Miller, Seirgei; Hammad, Amin; Doree, Andre.

    In: Automation in construction, Vol. 106, 102853, 05.06.2019.

    Research output: Contribution to journalArticleAcademicpeer-review

    TY - JOUR

    T1 - Beyond data visualization

    T2 - A context-realistic construction equipment training simulators

    AU - Vahdatikhaki, Faridaddin

    AU - El Ammari, Khaled

    AU - Langroodi, Armin Kassemi

    AU - Miller, Seirgei

    AU - Hammad, Amin

    AU - Doree, Andre

    PY - 2019/6/5

    Y1 - 2019/6/5

    N2 - Virtual Reality (VR) based training simulators are successfully employed in many industries (e.g., aviation) to help train operators and professionals in a safe environment. The construction industry has also started to use this technology in recent years for training operators of heavy equipment. However, the context presented in the available training simulators is unrealistic because in many instances the training takes place in static sites where there is no mobility in the site. To realistically introduce the context of construction sites into VR scenes sensory data from actual projects can be used. However, currently, there is no systematic insight into (1) the dimensions of context that need to be present in a training simulator, (2) the types of data required to represent various dimensions of the context, and (3) methods for converting context data into a coherent context-realistic training scene that enables bidirectional feedback between trainees and the VR scene. Therefore, this research aims to develop a novel framework to generate coherent context-realistic training simulators from data collected from actual construction projects to enhance construction training simulators. The proposed framework provides a step-wise guideline into (a) collection of appropriate data for context-realistic simulators, (b) development of agents and simulation physics from actual site data and their integration into a scene, (c) scene-trainee interactions in context-realistic scenes, and (d) context-based assessment of the trainees' performance from safety, productivity, and quality perspectives. A prototype is developed and a case study is conducted to demonstrate the feasibility of the proposed framework. A workshop with expert training instructors is conducted to evaluate the effectiveness of the proposed framework for improving simulator-based training. It is shown that compared to the existing simulators, the context-realistic training simulators can significantly improve various aspects of operator training, especially safety and teamwork. The research provided an insight into the future of construction training simulator by indicating the importance and relevance of (1) collecting appropriate data, and (2) developing robust data-to-agent and data-to-physics methods.

    AB - Virtual Reality (VR) based training simulators are successfully employed in many industries (e.g., aviation) to help train operators and professionals in a safe environment. The construction industry has also started to use this technology in recent years for training operators of heavy equipment. However, the context presented in the available training simulators is unrealistic because in many instances the training takes place in static sites where there is no mobility in the site. To realistically introduce the context of construction sites into VR scenes sensory data from actual projects can be used. However, currently, there is no systematic insight into (1) the dimensions of context that need to be present in a training simulator, (2) the types of data required to represent various dimensions of the context, and (3) methods for converting context data into a coherent context-realistic training scene that enables bidirectional feedback between trainees and the VR scene. Therefore, this research aims to develop a novel framework to generate coherent context-realistic training simulators from data collected from actual construction projects to enhance construction training simulators. The proposed framework provides a step-wise guideline into (a) collection of appropriate data for context-realistic simulators, (b) development of agents and simulation physics from actual site data and their integration into a scene, (c) scene-trainee interactions in context-realistic scenes, and (d) context-based assessment of the trainees' performance from safety, productivity, and quality perspectives. A prototype is developed and a case study is conducted to demonstrate the feasibility of the proposed framework. A workshop with expert training instructors is conducted to evaluate the effectiveness of the proposed framework for improving simulator-based training. It is shown that compared to the existing simulators, the context-realistic training simulators can significantly improve various aspects of operator training, especially safety and teamwork. The research provided an insight into the future of construction training simulator by indicating the importance and relevance of (1) collecting appropriate data, and (2) developing robust data-to-agent and data-to-physics methods.

    KW - Construction safety

    KW - Real-time locations system

    KW - Situational awareness

    KW - Training simulator

    KW - Virtual reality

    U2 - 10.1016/j.autcon.2019.102853

    DO - 10.1016/j.autcon.2019.102853

    M3 - Article

    AN - SCOPUS:85066623099

    VL - 106

    JO - Automation in construction

    JF - Automation in construction

    SN - 0926-5805

    M1 - 102853

    ER -