TY - JOUR
T1 - Managing the risks of artificial general intelligence
T2 - A human factors and ergonomics perspective
AU - Salmon, Paul M.
AU - Baber, Chris
AU - Burns, Catherine
AU - Carden, Tony
AU - Cooke, Nancy
AU - Cummings, Missy
AU - Hancock, Peter
AU - McLean, Scott
AU - Read, Gemma J. M.
AU - Stanton, Neville A.
PY - 2023/5/28
Y1 - 2023/5/28
N2 - Artificial General Intelligence (AGI) is the next and forthcoming evolution of Artificial Intelligence (AI). Though there could be significant benefits to society, there are also concerns that AGI could pose an existential threat. The critical role of Human Factors and Ergonomics (HFE) in the design of safe, ethical, and usable AGI has been emphasized; however, there is little evidence to suggest that HFE is currently influencing development programs. Further, given the broad spectrum of HFE application areas, it is not clear what activities are required to fulfill this role. This article presents the perspectives of 10 researchers working in AI safety on the potential risks associated with AGI, the HFE concepts that require consideration during AGI design, and the activities required for HFE to fulfill its critical role in what could be humanity's final invention. Though a diverse set of perspectives is presented, there is broad agreement that AGI potentially poses an existential threat, and that many HFE concepts should be considered during AGI design and operation. A range of critical activities are proposed, including collaboration with AGI developers, dissemination of HFE work in other relevant disciplines, the embedment of HFE throughout the AGI lifecycle, and the application of systems HFE methods to help identify and manage risks.
AB - Artificial General Intelligence (AGI) is the next and forthcoming evolution of Artificial Intelligence (AI). Though there could be significant benefits to society, there are also concerns that AGI could pose an existential threat. The critical role of Human Factors and Ergonomics (HFE) in the design of safe, ethical, and usable AGI has been emphasized; however, there is little evidence to suggest that HFE is currently influencing development programs. Further, given the broad spectrum of HFE application areas, it is not clear what activities are required to fulfill this role. This article presents the perspectives of 10 researchers working in AI safety on the potential risks associated with AGI, the HFE concepts that require consideration during AGI design, and the activities required for HFE to fulfill its critical role in what could be humanity's final invention. Though a diverse set of perspectives is presented, there is broad agreement that AGI potentially poses an existential threat, and that many HFE concepts should be considered during AGI design and operation. A range of critical activities are proposed, including collaboration with AGI developers, dissemination of HFE work in other relevant disciplines, the embedment of HFE throughout the AGI lifecycle, and the application of systems HFE methods to help identify and manage risks.
KW - human factors
KW - safety
KW - risk
KW - artificial general intelligence
KW - artificial intelligence
U2 - 10.1002/hfm.20996
DO - 10.1002/hfm.20996
M3 - Article
SN - 1090-8471
JO - Human Factors and Ergonomics in Manufacturing & Service Industries
JF - Human Factors and Ergonomics in Manufacturing & Service Industries
ER -