Humans as Cultural Gatekeepers: A Reverse Turing Test Approach

Humans as Cultural Gatekeepers: A Reverse Turing Test Approach

연구 분야: Analysis

학회: International Conference on Human-Computer Interaction

In this paper, we explore the role-play of humans as cultural gatekeepers via a reverse Turing approach where machines or agents are evaluated on their ability to understand human culture. The study is organized in four steps: Step 1, we first conduct a survey of CQ and overseas work adjustment aimed to provide a supporting contribution to the analysis of CQ and work adjustment to which Person-Environment Fit (PEF) theory has been applied. We collect the data at this step. Step 2, as humans, we analyze the results and perform statistical analysis to prepare the body of knowledge for benchmarking with the agents in the next step. Finally, in Step 3, humans evaluate an agent’s understanding of cultural nuances by designing and administering tests that assess its ability to navigate the same given complex scenarios as humans did in Step 1. The results will be compared, analyzed, and discussed by humans. In the last step, Step 4, we reverse the direction of the test in Step 3 by using agents as the panel examiners. The results revealed a partial understanding of the CQ of the agents, and the reversed Turing test was incomplete.