A validated standardised measurement instrument for evaluating human interaction with an artificial social agent (ASA), resulted from multi-year efforts involving 100+ ASA researchers worldwide. The long version of ASAQ is suitable for a comprehensive evaluation of human-ASA interaction, while the short version of ASAQ allows quick analysis and description of the interaction with the ASA. ASAQ is also supported with two charts for reporting ASA questionnaire results and a quick overview of agent profile. The ASAQ Chart can be used for comparing the ASAQ results of up-to 4 ASAs on the original -3 to 3 scale, while the ASAQ Percentile Chart can be used for contrasting the ASAQ results with the ASAQ Representative Set. This set contains dataset of representative ASAs and their unique participants' ASAQ ratings.
What does it measure?
Believability
Does the ASA resemble human or a nature being? Is it suitable for its role?
Usability
Does the ASA easy to use? Is it easy to learn?
Performance
Does the ASA do its task?
Likeability
Does the user like the ASA? Is it pleasing?
Sociability
Can the ASA easily interact with the user socially?
Personality Presence
Does the ASA have a distinctive character?
User Acceptance
Does the user intent to interact the ASA again in the future?
Enjoyability
Does the user enjoy interacting with the ASA?
User Engagement
Did the interaction capture the user's attention?
User Trust
Does the ASA always give good advice? Is it trustworthy and reliable?
User-Agent Alliance
Do the ASA and the user have a strategic alliance?
Attentiveness
Is the ASA attentive towards the user?
Coherence
Does the ASA's behavior make sense?
Intentionality
Does the ASA have a clue of what it is doing?
User Attitude
Does the user see the interaction with the ASA as something positive?
Social Presence
Does the ASA have a social presence?
Impact on Self Image
Would others (who are close to the user) encourage the user to use the ASA?
Emotional Experience
Can the ASA express its emotion? Are the user's emotions caused by the ASA?
User-Agent Interplay
Do the ASA's and the user's emotions effect each other?
HOW DOES IT WORK?
ASAQ Instrument
Siska Fitrianie, Merijn Bruijnes, Amal Abdulrahman, and Willem-Paul Brinkman. 2025. The Artificial Social Agent Questionnaire (ASAQ) - Development and evaluation of a validated instrument for capturing human interaction experiences with artificial social agents. International Journal of Human-Computer Studies (2025), 103482. https://doi.org/10.1016/j.ijhcs.2025.103482
Recent Publications
- Siska Fitrianie, Merijn Bruijnes, Amal Abdulrahman, and Willem-Paul Brinkman. 2025. The Artificial Social Agent Questionnaire (ASAQ) - Development and evaluation of a validated instrument for capturing human interaction experiences with artificial social agents. International Journal of Human-Computer Studies (2025), 103482. https://doi.org/10.1016/j.ijhcs.2025.103482
- Nele Albers, Andrea Bönsch, Jonathan Ehret, Boleslav A. Khodakov, and Willem-Paul Brinkman. 2024. German and Dutch Translations of the Artificial-Social-Agent Questionnaire Instrument for Evaluating Human-Agent Interactions. In Proceedings of the 24th ACM International Conference on Intelligent Virtual Agents (IVA '24). Association for Computing Machinery, New York, NY, USA, Article 33, 1–4. https://doi.org/10.1145/3652988.3673928
- Fengxiang Li, Siska Fitrianie, Merijn Bruijnes, Amal Abdulrahman, Fu Guo, and Willem-Paul Brinkman. 2023. Mandarin Chinese translation of the Artificial-Social-Agent questionnaire instrument for evaluating human-agent interaction. Frontiers in Computer Science, Sec. Human-Media Interaction, Volume 5. https://doi.org/10.3389/fcomp.2023.1149305
- Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. The artificial-social-agent questionnaire: establishing the long and short questionnaire versions. In Proc. of the 22nd ACM International Conference on Intelligent Virtual Agents (IVA '22). Association for Computing Machinery, New York, NY, USA, Article 18, 1–8. https://doi.org/10.1145/3514197.3549612
Available Languages
Interested to develop a new language version? envelope contact us
