The Artificial-Social-Agent Questionnaire (ASAQ)
A validated standardised measurement instrument for evaluating human interaction with an artificial social agent (ASA), resulted from multi-year efforts involving more than 100 ASA researchers worldwide. The long version of the ASAQ is suitable for a comprehensive evaluation of human-ASA interaction, while the short version allows quick analysis and description of the interaction with the ASA. It is also supported with an ASA chart for reporting ASA questionnaire results and a quick overview of agent profile.
What does it measure? |
|||||||||
BelievabilityDoes the ASA resemble human or a nature being? Is it suitable for its role? |
UsabilityDoes the ASA easy to use? easy to learn? |
PerformanceDoes the ASA do its task? |
LikeabilityDoes the user like the ASA? Is it pleasing? |
SociabilityCan the ASA easily interact with the user socially? |
|||||
Personality PresenceDoes the ASA have a distinctive character? |
User AcceptanceDoes the user intent to interact the ASA again in the future? |
EnjoyabilityDoes the user enjoy interacting with the ASA? |
User EngagementDid the interaction capture the user's attention? |
User TrustDoes the ASA always give good advice? Is it trustworthy and reliable? |
|||||
User-Agent AllianceDo the ASA and the user have a strategic alliance? |
AttentivenessIs the ASA attentive? |
CoherenceDoes the ASA's behavior make sense? |
IntentionalityDoes the ASA have a clue of what it is doing? |
User AttitudeDoes the user see the interaction with the ASA as something positive? |
|||||
Social PresenceDoes the ASA have a social presence? |
Impact on Self ImageWould others (who are close to the user) encourage the user to use the ASA? |
Emotional ExperienceCan the ASA express its emotion? Are the user's emotions caused by the ASA? |
User-Agent InterplayDo the ASA's and the user's emotions effect each other? |
||||||
Download |
|||||
The ASAQThe long version of the Artificial-Social-Agent Questionnaire as pdf |
The ASAQ-S The short version of the Artificial-Social-Agent Questionnaire as pdf |
ASA-Chart Generates an ASA-Chart for a single ASA or comparing two ASAs |
|||
TutorialDescribes how to use the ASAQ in an experiment and how to analyse the results |
Normative Dataset Data of 14 different ASAs from previous experiments involving 532 participants |
||||
Recent publications of the ASAQ
- Fengxiang Li, Siska Fitrianie, Merijn Bruijnes, Amal Abdulrahman, Fu Guo, and Willem-Paul Brinkman. 2023. Mandarin Chinese translation of the Artificial-Social-Agent questionnaire instrument for evaluating human-agent interaction. Frontiers in Computer Science, Sec. Human-Media Interaction, Volume 5 https://doi.org/10.3389/fcomp.2023.1149305
- Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. The artificial-social-agent questionnaire: establishing the long and short questionnaire versions. In Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents (IVA '22). Association for Computing Machinery, New York, NY, USA, Article 18, 1–8. https://doi.org/10.1145/3514197.3549612
- Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. Artificial Social Agent Questionnaire Instrument. (2022). https://doi.org/10.4121/19650846 4TU.ResearchData.
- Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. Data and analysis underlying the research into the Artificial-Social-Agent Questionnaire: Establishing the long and short questionnaire versions. (2022). https://doi.org/10.4121/19758436 4TU.ResearchData.
See more publications and related data ...
Available Languages
English
Mandarin Chinese
Dutch
German