ASAQ Representative Set 2024
A dataset comprising 29 agents and 1,066 participants was collected using the third-person perspective adaptation of the ASAQ,
with video clips employed as stimuli.
fa fa-exclamation-circle Note: The scores of all "R_" constructs/dimensions have been reversed
Siska Fitrianie, Merijn Bruijnes, Amal Abdulrahman, and Willem-Paul Brinkman. 2025. The Artificial Social Agent Questionnaire (ASAQ) - Development and evaluation of a validated instrument for capturing human interaction experiences with artificial social agents. International Journal of Human-Computer Studies (2025), 103482. https://doi.org/10.1016/j.ijhcs.2025.103482
ASAQ Representative Set 2025
Complementing on the ASAQ Representative Set 2024—which uses a third-person perspective—this dataset captures first-person interactions with widely used ASAs. It includes responses from 1,296 participants, 666 of whom provided detailed ASAQ evaluations based on recent experiences.
fa fa-exclamation-circle Note: The scores of all "R_" constructs/dimensions have been reversed
Siska Fitrianie, Amal Abdulrahman, Merijn Bruijnes, and Willem-Paul Brinkman. 2025. Establishing Reference Points for Artificial Social Agent Evaluation: the ASAQ Representative Set 2025. Frontiers in Computer Science. 7:1726078. https://doi/10.3389/fcomp.2025.1726078.
Data Gathered during and for the Creation of the ASAQ
Existing Questionnaires: IVA Proceedings 2013-2018
Reported in https://doi.org/10.1145/3308532.3329421
Study 1: Defining Categories and Study 2: Defining Constructs
Reported in https://doi.org/10.1145/3383652.3423873
Study 3: Collecting Questionnaire Items, Study 4: Defining Questionnaire Items and Study 6: Reliability Analysis of the Questionnaire Items
Reported in https://doi.org/10.1145/3472306.3478341
- Experts' discussion on generating initial items (.xlsx)
- 431 expert-generated questionnaire items (.csv)
- Experts' answers on the target items and their corresponding (randomly, on-the-fly) selected distractor items (.csv)
- 207 content-validated questionnaire items (.csv)
- Crowd workers' answers on 104 questionnaire items (the first half of the questionnaire - .csv)
- Crowd workers' answers on 103 questionnaire items (the second half of the questionnaire - .csv)
- 131 reliability-analyzed questionnaire items (.csv)
Study 5: Collecting Prototypical ASAs
- Experts' discussion on the list of prototypical ASAs (.xlsx)
- 56 prototypical ASAs short-video clips (30s - .mp4)
- 3 experts' prediction scores on 54 ASAs (.csv): expert A, expert B, and expert C; or their average ratings of ASAs for the selection purpose
Study 7: Construct Validity: Convergent and Discriminant Validity analysis
Reported in https://doi.org/10.1145/3514197.3549612
- Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. Artificial Social Agent Questionnaire Instrument. (2022). 4TU.ResearchData. dataset. https://doi.org/10.4121/19650846
- Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. Data and analysis underlying the research into the Artificial-Social-Agent Questionnaire: Establishing the long and short questionnaire versions. (2022). 4TU.ResearchData. dataset. https://doi.org/10.4121/19758436
- Crowd-workers' answers on 131 questionnaire items (.csv)
- Study data management plan
- Study ethical commitee checklist
- Study approval from TUDElft Ethical Committee
Study 8: Cross Validation Final Questionnaire Set
Reported in https://doi.org/10.1016/j.ijhcs.2025.103482
- Siska Fitrianie, Merijn Bruijnes, Amal Abdulrahman, and Willem-Paul Brinkman. 2025. Data and Analysis Underlying the Research into The Artificial Social Agent Questionnaire (ASAQ) - Development and Evaluation of a Validated Instrument for Capturing Human Interaction Experiences with Artificial Social Agents. 4TU.ResearchData. dataset. https://doi.org/10.4121/4fe035a8-45ff-4ffc-a269-380d09361029
- Study data management plan
- Study ethical commitee checklist
- Study approval from TUDelft Ethical Committee
Study 9: Concurrent Analysis and A Normative Dataset Development
Reported in: https://doi/10.3389/fcomp.2025.1726078.
- Siska Fitrianie, Amal Abdulrahman, Merijn Bruijnes, and Willem-Paul Brinkman (2026). Data and Analysis Underlying the Research into Establishing Reference Points for Artificial Social Agent Evaluation: The ASAQ Representative Set 2025. 4TU.ResearchData. dataset. https://doi.org/10.4121/638738c4-3905-4e71-8364-523c74af7ee8
- Wiki Study 9: Concurrent Analysis and A Normative Dataset Development
- Study data management plan
- Study ethical commitee checklist
- Study approval from TUDElft Ethical Committee
Translation of the ASAQ
Chinese:
Willem-Paul Brinkman, Siska Fitrianie, Fengxiang Li, Merijn Bruijnes, and Amal Abdulrahman (2024). Data and code underlying the paper: Mandarin Chinese translation of the Artificial-Social-Agent questionnaire instrument for evaluating human-agent interaction. 4TU.ResearchData. dataset. https://doi.org/10.4121/12bb2e67-85f0-41c0-bd34-4cca100e4aaf
Dutch and German:
Nele Albers, Andrea Bönsch, Jonathan Ehret, Boleslav A. Khodakov, and Willem-Paul Brinkman (2024). German and Dutch Translations of the Artificial-Social-Agent Questionnaire Instrument for Evaluating Human-Agent Interactions: Final Questionnaires, Data, Analysis Code and Appendix. 4TU.ResearchData. dataset. https://doi.org/10.4121/a1457cc7-424a-4bb1-aeac-1288b5178fbe
