Publication

Conference Papers and Journals

• Siska Fitrianie, Amal Abdulrahman, Merijn Bruijnes, and Willem-Paul Brinkman. 2025. Establishing Reference Points for Artificial Social Agent Evaluation: the ASAQ Representative Set 2025. Frontiers in Computer Science. 7:1726078. https://doi/10.3389/fcomp.2025.1726078.
• Siska Fitrianie, Merijn Bruijnes, Amal Abdulrahman, and Willem-Paul Brinkman. 2025. The Artificial Social Agent Questionnaire (ASAQ) - Development and evaluation of a validated instrument for capturing human interaction experiences with artificial social agents. International Journal of Human-Computer Studies (2025), 103482. https://doi.org/10.1016/j.ijhcs.2025.103482
• Nele Albers, Andrea Bönsch, Jonathan Ehret, Boleslav A. Khodakov, and Willem-Paul Brinkman. 2024. German and Dutch Translations of the Artificial-Social-Agent Questionnaire Instrument for Evaluating Human-Agent Interactions. In Proceedings of the 24th ACM International Conference on Intelligent Virtual Agents (IVA '24). Association for Computing Machinery, New York, NY, USA, Article 33, 1–4. https://doi.org/10.1145/3652988.3673928
• Fengxiang Li, Siska Fitrianie, Merijn Bruijnes, Amal Abdulrahman, Fu Guo, and Willem-Paul Brinkman. 2023. Mandarin Chinese translation of the Artificial-Social-Agent questionnaire instrument for evaluating human-agent interaction. Frontiers in Computer Science, Sec. Human-Media Interaction, Volume 5 https://doi.org/10.3389/fcomp.2023.1149305
• Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, Amal Abdulrahman, and Willem-Paul Brinkman. 2022. The artificial-social-agent questionnaire: establishing the long and short questionnaire versions. In Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents (IVA '22). Association for Computing Machinery, New York, NY, USA, Article 18, 1–8. https://doi.org/10.1145/3514197.3549612
• Siska Fitrianie, Merijn Bruijnes, Fengxiang Li, and Willem-Paul Brinkman. 2021. Questionnaire Items for Evaluating Artificial Social Agents - Expert Generated, Content Validated and Reliability Analysed. In Proceedings of the 21th ACM International Conference on Intelligent Virtual Agents (IVA '21). Association for Computing Machinery, New York, NY, USA, 84–86. https://doi.org/10.1145/3472306.3478341 
• Siska Fitrianie, Merijn Bruijnes, Deborah Richards, Andrea Bönsch, and Willem-Paul Brinkman. 2020. The 19 Unifying Questionnaire Constructs of Artificial Social Agents: An IVA Community Analysis. In Proc. of the 20th ACM International Conference on Intelligent Virtual Agents (IVA '20). ACM, New York, NY, USA, Article 21, 1–8. https://doi.org/10.1145/3383652.3423873 and its presentation video - .mp4.
• Siska Fitrianie, Merijn Bruijnes, Deborah Richards, Amal Abdulrahman, and Willem-Paul Brinkman. 2019. What are We Measuring Anyway? - A Literature Survey of Questionnaires Used in Studies Reported in the Intelligent Virtual Agent Conferences. In Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents (IVA '19). Association for Computing Machinery, New York, NY, USA, 159–161. https://doi.org/10.1145/3308532.3329421 and 

Thesis

• Celal Karakoç. 2025. Interaction with Artificial Social Agents: a thematic analysis of people’s experiences. Bachelor Thesis Delft University of Technology. 2025.

Technical Reports

• Siska Fitrianie, Merijn Bruijnes, and Willem-Paul Brinkman. 2022. Technical Report: Study 7 - Construct Validity: Convergent and Discriminant Validity analysis, No.ASAEvalInst-TR#08, Date: 13-July-2022. (.pdf)
• Siska Fitrianie, Merijn Bruijnes, and Willem-Paul Brinkman. 2021. Technical Report: Study 6 - Analyzing Reliability of Questionnaire Items, No.ASAEvalInst-TR#07, Date: 17-June-2021. (.pdf).
• Siska Fitrianie, Merijn Bruijnes, and Willem-Paul Brinkman. 2020. Technical Report: Study 5 - Collecting Prototypical Artificial Social Agents, No.ASAEvalInst-TR#06, Date: 11-December-2020. (.pdf).
• Siska Fitrianie, Merijn Bruijnes, and Willem-Paul Brinkman. 2020.Technical Report: Study 4 - Towards Defining Questionnaire Items: A List of Potential Candidate Questionnaire Items, No. ASAEvalInst-TR#05 v1.01, Date: 03-July-2020. (.pdf)
• Siska Fitrianie, Merijn Bruijnes, and Willem-Paul Brinkman. 2020. Technical Report: Study 3 - Collect Questionnaire Items, No. ASAEvalInst-TR#04, Date: 01-March-2020. (.pdf).
• Siska Fitrianie, Merijn Bruijnes, and Willem-Paul Brinkman. 2020. Technical Report: Study 2 - Define Construct, No. ASAEvalInst-TR#03, Date: 25-January-2020. (.pdf)
• Siska Fitrianie, Merijn Bruijnes, and Willem-Paul Brinkman. 2019. Technical Report: Study 1 - Define Categories, No. ASAEvalInst-TR#02, Date: 15-May-2019. (.pdf)
• Siska Fitrianie, Merijn Bruijnes, and Willem-Paul Brinkman. 2018. Technical Report: Existing Questionnaires - IVA Proceedings 2013-2018, No. ASAEvalInst-TR#01, Date: 21-December-2018. (.pdf)

Presentation Slides, Videos and Posters

• Poster presentation at IVA Conference 2021 (.pdf).
• Video presentation at IVA Conference 2021 (.mp4)
• Video presentation at IVA Conference 2020 (.mp4) and in Youtube channel
• Presentation slides at IVA Conference 2019 (.pptx)
• Presentation slides at Workshop on Methodology and/of Evaluation of IVAs at IVA Conference 2019 (.pptx)