Research in the field of social sciences has been greatly enhanced by digital technologies. From information extraction algorithms to interactive questionnaires, to attention tracking systems these tools allow social scientists to gain insight into the behavior of their research targets. The use of advanced digital tools may oftentimes become a complex process. In an effort to maximize efficiency and achieve a high standard of usability, these tools must undergo a thorough user experience (UX) evaluation process that will ensure their development focuses on the needs of the researchers but can also navigate resource limitations. In this study, we present a UX evaluation process applied at the iMedius FormBuilder, an expert digital tool from the field of social research. This tool is a questionnaire composer that allows use of a wide range of feedback elements including eye-tracking technology and is being developed within the framework of the iMedius research project, which aims at the integration of multidisciplinary media impact assessment instruments. During the UX evaluation process, which consisted of established techniques, input from both experts and stakeholders was collected. Based on this input, conclusions were drawn regarding the importance of functionality and intuitive interaction, the value of attention tracking integration and the necessity of collaborative development. The proposed UX evaluation and the insights it provides can be valuable to social scientists and tool developers alike, leading to an overall upgraded data collection process in the field of social and media research.