Desenvolvimento de um Instrumento para Avaliação da Qualidade da Orientação na Pós-graduação (QQOPG)

Abstract

The quality of academic advising in graduate education is a crucial factor for students' development and the successful completion of their programs. However, the literature lacks validated instruments that comprehensively assess this dimension. This dissertation, comprising five studies, aimed to develop and gather validity evidence based on content and internal structure for a questionnaire to fill this gap. The first stage of this study involved the construction of the instrument and followed four phases: (1) a narrative literature review to define the assessed constructs; (2) item generation with the aid of artificial intelligence; (3) a focus group with the target population to assess item clarity and adequacy; and (4) content validation by experts. After these stages, the questionnaire, initially comprising 99 items, was empirically tested with a sample of 711 graduate students from across the country using a Balanced Incomplete Block Design. The data were analyzed through Exploratory Factor Analysis and Item Response Theory. The psychometric analyses resulted in a unidimensional structure with 54 items, excellent internal consistency (α = 0.98; ώt = 0.98; empirical reliability = 0.94), and good model fit (AIC = 43,647.8; BIC = 44,880.8). The highest-rated advisors (i.e., those with higher scores) are accessible, communicate clearly, provide support in bureaucratic aspects of graduate studies, encourage autonomy, offer technical and methodological support, contribute to students' professional development, and foster their self-confidence.