<?xml version='1.0' encoding='utf-8'?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<article article-type="research-article" dtd-version="1.2" xml:lang="ru" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><front><journal-meta><journal-id journal-id-type="issn">2313-8971</journal-id><journal-title-group><journal-title>Научный результат. Педагогика и психология образования</journal-title></journal-title-group><issn pub-type="epub">2313-8971</issn></journal-meta><article-meta><article-id pub-id-type="doi">10.18413/2313-8971-2026-12-1-0-4</article-id><article-id pub-id-type="publisher-id">4070</article-id><article-categories><subj-group subj-group-type="heading"><subject>ПЕДАГОГИКА</subject></subj-group></article-categories><title-group><article-title>&lt;strong&gt;What counts as academic rigour? Epistemic politics&amp;nbsp;in MA dissertation assessment in an Algerian EFL department&lt;/strong&gt;</article-title><trans-title-group xml:lang="en"><trans-title>&lt;strong&gt;What counts as academic rigour? Epistemic politics in MA dissertation assessment in an Algerian EFL department&lt;/strong&gt;</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author"><name-alternatives><name xml:lang="ru"><surname>Tobbi</surname><given-names>Saida</given-names></name><name xml:lang="en"><surname>Tobbi</surname><given-names>Saida</given-names></name></name-alternatives><email>s.tobbi@univ-batna2.dz</email><xref ref-type="aff" rid="aff1" /></contrib></contrib-group><aff id="aff1"><institution>Batna 2 University</institution></aff><pub-date pub-type="epub"><year>2026</year></pub-date><volume>12</volume><issue>1</issue><fpage>0</fpage><lpage>0</lpage><self-uri content-type="pdf" xlink:href="/media/pedagogy/2026/1/Тобби.pdf" /><abstract xml:lang="ru"><p>Introduction. Academic rigour is central to graduate assessment but how written rubrics actually translate into examiners&amp;rsquo; judgements remains under-theorized. Objective. This paper investigates how standards of academic rigour are both articulated in written policy and enacted in practice when assessing Master of Arts dissertations. Materials and Methods. Drawing on a qualitative, multi-methods study conducted at the English Department, University of Batna 2, this research project employs a purposeful corpus comprising 120 Master&amp;#39;s dissertations that were submitted between 1 May 2023 and 30 June 2025. Additionally, it incorporates the examiners&amp;#39; reports and semi-structured interviews with 12 supervisors and 13 examiners. A stratified sub-sample of 36 dissertations was analysed in depth. Data were examined through document analysis, thematic coding and cross-source triangulation to map written criteria against evaluative practice. Results. The results show that, although official rubrics supply clear procedural criteria, evaluators frequently rely on tacit interpretive standards so that policy and practice align only partially. Three interrelated mechanisms explain this divergence: methodological legibility (how clearly methodological choices make a thesis readable and defensible), supervisory socialisation (the informal norms supervisors transmit), and internal board composition (the mix of examiners&amp;rsquo; expertise and expectations). Conclusion. We argue that improving fairness and consistency requires calibrated rubrics augmented with annotated exemplars, routine examiner-calibration workshops, and targeted supervisor development to increase analytic transparency. The study&amp;rsquo;s significance lies in offering an empirically grounded account of the policy &amp;ndash; practice gap, providing concrete interventions for institutional assessment and quality-assurance, and setting an agenda for comparative and experimental research to evaluate the effectiveness of the proposed measures.</p></abstract><trans-abstract xml:lang="en"><p>Introduction. Academic rigour is central to graduate assessment but how written rubrics actually translate into examiners&amp;rsquo; judgements remains under-theorized. Objective. This paper investigates how standards of academic rigour are both articulated in written policy and enacted in practice when assessing Master of Arts dissertations. Materials and Methods. Drawing on a qualitative, multi-methods study conducted at the English Department, University of Batna 2, this research project employs a purposeful corpus comprising 120 Master&amp;#39;s dissertations that were submitted between 1 May 2023 and 30 June 2025. Additionally, it incorporates the examiners&amp;#39; reports and semi-structured interviews with 12 supervisors and 13 examiners. A stratified sub-sample of 36 dissertations was analysed in depth. Data were examined through document analysis, thematic coding and cross-source triangulation to map written criteria against evaluative practice. Results. The results show that, although official rubrics supply clear procedural criteria, evaluators frequently rely on tacit interpretive standards so that policy and practice align only partially. Three interrelated mechanisms explain this divergence: methodological legibility (how clearly methodological choices make a thesis readable and defensible), supervisory socialisation (the informal norms supervisors transmit), and internal board composition (the mix of examiners&amp;rsquo; expertise and expectations). Conclusion. We argue that improving fairness and consistency requires calibrated rubrics augmented with annotated exemplars, routine examiner-calibration workshops, and targeted supervisor development to increase analytic transparency. The study&amp;rsquo;s significance lies in offering an empirically grounded account of the policy &amp;ndash; practice gap, providing concrete interventions for institutional assessment and quality-assurance, and setting an agenda for comparative and experimental research to evaluate the effectiveness of the proposed measures.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>academic rigour</kwd><kwd>dissertation assessment</kwd><kwd>higher education evaluation</kwd><kwd>examiner guidelines</kwd><kwd>rubric calibration</kwd></kwd-group><kwd-group xml:lang="en"><kwd>academic rigour</kwd><kwd>dissertation assessment</kwd><kwd>higher education evaluation</kwd><kwd>examiner guidelines</kwd><kwd>rubric calibration</kwd></kwd-group></article-meta></front><back><ref-list><title>Список литературы</title><ref id="B1"><mixed-citation>Bastola, N. and Hu, G. (2020), &amp;ldquo;Supervisory feedback across disciplines: Does it meet students&amp;rsquo; expectations?&amp;rdquo;, Assessment &amp;amp; Evaluation in Higher Education, 46, 407-423. https: // doi.org/10.1080/02602938.2020.1780562. (In UK).</mixed-citation></ref><ref id="B2"><mixed-citation>Belcher, B., Rasmussen, K., Kemshaw, M. and Zornes, D. (2016), &amp;ldquo;Defining and assessing research quality in a transdisciplinary context&amp;rdquo;, Research Evaluation, 25(1), 1-17. https: // doi.org/10.1093/reseval/rvv0. 25. (In UK).</mixed-citation></ref><ref id="B3"><mixed-citation>Benbouabdallah, H. and Benmekhlouf, I. (2023), &amp;ldquo;Teachers&amp;rsquo; opinions regarding the main standards for evaluating a master thesis: The case of EFL teachers at the Department of English, Batna 2 University&amp;rdquo;, Unpublished Master&amp;rsquo;s dissertation, University of Batna 2, Batna, Algeria.</mixed-citation></ref><ref id="B4"><mixed-citation>Bourdieu, P. (1988), Homo academicus, Stanford University Press, Stanford, United States.</mixed-citation></ref><ref id="B5"><mixed-citation>Bourke, S. and Holbrook, A. (2013), &amp;ldquo;Examining PhD and research masters theses&amp;rdquo;, Assessment &amp;amp; Evaluation in Higher Education, 38(4), 407-416. https: // doi.org/10.1080/02602938.2011.638738. (In UK).</mixed-citation></ref><ref id="B6"><mixed-citation>Bukhari, N., Jamal, J., Ismail, A. and Shamsuddin, J. (2021), &amp;ldquo;Assessment rubric for research report writing: A tool for supervision&amp;rdquo;, Malaysian Journal of Learning and Instruction, 18(2), 1-43. https: // doi.org/10.32890/mjli2021.18.2.1. (In Malaysia).</mixed-citation></ref><ref id="B7"><mixed-citation>Chugh, R., Macht, S. and Harreveld, B. (2021), &amp;ldquo;Supervisory feedback to postgraduate research students: A literature review&amp;rdquo;, Assessment &amp;amp; Evaluation in Higher Education, 47(5), 683-697. https://doi.org/10.1080/02602938.2021.1955241. (In UK).</mixed-citation></ref><ref id="B8"><mixed-citation>Braun, V. and Clarke, V. (2006), &amp;ldquo;Using thematic analysis in psychology&amp;rdquo;, Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa. (In UK).</mixed-citation></ref><ref id="B9"><mixed-citation>Crowe, M., Slater, P. and McKenna, H. (2024), &amp;ldquo;Demonstrating research quality&amp;rdquo;, Journal of Psychiatric and Mental Health Nursing, 32(3), 686-688. https://doi.org/10.1111/jpm.13145. (In UK).</mixed-citation></ref><ref id="B10"><mixed-citation>Goodman, P., Robert, R. and Johnson, J. (2020), &amp;ldquo;Rigor in PhD dissertation research&amp;rdquo;, Nursing Forum, 55(4). https://doi.org/10.1111/nuf.12477. (In UK/In USA)</mixed-citation></ref><ref id="B11"><mixed-citation>Holbrook, A., Bourke, S., Lovat, T. and Dally, K. (2004), &amp;ldquo;Investigating PhD thesis examination reports&amp;rdquo;, International Journal of Educational Research, 41, 98-120. https://doi.org/10.1016/j.ijer.2005.04.008. (In Netherlands).</mixed-citation></ref><ref id="B12"><mixed-citation>Knorr-Cetina, K. (1999), Epistemic cultures: How the sciences make knowledge, Harvard University Press, Cambridge, United States.</mixed-citation></ref><ref id="B13"><mixed-citation>Kumar, V. and Stracke, E. (2011), &amp;ldquo;Examiners&amp;rsquo; reports on theses: Feedback or assessment?&amp;rdquo;, Journal of English for Academic Purposes, 10, 211-222. https://doi.org/10.1016/j.jeap.2011.06.001. (In UK).</mixed-citation></ref><ref id="B14"><mixed-citation>Lee, A. (2018), &amp;ldquo;How can we develop supervisors for the modern doctorate?&amp;rdquo;, Studies in Higher Education, 43, 878-890. https://doi.org/10.1080/03075079.2018.1438116. (In UK).</mixed-citation></ref><ref id="B15"><mixed-citation>Mafora, P. and Lessing, A. (2016), &amp;ldquo;The voice of the external examiner: Experiences from South African higher education&amp;rdquo;, South African Journal of Higher Education, 28, 1295-1314. https://doi.org/10.20853/28-4-389. (In South Africa).</mixed-citation></ref><ref id="B16"><mixed-citation>Man, D., Xu, Y., Chau, M., O&amp;rsquo;Toole, J. and Shunmugam, K. (2020), &amp;ldquo;Assessment feedback in examiner reports on master&amp;rsquo;s dissertations in translation studies&amp;rdquo;, Studies in Educational Evaluation, 64, 100823. https://doi.org/10.1016/j.stueduc.2019.100823. (In UK/In Netherlands).</mixed-citation></ref><ref id="B17"><mixed-citation>Morse, J.M. (2015), &amp;ldquo;Critical analysis of strategies for determining rigor in qualitative inquiry&amp;rdquo;, Qualitative Health Research, 25, 1212-1222. https://doi.org/10.1177/1049732315588501. (In USA).</mixed-citation></ref><ref id="B18"><mixed-citation>Mullins, G. and Kiley, M. (2002), &amp;ldquo;&amp;lsquo;It&amp;rsquo;s a PhD, not a Nobel Prize&amp;rsquo;: How experienced examiners assess research theses&amp;rdquo;, Studies in Higher Education, 27(3), 369-386. https: // doi.org/10.1080/0307507022000011507. (In UK).</mixed-citation></ref><ref id="B19"><mixed-citation>Othman, J. and Lo, Y. (2023), &amp;ldquo;Constructing academic identity through critical argumentation: A narrative inquiry of Chinese EFL doctoral students&amp;rsquo; experiences&amp;rdquo;, SAGE Open, 13. https://doi.org/10.1177/21582440231218811. (In USA).</mixed-citation></ref><ref id="B20"><mixed-citation>Phuong, H., Phan, Q. and Le, T. (2023), &amp;ldquo;The effects of using analytical rubrics in peer and self-assessment on EFL students&amp;rsquo; writing proficiency: A Vietnamese contextual study&amp;rdquo;, Language Testing in Asia, 13. https://doi.org/10.1186/s40468-023-00256-y. (In UK).</mixed-citation></ref><ref id="B21"><mixed-citation>Reddy, Y.M. and Andrade, H. (2010), &amp;ldquo;A review of rubric use in higher education&amp;rdquo;, Assessment &amp;amp; Evaluation in Higher Education, 35(4), 435-448. https: // doi.org/10.1080/02602930902862859. (In UK).</mixed-citation></ref><ref id="B22"><mixed-citation>Sadler, D.R. (2009), &amp;ldquo;Indeterminacy in the use of preset criteria for assessment and grading&amp;rdquo;, Assessment &amp;amp; Evaluation in Higher Education, 34(2), 159-179. https: // doi.org/10.1080/02602930801956059. (In UK).</mixed-citation></ref><ref id="B23"><mixed-citation>Stigmar, M. (2018), &amp;ldquo;Learning from reasons given for rejected doctorates: Drawing on some Swedish cases from 1984 to 2017&amp;rdquo;, Higher Education, 77, 1031-1045. United Kingdom. https://doi.org/10.1007/s10734-018-0318-2. (In UK).</mixed-citation></ref><ref id="B24"><mixed-citation>Tiwari, H. (2024), &amp;ldquo;Behind the curtain: External Examiners&amp;rsquo; Experiences about Thesis Evaluation&amp;rdquo;, Shanti Journal, 4(1). https://doi.org/10.3126/shantij.v4i1.70529. (In Nepal).</mixed-citation></ref><ref id="B25"><mixed-citation>Varela, M., Lopes, P. and Rodrigues, R. (2021), &amp;ldquo;Rigour in the management case study method: A study on master&amp;rsquo;s dissertations&amp;rdquo;, The Electronic Journal of Business Research Methods, 19, 1-13. (In UK).</mixed-citation></ref><ref id="B26"><mixed-citation>Vita, G. and Begley, J. (2023), &amp;ldquo;A framework of &amp;lsquo;doctorateness&amp;rsquo; for the social sciences and postgraduate researchers&amp;rsquo; perceptions of key attributes of an excellent PhD thesis&amp;rdquo;, Studies in Higher Education, 49, 1884-1899. https://doi.org/10.1080/03075079.2023.2281540. (In UK).</mixed-citation></ref><ref id="B27"><mixed-citation>Yadav, D. (2021), &amp;ldquo;Criteria for good qualitative research: A comprehensive review&amp;rdquo;, The Asia-Pacific Education Researcher, 31, 679-689. https://doi.org/10.1007/s40299-021-00619-0. (In Singapore/In Philippines).</mixed-citation></ref></ref-list></back></article>