Importance of peer assessment , Citation 2014). They reflect on their own efforts, and extend and enrich this reflection by exchanging feedback on their own and their peers' work. Assessment for learning (AfL) and differentiated instruction (DI) both imply a focus on learning processes and learning needs and affect student learning positively (Corno, Citation 2008; Ruiz-Primo & Furtak, Citation 2006; Tomlinson et al. When students engage in the exchange and explanation of ideas, it helps solidify their understanding of concepts, promotes collaboration, and encourages Oct 1, 2023 · Due to these advantages, peer feedback has been increasingly used as an effective pedagogical tool, and notably it is frequently implemented in web-based formats to reduce teachers' workload and better promote student learning through scaffolds afford by the computerized environment (Double et al. Similarly, in a literature review of peer assessment studies, Topping (1998) also reported positive effects of peer assessment, not only on achievement, but also on students’ attitudes towards learning. Dec 5, 2022 · Developing critical thinking is becoming increasingly important as is giving and receiving feedback during the learning process. , 2017; Yan et al. peer assessment systems (find three examples referenced at the end of this article), man y of them online programs that expedite the collection, tabulation, and distribution of the results. Peer reviews and assessment are often included to get the pupils to a goal (Taras, 2002; Topping, 2003). 2016; Sanchez et al. It empowers you to take an active role in your peers’ learning process. In this article, we will delve into the importance of assessment in education and explore different types of assessments. The main benefits of peer assessment are increasing critical thinking, encouraging learning through giving feedback, and active engagement in the process. Conducting peer assessment online can sign ificantly reduce the logistical burden of Dec 10, 2024 · Develops the capacity for peer and self-assessment. For example, mastery learning approaches combine feedback with additional support for pupils that are falling behind, while approaches like formative assessment also include work to understand specific gaps in learning that need to be addressed and how the teacher wants the pupil to progress. Jun 1, 2022 · Peer assessment (PA) is employed as one fundamental practice of classroom-based assessment in terms of its learning-oriented and formative nature. The Role of Assessment in Feb 23, 2016 · The important feature of peer assessment, however, is that it should assess the process of peer . , 2022). A widely quoted definition of peer assessment refers to an arrangement for learners to consider and specify the level, value or quality of a product or performance of other equal-status learners (O'Donnell and Topping, 1998). Methods: The aim of the current systematic review is to examine the most recent literature (from 2011 to 2022) on these topics, considering the relevant Jun 26, 2022 · Introduction. Students collect information, identify, evaluate, and reflect about their own works based on explicit criteria and standards What is peer assessment in education? Peer assessment, or peer evaluation, is a method of assessing children’s work where students look at a partner’s work and assess it. 4 11 One reason might be that formative peer assessment is often presented as a ‘stand alone’ activity and not Results show that a comparison between the tutor and the student peer mark may be misleading as a guide to the validity of peer assessment, and the importance of considering the individual sections of the marking criteria is illustrated. Our rened denition of peer assessment incorporates what we refer to as design elements of peer assessment or in other words the variables that can describe the potential design characteristics of a peer assessment activity (e. Topping, in International Encyclopedia of Education(Fourth Edition), 2023 Definitions Peer assessment. 's typology explores the diversity of peer assessment in a broader context by extending Topping’s typology classifying 20 variables into five clusters (peer assessment decisions, link between assessment and learning environments, peer May 16, 2019 · Classroom assessment includes both formative assessment, used to adapt instruction and help students to improve, and summative assessment, used to assign grades. , 2020; Li et al. Keywords: peer assessment, evaluation process, assessment tool, credibility of peer review This is a research project that was supported by a grant from the Research Center for the Humanities, Deanship of Scientific Research at King Saud University. Slavin (1997) refers to peer-assessment as one of the best and perfect success in educational history. Classroom assessment has shifted from being a tool to record student achievement to an activity to support learning. However, in addition to establishing comparability between teacher and peer assessment scores, it is important to determine whether peer assessment also has a positive effect on future academic performance. A body of research has emerged by looking at how such a paradigm can best serve the learning process (Turner, 2012; Turner and Purpura, 2016). May 29, 2017 · The current study will emphasize the importance of using peer assessment as a tool to engage students in the evaluation process, clarify the role of peer assessment in promoting student learning Dec 6, 2023 · Assessment serves multiple purposes, such as understanding the effectiveness of instruction, determining individual strengths and weaknesses, and ensuring that educational objectives are met. It helps students develop lifelong skills and assess and provide feedback to others, and also equips them with skills to self- assess and improve Apr 30, 2018 · The importance of peer assessment & self-assessment in PBL applied to an administration course. Self- Many studies of feedback also include other practices. Why use peer assessment? Peer assessment can: Empower students to take responsibility for and manage their own learning. peers to each other, as well as between peer assessment and teacher assessment. Initially, only a Self- and peer assessment and peer-to-peer discourse were used to enhance student reflection. In doing so, it presents an opportunity to explore the issues arising in respect of assessment practice and sets out a proposed approach by which the Curriculum and Assessment Board (CAB) can consider these matters in more detail and agree their Aug 22, 2016 · Most proponents of self- and peer-assessments emphasize the importance of providing students with assessment criteria–-or guiding them as a group to establish their own criteria–-early in the learning process, and building one or more points of formative assessment into the learning process before the criteria are employed for grading Increasingly, peer assessment has been performed on line due in part to the growth in online learning activities as well as the ease by which peer assessment can be implemented online (van Popta et al. Feb 5, 2022 · Introduction. Keywords: individual skills; interactive peer assessment strategy; peer tutoring; practical performance; teamwork skills Introduction Traditional assessment/assessment is a concept that many students may consider to be a baseless evaluation process undertaken by their teachers. The primary objective is to explicitly implement peer assessment as a scaffolding tool to enhance students' inquiry output TEACHING PEER ASSESSMENT General points for peer assessment • academics should explicitly discuss with, and inform, students about peer assessment expectations and objectives • academics should explicitly encourage students, and provide them with the tools to give their peers positive and constructive feedback that is productive and Mar 9, 2021 · Assessment feedback is heralded as an integral facilitator of teaching and learning. It provides strategies for teachers to develop students' skills in assessing their own and peers' work, including having students set assessment criteria and giving feedback. Oct 2, 2001 · With the implementation of clinical governance and professional self-regulation, substantial responsibility is devolved on to clinical nurses. Keith J. Assessment plays a crucial role in education and has importance in teaching and learning. Peer assessment can prevent group process problems. For example, if a Peer assessment, by and large, How peer assessment impacts professors and students. To be specific, the following strategies should be considered (Almahasneh & Abdul The Importance of Peer Assessment According to Cornell University , peer assessment provides a structured learning process for students to critique and provide feedback to each other on their work. Through Peer-assessment the pupils ' role has changed from being a ‘passive recipient’ of knowledge to an ‘active learner ' who will take personal responsibility for their own learning '(P. Jun 21, 2023 · Analysis of the literature reveals a dearth of focused frameworks specifically addressing peer assessment challenges in CTW context. In formative peer-assessment, needs of the learners are of great importance while in summative peer-assessment results are important. ” (Wiliam, 2006, p. Over the past decade, innovative contributions have been made via international initiatives, like the Organisation for Economic Co-operation and Development’s Assessment of Higher Education Learning Outcomes; national initiatives, like the Valid Assessment self and peer-assessment, simulation, collaborative assessment) as an effective way to assess student learning outcomes (Dawson, 2017; Maki, 2017; Sadler, 2017; Yorke, 2003). For students to make a review, they need to be self-reflective and develop critical-thinking and problem-solving skills. For instance, Sargeant (2008) noted that all seven authors in a special issue of the Journal of Continuing Education in the Health Professions “conceptualize self-assessment within a formative, educational perspective, and see it as an activity that draws upon both external and internal Mar 9, 2021 · Assessment feedback is heralded as an integral facilitator of teaching and learning. Grouping students to work together and peer-assess each other ’ s contributions Jan 25, 2024 · Background Computer-supported collaborative inquiry learning (CSCiL) has been proposed as a successful learning method to foster scientific literacy. 97). We are accountable for our professional competence and knowledge to various parties such as the … Aug 1, 2010 · The selected literature had to meet the following criteria: (a) be published between 1990 and 2007; (b) be published in a journal; (c) the journal be listed in the Education and Educational Research domain of the Social Sciences Citation Index; (d) be an empirical study, and (e) the main topic be PA between students in an educational setting (related search terms for the abstracts included Dec 11, 2020 · The assessment of professionalism and students’ professional behaviour has become an increasingly important part of the medical school curriculum with peer assessment emerging as a possible, alternative method for providing formative peer feedback to students regarding their professional behaviour [1,2,3,4]. The articles collected in this special issue constitute a representative kaleidoscope of current research on peer assessment. • The emphasis on feedback as a quality assurance mechanism (Evans, 2013; Sadler, 2017; In this, peer and self assessment can approach it as a whole, learning to accept new ideas, feedback and criticism from our peers, as well as the importance of an honest self assessment could help various terms, including peer assessment, peer f eedback, peer evaluation, and peer grading. Esp. The practice of peer assessment may be defined as “an arrangement in which individuals consider the amount, level, value, worth, quality, or success of the products or outcomes of learning of peers of similar status” (Topping Citation 1998, 250). This process isn’t just about identifying mistakes but also about commending good work and suggesting improvements. In this article, we adopt the term peer assessment, as it more generally refers to the method of peers assessing or being assessed by each other, wherea s the term feedback is used when we refer to the Peer assessment is the evaluation of students' work by other students of equal status. Moreover, within these practices peer assessment is disconnected from the instruc- May 24, 2023 · The ability to work collaboratively in digitally connected ways has never been more important and is closely linked with the capabilities required for successful peer and collaborative assessment. Mar 1, 2022 · Peer and teacher assessments have become the crucial dimensions in AaL and AfL (Nicol & Macfarlane-Dick, 2006; Popham, 2011; Wiliam, 2011). Formative assessment is usually performed through self, peer, and teacher assessment. It provides valuable information about students’ progress, identifies areas of improvement, and helps enhance the teaching and learning process. Then a theoretical model outlines some of the processes which may occur during PA. collaboration and not simply the product. , 2019). A clear success criteria needs to be established for peer assessment to work so the child reviewing it can understand if it meets the criteria. The focus of the narrative An important aspect of peer assessment and feedback practices is the link of these activities to Vygotsky’s (1978) social development theory, which emphasizes the vital role of social interaction in learning (Lundstorm & Baker, 2009; Topping, 2021). Black, 2003, p. Formative assessment is a key professional skill. Peer assessment is a valuable tool because feedback from peers can be delivered with more immediacy and in greater volume than teacher feedback. Sometimes, the information in the research paper may already be outdated before it is cleared for publication. Jan 30, 2019 · The application of peer assessment to improve writing skills would be enhanced if teachers are better prepared. This arrangement sometimes refers to making assessment for one’s fellow classmates, and sometimes to Jan 1, 2014 · Specific arrangements of peer assessment might have considerable and differential effects on the provision of assessment information. Dec 10, 2019 · Peer assessments tend to be highly correlated with teacher assessments of the same students (Falchikov and Goldfinch 2000; Li et al. Despite the acknowledgement of its crucial role in education, there are inconsistencies in its powerful impact Feb 25, 2021 · The present paper offers a definition of peer assessment and then reviews the major syntheses on its effectiveness. This research looked at correlations and/or differences between Apr 19, 2020 · Introduction. Sep 23, 2023 · Importance of Assessment. To give an overview of the different peer-assessment arrangements I have mapped them against the respective stages in the assessment process to show where the students can engage. Introduction One type of peer-assessment, known as formative assessment, provides feedback and aims at filling the gap between ‘current and desired performance’ (Sadler 1989). What is self and peer assessment? Self-assessment enables students to take ownership of their learning by judging the extent of their knowledge and understanding. This research aims to bridge the knowledge gap surrounding the role of peers as scaffolding sources in CSCiL environments. In the study, it was stated that peer assessment is a good predictor of self -assessment. In some instances, the practice of peer feedback will include the assigning of a grade, Peer assessment, or peer learning, is the process by which students learn from and with each other. investigated the effect of peer assessment training on self -assessment. Peer- and self-assessment data can be used in calculating final grades. 9 “The research shows that the person providing the feedback benefits just as much as the recipient, because they are forced to internalize the learning intentions and success criteria in the context of someone else’s work, which is less emotionally charged than one’s own work. 21). , Citation 2003; Black & Wiliam, Citation 1998; Yin et al. However, it is still unknown if there are more commonly used peer assessment formats and design elements that could be considered when designing peer assessment activities in educational contexts. It provides a structure for them to reflect on their work, what they have learned and how to improve. Pairs of Jun 1, 2020 · The results suggest that peer assessment improves academic performance compared with no assessment (g = 0. A typology of 44 elements explains the differences between the many types of peer assessment. Use the assessment results effectively: Use the results of the assessment to provide feedback, set goals and expectations, and create development plans. Jul 24, 2012 · The document discusses the importance of self and peer assessment in the New Zealand education system. The importance of peer assessment highlighted in different educational learning and educational research. 2017). Similar reviews have been conducted about self- Sep 12, 2021 · The documented effects of peer assessment. Despite the acknowledgement of its crucial role in education, there are inconsistencies in its powerful impact in teaching and learning: the role of the categories of feedback, the role of providers of feedback, constituents of effective feedback, and barriers to effective feedback. Nov 25, 2024 · Accurately measuring collaborative problem-solving capability (CPSC) is not only important in itself, but also in order to develop education and training programs. A sample of 16 peer pairs was randomly selected from the population of 108 fourth-year students who participated in the 2014 Clinical Dental Ethics OSCE. This paper aims to briefly outline approaches to assessment in the curriculum from ages 3-18. THE IMPORTANCE OF PEER ASSESSMENT & SELF ASSESSMENT IN PBL APPLIED TO AN ADMINISTRATION COURSE. Importance of Peer Assessment Assessment for Learning – Curriculum Corporation Assessment matters: Self-assessment and peer assessment – The University of Waikato Leahy, S & Wiliam, D, 2015, Embedding Formative Assessment: practical techniques for K-12 classrooms, Hawker Brownlow Education Peer feedback involves students giving and receiving information about performance or Jul 28, 2006 · The results show that a comparison between the tutor and the student peer mark may be misleading as a guide to the validity of peer assessment. 31, p = . Peer- assessment as one of these alternative assessments seeks a new way for authentic assessment and is considered to be effective. These approaches can help students develop critical thinking, communication, and collaboration skills, as well as metacognitive skills and self-awareness. Enhance students' learning through knowledge diffusion and exchange of ideas. J. It suggests a reciprocal learning process, and it should be mutually beneficial to students. Since it is carried out by individuals who have similar competencies, it is one of the best ways to gather first-hand feedback that highlights the strengths and weaknesses of an individual. Dec 7, 2022 · assessment and peer assessment activities. First, it shows the effectiveness of peer assessment in developing critical thinking competence in tourism management education, which provides new empirical evidence, validating the social constructivist theory. Jun 24, 2015 · Importance of peer-assessment is also reported in previous studies. This case study investigates secondary students Peer assessment practices e as reviewed in Falchikov and Goldﬁnch (2000) e have hardly evolved beyond a summa-tive and quantitative view of peer assessment with a strong reliance on scoring and grading. As the assessment process affects both teachers and students, significance and consideration should be given to assessment procedures in foreign language teaching. These two forms of assessment must be coherently linked through a well-articulated model of learning. Peer and self-assessment are important tools for developing lifelong learners. However, the main part of this paper is preoccupied with how to do PA successfully. For example, Butler and Hodge (2001) studing the effects of peer assessment in high school physical education, found that peer assessment had practical applications and value for students. Explicitly teaching students how to assess their own work, and the work of their peers, has many benefits. anonymity). This systematic review aims to determine Feb 1, 2021 · Parker and Hill [1] reviewed evaluation of NP's performance in the United States and stated that peer assessment is gaining interest as the evaluation method, Kenny et al. The importance of Peer and Self Assessment Nov 25, 2020 · Peer assessment is a common method of evaluation used in the classroom, workplace, and research. , Citation 2021); and Peer assessment. The aim of this work is to study how technology can scaffold peer assessment activities to develop critical thinking among pre-service teachers and study the relevance of giving and receiving feedback. The study shows that using peer assessment promotes learning and enables a teacher to focus on helping students with more significant difficulties or advanced tasks (Double et al. described the value of peer-assessment. As stated in the famous pamphlet Assessment, Evaluation and Accountability. , Citation 2018b; Yucel et al. It is essential for demonstrating the effectiveness of collaborative learning outcomes in preparing students for professional practice. attitude changes due to peer assessment. But, what are the specific advantages that peer evaluation brings to the table in a Team-Based Learning context? We outline the 5 most important benefits in this post. Regardless of its well-established ability to develop self-reflection, resourcefulness and gains not seen with external evaluation (Pintrich 1995; Pintrich and Zusho 2007; Dow et al. Enable students to learn to assess and give others constructive feedback to develop lifelong assessment skills. 3 Papinczak et al (2007) found that students who were committed to providing valid and helpful feedback to their peers were more accurate peer assessors themselves. Data were collected from self- and peer assessment forms. However, most existing CPSC measurement tools have two weaknesses: not accounting for individual’s contribution to the final outcome and relying on predefined problems. This study investigates the impact of peer assessment on students’ engagement in their learning in a group work context. [23] also stated that peer assessment is the most effective method for evaluating professionalism of NPs and is important for providing feedback and fostering professional Peer assessment is an important component of a more participatory culture of learning. 1, pp. , Citation 2014); align peer assessment processes with collaborative learning practices (Stenberg et al. How to do peer assessment: Nov 1, 2013 · The focus of this chapter is on the use of peer assessment (PA) in rating oral and written language skills. In this commentary, we argue that research on peer assessment is currently in a stage of adolescence, grappling with the developmental tasks of identity formation and affiliation Jun 13, 2017 · This Special Topic of AERA Open was produced to advance the growing field of research into the assessment of student learning outcomes. 451-467, 2018 Perhaps the biggest strength is that peer assessment correlates well with future clinical and academic performance. 1. Research indicates that peer assessment has become an important alternative to or complementary source of the teacher assessment in the ESL/EFL classrooms (Diab, 2010; Yeh et al. 2004). Assessment for learning strategy such as self-assessment and peer assessment allows students’ active involvement in assessment (Black et al. Addressing these limitations, we extended criteria of the Nov 1, 2024 · This study offers important insights into the literature on critical thinking development. The results of their study emphasized the importance of both feedback in peer assessment and in developing trust Feb 5, 2022 · important because peer assessment happens ‘ throughout our lives ’ (Topping, 2009, p. 007), but was not significantly Aug 3, 2023 · • It is an important process for data validation in research. It promotes student understanding of their learning, and provides opportunities for critical analysis of their own efforts encouraging them to become more autonomous learners. 4 Nevertheless, surprisingly, few studies highlight the collaborative part of peer assessment. Peer evaluation is an integral part of Team-Based Learning that leads to an environment wherein students not only help each other improve but also deeply reflect on their own work. , 2016, 2020; Sanchez et al. The chapter commences with an overview of PA, outlining the various theoretical stances 1. Revista Ibero-Americana de Estudos em Educação, vol. Dec 2, 2023 · Peer assessment helps develop interpersonal skills that are essential in academic and professional environments. April 2018; Revista Ibero-Americana de Estudos em Educação 13(esp1):451-467; A growing body of research has recognized the importance of students’ having active roles in feedback processes. 004) and teacher assessment (g = 0. When students are tasked with evaluating their peers, they must communicate feedback effectively and respectfully. In this webinar, we will examine how to implement peer assessment for PBL by: Apr 6, 2022 · Peer review and self-review were introduced in an information literacy course. 5). A series of practice and application activities were introduced 2. This coincides with earlier research emphasising the social factors of peer assessment and the importance for teachers to consider them. It is also important to communicate the results to employees in a supportive and constructive manner. Feedback literacy refers to students’ understandings of and participation in feedback processes, and research on students’ feedback literacy has so far focused on higher education; secondary schools have not received attention. Topping (1998) concluded that peer assessment practices varied widely and Oct 2, 2024 · To build student engagement in peer assessment, educators can clearly specify upfront the aims and benefits of peer assessment and how it aligns with intended learning outcomes (Adachi et al. The importance of considering the individual sections of the marking criteria is illustrated. Children should be able to engage in self-reflection and peer feedback and be able to identify the next steps in their or their peer’s learning. Importance of Peer-assessment Peer assessment is considered to be one of the main forms of alternative assessment. A thoughtfully designed peer and collaborative assessment process Nov 14, 2024 · Background The assessment of team performance within large-scale Interprofessional Learning (IPL) initiatives is an important but underexplored area. 13, núm. ASSESSMENT MATTERS: SELF ASSESSMENT & PEER ASSESSMENT • TDU Peer assessment What is peer assessment? There are many variants of peer assessment, but essentially it involves students providing feedback to other students on the quality of their work. Moussaoui (2012) stated that peer assessment contributes to the development of critical thinking skills, while Ping (2013) Aug 26, 2019 · Fortunately, a formative view of self-assessment seems to be taking hold in various educational contexts. From an analysis of 4 years of data from undergraduate classes in project management, it develops a model of causal relationships validated using the PLS-SEM method assessment evaluates ongoing learning and aids in self-regulation (Maki, 2002). Peer assessment is considered to be one of the main forms of alternative assessment. Peer assessment requires students to evaluate and grade the work of their colleagues, and whilst there can be advantages to this (for example, learning to apply criteria and judgement to a piece of work) there are also many potential negative effects on student grades, confidence and self-esteem, and psychological stresses in . Oct 5, 2020 · Peer and self-assessment are important components of assessment for learning (Assessment Reform Group 1999; Black et al. g. The main value of these aforementioned principles is to distinguish the effects of assessment and review any classroom based issues between the teacher and the student. By participating in peer assessment, educators are encouraged to critically evaluate their own teaching practices and those of their colleagues, promoting a Jan 14, 2020 · How can students’ competence be developed through peer assessment? This paper focuses on how relevant variables such as participation, evaluative judgement and the quality of the assessment interact and influence peer assessment. For example, Gielen et al. Although there are some unrecognized aspects, peer-assessment is considered to be effective (Shepard 2000 and Topping 1998). Using Kane’s validity framework, we investigated whether peer assessment of student-produced videos The primary aim of Peer Assessment in Micro Teaching: This assessment method was designed to assess and improve teaching skills, pedagogical approaches, and classroom management strategies. Teachers need to support students through developing their skills of self-assessment. 20 Lurie et al (2007) reported that peer assessment of work Peer- and self-assessment has shown that group members will be more likely to be personally accountable for their share of the work load knowing that their peers will be assessing one another. Cons of Peer Journal/Article Assessment • Peer journal assessment can be time-consuming. Peer- and self-assessment promotes self-reflection. Student engagement is a key performance indicator for many higher education metrics which affect their rating, funding, impact and esteem position in an increasingly competitive higher education sector. 2012), peer assessment is still viewed with some skepticism by many faculty, who remain reticent to put it into practice. , 2003). Find out how to train and guide students to give and use task-involving feedback, and how to promote exploratory talk during peer assessment. Oct 26, 2021 · What importance do self-assessment and peer assessment have in mastering skills? Peer and self-assessment, where students assess each other and themselves, can encourage . Peer assessment involves students giving feedback on each other’s work, enabling a collaborative learning environment. Abstract This paper reports a study which implemented and evaluated a method of peer assessment, as a formative and summative assessment procedure. Peer assessment should happen during the learning process – on works in progress, and be followed by opportunities for learners to use the feedback they received to revise their work. response, this review will firstly reflect on the importance and impact of peer and self assessment on children’s attainment and then consider both current practice and available research before bringing together ideas to arrive at some conclusions on effective peer and self assessment. Peer Assessment Activity 5. Here’s a list of the benefits of making peer assessment part of group learning experiences. Feb 9, 2023 · The growing number of peer assessment studies in the last decades created diverse design options for researchers and teachers to implement peer assessment. Students often undertake peer assessment in conjunction with formal self-assessment. According to Nicol and Macfarlane-Dick (2006), in higher education, the main purpose of formative assessment is to enhance the self-regulatory skills of learners. 28, p = . Implementing Peer Assessment in Project-Based Learning In peer assessment for PBL, students give feedback to each other throughout the project, which can enhance the quality of projects while also developing students’ evaluation, social, and communication skills. learning and academic performance (Andrade, 2010). Sep 12, 2018 · Learn how to use peer assessment to improve students' understanding, engagement and interpersonal skills in the classroom. Central to these two concepts is accountability for practice. Due to recent criticism in the pedagogical field, traditional means of Feb 9, 2023 · Let them know the assessment is an opportunity to improve and grow in their role. , 2017; van Popta et al. whu adaxl vgzrynf ralwqj dxg kcs pkkglbccn iyijrb pfgzmjnm ofqnru

Importance of peer assessment. Addressing these limitations, we extended criteria of the .