Three Paradigms of Assessment: Measurement, Procedure, & Inquiry
Dr. Frank Serafini
Published in The Reading Teacher 2001
Different assessment frameworks have different intended audiences, are used for different purposes and utilize different procedures to collect information (Farr,1992). However, the various procedures, intended audiences and purposes are not the only differences in these assessment frameworks. Each of these assessments may also involve different beliefs about the nature of knowledge, the level of teacher and student involvement, the criteria for evaluating student achievement and the effects of these assessment frameworks on classroom instruction (Garcia & Pearson,1994).
The differences between standardized, norm-referenced testing programs and classroom based assessments have been written about extensively (Neill,1993). However, as one begins to investigate the various assessment frameworks contained in the professional literature, the distinguishing features of these assessment frameworks, commonly referred to as performance based, authentic or classroom based assessment, tend to overlap and blend together.
Various assessment frameworks utilize similar procedures and data collection methodologies, and many of these ÒalternativeÓ assessments do not adhere to traditional criteria of standardization, reliability and objectivity (Linn, Baker & Dunbar,1991). This article is intended to help teachers and other concerned educators by providing a broader perspective concerning assessment frameworks or ÒparadigmsÓ and how these assessments effect classroom practice.
At the annual Whole Language Umbrella conference in San Diego, California, Short and Burke (1994b), described three paradigms of curriculum. They suggested that curriculum could be viewed as FACT, as ACTIVITY and as INQUIRY. In this description, curriculum as FACT refers to knowledge as a commodity that is ÒtransferrableÓ and exists separate from the ÒknowerÓ, whereas curriculum as ACTIVITY, is concerned with the actual activities within the classroom, and curriculum as INQUIRY is concerned with the process of creating knowledge in the classroom. As teachers begin to move from a teacher directed curriculum, based on the transmission of ÒfactsÓ, to a student centered curriculum, based on inquiry processes, the purposes of assessment, and the methods used to collect information may need to be revisited.
In reference to Burke and ShortÕs work, Heald-Taylor subsequently developed three paradigms for literature instruction (Heald-Taylor,1996) and three paradigms for spelling instruction (Heald-Taylor,1998). Heald-Taylor used Burke and ShortÕs curricular paradigms as a device to analyze literature and spelling instruction to help teachers understand their own perspectives, or paradigms, concerning literacy development and classroom practices. This article will look at the distinctions between these three paradigms, and use the structure suggested by Burke and Short to shed light on the differences between the various assessment frameworks that operate in schools today.
Burke and Short originally developed these three paradigms to distinguish between the traditional models of curriculum development and an inquiry model of curriculum development. The traditional model of curriculum development, curriculum as FACT, is based on modernist or positivist perspectives of reality and epistemology (Elkind,1997). From this perspective, knowledge is viewed as an objective commodity that can be transmitted from teacher to student and subsequently measured through standardized forms of assessment (Bertrand,1991).
In comparison, from a constructivist perspective, curriculum as INQUIRY, knowledge is viewed as socially and cognitively constructed by humans as they interact with their environment (Fosnot,1996). Knowledge is viewed as a construction, and not a commodity that exists separate from the ÒknowerÓ. It is this shift from a positivist perspective to a constructivist perspective that underlies the differences in the assessment paradigms to be described in this article.
The curricular paradigms described by Burke and Short, are purported to represent different philosophical views of reality, knowledge and learning (Short & Burke,1994a). However, in describing the differences between the three paradigms in assessment, one must also look at the level of student and teacher involvement, the methods used to gather information, the purposes or goals of the assessment framework and the intended audiences for the results. Paralleling the structure used by Burke and Short, the three paradigms of assessment are entitled; (a) assessment as measurement, (b) assessment as procedure and (c) assessment as inquiry.
In this article, I will describe how the three assessment paradigms are similar and how they are different, using various writing assessments, specifically writing portfolios, as an example to help distinguish between the different paradigms. Next, I will present several factors that I believe support teachers making a Òparadigm shiftÓ from assessment as measurement to an assessment as inquiry paradigm. Finally, I will explain several pedagogical suggestions that teachers in transition are using to change their perspectives on assessment.
Assessment as Measurement
The first paradigm is assessment as measurement, and as mentioned previously, this paradigm is closely associated with a positivist or modernist view of reality and knowledge. The primary instrument of this paradigm is the large scale, norm-referenced standardized test. These standardized tests are designed to ÒobjectivelyÓ measure the amount of knowledge that a student has acquired over a given period of time (Wineberg,1997). A major concern for classroom teachers is whether these assessments provide the necessary information required to make day to day instructional and curricular decisions (Johnston,1992).
In the assessment as measurement paradigm, knowledge is believed to exist separate from the learner and students work to acquire it, not construct it. The student is seen as an empty vessel, a Òblank slateÓ, ready to be filled up with knowledge.
Learning is viewed as the transmission of knowledge from teacher to student, while meaning is believed to reside within the text and only one interpretation or judgment is accepted in the standardized tests (Short & Burke,1994b).
In the assessment as measurement paradigm, objectivity, standardization and reliability take priority over concerns of teacher and student involvement. In these tests, the role of the classroom teacher is scripted, scoring is done by computer, and the tests are kept secured to insure fairness. The studentÕs primary role in these standardized testing programs, is that of test taker. In other words, there is little opportunity for self-evaluation or student reflection. The test is given and a score is tabulated. In this externally mandated, form of assessment, classroom teachers have little or no input into the decision making process and relatively little use for the results of these assessments in directing classroom and curricular decisions (Rothman,1996).
Primarily, standardized tests are designed to compare large scale educational programs and to provide accountability to public stakeholders (Murphy,1997). These tests are used by school districts, state departments and other external stakeholders to rank and compare schools and children (Meier,1994). Because of the high stakes agenda associated with these standardized tests, such as funding decisions and school appropriations, they may become highly competitive (Kaufhold,1995). These tests are a reality for classroom teachers, however, they were not designed to support classroom instruction, rather they were designed for large scale educational and program evaluation (Taylor & Walton,1997).
In the assessment as measurement paradigm, decisions about the information to be collected, and the means of evaluating this information, is usually determined by authorities outside the classroom. For example, writing ability is measured on standardized tests by means of multiple choice questions, that focus primarily on issues of grammar, word choice and spelling. The test items are designed to measure the amount of Òwriting knowledgeÓ a student has accumulated over their school experiences. These tests are also concerned with what a child has not learned or understood. In this way, standardized tests are concerned with Òdeficits of knowledgeÓ as well as ÒaccumulationsÓ.
In this paradigm, portfolios or collections of ÒauthenticÓ writing samples are not generally used to evaluate studentÕs writing abilities. In fact, rarely will an actual example of studentÕs writing even be evaluated in a standardized testing program.
Assessment as Procedure
The assessment as procedure paradigm has elements of both the assessment as measurement paradigm, as well as the assessment as inquiry paradigm. In this paradigm, the primary focus is on the assessment procedures, not with the underlying purposes of the assessment program, nor the epistemological stance. Epistemologically, this paradigm is closely related to the assessment as measurement paradigm. Knowledge is still believed to exist independent of the learner, and that this knowledge can be transmitted to the student and eventually objectively measured.
The main difference between this paradigm and the assessment as measurement paradigm, is that the procedures have changed to resemble qualitative data collection methods. However, even though the methods have changed, the underlying beliefs that student achievement can be objectively measured, and that knowledge exists independent of the learner, has not. In this way this paradigm has elements of both the measurement, as well as the inquiry paradigms.
Daly, a social philosopher, has referred to a focus on procedures as ÒmethodolatryÓ (as cited in Noddings,1992). She described methodolatry as an overemphasis on the correct method of doing things, rather than a focus on the purposes for doing these things. This definition of methodolatry captures the essence of this paradigm very well. The assessment as procedure paradigm is primarily concerned with different methods for collecting data, rather than new purposes or audiences for collecting this information.
In comparison, this paradigm, like the assessment as measurement paradigm, teachers and students are not directly involved in making decisions concerning the assessment procedures nor the purposes for these assessments. The primary concern is with reporting information, albeit information gathered by new methods, to external stakeholders, not with directing classroom instruction (Cizek,1998).
In Arizona for example, many portfolio assessment projects were initiated by school district administrations in response to the state mandated Arizona Student Assessment Program (ASAP). In response to the ASAP, many teachers were directed by their districts to keep portfolios of childrenÕs work as part of the state writing assessment. They were required to use a Ògeneric rubricÓ to score each piece of writing in the studentÕs portfolio and submit a final writing score for each student. This Òportfolio scoreÓ would be in lieu of the ASAP performance based test score. Teachers simply collected the student work, used the rubric to determine a score and submitted the score to the state department. This was done because an authority outside the classroom directed them to do so.
Because of this, these portfolios often become an end in and of themselves. The portfolios were mandated and used to provide scores for the state department. Because of the external mandate, limited teacher input and little or no staff development, these portfolios became a classroom activity, something teachers were required to administer, rather than a vehicle to promote student or teacher reflection or direct classroom decisions (Smith,1991).
In this paradigm, the actual procedures for collecting student work, the activities themselves, and not the purposes for collecting the student work, has taken priority. As a result of the ASAP, some teachers became more concerned with the type of folders to be used and the procedures for passing these portfolios on to the next grade level, instead of being involved in discussions about the various ways these portfolios could be used to promote reflection and self-evaluation.
In the assessment as procedure paradigm, teachers are still being asked to objectively measure students abilities, reporting information in numerical form to external audiences. They remain outside the decision making process, barely involved in determining the purposes for these assessments.
Many of these Òassessment as procedure programsÓ are destined to fail because they become an end in and of themselves. Classroom teachers have not been involved in the creation of these new methods, nor are these methods intended to provide new insights into a childÕs learning. Teachers are simply burdened with another set of procedures given to them by their administration, in order to provide scores for an external authority.
In effect, the actual procedure or method of collecting information, in and of itself, does not determine the assessment paradigm. This paradigm is in effect a blend of two other paradigms. It is the purpose and the audience for these assessments, along with the epistemological stance and methods used to gather information, that helps determine the paradigm.
Assessment as Inquiry
In the assessment as inquiry paradigm, assessment is viewed as a process of inquiry, based on constructivist theories of knowledge (Fosnot,1996), student-centered learning (Altwerger, Edelsky & Flores,1987) and the inquiry process (Short, Harste and Burke,1995). Here, the teacher uses various qualitative and quantitative assessment techniques to inquire about a particular learner and their learning processes. It is a process of inquiry, and a process of interpretation, used to promote reflection concerning studentsÕ understandings, attitudes and literate abilities.
Not only have the procedures changed for collecting information, but so has the level of teacher and student involvement, the purposes of these assessments, the epistemological perspective and the audiences for the information created. In the assessment as procedure paradigm, the changes were only at the pedagogical level, concerned with new information gathering procedures. In comparison, within this paradigm, the purpose of the assessments are a deeper understanding of individual learners in their specific learning contexts. The audience has also changed from external authorities to the teachers, parents and students involved in the classroom.
Assessment, in this paradigm, is viewed as a social, contextually specific, interpretive activity (Crafton & Burke,1994). Knowledge is believed to be constructed by the individual within the social contexts of the learning event itself, rather than being acquired solely through transmission or direct instructional techniques. In this paradigm, multiple interpretations are encouraged and each learner transacts with different texts and the world to create meanings for themselves. (Rosenblatt,1979).
Using assessment as inquiry, teachers are no longer simply Òtest administratorsÓ. Rather, teachers and students are viewed as active creators of knowledge, rather than as passive recipients. (Wells,1984). Instead of using tests to measure student abilities and compare children based on the results of a standardized test, these classroom based-assessment procedures are used by teachers to facilitate learning and direct curricular decisions and communicate more effectively with students and parents (Serafini,1995).
In this assessment as inquiry paradigm, it is believed there no longer exists a simple prescription for each studentÕs ailment or a program that one can administer quickly and relatively effortlessly to eliminate inappropriate behaviors. Assessment is not viewed as an ÒobjectiveÓ measurement process, intended for comparisons and prescriptions, rather it is seen as a human interaction, involving the human as the primary assessment instrument (Johnston,1997). The differences between this paradigm and the assessment as procedure paradigm, are in the ÒWHYÓ teachers implement these procedures not necessarily in the ÒHOWÓ these procedures are carried out. What is done with the information and for whom the assessments are conducted has also changed.
Instead of state departments mandating a particular portfolio assessment program, such as the ASAP example used earlier, teachers have chosen to implement their own portfolio assessment process to collect samples of student work in order to make appropriate instructional decisions. These portfolios have become vehicles to promote reflection and student self-evaluation (Tierney,1998). The methods used to collect information may be similar, but the purposes and the goals of the assessment as inquiry paradigm are quite different.
In this paradigm, portfolios are seen as a vehicle for promoting student and teacher reflection, self-evaluation and goal setting. These portfolios are an on-going collection of student work used to understand a studentÕs interests, abilities, needs and values. The artifacts in the portfolios are not generally scored, nor used to compare children against their same age cohorts, rather the contents are reflected upon in order to help students understand their academic progress and to document their growth. This has been referred to as Òlearner referencedÓ assessment (Johnston,1997).
The work included in these portfolios has been created in a more ÒauthenticÓ context, rather than in a testing situation (Bergeron,1996). In this paradigm, classroom instruction does not stop in order to assess learning. Assessment is viewed as part of the learning process, not separate from it.
Portfolios are non-competitive, and attempt to focus on studentÕs strengths rather than their deficiencies (Murphy,1997). The portfolios in this paradigm, are used to uncover the possibilities for students, to understand the child as a whole and attempt to provide a window into a studentÕs conceptual framework and ways of seeing the world.
Educational communities would look radically different if this were the dominant theory of assessment, however, standardized tests will not disappear tomorrow. This shift, from assessment as measurement to assessment as inquiry, will take time, resources, administrative support and dialogue among interested educators. Viewing assessment as inquiry would shift the focus of assessment research and practices from the standardized testing programs to the classroom itself, where it may be of more service in helping teachers to improve classroom learning experiences (Serafini,1998).
Supporting Teachers in Transition
The shift towards an inquiry-based assessment paradigm places different demands not only upon classroom teachers, but also on school administrations, staff development programs and teacher education models. Making changes in a teacherÕs practice or educational belief system, demands considerable time, research and the opportunity for teachers to collaborate with other educators (Fullan, 1994). In general, teachers need time, support, and the opportunity to dialogue with colleagues. Teachers need time to read professional literature concerning assessment, engage in dialogue with other teachers in transition and have the chance to try these new procedures in a supportive, collaborative environment.
Time is already at a premium during the school day for classroom teachers. Paperwork, school site committees, staff meetings, large classroom enrollments and shortened prep periods all contribute to the inadequate amount of time allotted to professional development. Administrators and staff development specialists need to become more creative and supportive in finding time to help classroom teachers understanding these new assessment procedures, read about their implementation, try these out in the classroom and reflect on their progress.
Change can be threatening. Teachers, like other educators, need peer support when working through new ideas. A trusting environment where teachers can enter into open dialogue with each other is of primary importance. However, when teachers are allowed to voice their concerns and ideas, change may become less threatening.
By looking at the existing school structures and developing alternatives to the traditional school day, administrators may find new ways to create time for teachers to collaborate, research new assessment practices and take the first step towards making a shift in their assessment beliefs and practices. When teachers and administrators come to value the changes necessary to move towards reflective practice and assessment as inquiry, it becomes easier for these groups to justify the time required to support these changes.
In making this shift, teachers will need to reevaluate not only the procedures used to generate information about their students, but also the purposes and audiences for the information collected. In this way it is a Òparadigm shiftÓ, a new stance towards assessment and knowledge, as well as a change in the actual procedures used (Cambourne & Turbill, 1997)
Making the Shift
In order to make this Òparadigm shiftÓ from assessment as measurement to assessment as inquiry, teachers need a supportive environment where administration and staff development programs provide time to collaborate with other educators, time to reflect and the opportunity to work through the new purposes and procedures in the new assessment framework. The general support mechanism need to be in place to allow teachers the time, dialogue and collaboration necessary for change to occur.
Along with these ÒgeneralÓ supports, specific changes in a teacherÕs practice and thinking may support a transition to this new paradigm. Teachers my want to consider the following ideas: (a) teachers as knowledgeable, reflective participants, (b) meaningful student involvement and (c) negotiating criteria used to assess student performance. Each of these ideas will now be addressed in more detail, including some practical suggestions for teacher consideration.
Teachers as Knowledgeable, Reflective Participants
The teacher as a knowledgeable, reflective participant is the foundation for the assessment as inquiry paradigm. Rather than relying on testing agencies outside the classroom context to evaluate student progress, teachers in this paradigm assume an active role in the assessment process. This new role involves using observational strategies and other classroom based assessment procedures to gather information about student achievement.
The information collected, like all information, is then interpreted by the teacher based on their existing knowledge and experiences. Teachers reflect on and interpret classroom experiences and student performances for purposes of making decisions about curriculum and instruction, rather than relying solely on the interpretations or scores from an externally mandated test. The more extensive the teacher knowledge base, the more effective the interpretations and subsequent instructional decisions (Fenstermacher, 1994). When teachers assume an active role in the assessment process, the audience and purposes for these assessments shifts from an external focus on comparison and student ranking, to an internal focus on informing classroom practice (Tierney,1998).
Traditionally, teachers were perceived as Òprogram operatorsÓ and the knowledge they needed to be successful was based on how to implement prepackaged curriculum, or present the lessons scripted for them in teacher manuals (Bullough & Gitlin,1985). Subsequent traditional teacher education programs were developed around ÒmethodsÓ courses that explained how to Òdeliver the curriculumÓ. These notions of teacher as automated program delivery person, becomes problematic in shifting to an assessment as inquiry paradigm.
Many teacher education programs have attempted to restructure their programs to develop teachers that assume an active, reflective role in curriculum and assessment decisions (Ross,1989). The teacher as a reflective participant is a different stance to teaching than the transmission, direct instruction models still taught in some traditional teacher education programs (Zeichner,1987). If teachers are going to make the transition from assessment as measurement to assessment as inquiry, they need to know more about observing learners, how to make curriculum decisions based on these observations and to increase their knowledge base concerning child development and learning processes.
In the assessment as inquiry paradigm, teacher participation means that not only do teachers administer the assessments, they also have a voice in the decisions as to how, when and for what purposes these assessments are being used. Teachers are no longer simply the test givers, but become critically involved, deciding which assessments generate the most useful information for their instructional purposes. These new assessments are not blindly accepted, but are judged on the type of information they create, the purposes for these assessments and the needs of the audiences involved.
As reflective participants, teachers make a commitment to learn from past experiences. It is an intentional, systematic and deliberate focus on why things occur and what effects these experiences have on student learning (Dewey, 1933). Reflection has been defined as Òsystematic enquiry into oneÕs own practice to improve that practice and to deepen oneÕs understanding of itÓ (Lucas, 1991).
Reflective thinking is initiated by the perception of a problem (Dewey,1933). It is this acknowledgement of uncertainty and ÒunsettlednessÓ that initiates the inquiry process. In other words, in order to support teachers as reflective participants, teachers need to be able to discuss their doubts and inquiry questions without being seen as unknowing or incompetent. Being able to make oneÕs practice problematic has been observed as a first step in this process (Valli,1997). When teachers have no doubts about their practice, nor the programs they are using, reflection remains of minimal importance.
In working towards becoming knowledgeable, reflective participants in the assessment process, teachers have assumed the role of Òteacher-researcherÓ to better understand the experiences and interactions in their classrooms (Cochran-Smith & Lytle,1992). In doing so, teachers have become producers of research and knowledge as well as consumers (Richardson,1994). By video taping classroom events (Berg & Smith,1996), observing peers at work in classrooms and working in team teaching situations, teachers are opening up avenues for dialogue and collaboration. This Òopening upÓ has allowed teachers the opportunity to become more reflective about their practice. Teachers also use journal writing as a way to help understand the perspectives and beliefs they bring to their practice, and their effect on classroom events (Hubbard & Power,1993).
Many teachers have used journal writing to create Òbelief statementsÓ, or Òplatform statementsÓ about their philosophy of education in order to understand the expectations and hidden beliefs they bring to the assessment process (Kottkamp,1990). In writing these statements, teachers have been able to ÒunpackÓ their values and biases, and to distance themselves from their practice in order to critique their practice more effectively. The purpose of these procedures is to help teachers see their practice from a different, more critical perspective (Osterman, 1990).
Another way to help teachers make this shift, is to support the development of teacher dialogue groups. When teachers come together to discuss educational issues that are relevant to their practice, change and growth become possible (Ohanian,1994). Teacher-research groups (Queenan,1988) and assessment driven, teacher dialogue groups (Stephens et al.,1996) help provide a structure for teachers to support each other through the change process. Through these dialogue groups, teacher research groups and journal writing, teachers are inquiring into the quality of the learning experiences provided their students and the effectiveness of the decisions they make in their classroom.
Meaningful Student Involvement
The assessment as measurement paradigm has historically left students out of the assessment process (Bushweller,1997). Assessment has been something we do ÒtoÓ students rather than ÒwithÓ students. Schools administer standardized tests, send them off to be scored by external testing agencies, where eventually the results of the tests are reported back about how students performed. Through this traditional assessment as measurement paradigm, students and schools have come to rely on external testing agencies to judge their effectiveness and to document their educational progress. This lack of involvement has created passive recipients, not active participants, in the learning as well as the assessment process (Calfee & Perfumo,1993).
In the assessment as inquiry paradigm, portfolios of student work, student led conferences, learning response logs, along with negotiated reporting procedures strive to include the student in the assessment process (Tierney, Carter & Desai,1991). This new level of involvement helps students to accept more responsibility for their learning and helps them to reflect on their own educational progress. Students need to be invited to participate in determining the criteria by which their work will be judged and then play a role in actually judging their work (Kohn,1993).
Portfolios are used as a vehicle to promote reflection on a studentÕs academic progress as well as document their growth in various subject areas (Graves, 1992). Students collect work generated during the school year to evaluate their progress and set goals for their future learning experiences. Many times these portfolios are used in conjunction with student led conferences where students share their portfolios and reflections with parents and other interested audiences. These portfolios have an authentic purpose and are a primary vehicle for supporting student reflection, as well as student involvement in the assessment process.
Another way students are involved in the assessment process is through negotiated reporting configurations (Anthony et al, 1991). Students are invited to become intimately involved in the creation of their report cards in a negotiated process with both teachers and parents. This process may begin by allowing students to evaluate their efforts and performances, based on criteria negotiated between the teacherÕs perspective, the information contained in various standards documents and the beliefs and values of the community. By opening up the criteria used to evaluate student work, and by inviting students to participate in the evaluation process, students begin to feel a part of the assessment process, rather than as a passive recipient of someone elseÕs evaluation.
Another way of involving students in assessing their progress is through classroom designed rubrics (Rickards & Cheek,1999). Rubrics are negotiated forms of criteria explicitly written for particular classroom work and activities. Again, by opening up the conversation to include students in the decisions about what criteria is used to evaluate their progress, students become involved in the assessment process. When students become an active part of the assessment process, assessment becomes a process of inquiry rather than an external measurement reducing student performance and ability to a numerical score for comparative purposes.
Negotiating the Criteria Used to Assess Student Performance
The debate over what children should be taught and what they need to know in order to be successful adults has been going on in the United States for centuries (Bracey, 1996). This debate has been rekindled by many of the standards based restructuring initiatives across the U.S. and other countries (Noddings,1997). The creation of standards documents by state legislatures and federal education agencies, along with the standardized testing that usually accompanies these documents, has tended to restrict assessment programs to the assessment as measurement paradigm, while at the same time supporting agendas tied to gatekeeping and exclusion (Tierney,1998). These documents are written as general learning statements by people far removed from actual classrooms and students. The negotiation of educational criteria becomes a highly political issue and hence a highly controversial one (Shannon,1996).
As educators, we just donÕt know all that students need to know, nor are we able to teach them everything we do know (Wiggins,1989). The criteria used for assessing student performance should be open for negotiation and revision to adapt to our changing societal demands. Teachers and students should have a voice in what is taught, how this knowledge is eventually assessed and what criteria is used for evaluation.
With all of these restructuring efforts, teachers have been bombarded with standards created by federal and state agencies, local school boards and professional organizations like the National Council Teachers of English and the International Reading Association. Using these documents as guidelines, teachers may open the negotiations by writing detailed belief or Òplatform statementsÓ concerning their expectations for student learning and behavior (Kottkamp,1990). These platform statements provide a place to open up a discussion among parents, teachers and school officials about the experiences to be provided students during the school year. By presenting their criteria to be negotiated, teachers open up a space for different voices to be heard concerning what is of value in education, and what place particular content areas and learning processes are to have in the school curriculum.
As mentioned above, classroom rubrics, designed with student and teacher input, are an excellent vehicle for negotiation and involvement in the assessment process. Students and teachers come together to ÒunpackÓ their values and beliefs about education in order to expose these to discussion and negotiation. It is this process of negotiation that is of primary importance, not necessarily the actual documents that are created in the process (Boomer, 1991).
The items included on school district report cards and how amenable these cards are to change should also be open to negotiation. School report cards are a written statement about what the community deems valuable in education. If it is on the report card and it gets a grade, it is probably seen as important by that community. Even the amount of space designated for each subject area is a statement concerning how much value is placed upon that topic. The larger the space, it seems the more value assigned to that particular subject or topic.
In the negotiating the criteria used to assess student performance, educators should consider the Òmodels of excellenceÓ already available in the outside world that classroom teachers and students can use to judge the quality of the work done in schools. Possibly educators can look to various awards such as the Newbery or Pulitzer prize for writing or the Nobel prize for science, in order to find criteria that is authentic and can be incorporated into the negotiation of student evaluation. What are the authentic models of criteria available for assessing student performance? Instead of school districts and state departments being the sole creators of these criteria of student progress, opening up the discussion to bring in multiple voices to negotiate the criteria used to evaluate student progress may create more authentic, more useful criteria.
Conclusion
When educators begin to acknowledge the complexity, and interpretive nature of the learning and assessment process, traditional assessment as measurement procedures become problematic. All assessments are interpretive, unfortunately teachers and students rarely become involved in large scale testing programÕs interpretations or dissemination of results. The assessment as inquiry paradigm offers teachers another perspective from which to understand the needs and abilities of their students, utilizing different assessment methods for different purposes and audiences.
Making this shift from assessment as measurement to assessment as inquiry takes time, administrative support, collaboration and the opportunity to dialogue. Simply mandating new procedures for teachers to administer will not help teachers make this shift in assessment paradigms.
It is my hope that classroom teachers will begin to take an active role in the assessments used in their classroom. Teachers need to involve students in the assessment process in meaningful ways, become knowledgeable, reflective participants in the assessment process themselves and negotiate the criteria used to evaluate academic performances. As educators, we need to acknowledge the complexity of the learning process and stop trying to find the Òquick fixÓ solutions to both educational and assessment issues. When assessment becomes a process of inquiry, an interpretive activity rather than simply the ÒobjectiveÓ measure of predetermined behaviors, teachers will be able to use assessment to make informed decisions concerning curriculum and instruction in their classrooms.
Bibliography
Altwerger,B.Edelsky,C.& Flores,B.(1987).Whole language: WhatÕs new? The Reading Teacher,41(2),144-154.
Anthony,R.Johnson,T.Mickelson,N & Preece,A.(1991). Evaluating literacy:A perspective for change.Portsmouth,NH:Heinemann.
Berg,M.H. & Smith,J.P.(1996).Using videotapes to improve teaching.Music EducatorÕs Journal 22(5),31-37.
Bergeron,B.(1996).Seeking authenticity:What is ÒrealÓ about thematic literacy instruction? The Reading Teacher,49(7), 544-551.
Bertrand,J.(1991).Student assessment and evaluation.In Bill Harp (Ed.),Assessment and Evaluation in Whole Language Programs (pp.17-33).Norwood,MA: Christopher Gordon.
Boomer, G.(Ed)(1991).Negotiating the Curriculum:A Teacher-Student
Partnership.Sydney:Ashton-Scholastic.
Bracey, G.(1995).Final exam: A study of the perpetual scrutiny of
American education.Washington:Technos Press.
Bullough,R.V.Jr.& Gitlin,A.(1985).Schooling and change:A view from
the lower rungs.TeacherÕs College Record 87,219-237.
Bushweller,K.(1997).Teach to the test.The American School Board
Journal,184, 20-25.
Calfee,R. & Perfumo,P.(1993).Student portfolios:Opportunities for a revolution in assessment.Journal of Reading,36(7)532-537.
Cambourne,B & Turbill, J.(Eds.).(1997) Responsive Evaualtion. Portsmouth,NH:Heinemann.
Cizek,G.(1998).The assessment revolutionÕs unfinished business.Kappa Delta Pi Record,34(4),144-149.
Cochran-Smith,M & Lytle,S.(Eds.).(1992)Inside/Outside:Teacher
research and knowledge. New York:Teachers College Press.
Crafton,L. & Burke,C.(1994).Inquiry-based evaluation:Teachers and students reflecting together.Primary Voices,2(2),2-7.
Dewey,J.(1933).How we think. Chicago:Henry Regnery.
Elkind,D.(1997).The death of child nature:Education in the postmodern world.Phi Delta Kappan,78,241-245.
Farr,R.(1992).Putting it all together:Solving the reading assessment puzzle.The Reading Teacher,46(1),26-37.
Fenstermacher,G.(1994).The knower and the known:The nature of knowledge in research on teaching.In L.Darling-Hammond (Ed.), Review of Research in Education,20 (pp.3-56). Washington, DC:American Educational Resrearch Association.
Fosnot,C.T.(1996).Constructivism:A psychlogical theory of learning. In C.T.Fosnot (Ed.),Constructivism:Theory,
perspectives and practice (pp.8-33). New York: Teachers College Press.
Fullan,M.(1994).Why teachers must become change agents.
Educational Leadership,50, 12-17.
Garcia,G.E. & Pearson, P.D.(1994). Assessment and diversity. In L. Darling-Hammond (Ed.),Review of Research in Education,20 (pp.337-391). Washington,DC:American Educational Research Association.
Graves, D.(1992).Portfolios: Keep a good idea growing. In Graves,D. & Sunstein,B. (Ed.),Portfolio Portraits.(pp.1- 12).Portsmouth NH:Heinemann.
Heald-Taylor, B.G.(1998).Three paradigms of spelling instruction in grades 3 to 6.The Reading Teacher,51(5),404-412.
Heald-Taylor, B.G.(1996).Three paradigms for literature
instruction in grades 3 to 6.The Reading Teacher,49(6),
456- 466.
Hubbard,R.S.& Power,B.M.(1993).The Art of Classroom Inquiry: A
Handbook for Teacher Reseachers. Portsmouth,NH: Heinemann.
Johnston,P.H.(1992).Nontechnical assessment.The Reading Teacher,
46(1),60-62.
Johnston,P.H.(1997).Knowing literacy:Constructive literacy
assessment.York,ME:Stenhouse.
Kaufhold, J.A.(1995).testing,testing.The American School Board
Journal,182, 41-42.
Kohn, A.(1993).Choices for students:Why and how to let students decide.Phi Delta Kappan,75, 8-20
Kottkamp,R.B.(1990).Means for facilitating reflection.Education
and Urban Society,22(2),182-203.
Linn,R.,Baker,E. & Dunbar,S.(1991).Complex, performance-based
assessment:Expectations and validation criteria.Educational
Researcher 20(8),15-21.
Lucas,P.(1991).Reflection, new practices and the need for flexibility in supervising student teachers.Journal of Higher
Education 15(2),84-93.
Meier,T.(1994).Why standardized tests are bad.Rethinking Our
Classrooms:Teaching for Equity and Social Justice Milwaukee, WI: Rethinking Schools Ltd.
Murphy,S.(1997).Literacy assessment and the politics of
identity.Reading and Writing Quarterly 13,261-278
Neill,M.(1993).A better way to test.The Executive Educator,15,
24-27.
Noddings,N.(1997).Thinking about standards.Phi Delta Kappan,79, 184-189.
Noddings,N.(1992).The Challenge to Care in Schools. New York: Teachers College Press.
Ohanian,S.(1994).WhoÕs In Charge?:A Teacher Speaks Her Mind. Portsmouth,NH: Heinemann.
Osterman,K.(1990).Reflective practice:A new agenda for education.Education and Urban Society,22(2),133-152.
Queenan,M.(1988).Impertinent questions about teacher research:A review.English Journal,77(2),41-46.
Richardson,V.(1994).Conducting research on practice.Educational Researcher,23(5),5-10.
Rickards,D. & Cheek Jr, E.(1999).Designing Rubrics for K-6
Classroom Assessment.Norwood,MA:Christopher-Gordon.
Rosenblatt,L.M.(1979).The Reader, the Text and the Poem. Carbondale, IL:Southern Illinois University Press.
Ross, D.(1989).First steps in developing a reflective approach.
Journal of Teacher Education 40(2),22-30.
Rothman,R.(1996).Taking aim at testing.The American School Board
Journal,183, 27-30.
Serafini,F.(1998).Making the shift.Talking Points:Conversation in
the Whole Language Community,9(2),20-21.
Serafini,F.(1995).Reflective Assessment.Talking Points:
Conversations in the Whole Language Community,6(4), 10-12.
Shannon,P.(1996).Mad as hell.Language Arts,73(1),14-18.
Short,K.,Harste,J. & Burke,C.(1995).Creating Classrooms for
Authors and Inquirers. Portsmouth,NH: Heinemann.
Short,K. & Burke, C.(1994a).Creating Curriculum. Portsmouth, NH: Heinemann.
Short,K. & Burke,C.(1994b).Curriculum as Inquiry. Paper presented at the Fifth Whole Language Umbrella Conference, San Diego,CA.
Smith,M.L.(1991).Put to the test:The effects of external testing on teachers.Educational Reseracher,20(5),8-11.
Stephens,D.,Story, J., Aihara,K., Hisatake,S., Ito,B., Kawamoto,C., Kubota,S., Mokulehua,J., Oka-Yamashita,S., Omalza,S., Tsuchiyama,E., Yamate,F., Yoshioka, E., Yoshizaki,L. and Yoshizawa,D.(1996),When assessment is inquiry. Language Arts,73(2),105-112.
Taylor,K. & Walton,S.(1997).Co-opting standardized tests in the service of learning.Phi Delta Kappan,79,66-70.
Tierney,R.J.(1998).Literacy assessment reform:Shifting beliefs, principled possibilities and emerging practices.The Reading
Teacher,51(5),374-390.
Tierney,R.J., Carter, M.A. and Desai, L.E.(1991).Portfolio
Assessment in the Reading-Writing Classroom. Norwood,MA:Christopher Gordon.
Valli,L.(1997).Listening to other voices:A description of teacher reflection in the United States.Peabody Journal of
Education,72(1),67-88.
Wells,G.(1984).The Meaning Makers. Portsmouth,NH:Heinemann.
Wiggins,G.(1989).The futility of trying to teach everything of importance.Educational Leadership,47,14-18.
Wineberg,S.(1997).T.S.Eliot, collaboration and the quandries of assessment in a rapidly changing world.Phi Delta
Kappan,79,59-65.
Zeichner,K.(1987).Preparing reflective teachers:An overview of instructional strategies which have been employed in preservice education.International Journal of Education
Research,11, 565-575.