NO CHILD (OR EDUCATOR) LEFT BEHIND:

A SUCCESSFUL MODEL FOR ASSESSING

ADEQUATE YEARLY PROGRESS

 

Shelly Solomon Huggins

Towson University

 

Adequate Yearly Progress! Let's talk instead about Student Achievement Through Daily Instruction (SATDI). After all, are increments of growth or decline really made on a yearly or daily basis? Students don't just become a year behind in school by the end of the year! It happens daily, as they continuously fail to meet each day's learning goal. The SATDI model, developed and implemented at Lansdowne Middle School in Baltimore County, helped to show an average of 30% growth in student achievement in targeted areas over a three-year period. Key to this model are instructional leadership, professional development, and strategic data collection focused on analyzing student work.

 

How can we hold students and educators responsible for the continuous improvement of achievement? One visionary administrator in the Baltimore County Public Schools asked that question of his school, and we spent the next three years answering it together.   Lansdowne Principal Thomas DeHart knew well his school population and its particular areas of need. The school's demographics indicated an at-risk population. The school was receiving Title I funds, 64 % of the students received free and reduced meals, 15% of students did not operate with English as their first language, there was a 34% mobility rate, and 15% of students were receiving special education services. The school's MSPAP scores were not close to meeting standards.

 

Lansdowne Middle School's 1999 MSPAP Scores

             

Grade 8         

% At Excellent

% At Satisfactory

Reading

0.0

13.5

Writing

9.5

33.6

Language Usage

5.5

28.6

Mathematics

4.5

41.8

Science

4.5

39.1

Social Studies

3.6

29.5

 

 

Mr. DeHart was concerned for the school and his students' achievement. He had a vision of holding students and teachers accountable for each day's learning. As a staff, we were energized by his vision and his proposal to create a position in the building for an instructional leader to be called an achievement facilitator. He offered me this position and encouraged me to make it my own, focusing on the instructional program, the school improvement plan, and professional development.

 

After spending the summer reviewing the school improvement plan and data, we were perplexed by the discrepancies in the state reported data points. The school's Maryland Functional Reading Test scores indicated 97% of our students passing. Our students were able to perform proficiently on a functional reading test but were having trouble with MSPAP, which required students to communicate what they learned in their subject areas through writing.   We realized that, if we could improve students' ability to communicate through reading and writing, they would be more productive citizens and the MSPAP scores would climb as well.

 

Around this time, the Baltimore County Public Schools assigned our school two new mentor teachers. Mentor teachers are placed in sites that have a large number of new, non-tenured teachers. The mentor teacher role is to provide support to new teachers in their first two to five years of teaching. The two mentor teachers who joined our leadership team were instructional leaders of the highest caliber.   Susan Domanico and Sam Richman embraced and constantly enhanced the SATDI vision.

 

Revitalized by two fresh eyes on the issues, the enlarged leadership team had several discussions to identify our targeted learning goals. We adopted aggressive reading and writing school improvement plan goals, which included a management plan component. Under the plan, teachers were going to be held accountable for daily student achievement through weekly data review sessions focusing on the analysis of student work. The data collected would reflect instructional growth on each of the four reading stances through the use of the reading strategy ACE and the language usage standards using the writing strategy of CUPS.

 

ACE is a strategy that helps organize students' responses to stance statements by leading them through a three-step process. First, they are encouraged to create an a nswer stem for the question. Second, they are asked to use c itations from the text to support their response. Third, they are prompted to e xtend their response into a broader experience for the reader. The CUPS strategy helps students organize their editing process through four areas: c apitalization, u sage, p unctuation, and s pelling. Targeting these strategies with the faculty and collecting weekly data for each section of students provided us with valuable diagnostic information, but it wasn't enough. We next needed to connect our students' growth with the MSPAP.

 

To make the connection between classroom learning and the large-scale assessment, we created quarterly simulations of the MSPAP.   The assessments had parallel activities so progress could be gauged across time. For example, the first activity in each simulation always assessed students' ability to create a content-based summary statement, which addressed the Global Stance.

 

Each simulation activity measured one of the four stances as well as the language usage standard. The content and context of the text changed with each quarter, but the assessed standard was the same. The scoring tools for the simulations were also maintained throughout the three years. The resulting academic growth in targeted stance statements is represented in the following table:

 

 

All Student Comparison

(Percent at Satisfactory)

 

Activity

“Child Labor”

Simulation 1

“Toilets”

Simulation 2

“Hindenburg”

Simulation 3

1

Summary Statement

(Global Stance)

61.4

60.4

73.6

2

Response in Light of Prior Knowledge

(Personal Stance)

46.4

64.4

67.0

3

Interpretation of Meaning

(Interpretive Stance)

45.6

46.4

65.6

4

Evaluating the Author's Craft

(Interpretive/Critical Stance)

37.7

46.8

49.1

5

Identifying the Author's Craft's Usefulness

(Critical Stance)

25.4

36.2

53.2

   6 *

Wild Card

(Mathematics Communication)

38.5*

31.0*

9.9*

7

Writing Prompt

(Writing to Persuade)

41.2

45.6

48.0

Capitalization

50.4

51.2

54.3

Usage

25.9

27.0

28.7

Punctuation

37.2

42.6

45.2

Spelling

22.8

18.8

21.3

 

* Note: Activity 6 was designated as a “wild card” question. It did not measure the same standard for each simulation and therefore cannot be compared over time.

 

We also disaggregated the data collected for simulations 2 and 3 by race and gender and found that our achievement gap data declined slightly between our minority students and our Caucasian students, as opposed to the gap in MSPAP scores, which had been increasing. Not only did overall achievement increase, on average, the racial difference of   9.2 % in the second simulation declined to a 7.5 % difference by the last one.

 

 

Disaggregated (by race) Simulation Scores

Percentage at satisfactory, all students

 

  Simulation 2

One

Two

Three

Four

Five

Six

Seven

Caps

Use

Punct

Spell

2

  ( M inority)

59.3

61.4

42.1

42.1

29.3

19.3

32.1

43.6

15

37.9

15.7

2

( C aucasian)

60.8

65.6

48.1

48.6

38.9

35.6

50.8

54.2

31.7

44.4

20

DIFFERENCE

(C-M)

1.5

4.2

6

6.5

9.6

16.3

18.7

10.6

16.7

6.5

4.3

 

 

 

Average

difference

of

9.2

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

  Simulation 3

One

Two

Three

Four

Five

Six

Seven

Caps

Use

Punct

Spell

3

  ( M inority)

72.0

59.9

58.6

41.4

43.3

7.6

34.4

48.4

22.9

46.5

21.0

3

( C aucasian)

74.2

69.8

68.3

52.1

57.0

10.8

53.3

56.5

31.0

44.7

21.4

DIFFERENCE

(C-M)

2.2

9.9

9.7

10.7

13.7

3.2

18.9

8.1

8.0

-1.8

0.4

                                                        Average difference of 7.5

 

 

Of course, we couldn't hold teachers accountable for growth without professionally arming them for instructional changes. After a series of whole group professional development sessions, which helped us to set a framework and build a general knowledge base for reading and writing in the content area strategies, we were able to differentiate the professional development for all faculty members.

 

The two mentor teachers and I divided up the faculty into groups by needs as indicated by a self-reporting survey and by administrator observation. Novice teachers were always grouped together, focusing on the same content as the more experienced teachers but in more depth and breadth. The other teachers met in heterogeneous groups, differentiated based on need. Many times, a third year teacher was working aside a twenty-year veteran. This type of differentiated instruction for faculty continued throughout the next three years.

 

These professional development sessions were often focused on aspects of reading and writing in the content area. Pre, post, and during reading strategies were presented and applied in the first few sessions. Anticipation guides were of particular interest to our faculty. Because vocabulary retention was an issue for our students, some of the professional development sessions focused on research-based practices for introducing content area vocabulary. The creation and application of scoring tools were also topics of several professional development programs.

 

After arming the faculty with the instructional strategies necessary for improvement, we also had to give them some basic understanding of data collection practices and statistics. Teachers were provided with a crash course in data and statistics that covered just what they needed to know to participate in the analysis of student work.

 

Eventually, teachers were held accountable for weekly submissions of data that directly reflected their students' attainment of daily objectives. Teachers collected data on the percentage of students in each section that were able to satisfactorily address the targeted stance statement within the content text. The data were also disaggregated so that teachers could focus on individual student strengths and weaknesses in addressing the stance statements.

 

After these data were collected and collated, the achievement facilitator met with each team of teachers to discuss the student work reflected in data. During these collaborative sessions, diagnostic information was reviewed and instructional alternatives were discussed.

 

Because teachers had data on individual and group growth over time and across content areas, they were able to adjust their instruction. If one particular teacher found success with a student others were struggling with, the successful teacher's strategies and pedagogy were explored, discussed, and adopted by others. If one teacher was struggling with a particular aspect of the standards addressed, the data clearly reflected the need for the team to help address that weakness.

 

For example, teachers began to realize that their students had a limited ability to extend their responses. It was decided that less instructional time would be spent on addressing the answer stem and citation statements of the responses for ACE and more time would be spent on the extension techniques. It was so exciting to see changes in instruction celebrated and heralded by colleagues. Teachers problem solved and struggled together, and students made unprecedented gains!

 

The collaborative nature of the weekly meetings was enlightening to new and veteran teachers alike. Instruction was the topic of concern everywhere in the building. Teachers were holding their students, their colleagues, and themselves to higher expectations than ever before. This focused effort paid off when MSPAP was next given in 2002 as the following growth was reported:

 

Lansdowne Middle School's 1999 and 2002 MSPAP Scores

 

1999

2002

 

Grade 8

% At Satisfactory

% At Satisfactory

% Of Growth

Reading

13.5

17.7

31%

Writing

33.6

44.1

31%

Language Usage

28.6

37.9

33%

 

 

How does this model apply today? Although the state mandated assessment has changed, in Maryland, the standards have not. The instructional standards, indicators and objectives that comprise the Maryland Voluntary State Curriculum could be the basis of this model.   Keys are teacher collaboration, data accountability for the continuous improvement of student work, and differentiated professional development.   Together, they help ensure Student Achievement through Daily Instruction and make Annual Yearly Progress a certainty!

  

About the Author

 

Dr. Shelly Solomon Huggins is a member of the Department of Secondary Education in the College of Education, at Towson University.   She may be reached at shuggins@towson.edu .