Since December I have been working with my team to prepare for next year, the first year that teachers will be measured in the art classroom based on assessments that (hopefully) show student growth. A Student Learning Objective (SLO) will be created which shows goals for students in your classroom based on certain data (example from ODE). The way we will measure if students meet these goals are assessments called Student Growth Measures (SGM). More information about SGM from ODE can be found here.
As you may know, I have given a pilot assessment to my students to see what a pre-assessment and post-assessment could look like in the Art 1 classroom and what issues may come up. The pre-assessment was given to 4 different sections of Art 1. Two sections gave a test with multiple-answer, multiple-choice, essay, and short answer questions. The other two sections gave a pre-assessment with multiple-choice, short answer, and essay questions. I did this to see how different types of questions may or may not show student growth. So far, the data has been helpful to seeing what students already know and don't know when entering my classroom. More about data collected here. However, we did run into a few issues along the way.
One of these issues is collecting reliable and objective data that tests student knowledge. I mentioned we used essay questions on this pre-assessment. Though this is a great way for students to explain their knowledge, it was difficult to grade the content opposed to a student's writing style/skill. Even though we had a rubric, grading was subjective and the results varied in a large way between different teachers (see above). Since we are being evaluated on this data as teachers, it is important that our assessments provide reliable and valid results.
Changes have been made to the test since we first gave it to create one solid version that does not include essays or short answer. This is the version that will be used next year. We included multiple-choice (making sure every question as 4 choices) and multiple-answer questions. To create the final (for now) version of the pre-assessment and post-assessment, we looked though the scope and sequence of our course, the existing questions on the test, and student results. The assessment includes at least one question about each topic in the course.
Example:
3. What kind of drawing is a quick sketch that captures what the artist sees?
A. Portrait
B. Point-of-view
C. Gestural
D. Linear Perspective
I am also currently working on a SGM for my Art 5 class but because this course is so independent it is difficult/impossible to create a multiple-choice type of assessment for it. Therefore, I am considering reviewing student portfolios as they enter and at the end of the course. If graded by an unbiased source (someone outside of my classroom) using a rubric, perhaps I could get reliable and valid data from this method. I will also be able to see where students are coming from and what their strengths and weaknesses are before I begin working with them.
I look forward to the weeks to come when I will be giving my post-assessment and be able to see if my students have grown. I will continue to post my results from this assessment journey I am on!
Tuesday, April 23, 2013
Friday, April 12, 2013
My Experience as an Online Student
It is a bit embarrassing to
share with you that until recently I had never taken an online class.
Throughout high school and college, all of my coursework has been in person.
Though I feel I’ve done a good job of learning about effective online
curriculum and teaching strategies, I obviously only knew one side of the
story. There are many things I wonder about when it comes to my students. Why did
they do this assignment, but not that one? Why don’t they make more of an
effort to stay on track? How can you be this far behind? Why on earth would you
do 10 assignments in one night?! Thus, I conducted an experiment myself of what
I would be like as a student in their shoes. For this experiment I used free
online coursework provided by Class-central.com in conjunction with the Open
Learning Initiative. “The Open Learning Initiative offers online courses to
anyone who wants to learn or teach. Our aim is to combine open, high-quality
courses, continuous feedback, and research to improve learning and transform
higher education,” (Carnegie Mellon on OLI). I enrolled in Spanish 1 in late
December, a course where a grade and certificate is received by participants.
In my Spanish class there were over 4,000 students enrolled (makes my 260
students seem like a small number!). I was ready to begin.
I started very motivated
about doing well in this course. I completed all the assignments I could in the
beginning, which to my surprise included watching several videos and completing
a written and spoken assignment. At first, I hoped Week 1 would include a quiz
rather than the written assignment because to me that felt like a quick and
simple way to accomplish something in my class. Aha! First realization:
students often do all the open quizzes in my class before attempting an art
project. Why? Perhaps it is because they also feel like a quiz is a quick way
to accomplish something, to fill something in on their grade book, and to see
how they are doing. However, the projects are worth more of their grade and
focus on students putting their learning into practice by demonstrating mastery
of a concept.
The next several weeks went
well. I found myself logging in once a week to complete my homework. This of
course meant I was spending quite a bit of time all at once getting things
done, and I was only taking ONE course. Many of my students take 5 courses at
once. It would be smarter for me to login multiple times a week to get my
assignments done in smaller chunks, but it takes a lot of dedication to find
the time during my busy week to do this. Second realization: Online learning
takes dedication, time management, and self-discipline! This is really no
surprise to me, but it takes more than I once imagined.
In the beginning I received
feedback from every assignment I submitted, usually a couple days after I
submitted it. As the course went on, the number of assignments that the grading
team had to look through became much higher and the feedback I was receiving
seemed to drop off completely. A week went by, two weeks, and still no grade
for my recent assignments. Finally, it had been a month since receiving any
feedback or grades and I also stopped submitting work. Without feedback or
contact from my teacher, I did not login to my class for 4 long weeks! I
thought to myself, “I am my worst student.” If even a motivated person like
myself was capable of blowing off classwork for an entire month, of course my
students could. Many of them have distractions like myself: full time jobs,
family issues, and whatever else life throws at them. However, I do always make
sure to give timely feedback. Realization three: It is easy to get more behind
than you realize and timely feedback is essential for student motivation.
At four weeks behind, the option of giving up and just retaking
this class later (or not) sounded pretty good to me. But wait! How on earth can
I encourage my students to be successful in this online environment if I myself
choose not to succeed? Realization four: giving up is easy, but it is not the
best option! So I got back on. I worked over spring break. I buckled
down and got it done. In the end, I was able to come back and catch up. I took
the quizzes and re-took the quizzes. I studied and worked on the assignments
until I got it all done. As behind as I was, the system was quite forgiving in
letting me catch back up on what I had missed. This is a plus to online
learning, and perhaps even required in this environment.
Through this experience I have gained insight and empathy for my
students. My “why’s” have been answered, and I have learned some Spanish along
the way. I will use these insights when speaking with students and working with
them to help them login and succeed. It is not as easy as you would think, but
that just means we all need to work on our self-discipline and use the tools at
our disposal. Together we can do it!
Subscribe to:
Posts (Atom)