Showing posts with label assessment. Show all posts
Showing posts with label assessment. Show all posts

Friday, November 15, 2013

Remembering Why We Do This

For the past few weeks, I have been collecting data from my post-test for my SLO. I wrote about this test earlier this year when we implemented it for the first time. At my school, this test is 23 multiple-choice questions offered through a website outside of our LMS. Students take this test during the first 3 weeks of school and the first 3 weeks after quarter 1 of Art 1. I started this journey feeling very upbeat and excited to see what my students came into my classroom knowing and how they would grow throughout the quarter. What I have found is some unsettling data.


At the moment (several hours before the closing of my post-test), I am sitting at 58.9% of my students hitting their growth targets. That puts me in the "Least Effective" category as a teacher. Throughout my young career as a teacher over these past 3 years, I have been told nothing but good things about my teaching methods by administrators. My students have given me positive feedback about what they are learning when I speak to them and I have generally felt fulfilled and proud of where I am as a teacher. These results threw a wrench into my teacher ego!

As it is, I am still not sure what is causing my students to do so poorly. I know of the barriers we have that might affect their performance; students not engaging with the content, test anxiety, students tired of taking all of these assessments (one per class, 2 times in 10 weeks), the weakness of multiple-choice questions to assess project-based learning, home environment, test questions with confusing wording, and a lack of effort to name a few. I have gone through many days of discouragement this week, feeling like everything I have learned about education is wrong and all the compliments about my teaching methods have been lies.

But then, I started to look at the data more closely. I began to see students growing by leaps and bounds! Some of my weakest performers have grown by the highest percentage. I even have students who have scored 100% on my post-test. When I was inputting the data of one of my students with special needs and saw that he not only hit his growth target but surpassed it, I jumped for joy! I was reminded why I am a teacher. It is not about crunching the numbers and hitting this arbitrary goal. It is about teaching each individual student and helping each of them grow. Maybe the data isn't showing it, but the students who have actively engaged in learning in my classroom have a wealth of new knowledge. I know this from talking to them, and from watching their work improve every single week.

I will continue to troubleshoot my assessments for my SLO and how I can overcome these barriers so the data starts to really reflect more of what is going on in my classroom. But, there are just some things that you can't quantify.

Am I a least-effective teacher? I certainly don't feel like one.

Tuesday, November 5, 2013

FIPing the Classroom

As a team leader this year I have attended a training to learn about Formalized Instructional Practices as a new-ish more formal way of teaching with a focus on student growth and evidence of learning. I am still learning and have more trainings and online courses to attend but I wanted to try something new in my classroom last week just to see how this teaching philosophy might play out in my online classroom.

"Formative instructional practices (FIP) are the formal and informal ways that teachers and students gather and respond to evidence of learning. It helps to think about learning as a journey, and formative instructional practices can guide teachers and students along the way, just like a GPS. These practices include four core components:
  • Creating and using clear learning targets
  • Collecting and documenting evidence of student learning
  • Analyzing evidence and providing effective feedback
  • Preparing students to take ownership of their learning" -from the Battelle for Kids Ohio Student Progress Portal

    The week focused on Feldman's Method of Art Criticism. Generally students go through this lesson by first reading the content in the classroom (like a text book) and then writing a paper using the 4 steps. We practice using Feldman's Method in a live lesson as well.
    
    New setup for FIP
     
    To try out "FIP"ing my classroom I incorporated a different structure this week in my classroom. First, students were to read all of the content they would normally read for the lesson. Secondly, they check their understanding in 2 different ways.

    First, they take a non-graded quiz that gives them clear feedback about why they are correct or incorrect.
    Secondly, they complete a self-assessment on the learning targets for the week. They include their biggest weakness and what steps they will take to earn a 3 on all of the learning targets. This allows students to take ownership of their learning.
    From there, students have options. They may use the additional resources available in the "Expand" folder such as a structuring guide, more in depth instructions for art criticism, and the live lesson where we practice. If confident about all of the learning targets, they may go straight on to complete the summative paper assessment for the week in the "Project" folder.

    I was pleased with the results of this so far and am excited to learn more about FIP and new ways to help my students succeed in reaching and exceeding learning targets in my classroom.


Thursday, September 12, 2013

From Recall to Higher-Order Thinking

This year is all about growth! Both student growth and teacher growth. With common core and an increased focus on literacy in the art classroom, we are challenged to look at our weaknesses and evolve to meet new standards of learning. Last year, my team and I spent a large amount of time working on converting our curriculum to include more writing and reading. Two years ago, I went through the process of adding quizzes to my classroom to check student's ability to recall the information they were assigned to read. This mostly assured me that students were being held accountable for reading the material as sometimes they would get away with simply completing the project by looking at examples. Now, my task is to take a basic recall quiz and turn it into one that pushes students to answer questions about comprehension, application, analysis, synthesis, and evaluation.

I used a very simple and helpful guide I found on pinterest to learn more about how these questions could appear in the art classroom. Then, I reflected on my current quiz questions which included one such as this:
1. Which objects appear the largest in a drawing?
A. Objects in the foreground
B. Objects in the middle ground
C. Objects in the background
The answer to this question was simply provided in the assigned reading and it does not ask students to apply their knowledge. So I came up with a series of new questions that challenge students to apply and then analyse.
Examples:
Apply: In this image, which part is the foreground?

 Analyze: Which option shows the correct use of proportion?



 


 And I have even added a question where students have to choose the drawing that shows the most depth in order to fulfil the evaluation question. I believe these new questions will test more than if my students can read the information and put it down on paper but if they actually understand it.

Tuesday, April 23, 2013

SLO's in the (online) Art Room

Since December I have been working with my team to prepare for next year, the first year that teachers will be measured in the art classroom based on assessments that (hopefully) show student growth. A Student Learning Objective (SLO) will be created which shows goals for students in your classroom based on certain data (example from ODE). The way we will measure if students meet these goals are assessments called Student Growth Measures (SGM). More information about SGM from ODE can be found here. 
As you may know, I have given a pilot assessment to my students to see what a pre-assessment and post-assessment could look like in the Art 1 classroom and what issues may come up. The pre-assessment was given to 4 different sections of Art 1. Two sections gave a test with multiple-answer, multiple-choice, essay, and short answer questions. The other two sections gave a pre-assessment with multiple-choice, short answer, and essay questions. I did this to see how different types of questions may or may not show student growth. So far, the data has been helpful to seeing what students already know and don't know when entering my classroom. More about data collected here. However, we did run into a few issues along the way.
One of these issues is collecting reliable and objective data that tests student knowledge. I mentioned we used essay questions on this pre-assessment. Though this is a great way for students to explain their knowledge, it was difficult to grade the content opposed to a student's writing style/skill. Even though we had a rubric, grading was subjective and the results varied in a large way between different teachers (see above). Since we are being evaluated on this data as teachers, it is important that our assessments provide reliable and valid results. 
Changes have been made to the test since we first gave it to create one solid version that does not include essays or short answer. This is the version that will be used next year. We included multiple-choice (making sure every question as 4 choices) and multiple-answer questions. To create the final (for now) version of the pre-assessment and post-assessment, we looked though the scope and sequence of our course, the existing questions on the test, and student results. The assessment includes at least one question about each topic in the course.
Example:
3. What kind of drawing is a quick sketch that captures what the artist sees?
A. Portrait
B. Point-of-view
C. Gestural
D. Linear Perspective 

I am also currently working on a SGM for my Art 5 class but because this course is so independent it is difficult/impossible to create a multiple-choice type of assessment for it. Therefore, I am considering reviewing student portfolios as they enter and at the end of the course. If graded by an unbiased source (someone outside of my classroom) using a rubric, perhaps I could get reliable and valid data from this method. I will also be able to see where students are coming from and what their strengths and weaknesses are before I begin working with them. 
I look forward to the weeks to come when I will be giving my post-assessment and be able to see if my students have grown. I will continue to post my results from this assessment journey I am on!

Wednesday, February 20, 2013

Aligning to Common Core in the (Online) Art Classroom

As the 2012-2013 school year continues to tick by, we continue to align the Art 1 classroom to meet the Common Core State Standards (CCSS), which will be mandatory by 2014-2015. Though it seems far away, my teammates and I are already working towards 100% alignment. Of course we all still have many questions. We spent last week together in PD brainstorming ideas for aligning our Art 1 curriculum to the CCSS. In many cases we are adding small written assignments to accompany drawing projects. This has lead to some shifts away from reading quizzes and towards short writing assignments. We also have changed some projects to incorporate more ideas of visual communication as a form of writing. As far as CCSS, I am continuing to follow the idea that art is a text meaning students can read artwork as a text and write artwork as a text to meet these standards. 

One of the lessons we’ve changed is the still life lesson. Before: students are instructed to choose 3 objects, set them up in a still life scene, and draw them using 7 different values. After CCSS changes: students are instructed to look at examples of still life paintings/drawings that tell a story. They will choose 3 objects that tell a story (drawing instructions are the same as before) and they must title their still life drawing something that describes their story. A rather small change not only aligns with CCSS but also incorporates more meaning and excitement into this project.
In addition to artwork as a text, it is helpful to know what your school offers in the way of textbooks or online resources to provide students with readings at grade level that go along with your content. 
In the texture lesson, students currently learn the differences between simulated (2D) and tactile (3D) textures and create a texture study by drawing out 4 different textures. We thought this would be a good opportunity to have students look closer at sculpture through an article in Scholastic Arts Magazine. For teachers who don’t know about this resource, it is an amazing way to align to CCSS. It provides articles, images, videos, and even written and multiple-choice assessments for grades 4-12! Right now, all the digital resources including issues of the magazine are free, though at some point will become viewable only to subscribers. We are going to use the section on sculptures from a recent issue to have students write about the role that texture plays in whichever sculpture they choose.  
 Looking at our lessons to align them with CCSS has allowed my team to focus on changing lessons that have been weak in the past. A lesson many students have trouble with is our Cubism lesson. Students learn about the style of cubism and about Picasso and Braque. With this knowledge, they create 2 pieces of art, one that is realistic, and one that is a cubist version of that same subject matter. We discuss the differences and similarities between analytic and synthetic cubism but students still have trouble with this concept, especially when it comes to making their cubist artworks. Thus I have added a reading and sorting activity to this unit to help students spend time looking at synthetic and analytic cubism more closely. Students will get their reading from Encyclopedia Britannica and use the reading to guide them in arranging characteristics of analytic and synthetic cubism into the correct categories.  

Whatever lessons you teach in your art classroom, aligning to CCSS does not have to mean big changes and extra work. Small changes and additions can make your lessons more meaningful and help students succeed.

Monday, January 28, 2013

The Perks of Data



Pre-test grades earned by students
I am beginning the second week of my semester this week and learning a lot about my students. As I have talked about in previous entries, I have students fill out an “interest inventory” or get to know you assignment at the beginning of my class. This semester, I am also piloting a pre-test that measures what students already know about art. At the end of the class they will take this test again (with some different questions on the same information) to display the growth they have made in my course. My interest inventory has always told me much about what my students wanted to learn and what they already knew, but the pre-test has taken it to a new level. I am now able to gage the level of understanding for specific concepts. I put a question in the pre-test asking students if they had ever taken an art class before, it turns out that 55% have prior art experience while 45% do not. Almost half of my students are completely new to this subject so depending on their interests, they may have never drawn realistically before. I analyzed the data from the test to see what concepts students were widely familiar with and which they were often incorrect about. Students understood foreground, pattern, texture, portraits, primary colors, mixed media, and abstract art, or they were at least able to guess the correct answers for them. I was surprised to see how much they already feel comfortable with coming in. This tells me that when I get to these concepts in the curriculum, students won't need as much time in the lesson to focus on the terms, but perhaps we can spend more time going over examples and brainstorming for their projects. On the other hand, students were often incorrect on the questions about linear perspective, value, art criticism, and cubism. This data seems to match up with what are usually some of the most difficult lessons to teach. Having this information early will help me focus in on these lessons and provide multiple ways of learning. I added a question to my interest inventory that I found to be very helpful in understanding what methods I should use to teach these lessons. When asked which method students preferred for learning a new technique, they preferred demonstrations most often (see below).

Now I know what my students feel more comfortable with, what they will most likely struggle with, and how they learn best. With a class of 260 students, trends in data are very important to pay attention to! I will use this data to guide my instruction and look forward to seeing student growth at the end of my semester. 

Tuesday, January 8, 2013

Trying New Things

 
I apologize for the lack of entries lately. Winter break kept me busy relaxing. I am now getting prepared for the second semester of this school year and the first time I will be teaching Art 5. I am excited to finally put the course to work and see how students respond. I also have added more assignments to Art 1 that align with the Common Core standards as well as a pre-test and post-test to measure student growth. Starting next school year, 50% of my evaluation will be measuring student growth in my class. Next semester the Art 1 classes will test a multiple choice, multiple answer, essay, and short answer assessment. I am very excited to see the results and also a little nervous to see how much my students learn and retain at the end of the course. The pre and post-tests include art history and media questions as well as well as questions that have students explain why they chose a particular answer for a previous question, as the PARCC test will do. Lastly there are two essay questions: one that asks students to write about the merits of art education in schools and the other a critique of a specific piece of art they have never seen. I will be sharing the results of the pre-test and I believe this data will help drive my instruction. Previously I have issued a survey for students to take where they are asked what they already know about art, rather than specific questions. I believe the pre-test will give me more specific results. Also, this semester I am taking a Spanish course online. This is the first course I have ever taken online and I am doing an experiment to see how I perform in such an environment. I am already starting to understand the perspective of my students and the challenges of self-motivation. I am hoping these findings will help me serve them better. Stay tuned!

Tuesday, December 4, 2012

Thoughts on Common Core and the Arts


I just spent the last 2 full days learning about the Common Core State Standards (CCSS) and the PARCC test that will go along with them. While at first overwhelmed and confused about how to apply these new literacy standards to the existing art curriculum, I have spent time researching what others are doing and working with my teammates to come up with some ideas. I am now very excited about these new standards. It has been said that the shift from the OGT test and current standards to the PARCC test and CCSS will switch our focus as teachers from teaching students what to think to teaching students how to think. And while the OGT’s never tested the arts, the CCSS for literacy is being introduced as everyone’s responsibility. They even have specific standards for us to meet, grouping all electives into a category called “other technical subjects”. Though this gives us art teachers more to cover in our classes and more curriculum to write, I am happily embracing this challenge to help our students become better thinkers. It seems to me that the CCSS are here to encourage us all to be better educators and really prepare our students for college and careers. Looking at the standards there were many things I was unclear about. One point of emphasis in the literacy standards was having students read complex texts. At first I wondered where we would find these complex texts for our students to read (online we do not have a text book to refer to) and also how these complex texts might relate to visual learning. I started googling “common core and the arts” and found a very helpful blog post (here) that outlines how a piece of art can be a “text” that students read. This really helped me get past my confusion and helped me come up with my first CCSS aligned lesson for my Art 1 classroom. Students complete a project in Art 1 where they create two portraits where at least one contains symbolism. In our live session we look at Renaissance portraiture and how artists communicate to the viewer about their subject such as personality or social standing. Though we always discuss this topic, I never have them write about it. Therefore, this lesson was one that could use a writing portion, and why not align it to the CCSS? Below is the assignment I came up with that I will be trying out next semester. It encourages students to “read” the pieces of art, analyze them, and provide evidence for their conclusions (evidence is very important in the literacy CCSS).

Portrait Analysis
You will begin your study of portraits in this lesson by looking at and analyzing the way that artists create portraits. Portraits often contain symbolism within them. Symbolism is the use of something that stands for or suggests something else by reason of relationship, association, convention, or accidental resemblance. When artists use symbolism in portraits they are communicating about their subject to the viewer. For example, the type of clothing a subject is wearing in a portrait can tell us about their social class or the culture they come from. The objects surrounding the subject can tell about them too, if they are surrounded by books perhaps they are a student or scholar. For this assignment you will act as a detective to find clues within 2 portraits that inform you about the subject of the work!

Artemisia Gentileschi, 1615
Self Portrait as a Female Martyr
Paul Gauguin, 1886, Self-Portrait
Frida Kahlo, 1940
Self-portrait with Thorn Necklace and Hummingbird
Kehinde Wiley, 2007, Dwayne I

Your Assignment
  • You will need to choose 2 portraits to write about from above. Write a detailed paragraph about each portrait answering the following questions:
    1. What kind of social class is the subject from? (wealthy, poor, middle class, royal...etc.) How does the artist communicate this?
    2. What do you think the subject's personality is like? How does the artist communicate this?
    3. Are their symbols present in the portrait? What do you think they mean? Why?
    4. Why do you think this portrait was created? Is there a story behind it? Why or why not?
  • Make sure you are giving specific examples of evidence from each portrait for your answers.
  • Think about how these artists captured their subjects in these portraits when creating your own portrait drawings! How can you show this person's personality and likeness? How can you incorporate symbolism?
  • Submit your finished essay to the dropbox.  

I am just beginning this task of aligning curriculum with the CCSS but I expect I’ll be posting more lesson ideas soon!

Wednesday, September 5, 2012

Building Learning



The dust is beginning to settle this week as we recover from some technical difficulties with our LMS (learning management system) last week. I am starting to get back into the groove of the school year contacting and welcoming new students and grading their first assignments. This week, students are working on using proportions to create a sense of space in their drawings. Like many Art 1 classes, mine focuses on foundational skills, at least at the beginning. Later, students will learn about linear perspective, which shows them how the foreground, middle, and background connect with this mathematical concept. An important element of any lesson in my online classroom is that is builds upon student learning and provides a foundation for future learning. When the connections are there, students retain more, and I can really tell when students understand the content. For this week’s lesson, students will complete a drawing of an interior room that uses the foreground, middle, and background to create depth and space. Part of their learning takes place by reading the lesson and looking at examples, but I feel the main part of learning takes place when they are asked to demonstrate it. A student might go through the process, “Now I’ve read about it. I know what it looks like. How can I create it? How can I make it my own?” I think that last question is especially important. I encourage my students to make each assignment personal even when the content is technical. In my online classroom I assess in chunks. Each week has a small project for students to complete which helps me witness students building upon their learning as they go. Assigning one project per week keeps students continuously learning and practicing their new skills. Creating is a way of learning that encourages problem solving and I love to see what my students come up with.