# A Self-Organised Assessment Method (SOAM)

A few year ago, I was a bit curious
about how well learners can evaluate each other. I designed a small
experiment to find out. It goes like this:

- Take a group of learners, say 15 in number, in a classroom.
- Give everybody 15 sheets of paper and ask them to write their names on the top right corner of every sheet.
- Now, ask everyone to write down a question about something they have recently learned, been taught or discussed. It should be from whatever course you are conducting. The question should be such that the person making it should be confident of answering. Also questions should be such that each can be answered in two minutes or less.
- Now collect all the sheets with the questions. If there are questions that are very similar to each other, then ask one of the authors to change his or her question.
- You can now construct a question paper with 15 questions. Make 15 copies of this question paper.
- Distribute the question paper and start a 30 minutes examination. Each learner has to write the answer to each of the 15 questions on a separate sheet of paper. On top of each answer sheet, they should write 'Answer to Q no. x' etc. Each person must answer all the questions except the one they made. So each person has 14 questions to answer on 14 sheets of paper.
- After the time is over, collect all the answer sheets and put all the answers to question 1 together, all the answers to question 2 together, and so on. At the end, you would have 15 piles of 14 sheets each.
- Distribute all the answers to question 1 to the author of that question, answers to question 2 to the author of that quesiton and so on.
- Ask each learner to give marks out of 10 for each answer sheet for the question authored by him/her.
- After all the answer sheets have been graded, take them back and re-group them by the name of each learner. So, now you have 15 piles of 14 sheets each, for each learner.
- Total the marks for each learner and convert to a percent score. You now have a list of scores.

In other words, you have conducted an
examination without making a question paper and without having to
mark a pile of answer books.

I tried this for three years in the
course I teach on Educational Technology for M.Ed. Students, each
time usually after the first two weeks. There is an uncanny
correlation between the scores and the scores at the end of the one
year course. I haven't yet done all the stats and written it all up
as a paper but I will.

In the meanwhile, I thought you might
like to try....

## 16 Comments:

Yes I am using it tomorrow in a training program for star managers of HDFC Bank tomorrow and shall keep u posted Doc

Jai Shankar

Excellent I shall implement with our M.A II Education students opting for ICT & ODL.

i SHALL ALSO SHARE THIS With Dept of Education-University of Mumbai

I'd like to figure out how to do this on mobile phones or Moodle.

This is excellent, I hate grading papers... I am going to use this next time I assess my class

Please do let me know how it went, if you tried it.

The batch size was 24.... and we did it with what was a competency mapping for a STAR MANAGER....24 Qs and As... and the correction happened.

The following were direct inputs to the particpants.

a) They could do a relative grading of their skills and identify with areas of improvement.

b) It gave the extremes of the managerial abilities and the standard deviation on the various skills

c)The total time taken for this activity including collection, segregation and redistribution was approx,150 mins

The side fun

a) Methods of collection and distribution were tried with one volunteer to multiple volunteer to individual collection as processes which gave access to decision evolving skills in the workshop as well as TEAM BUILDING by calling names and recognising each other..

THanks

Travesti

This comment has been removed by the author.

Do you think this would work with younger students? Perhaps not the grading part, but...

Great Jai Shankar! Thanks. Yes, Mashail, it will work with children and marking is also allowed.

I am looking forward to reading your paper. We are trying Self Organized Assessment Methods in the NZ Primary School context (children aged 5-11 years old) where they use technology to capture their own evidence of learning. Will share our findings too!

I'm doing it with my college students, and since they're studying to become teachers, I will also ask them to create and specify the parameters for a correct answer (like a rubric or checklist), then I'm killing two birds with one stone.

www.ted.com/tedx/events/6082

Can we try and emulate this experiment on a Tablets (laptops?), network, asynchronously, over the Internet, and probably Cloud hosted ? Something like a MOOC, but for testing and evaluation?

Any takers?

I am tinkering with 21st century communities and villages. Knowledge Machine is one key component. Wondering how MOOC's, Flip schooling, Khan Academy and continuous learning, can shape up?

Vipen Mahajan.

ex-NIIT in the 1990's.

Regards, Sugato.

vmahajan9@gmail.com

We may have an environment where we can allow students to write questions. Only multiple-choice though, but the exams would be automatically graded.

Gunnar

Any advice for 4-5-6-7 year olds who are not very proficient readers or writers yet!

Hi, I have used Socratic Dialogues - self written, to assess what I know about any particular subject and create more questions. I have done this successfully and reckon having students write their own dialogues could be a way of self assessment or group assessment if the dialogues are read by others. I would appreciate your own thoughts on this. I have written as much eslewhere on this blog following listening to your interesting TED talk. Many thanks and kind regards.

Robert L. Fielding

Post a Comment

<< Home