Sunday, March 16, 2008

[Eval 08] Week 4

I have chosen the guidelines SD1 and SD8 as the guidelines I would like to focus on.

For a bit of background, I work with home based workers who have to do training as part of their professional development. They are independent contractors and therefore not on a salary which would cover study time. These two guidelines probably address two of the most significant issues we have currently.


SD1: Are students able to agree some or all of their learning goals in negotiation with teaching staff?

We have major issues with trainees starting then not completing each module. This is frustrating for both the trainers and the office. Trainers are paid upon completion of each trainee completing the module, however over the last year we have had a dozen or so who have started, then decided for whatever reason not to continue. This is also frustrating for the office as we train people because we have a need for a certain number of people to be proficient in certain areas, if the trainees drop out then we are left without the required number of people able to do the work.

Therefore the issue is, how to ensure that people complete their exercises within an acceptable timeframe? Currently, we do not negotiate with each person their own individual timeframe, however I think that this is something which needs to be put in place at the beginning of each module, with a record kept both by the trainer and the office. If the timeframe is not being adhered to, then some discussion and possible renegotiation with the trainee needs to be done. To do this will also give the trainees some clear indications of how much we expect from them and would form the basis of a study plan. The trainers would also benefit from knowing what to expect from the trainees and would be able to better balance their workload.

SD8 – how to assess the value the students give to the course? This is something that has not been done before, apart from the basic 1-5 rating schemes which, as they are emailed back to me, are probably less than truthful. I have thought long and hard about this since we had the computer conference 2 weeks ago. There is the basic problem of how do you do it in order to receive truthful, constructive feedback, and who do you ask? As in all areas of life, there are people who would never have a good word to say about anything, therefore if such a person provides damning criticism of the course, is it valid feedback? However, to exclude such a person from a feedback exercise, isn’t this also tipping the balance? I think that the method of feedback collection has to be done so that people cannot make sweeping criticisms and if they have something very negative, or positive, to say then it must be backed up with examples.

There is also the issue of actually getting people to complete the feedback in a timely fashion, or even to complete it at all. Private companies seeking feedback from their clients often offer incentives such as prize draws etc, unfortunately, we do not have that luxury.

I have looked at online survey sites such as Survey Monkey which anonymise the feedback, taking away the fear of speaking your mind. The site also provides different ways of obtaining feedback, rather than just a 1-5 rating scale. I definitely need to look at alternatives to the traditional way we collect feedback, which isn't working.

6 comments:

Hilary said...

Hi Lesley

Apologies if I have missed something in one of your earlier postings, but I was a little confused regarding the dropout rate when training is a compulsory part of the PD for your trainees. There is obviously the option to drop-out but I just wondered what repercussions, if any, this has on them personally for the future?

Lesley said...

Hi Hilary,

They are contractors and not employees so we can only suggest that they do the PD. If they don't do it, then obviously they miss out on that line of work, but some of them are happier staying within their comfort zone, even if it does mean missing out on work.

A lot of them start and then can't be bothered carrying on. This does lower their profile for us when it comes to distributing work and is something we have been focusing on recently - with a good take up rate for training and completion among newer contractors.

Bronwyn hegarty said...

the issues you identify Lesley are quite sensitive areas I would imagine for a private training organisation.

I can see how learning contracts could prove very useful to address SD1 and the issue of people not completing modules.

For SD8, you will need to be quite creative to get the honest and constructive feedback you need to make improvements - which in turn could help address lack of completion of the modules. Your guidelines are very complimentary to each other and could have very important implications for addressing the issues you have identified in your workplace.

Great choice! :)

Jennifer said...

Hi Lesley,
motivation - a really hard one! Is the timeframe set by the instutution or by the students? After all if you don't work in Education (or have other family members involved) the term/semester scenario loses it's relevance. If this could be avoided then part of the negotiation strategy could circle around the 'are you ready to learn' scenario and the student could set a realistic timeframe for completion.

Feedback - in my experience it's not the answers but the questions that matter the most. You get what you ask for in this life - so maybe a more structured questionnaire on feedback is the answer - limiting the possiblity for falacious answers.

Enjoyed your post - really some good food for thought.

Cheers
Jennifer

Bronwyn hegarty said...

yes a good idea jennifer re a more structured questionnaire. as you say you will not get meaningful answers if the questions are not right.

I wonder if skilled interviewing in a focus group would extract more information as well.

Gordon said...

Hi Lesley,

Your post raises several interesting points and I wondered what sort of courses you are running.

The issue of non-completion of distance learning courses is one that seems to crop up often. There are several factors that may be at work. An example of one study can be found here http://eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/27/f6/ae.pdf and it concludes that personal issues were a significant factor, outside of the course itself. However it does also go on to recommend some key general design principles for successful distance learning courses which may be of interest.

Not mentioned is the issue of the adult learners taking what they want from the course and then stopping at that stage.

I can understand your vested interest though and the reasons for selecting SD1, given that the trainers only get paid on the basis of the number of completions.

Gordon