Video, video and more video!

I have spent the last two weeks video interviewing tutors and learners and editing the footage. This is proving to be very time consuming, especially where the learners are concerned. On Monday I waited around for an hour to talk to learners from the Creative Media class. They were meant to meet me at 3.30, but the tutor decided to let them watch a film as it was the end of term, so I finally got to see them at 4.20, by which time they wanted to leave. I managed to get 10 minutes of their time.

A lot of the tutors did not want me to talk to learners until they had finished their exams, at which point many of them are no longer attending College, so this has proved to be particularly problematic.

The tutor interviews have been more successful and I feel that I have more to work with in the final report. I have decided to edit them into smaller bite size pieces, which will focus on specific uses of the technology (e.g. using Assignments, Quizzes) rather than an amorphous mass of everything they did. This will be easier for me to analyse and will make for easier viewing for others.

Mahara ePortfolios

This morning I worked with the Creative Media students to help them to create views of their Mahara portfolios, in order to submit for assessment and moderation. Each student has created six folders for each area of the qualification in their portfolio, and the tutor and I decided to get them all to create the same view (as a sort of 'template' view) so that when he marks the work it will all be in the same format. We used the 'Display a folder' option for the views so that it generally fits on one screen and then if a student uploads any additional content, they do not need to change the view as it will automatically update, even if it has been submitted to the tutor.

This is an example of one of the views. The students will now generate secret URLS in Mahara, so that when the tutor is ready to submit the views to the awarding body as evidence, he will simply provide a list of URLs and the examiners will be able to view all of the portfolios.

Changes to interview plans

I had originally planned to get our multimedia designer to film my interviews, but on reflection I am going to do them myself using the flip camera. It is a more flexible arrangement as any last minute changes to plans can are easier to arrange and perhaps more importantly tutors and learners being interviewed are more comfortable with just me and a flip. Once the flip is set up and running people tend to forget that it is there and will therefore be more relaxed in front of the camera. Although I thought that the sound in some of my previous interviews was not too good, I think that was due to the rooms used and this time I have booked time in our small training room, which is nice and quiet.

I am also going to speak to learners and tutors from other curriculum areas who have used other tools to get a wider range of feedback and not the IT Diploma learners as I had previously intended to do.

14th June 2010

Today I worked with the the learners from Addey and Stanhope school who are studying on the Creative and Media Diploma. They are planning to upload all of their coursework into their ePortfolios and then submit the work to Edexcel. This is the first time we have tried anything like this and the tutor thinks that it will make a vast difference to the time it will take in submitting all the work, as he will only need to supply web links to the views of their work. I will need to spend another session with them showing them how to create the views, but we are very excited about how this will work. We are also encouraging them to use the CV feature and to use the blog, as they are required to keep a journal in this course. Due to the nature of the course they are creating videos of their work, so this is an ideal vehicle to display what they have done.

I am looking forward to being able to get some positive feedback on the use of Mahara with this group of learners - watch this space!

Preparing for final interviews

I am currently preparing my questions for the interviews with learners and tutors for the final phase of the project, which is proving to be a logistical nightmare. As well as negotiating times to interview the tutors I need to book a room to record them and also to liaise with Henry, our multimedia designer, who is going to record them for me. Although my previous interviews were recorded using a flip camera, and the quality of the video was good, the sound quality was not as good and it was sometimes difficult to hear what was said.

I have arranged to go into both the Higher and Advanced IT Diploma group classes in the next couple of weeks to get volunteers for interviews. I hope that they will volunteer to be interviewed, but if not, the plan is to offer them a store card (value £20) as an incentive, but this is really a last resort. Following the last JISC event, I had received suggestions of incentives that I could offer. One suggestion was to offer printer credits, which with another group would be useful, but these groups of learners do not need to print out their work for either assessment by tutors or final submissions for the course, so not practical in this instance.

May 2010

Not much activity this month. The IT diploma students have finished the controlled assessment and are getting ready to go on their work placements. They have been using their Mahara ePortfolios to create their CVs which will be submitted to employers prior to their placements. I hope to get some feedback from some of the employers about the content and usefulness of CVs presented in this way.

Following the meeting with the creative media diploma tutors and our school contact, I arranged for two members of staff from the school to have access to the learners PDPs as agreed and provided instructions for logging in. I have been checking to see if anybody has looked at the PDPs, and to date they have not even logged in to the course. This is very disappointing as the school liaison was keen to participate and had expressed a special interest in being able to see the learners attendance and punctuality information, rather than waiting for register information to be sent to the school.

They had also agreed that the learners would be able to access a chat room, in the course, on the Learner portal during their IT sessions when at school. This has not happened and Nik, the course tutor, has spent several Thursday afternoons waiting for somebody to join him in the chat room! I spoke to some of the learners to find out why they were not accessing the chat room and they said that their school teachers needed them to spend the time on their Functional Skills. We have a meeting arranged in early June which will be an opportunity to ask why the school contacts did not access the Learner Portal.

New collaborations

Had a meeting today with the Creative Media tutor and a representitive from the secondary school who the College is collaborating with on the diploma delivery. Nik, the tutor, has agreed to run an online chat on a Thursday afternoon when the diploma students are in an IT lesson at the school, so that they can communicate in between their lessons at the College. We are also enabling the school tutors to access the learners' PDPs so that they can be fully informed of the learner progress and crucially, any attendance or punctuality issues will be immediately highlighted. I hope that this will provide more data for the final evaluation, especially around the collaboration of stakeholders.

Interim evaluation report

I have now finished the interim evaluation report. It has been hard to write, as instead of having too much data to analyse (which I had feared would be the case) I haven't had a lot to work with. Feedback from students has mostly come in the form of questionnaires and discussion posts and I have been unable to interview as many tutors as I would have liked. Because the Diploma in IT is delivered solely by the College, there have been no opportunities for collaboration between the different stakeholders, which in turn has limited what I could evaluate.


I hope that in the Spring term things will be different. The learners will be going on work experience and the Mahara ePortfolio will provide opportunities for more sharing of information and feedback between employers, tutors and learners.


Also, next term I will be extending the evaluation to include a group of students, who are studying on the Higher Diploma in Creative Media. These students are 14 and 15 year olds who are based at a local school and they only attend the College once a week, so this presents an ideal opportunity to look at the effects of the support that can be offered by different features of the Learner Portal whilst they are away from the College.

February 2010

Rushing around trying to get data for the interim report and make some sense of the data I have already collected. Trying to find time to speak to tutors and learners has been difficult - everybody is so pushed for time, especially as they are currently in the controlled assessment phase of the delivery. Trying to find a quiet room to film videos, that is free when the tutors are free, is proving difficult and I have had to redo one video because the sound was too poor.

Using the PDP

I do not think that the learners are using the PDP to its full potential and I need to try another tactic to engage them. We have arranged another event for the whole Diploma team and this time I am going to bring my colleague, Angela, who is the eLearning link person for the school of CIT in the hope that she will be able to work with tutors and support them with their use of the Learner Portal.

We have also discussed ways that we can engage the staff and learners and to get them to see the value of its' use, and she has suggested that I post a question on the discussion boards in both courses in video form. As the learners studying for the Higher Diploma have been given devices to record audio for their media projects, they will be able to record their responses to the discussion and upload. Provided I frame the question and also provide a bit of background to the use of the PDP, I hope to get some more valuable feedback. Although they have already contributed to the discussion board, it feels very much like "I've been told I have to do this, so I will do as I am told"!

I do not think they can see the value that the PDP could add to their learning experience and I hope to be able to change this. I am going to provide an example of a PDP with which to inspire them and to allow them to see how it could really help them.

Second group session

I decided to try to talk to the whole group of Advanced Diploma students and this time use the Turning Point voting buttons to engage them. This was more successful than the last group - they were more animated (in fact a bit too lively) and they seemed to enjoy using the voting buttons. Jo came with me to video the session, but they did not want to be filmed. Therefore Jo tried to record their feedback by pointing the camera at the floor and simply recording audio.

After a few warm up questions, I began to ask them my questions about the use of the Learner Portal. They were happy to vote but when I asked them to expand on the answers they had given, I had difficulty in getting them to answer sensibly. They were very loud and although Jo recorded their responses it was hard to transcribe. There are a few nuggets that will be in my report.

I am not sure how much I have got out of this and whether the results are any better than if I had just asked them to complete a questionnaire. It would have been much better to do this with a small group, but they are unwilling to put themselves forward for this. Perhaps now that they have met me this might be a possibility.

Meeting the students

I have been trying to arrange focus groups with both ICT Diploma groups without much success. In both groups the students are very reluctant to put themselves forward, so much so that in the Higher Diploma class only one student is currently willing to attend - not sure that they can be a group of one! Added to this they are beginning to enter the controlled assessment phase of the course and time is getting very tight.

I therefore thought I would go into the class this morning to meet the whole class and ask them my questions whilst their tutor set up their PCs for the assessment - my thinking here was that if I met them all together they would be less reticent. Hmm - how wrong could I be. They were unwilling to be videoed and getting them to respond to my questions was like pulling teeth. One or two of the group had a few things to say, but for the most part, responses were monosyllabic and not particularly illuminating. I was hoping that following this morning session, I could encourage a couple more of the group to join in a focus group, but they are still unwilling.

I have since spoken to the tutor, who informs me that they were quiet because they were nervous about starting the controlled assessment so maybe there is hope yet. I still have to get them to complete a questionnaire, so hopefully this will provide better feedback.

I have a similar session with the Advanced Diploma group on Thursday - this time I am going to try to engage the group by using the voting buttons. Watch this space.