Archive for December, 2011
This will be a quick update to my post from earlier this week. As I mentioned previously, PASS has plans to do away with all paper evaluation forms in the future. This change can come none to soon for me! After I published Fridays blog, I was contacted by a speaker who had some evaluations in their report that obviously werent theirs. So, after some digging, the staff at PASS HQ figured out that during data entry several evals were incorrectly included under this speakers session id. We corrected the scores and doing so caused the overall “top 10” to change slightly. The updated top sessions with ties is now actually a top 12 list where before it was actually a top 11. Additionally doing this updated the track rankings in the BIA track as well. I apologize for the mix up on these evals but, I guess this is not totally unexpected when hiring temporary workers to enter 8,000+ individual evals. The updated rankings can be found here
Every year after the Summit the results of the thousands of evaluations are tabulated. It seems every year the only question I hear after the summit is “when are the evaluations coming out?” Well dear reader I’m happy to say, that day is today. First id like to point out that this year we had well over 13000 unique session evaluations which is an increase of about 30% over 2010.
Online Evaluations produce unexpected results
One interesting thing I noticed in this years online evals was that we received evals for all sorts of “events” that happened at the Summit. Normally, we only get them for sessions but because of the way the session scheduler was automated and integrated into the session eval forms, we actually received evals on many other events that took place at the summit other than regular sessions. Receiving candid feedback on these events was quite refreshing and will be worked back into next years similar events.
Moving into the 21st century
This year since we offered online evaluations as well as paper evaluations I was interested to see what the turnout would be and while the amount of paper vs online evaluations entered was more lopsided towards paper than I’d have liked. I believe that overall they were well used and next year we plan on only having online session evals. I expect that if the room monitors push the online evals in the same manner they pushed the paper this year that we’ll get enough evals next year for this to be an effective option. The real benefit other than costs of entering paper evals and killing trees is that if all of the evals come in a digital form I would see no reason that they shouldn’t be ready either real time or within a week or 2 from the end of the event but, Ill leave those details to next years Board member whose in charge of the Summit.
Without Further ado, Here’s the link to the 2011 Summit top 10 list
The top ten was calculated by averaging all of the evaluation answers then we excluded results if there were less than 20 evaluations or 20 attendees.
Also, if you were a speaker, You can log into the PASS Speaker portal site and get your full evaluation results (and the overall event scores) from the following link
Please join me again in congratulating all of the speakers from this years Summit, without them and their excellent contributions our community wouldnt be the same.
Edited-> I had the wrong filter criteria on our exclusion of sessions from the top list specification. I stated we excluded if there were less than 10 evals and 10 attendees when the number was 15 each, I apologize for my fading memory.