Click Here for Past Newsletters

    
CIASTD Member Newsletter October, 2002
CIASTD Chapter Services
8444 Castlewood Drive, Suite 400
Indianapolis, IN 46250
(317) 841-1395
Fax: (317) 841-8206
To send us an email, Click Here: info@ciastd.com
In This Issue:

Other Links:

Editor:
Jay McNaught

VP for Communications:
Debbie Featherston

Design:
MP Records Communications

 

A Message From The President
From Sharon Boller
President, CIASTD

I've Got Fall Forum on My Mind

Potato soup is simmering on the stove, I'm wrapped in a sweatshirt, and it's Sunday evening. Fall is definitely in the air - even if the temperature did reach 80 today. Every year for the past nine years, CIASTD has hosted a one-day conference in November. Our highly original name for this event is Fall Forum. The word forum helps convey the idea that this event is an opportunity for training and development professionals to communicate ideas and best practices with one another. The word Fall helps convey the idea that this great event happens in the….Fall!

I'm amazed at how this event has grown and grown up over the past nine years. The first conference involved about 40 attendees, and it was held at the Primo South. Gradually, planning committees got more sophisticated, the conference break-out sessions became more numerous, the number of exhibitors increased, and the event GREW! More and more people started to come and the space we needed got bigger and bigger. This year's event is targeted to attract 200 attendees!

Under the direction of Vic Holove (VP of Special Events), this year's event will blow away last year's event in terms of quality and diversity (and last year's event was awesome!). The theme Reality Revolution is timely in a way the committee probably couldn't even have envisioned when they chose it at the end of 2002. The caliber of speakers and presentations is simply outstanding. For the first time ever, we have pre-conference events (Calculating ROI, Using Extended DISC, and Creating Fun in the Workplace) and an evening cocktail hour to kick off the main event. We have an oh-so-timely keynote presentation on the issue of trust in the workplace (can you say Enron, Xerox, and Arthur Anderson)?

We have encore presentations from Len Mozzi (using theater techniques in training) and Leslie Yerkes (creating fun in the workplace). I personally saw both of these presenters during the year, and I can honestly say they were among the most powerful, helpful presentations I've ever attended through CIASTD. We have some of our own chapter members contributing including Dan Johnson and Karen Valencic, two of our members' perennial favorites.

If you attend no other CIASTD event this year, do NOT miss the Reality Revolution. I truly believe it can revolutionize the way you view performance and the way you improve performance!

See you on November 8.

Sharon is the founder and president of Bottom-Line Performance, Inc. She has been in the field of training and development for more than 15 years and has gained extensive experience in instructional design and performance consulting.

Back to Top

October 11 CIASTD Meeting
By Scott Horvath, CIASTD Newsletter Committee

Improving performance is a key factor for any organization and its employees. In October, CIASTD presents, 'Program Results Based Performance Improvement,' a short seminar to assist you in developing performance consulting, analysis, and evaluation strategies for any intervention.

This workshop will improve the way your work group influences the performance of the organization by using proven techniques and methods used in progressive organizations. The results oriented approach of guest speaker, Patrick Whalen, will help you develop interventions with the focus on the expected results providing lasting solutions that constitute a true results-oriented approach.

You will be provided with skills to better understand the basic criteria and fundamental elements for developing performance improvement interventions, determine the components and steps of results-based performance consulting, analysis, and evaluation throughout the entire process and discuss the key issues surrounding potential implementation, and ultimate payoff of results-based performance improvement.

Patrick Whalen is Director of Analysis and Measurement for the Jack Phillips Center for Research, a division of Franklin Covey. He provides consulting and facilitation services for a variety of organizations. In addition, Whalen has authored and co-authored several articles and chapters on topics such as improving job performance, measuring ROI, and performance consulting and analysis. He has presented at numerous professional conferences.

The October 11th participative workshop will be divided into two distinct sections. The first part of the presentation is a brief discussion of key issues driving this results based approach. Throughout the remainder of the presentation, the comprehensive process is explored using several exercises taken from actual situations. A variety of handouts are used to enhance understanding. All sections of the presentation involve a combination of lecture, group discussion, and activities. Participants will also receive a comprehensive quick reference Results Based Process guide.

Please remember to come early to capture the best seats and to enjoy light snacks and beverages at our Cranberry Juice Cocktail Hour starting at 7:30 a.m. Registration for the program will begin at 8 a.m. and walk-ins will be subject to a $5.00 door fee. The presentation will be 8:30 - 11:00 a.m. at the Ivy Tech State College, Fourth Floor Auditorium. Ivy Tech State College is located at 1 West 26th Street near downtown Indianapolis. Free parking is available behind the building (enter just north of Fall Creek off Illinois St.).

Click Here to Register Securely on the Web

Back to Top

September Meeting
CIASTD meetings always feature excellent presentations. The September meeting was no exception.

"Let's start at the very beginning…" Pat Todd opened her presentation with a song. "When you read you begin with ABC; when you train you begin with ADDIE." She explained that in the ADDIE (Analysis, Design, Development, Implementation, Evaluation) training development model, the E (evaluate) comes last, but we really should think of it at the very beginning.

Pat said there are many reasons to do evaluation. Evaluation helps us to do continuous quality improvement. Evaluation helps us demonstrate the value of the training. Evaluation should also validate that the training met the established business objectives. Because evaluation should be closely tied to the business objectives, it should be planned and considered at the very beginning of the training development project.

She showed a flowchart the depicted the entire scope of the evaluation process. Throughout the flowchart, she emphasized loop-backs that took the information learned during evaluation and used it to improve future training.

Pat encouraged us to utilize an evaluation strategy. There are many benefits to having an evaluation strategy in place. The strategy helps to establish priorities by linking products and services to the business objectives. The strategy encourages everyone to view evaluation as a process and not simply an event.

Typically, when we think of evaluation we think of Kirkpatrick's levels of evaluation, and we focus on the four levels. Pat pointed out that there are really five levels of evaluation. The first four levels are:

  1. Measures Reaction… how did the students react to the training?
  2. Measures New Knowledge… what did they know after they left versus what they knew before they started the training?
  3. Measures Behavior Change… how do they use the training? What do they do differently after the training?
  4. Results… did the change in behavior positively impact the organization?

Pat then explained that the fifth level of evaluation was has to do with ROI (return on investment).

If you can't always do level one evaluation, there are certain times when it is very important. Pat asked the group to brainstorm on when these times might be. The audience came up with some good ideas that included:

  • When you first roll out a new course
  • When there is a change in content in a course
  • When you have a new instructor.
  • When you are delivering a program to a new location
  • When there is a potential problem with a program that may need monitoring

What are the criteria for conducting level two evaluations? The audience came up with the following:

  • You need to make sure that people have reached a certain level of knowledge before allowing them to progress to a different level - this becomes a type of pre-screening to make sure that those going to the next level are prepared
  • When you need to demonstrate knowledge transfer
  • When it is critical that individuals learn the content of a program (safety, certification, regulatory, etc.)

When should you do level three? There are times when you can't. For example, if you are a vendor providing training for other companies, you may not be allowed to get in and measure changes in environment. However there are times when level three is particularly important:

  • When you need to evaluate to see if the environment is supportive of changed behavior
  • When the training will impact the business drivers
  • When training is expensive it becomes even more important to document changed behavior
  • When behaviors are critical
  • When trying to determine if there are environmental behaviors that are preventing change
  • When there have been past failures with similar training
  • When management requires it

How about level four? It becomes particularly useful when trying to predict future outcomes. It is useful for preparing to quantify the outcomes or results of specific training.

Level five information came form the Jack Phillips Institute on Research. There are very important times to conduct this level of evaluation. There is actually a lot of overlap with level four, since level four in many ways paves the way for level five. Overall, level five becomes very strategic when it is important to demonstrate that the training was cost-effective.

Pat continued the presentation by returning to the Evaluation Strategy. She had attendees discuss a strategy that she handed out and analyze different parts of it. She then concluded the presentation by having us construct an action plan. She asked the audience to identify what we would do differently now that we had studied evaluations. In a sense, this exercise was a level two activity. By completing the action plan document, attendees were demonstrating their knowledge of what they learned. This also was a good lead-in to level three. Participants can check in the future as to whether or not they followed the plan that they worked on in class. She encouraged everyone to bring the evaluation back to the October meeting, when Patrick Whalen, a representative from the Jack Phillips organization, would be able to review our action plans and discuss Level 5, ROI.

Pat Todd is an associate consultant in Global Marketing and Sales Training at Eli Lilly and Company. She earned her Ph.D. in Instructional Research and Design from Purdue University in 1997. Pat's experience includes eleven years in the pharmaceutical industry and four years in automotive industry. The last four years have been devoted to conducting training evaluation and competency assessments.

Note: for examples of tools used for the different levels of evaluation, check out the CIASTD web site. Pat's complete PowerPoint presentation is available to be downloaded.

Back to Top

Member Profile
by Judy Hasselkus, CIASTD Newsletter Committee

Meet Pamela Eddy,
Sr. Training Associate,
Eli Lilly and Company


It was back to school time for Pamela Eddy. As she readied her son for another year in elementary school, Eddy prepared herself for a return to the classroom. At 40, she resigned her job with Indiana University and entered the masters program there in Instructional Technology. "My return to school was partly out of a desire to retool for the 21st century," says Eddy, "and partly out of a desire to more significantly participate in the field of learning and technology." After months of intensive study, Eddy emerged with a broadened skill set-degree in hand and a new career in the offing.

A senior training associate with Eli Lilly and Company, Eddy has spent the past year working as project manager for an eLearning initiative. Her work has involved creating 14 hours of asynchronous learning focused on software training and process changes in clinical trial data collection. Eddy reports that the major challenge she faces in her work is completing her own projects while also learning about all of the performance improvement efforts within the company.

Prior to redirecting her career, Eddy's work was in international program administration. "All my work has been associated with adult learners and/or international program administration," Eddy explains, adding that she has an abiding passion for improving adult learning initiatives in developing countries. Her international interests have been fueled, in part, by time spent living overseas in China, Taiwan, Israel, Japan, and the Philippines.

Having entered the field of performance improvement directly from a degree program, Eddy is a proponent of formal learning to prepare for entry into the profession. "I find it difficult to imagine entering this field without some formal learning-either school or well-regarded instructional design workshops," she says. When asked what advice she would offer to newcomers to the field, Eddy also stresses the importance of ongoing, self-directed learning. Her recommendation? "Constantly scrutinize performance improvement principles and concepts and find innovative ways to put them into practice."

Eddy joined CIASTD this year. She hopes to become more familiar with the training community in Indianapolis through her membership and participation in the organization.

Favorite book or resource?
Planning Programs for Adult Learners-a Practical Guide for Educators, Trainers, and Staff Developers by R.S. Cafarella, published by Jossey-Bass Publishers ("It covers all the basics, but in the context of human dynamics," Eddy notes.)

Original career goal?
Eddy once wanted to become an archaeologist. Experiential learning changed her mind. "Fortunately, I participated in a semester of archaeology study in college," Eddy says. "It effectively cured my desire to dig in the dirt."

Unique or interesting accomplishment?

Eddy once climbed the pyramids in Egypt. "Verboten but fantastic!" she exclaims.

Back to Top

New Members

In each issue of The Facilitator, we will list members that have joined or re-joined CIASTD since the previous issue. Since the last issue of The Facilitator, we have signed several members. To see a list of the new members, click here. If you are a member of CIASTD, and would like access to the complete membership list, visit our site at www.CIASTD.org.

Back to Top