AICC Subcommittee Working Group Meeting Minutes
June 11 - 15, 2001
Pittsburgh, PA

CMI Subcommittee (Jack Hyde, chair)

Schawn Thropp, (ADL) and Claude Ostyn (click2learn) described recent work on the IMS/ADL data model. Next steps include: validate the strawman data model, complete the mission sub-models, and specify the binding (e.g., XML, dot notation).    (presentation slides)

Jack Hyde (FlightSafety Boeing) reviewed a survey instrument developed to find out how organizations had been implementing the AICC CMI standard and how the proposed reduced standard would affect vendors who had already implemented the AICC standard.

Independent Test Lab Subcommittee (Bill McDonald, chair)

Bill McDonald (FlightSaftey Boeing) reported on the activities of the test labs. Since the last meeting, the labs had completed 11 certification tetsts. The ADL has developed a test suite for SCORM 1.1 and their test labs should be operational by the end of the year. The AICC will continue to offer certification tests for the near future but re-evaluate the need as the ADL test labs become used.    (presentation slides)

The AICC voted to accept the certification of ets-online courses that were recently tested by the NUWC test lab.

DELS Subcommittee (Bernard Bouyt, chair)

Bernard Bouyt (Airbus) reviewed an extensive list of metadata items. After the subcommittee reviews this list, they will be incorporated into the DELS white paper as version 6.0. He reviewed the different types of routers. He also discussed generic and customized courses. He concluded with a summary of the Airbus approach to e-training.  (presentation slides)

TUESDAY – June 12

Chairman’s Report

Gary Morrison (U.S. Airways) reported that the AICC was in good financial health. Subsequent meetings will be held as follows:

 

Date	Location
Sept 10 - 14, 2001	Windsor, England (hosted by Vega)
Feb 4 - 8, 2002	Orlando, FL (hosted by StarMedia)
June, 2002	Vienna (hosted by the Lauda Air)

Ian Wright discussed the venue for the meeting in Windsor.  A meeting announcement will be distributed in early July.

Courseware Management and Processes Subcommittee (Yvonne Johnson, chair)

Yvonne Johnson (Boeing) proposed a mission and objectives for this new subcommittee. She proposed that it look at high-level ISD process template, metrics that define good computer-based training, and how to implement ADL/SCORM.  (presentation slides)

Wayne Hostetter (StarMedia) delivered a presentation on the key elements of quality assurance. Quality assurance has to be a team effort with everyone involved and it must be built into the development process from the outset.  Jay Dempsey (StarMedia) follow with a discussion on configuration management in courseware development. It requires the establishment of document process and standards, control points, responsibilities, and network rights. Rules to live by:

• Once an item falls under formal CM, it requires a formal action to change it.
• Nothing goes to or from the customer unless it goes through CM
• Files should always be in two places at the same time
• The people that do the work probably know best how to do it given the goals of formal CM
• Make people responsible and make it part of the process. Don’t forget hardware, operating systems, drives, plug-ins etdc.  (presentation slides)

Doug Stuart (Boeing) presented a preliminary set of metrics for the courseware development process. Possible metrics include such indices as efficiency (development hours per hour of student contact time, cycle time (days to developemt one hour of student contact time), and timeliness.  (presentation slides)

Wayne Hostetter (StarMedia) and Jay Dempsey (StarMedia) made a presentation about simulation-based training versus computer-based training. (presentation slides)

Jean Genest (CAE) presented information on the structure of interactive learning services. He showed some of the 3D FMS trainer designs developed at CAE.  (presentation slides)

Lenny Greenberg (Pathlore) described the details of the SCORM standard. It includes the learning object "tagging" from IMS, the web-based AICC standard, the XML binding from the AICC course packaging standard. The standards group are converging: AICC and SCORM is in synch, IEEE will likely adopt SCORM as a standard, and IMS has adopted the SCORM API. The IMS course packaging specification will be included in SCORM 1.2. He showed several samples of SCORM implemented in Authorware, Dreamweaver, and Flash courses.  (presentation slides)

B ill Shook (Boeing) described current and future ADL activities at Boeing and the need for ADL to integrate with IETMS development.

Steve Smith (Rockwell-Collins) discussed the value of evaluating and validating courseware. He described Kirkpatrick’s levels of evaluation: reaction (e.g., student satisfaction), learning (e.g., meeting the objectives), behavior (e.g., behavior change in workplace), and results (e.g., impact on the organization). A fifth level involves analysis of return on investment.  (presentation slides)

Mike Sharp (Honeywell) talked about the definition of quality in training programs using examples from training programs at Honeywell. He proposed that we develop some simple guidelines for the development of courseware in any medium. Do we need a set of tools to help organizati0ns to look critically at training programs?   (presentation slides)

Reception Hosted by CAE and StarMedia

WEDNESDAY – June 13

Training Infrastructure (Ian Wright, chair)

Ian Wright (Vega) led a review of old AICC documents to determine whether they should be revised, archived, or denigrated. The subcommittee determined that the following AICC documents would be archived: AUD001-A, AUD002, AUD003, MPD006, CRS005, MPD011, and MPD005. One document, CRFS004, Guidelines for Courseware Interchange, will be revised so that it reflects current practices and thinking.  AGR002 was also reviewed. I. Wright will generate a draft revision and submit it to other members of the subcommittee for review.  (presentation slides)

Bill McDonald (FlightSafety Boeing) discussed several courseware interchange concepts. At the outset of every development project, developers should think about the content’s expected life and consider a strategy for migration of the content out of the authoring system in which it is to be developed. Don’t just hope (unrealistically) that the authoring technology that you use will be around for the entire life of the content. (presentation slides)

Paul MacDougall (Air Canada) presented the ATA’s Flight Operations Working Group (FOWG) preliminary identification of aircraft systems and phase of flight identification in electronic training materials.

Presentations by Authoring System Vendors

Howard Fletcher, Catherine Rickelman, and Jason Kane (IBM-Lotus) demonstrated KnowledgeProducer, a SCORM-compliant content authoring environment.  (presentation slides)

Carl Miner (Allen Communication) demonstrated one of their emerging products, XDP [Xtreme Development Process], designed to create quickly developed instructionally sound SCORM-compliant web-based courseware.

Jim Blaisdell, Jan Utterstrom, and Brian Gordon (click2learn) demonstrated courseware created rapidly with the ToolBook and Ingenium’s AICC compliancy. 

Tom King (Macromedia) demonstrated the newest versions of Authorware, Dreamweaver, Shockwave 3D, ColdFusion, Flash, Site Spring, and ColdFusion.  (presentation slides)

Gary Morrison, Henk ven Meeteren, and Derek Ausk (U.S. Airways) described some of the innovations in their courseware development efforts at U.S. Airways, particularly their implementation of smart graphics.

Reception Hosted by IBM Knowledge Producer

THURSDAY – June 14

Presentations from End-Users

Mike Sharp (Honeywell) described some of the lessons they learned from their development of web-based FMS training. 

Capt. David Sambrano (United) described the Sky-Pad project, the design of a portable display system which provides supplemental information to the pilot (e.g., weather, Jepp charts, irregular operational control, ACARS data, etc.) It is not designed to replace flight deck avionics and is not permanently be attached to the aircraft.  (presentation slides)

Simulation and Smart Graphics Subcommittee (Gary Morrison, Jack Hyde, Co-Chairs)

Gilbert Jaar (CAE) described RAVE [Real-time Advanced Visualization Environment], a product deceloped by CAE to create and test smart graphics. This software allows users edit and test smart graphics, is platform-independent, based on world coordinate system (pan, tilt, zoom), is scalable (i.e., tiling), and allows layering. Michelle Asmar (CAE) demonstrated its editing capabilities and then showed a virtual cockpit created using the software.  (presentation slides)

Kris Rockwell (US Airways) described an approach to creating smart graphics using SVG (Scalable Vector Graphics). The files are small (e.g., 180K). They can be embedded within any application that uses ActiveX (e.g., html, Authorware). The objects are reusable.  (presentation slides)

Jack Hyde (FlightSafety Boeing) presented a framework for a possible simulation interoperability. The goals of such a standard would be seamless simulation/CBT interoperability that will allow for any simulation to work with any CBT authoring/delivery tool. It should enable multiple instructional strategies and unleash the potential of desktop simulation. He presented a possible model for how this could be done using a windowing system. For the standard to be successful it must provide a clearly defined, straightforward, comprehensive, robust standard.  (presentation slides)

Randy Saunders (Raytheon) discussed IEEE alignment with AICC smart graphics. As chair of the IEEE P1484.7 subgroup, he will use the work of the AICC to provide his committee with a starting point.

Training Technology Subcommittee (Jean Louis Bravo, Chair)

Jean-Louis Bravo (Airbus) proposed a set of goals and objectives for this newly reorganized committee. He proposed that a working group be started up which would refine the goals and get some ideas for projects. He demonstrated the ADOPT testing system in use at Airbus.  (presentation slides)

Dan Rehak (Carnegie Mellon) provided an update on the CLEO [Customized Learrning Experiences Online] Lab which is designed to accelerate e-learning interoperability by conducting applied research and providing input to the specification process conducted by such groups as the AICC and IMS. The CLEO Lab is organized under the auspices of the IEEE and is funded by Carnegie Mellon and UK Open University. Participants include CISCO, click2learn, IBM Mindspan, Microsoft, NETg, and ADL. They will develop white papers addressing data models for learning content structure, sequencing, and control; learning model descriptions; and technical results from test bed results. He reported that SCORM (i.e., the AICC CMI Guidelines for Interoperability) has significant endorsement from content and LMS vendors. Its technical approach appears viable. The web site is: www.cleolab.org.  (presentation slides)

 

Name

Organization

Phone

Fax

Alizon, Patrick

Airbus

+33 (0) 5 61 93 47 64

Andersen, Mike

U.S. Navy

904-542-8099

904-542-8101

Andresen, Steinar

Braathens

67597417

67582060

Andrews, Mark

United Airlines

303-780-5239

303-780-5631

Asmar, Michele

CAE

514-341-6780 (ext. 2340)

Ausk, Derek J.

U.S. Airways

412-747-1655

412-747-1648

Barone, Janet

U.S. Airways

412-747-2905

412-747-3597

Bergstrom, Scott

AICC/BYU-I

208-356-1136

208-356-1185

Blaisdell, Jim

click2learn

425-637-5813

425-637-1504

Blaser, Angie

U.S. Airways

412-359-6414

412-359-2744

Bouyt, Bernard

Airbus

33/(0)5 61 93 21 39

33/(0)5 61 93 20 73

Bravo, Jean-Louis

Airbus

+33 (0) 561932044

+33 (0) 561932512

Capezzuto, Sherri

U.S. Airways

412-747-7094

412-472-4450

Collins, Christina

U.S. Airways

412-747-1332

412-747-5523

Dempsey, Jay

StarMedia

(407) 249-1990

(407) 382-2345

DeNise, Bruce

Northwest Airlines

612-727-0961

612-727-6094

Dorsey, Rose

U.S. Airways

412-747-2901

Drinkwater, Ben

FlightSafety Boeing

206-662-7903

202-662-7586

Eisel, Cyndi

U.S. Airways

412-747-1672

412-747-3597

Escano, Martin

D.P. Associates

(757) 489-7675

(757) 489-7679

Ethier, Luc

CAE

514-341-6780 (ext. 4383)

Farance, Frank

Farance, Inc.

212-486-4700

212-759-1605

Fletcher, Howard

IMB Lotus

617-693-8907

617-693-5532

Genest, Jean

CAE

514-341-2000 (ext. 2937)

Gordon, Brian

click2learn

425-462-0501

Greenberg, Lenny

Pathlore

614-781-7288

614-781-7288

Harless, Niki

U.S. Airways

412-747-9064

Hart, Patricia

U.S. Airways

412-747-0161

Henderson, Sharon

U.S. Airways

412-747-1673

412-747-3597

Hoberny, Alan,

ADL

814 269 6221

814 269 6885

Hostetter, Wayne

StarMedia

(407) 619-0422

(407) 382-2345

Hyde, Jack

FlightSafety Boeing

253-839-4549

Idle, J. P.

U.S. Navy

360-315-1884

Itkonen, Kari

Finnair

+ 358 9 818 4751

+ 358 9 818 4799

Jaar, Gilbert

CAE

(514) 333-6300 x273

514) 340-5461

Johnson, Yvonne

The Boeing Company

314-234-1403

314-234-1527

Kerrigan, Sally

U.S. Airways

412-747-2903

412-747-3597

King, John

King Schools

858-576-6222

858-54`-2200

King, Martha

King Schools

858-576-6222

858-54`-2200

King, Tom

Macromedia

253-856-2799

Knott, Larry

Northwest Airlines

612-726-0668

612-726-3507

Larue, Suzanne

Air Canada

MacDougall, Paul

Air Canada

905-676-4300 ext 2361

905-676-2252

May, Tom

D.P. Associates

(210) 659-3241

(210) 659-4508

McDonald, Bill

FlightSafetyBoeing

206-662-8485

Medley, Mike

FlightSafety Boeing

714-779-0231

714-779-0231

Miner, Carl

Allen Communication

801-537-7800

801-537-7805

Montgomery, Anne

AICC

505-526-2582

505-526-6041

Morrison, Gary

U.S. Airways

412-747-1651

412-747-6041

Nazzaro, Jim

FedEx

(901) 397-9760

Nelson, Mark

SIUS

801 376-8028

801 225 4661

O'Brien, Kevin

Honeywell Aerospace Electronic Systems

(602) 436-6558

Ostyn, Claude

click2learn

425-637-1562

425-455-3071

Pappas, Richard

Simgraph

450-682-1003

450-682-1131

Pfetzing, Ralf

Lufthansa

+49 69 696 12439

+49 69 696 92690

Rehak, Dan

Carnegie Mellon University

412-268-1753

Rockwell, Kris

U.S. Airways

412-747-1661

412-747-1648

Sambrano, David

United

Saunders, Randy

IEEE/Raytheon

301-925-0316

Schwarz, Herbert

Lauda Air

+43-699-1-3059768

+43-1-7000-578210

Sharp, Mike

Honeywell

602-436-2830

602-436-3535

Shook, William

Boeing

314-232-1078

314-2324-4493

Siddique, Rubin

Lufthansa

+49 69 696 93112

+49 69 696 92690

Smith, Steve

Rockwell Collins

(319) 295-0348

(319) 295-1542

Steinke, Kevin

U.S. Airways

412-747-2921

412-747-3597

Stuart, Doug

Boeing

314-234-4404

314-233-5489

Swope, Greg

U.S. Airways

412-747-7880

412-472-4450

Tepe, Kirk

FedEx

901-360-4037

901-360-4955

Thropp, Schawn

ADL

814 269 2579

814 269 6885

Utterstrom, Jan

click2learn

425-637-5813

425-637-1504

van Meeteren

U.S. Airways

412-747-1653

412-747-1648

Vanderbilt

ITTA

630-268-1818 ext 327

630-268-1384

Walker, Mark

Macromedia

732-695-2201

732-695-9005

Weiler, Grizz

United Airlines

303-780-5851

303-780-5860

Williams, Jim

U.S. Airways

412-747-1320

412-747-1648

Wright, Ian

Vega

+44 (0) 20 82 30 40 50

+44 (0) 20 82 30 40 40

Zizak, Chris

U.S. Airways

412-747-9357