Portfolio of Projects

Completed Projects - Individual Work or Significant Contributions on Collaborative Work

IU IST R511 - Colloquium Journal Report

Colloquium Journal Report

 

Jennifer Maddrell
Indiana University
<!--[if !supportLineBreakNewLine]-->
<!--[endif]-->

R511: Instructional Technology Foundations

Week 15 Deliverable

Professor Hubbard-Welsh

24 April 2006

Colloquium Journal Summary 

The Colloquium serves as an introduction to the Instructional Systems Technology (IST) field, as well as the Indiana University (IU) IST program, and supplements course materials by presenting important people, ideas, trends and issues impacting the field. The following summarizes key elements within the presentations that provide greater insight into both (a). The IU IST Program and IST Career Field and (b). IST Ideas / Trends / Issues.

The IU IST Program and IST Career Field:

                    People in IST: New distance students in the IU IST program typically lack face-to-face interactions with faculty. The Colloquium provides a unique opportunity for distance students to not only put a face with a name, but also to learn about the faculty’s interests, research and current projects (see below). Further, it is valuable to hear from those outside IU who are instrumental in shaping the field, including those taking part in the groundbreaking Massachusetts Institute of Technology (MIT) Open Course Ware initiative in which MIT course material is made available (without charge) to anyone with Internet access.

IST Resources: The Colloquium introduces students to IST resources both inside and outside the IU IST program. Dr. Frick’s review of the IU computing environment and other school resources provides a good introduction to the many resources available to distance students (listservs, library and research sources, software). In addition, Dr. Bonk and Dr. Berque highlight new and emerging media technologies that can aid in the instructional process. Further, each presenter includes additional references and resources that encourage and facilitate further review on the topic.

IST Career Perspective: Students enter the IU IST program with varied career backgrounds. While some may already work in the field, specific job and professional experiences may be very different. By hearing working professionals discuss their career interests, backgrounds and projects within the Colloquium presentations, an IST student gains a better perspective on the diversity of the field, as well as the potential career opportunities. For example, some presenters, such as Dr. Reigeluth and Bonnie Bracey, address their diverse interests within a K-12 educational setting, while Dr. Pershing focuses on his work in the area of Performance Technology within a corporate setting. Further, information regarding professional associations supplements course material and provides history and background on IST as a professional practice.

IST Ideas / Trends / Issues:

IST Research and Projects: The Colloquium introduces students to important research and projects related to the field. For example, Dr. Reigeluth’s current research focuses on what he views as a required “paradigm shift” in education to bring instructional processes in line with the “information age”. The outcome of his research is the recommendation for customized and learner-focused instruction that he notes will require a new instructional design process to meet the “complex environment that involves learners in their own instruction.” In addition, Dr. Frick presents his research in designing web-based instruction, as well as the status of his “SimEducation” project. Dr. Frick proposes that design must go “beyond the tools” to the process of effective and efficient design.

IST Media Technologies: The opportunities to integrate media technology into education are discussed in most presentations and many technologies to support learning and instruction are presented. Bonnie Bracey shares her perspective on the importance of incorporating media technology within a learning setting to engage students and create a rich “learning landscape” which provides students with information and experiences far beyond the classroom. Dr. Bonk reviews the growth of online learning and presents numerous emerging technologies to facilitate online and distance education, while Dr. Berque presents technology that he developed to better facilitate face-to-face learning. In addition, Dr. Metcalf highlights the positive impact that Internet innovations (the convergence of Internet, telephone and television networks) may have on the quality and access to educational information.

IST Practices: Those working in the field present their instructional design ideas and instructional approaches based on their direct experience. Many stress the importance of engaging students and of incorporating social learning and constructivist approaches, as does Dr. Ochoa in her presentation of instructional methods for Problem Based Learning. Steve Lerman proposes that too much learning is “passive” and “scheduled” and advocates that instruction needs to be designed to incorporate active participation and “learning on demand”. In highlighting the instructional design process and approach used by MIT in the Sloan School of Business, Toby Wall presents an approach that incorporates significant application and practice, socialization and building community with the instructional design of their programs.

AttachmentSize
Colloquium Journal Report Jennifer Maddrell - Final.doc94 KB

2007 IU IST Conference Proposal: Using Drupal to Support Personal and Collaborative Online Environments

Attached is my presentation proposal to the Indiana University 2007 IST Conference.
AttachmentSize
Drupal Workshop Proposal for IU IST 2007.pdf312.26 KB

Athabasca University: System Analysis

This paper surveys the distance education system at Athabasca University.
Athabasca University System Analysis - Upload a Document to Scribd
Read this document on Scribd: Athabasca University System Analysis

System Analysis 1 Running head: SYSTEM ANALYSIS OF ATHABASCA UNIVERSITY System Analysis of Athabasca University Jennifer Maddrell Old Dominion University System Analysis 2 Focus and Purpose Institution Typology Athabasca University was formed as a distance education university by the Government of Alberta Canada in 1970. While Athabasca provides distance education course offerings for colleges and universities throughout Canada through inter-institution course transfer credit, it continues to operate as an autonomous degree granting distance learning university. With liberal transfer of credit options within the Canadian college and university system, credit for prior learning, rolling enrollment, and admission provisions that allow undergraduate admission to anyone over 16 years of age without regard to prior academic achievement, Athabasca classifies itself as an Open University. The government remains a major force behind Athabasca. In 2007, the Province of Alberta provided $31,064,000 (CAD) in grant funding which represented over 30% of the university’s operating revenue. Further, the university’s governance is dictated by Alberta Regulation 50/204, the Post-secondary Learning Act, which establishes the powers and duties of the university’s administration by the Athabasca University Governing Council. As of March 31, 2007, the Governing Council, headed by an Executive Officer (also the President of Athabasca University), included one nonacademic staff member, one tutor member, two academic staff members, two student members, nine appointed public members, and one alumni member. Mission and Mandate Since its inception, Athabasca University’s stated mission has been to offer distance education to residents of Alberta, the rest of Canada, and the world. As presented within the 2007Annual Report, the university’s mission is to 1) remove barriers that restrict access to university level studies, 2) increase equality of educational opportunities for adult learners System Analysis 3 worldwide, 3) commit to excellence in teaching, research, scholarship, and public service, and 4) focus on distance education and the associated learning technologies. Athabasca’s mandate is restated in the 2007 Annual Report and calls for the publicly funded university to offer undergraduate degree programs in natural and pure sciences, humanities, social sciences, interdisciplinary studies, administrative studies, commerce, nursing, and allied professional fields, as well as graduate degree programs in distance education, health studies, and business administration. Strategic University Plan for 2006 – 2011. A new strategic plan was drafted in 2006 and is presented as an appendix to the 2007 Annual Report. The plan outlines specific goals intended to achieve Athabasca’s continued commitment to open access and the delivery of high quality distance education, as well as a renewed focus on research. Features Open Admissions and Enrollment As noted, edibility for admissions to undergraduate courses at Athabasca is liberal compared to other degree granting universities in North America. Students age 16 or older are admitted throughout the year regardless of their previous educational experience or achievement. From 1997 to 2007, total course enrollment increased a dramatic 415%. Currently, 34,000 students are enrolled in undergraduate courses and 3,000 are enrolled in graduate level courses which Athabasca reports as a full load equivalent of 5,930 undergraduate students and 1,263 graduate students. Of the total number of students enrolled, 35% are residents of Alberta. System Analysis 4 As is common in other distance education programs, nearly all enrolled students work while attending classes. During a recent survey conducted by the university and cited in the 2006 Annual Report, 94% of graduates reported working while completing their coursework. Course and Degrees During the 2006 - 2007 fiscal year, 68,284 individual courses were taken representing an increase of 6.4% over the prior year. Over that same time period, 780 undergraduate degrees and 208 graduate degrees were conferred. Athabasca currently offers 11 undergraduate degrees, 20 certificate programs, and 8 graduate degrees. In the fall of 2008, Athabasca will begin a new doctoral program which will grant a Doctor in Distance Education (EdD). The undergraduate degree programs with the highest current enrollment include Bachelor of Arts with 2,413 enrolled, Bachelor of Nursing with 2,122 enrolled, Bachelor of Commerce with 1,760 enrolled, and Bachelor of Professional Arts with 1,614 enrolled. The graduate degree programs with the highest current enrollment include Master of Arts with 632 enrolled, Master of Business Administration with 835 enrolled, Master of Distance Education with 369 enrolled, Master of Health Studies with 465 enrolled, Master of Nursing with 529 enrolled. Despite the growing admission figures and the increasing number of degree programs, graduation rates are low compared to other Canadian universities. Powell and Keen (2006) report that while hundreds of thousands of students have enrolled at the undergraduate level, only several thousand undergraduate degrees have been conferred. While these figures could imply poor student satisfaction with the courses, biennial Government of Alberta Graduate Satisfaction and Labour Market Experience surveys consistently report high perceived quality ratings from Athabasca University students. Most students attending courses at Athabasca do not intend to System Analysis 5 complete a degree at Athabasca, but are interested in taking courses to fulfill requirements within other degree programs (about half the enrollment) or for other personal and professional reasons. Tuition Tuition rates for the degree programs are reasonable compared to most public or private universities in North America. Based on current tuition rates, the approximate tuition range for an undergraduate degree is $5,900 - $6,890 CAD for Canadian residents and $10,500 - $11,970 CAD for those residing outside of Canada. Tuition for graduate degree programs currently range from $10,250 – 13,000 CAD for Canadian residents and $12,250 – $15,500 CAD for those residing outside of Canada. During the 2006 – 2007 fiscal year, Athabasca collected $33,485,000 CAD in undergraduate tuition and $12,282,000 CAD in graduate tuition, representing 35% and 13% of revenue, respectively. Instruction Method of Study. Athabasca offers instruction in either grouped or individual study. Grouped study typically begins at a set date, either in September and January, and continues for either 13 weeks, for a 3 credit course, or 26 weeks, for a 6 credit course. Grouped study courses represent only about 20% of total course enrollments (Davis, 2001). The courses are generally facilitated by an instructor and instruction is delivered in either a print based or online format. However, some group study is offered in traditional classrooms at designated Athabasca learning sites or at partner institutions with collaboration agreements with Athabasca. Individual study, the far more common method of study, begins on the first day of any month. Students must simply register by the 10th day of the preceding month. Instructional materials are delivered in either a print based or online format. The course term, known as the “contract period”, lasts 6 months for a 4 credit or less course and 12 months for a 6 credit course. System Analysis 6 While the individualized study courses are self-paced, the learners are offered a tutor. Upon registration in a course, the student is introduced to the assigned tutor via letter or e-mail. The tutor’s role is to provide subject matter assistance, feedback on assignments, exam preparation, and grade assignment. Tutors generally provide assistance via e-mail or phone. Within the School of Business, Athabasca has also begun the use of tutor support call centers as an alternative to traditional tutors. Learners call a toll free number and work with the tutor on duty at the time the call is placed to the call center. Faculty. As of March 31, 2007, Athabasca employed 1,226 people, including 152 in academic full time positions, 168 in academic part time positions, and 322 tutors. The balance comprised management, professional, and support staff. Over the three year period from 2004 – 2006, the annual average number of referred articles, books, and conference presentations by faculty was 146, 53 and 281, respectively. Design and Delivery of Instruction. Athabasca employs a team approach to course design. A typical course design team includes a subject matter expert, visual designer, digital media technologist, copyright officer, and editor. Course materials are delivered via fax, regular mail, or the Internet. Print and digital course materials are delivered to students as part of a course package of resources distributed from the Materials Management Office which, depending upon the course, may include student manuals, study guides, and text books. While print and digital media, including CDs and DVDs, have historically been mailed to students, instruction via the Internet is rapidly becoming a primary means of instructional delivery. As outlined in the 2006 – 2007 Annual Report, Athabasca has budgeted $21 million for information technology hardware and software upgrades between 2006 and 2011 in order to accommodate this shift in instructional delivery. Along with e-mail delivery of content, other System Analysis 7 forms of Internet based instructional delivery are also employed. In 2005, Athabasca began facilitating online courses using Moodle, the open source learning management system. In addition, live instruction is often delivered via streaming audio and video and some live class sessions are being held using web conferencing tools, such as Elluminate. Other technology. In addition to the learning technologies noted above, Athabasca maintains an online student web portal, myAU, based on the open source uPortal software (Guohua & Bonk, 2007). This online web portal offers students and faculty a single sign-on to university services, including the campus administrative systems, the learning management system, as well as the library information systems. Student Services Financial Assistance. Students at Athabasca are eligible for financial assistance. Full time students may apply for grants, loans, and scholarships while part time students (those enrolled in less than 9 credits in a 4 month period) are only eligible for grants and loans. Learning Services. Athabasca offers students a host of learning services, including academic advising, access for students with disabilities, admission and registration services, and exam supervision. In addition, all actively registered students have library borrowing privileges. The library information desk is manned 24 hours a day via e-mail, fax, mail, or phone to provide instructions on how to access information or to provide research assistance. The Athabasca library website provides online access to the entire library catalogue, thousands of electronic books and reference websites, and over 32,000 journal articles contained within 200 full text subscription journal databases. Athabasca also has inter-loan library agreements through the Alberta library system and the Canadian University Reciprocal Borrowing Agreement (CURBA). System Analysis 8 Student Interaction. Students have the option of participating in established school clubs, peer support groups, online discussion forums, or social groups. Athabasca also publishes a quarterly online magazine (the au.world e-zine) which highlights current information of interest to Athabasca students. Open Access Publishing. Athabasca is committed to providing open access and online dissemination of publications produced by the university. This includes open online access to The International Review of Research in Open and Distance Learning, a refereed journal published by Athabasca. Evaluation and Accreditation Athabasca’s internal review protocols are contained within a comprehensive Program Review Policy document. Under the terms of the review policy, all programs must be reviewed by internal and external assessors at least every six years. The material assessed during the review includes such items as the current course syllabi and related course materials, feedback from partner institutions, program financial statements and budges, surveys of students and graduates, and opinions of tutors and instructors. As in the United States, the Canadian central government does not accredit universities. However, Athabasca was accredited by the United States’ Middle States Commission on Higher Education (MSCHE) in June 2005. In addition, the recently established Campus Alberta Quality Council, formed as a quality assurance agency as part of the 2004 Post-secondary Learning Act and the Approval of Programs of Study Regulation (51/2004), has reviewed and recommended several new programs within the university, including the new Distance Education EdD program. According to the mandates under the Act, all new degree programs must be reviewed and recommended by the Council. System Analysis 9 Strengths and Weaknesses Strengths As a pioneer in the delivery of university level distance education, Athabasca offers distance learners a flexible, affordable, and accredited education with a comprehensive roster of student services. Enrollments are growing and the university has seen an increase in research funding ($2,117,000 CAD for the fiscal year ending March 31, 2007 representing a 14% increase from the prior year). Further, with backing and oversight from the Alberta government, Athabasca is financial secure and is operating at a net profit ($1,446,000 CAD for the fiscal year ending March 31, 2007). Weaknesses Athabasca’s rapid growth over the past decade is straining the university’s infrastructure. As noted in the 2006 – 2007 Annual Report, Athabasca’s infrastructure was designed for 10,000 students and the rapid growth over the past decade has caused a critical need for additional space. While space is not needed to support classrooms, physical space is needed to house curriculum development, learner support services, and research functions. Further, Athabasca is struggling to recruit and retain faculty to accommodate the growing enrollment; a difficult task given the limited pool of doctoral level candidates within the university, the location of the main campus in Athabasca, and the limited research opportunities outside of distance education. However, there are threats to Athabasca’s continued growth. Once one of only a few distance education universities, Athabasca now faces increased competition from both stand alone online universities and distance education arms of traditional universities. In addition, while the Alberta government subsidy to Athabasca covers a substantial portion of the operating System Analysis 10 budget, currently over 30% of annual revenue, Athabasca’s operations would be at risk should the government decide to alter the amount or provisions of the operating grant. Further, graduation rates are low. While this does not point to a problem in overall quality or learner satisfaction, it does suggest that most students are merely pursuing individual courses or taking transfer credits back to a home institution. As such, it becomes difficult for Athabasca to make a mark as a standalone degree granting intuition when the majority of students are taking individual courses for transfer credit to receive a degree from a traditional (bricks and mortar) institution. System Analysis 11 References Athabasca University - about Athabasca University. Retrieved from http://www.athabascau.ca/ Alan Davis. (2001). Athabasca university: conversion from traditional distance education to online courses, programs and services, The International Review of Research in Open and Distance Learning; Vol 1, No 2 (2001). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/19/358. Alberta Government. (2004). Alberta Post Secondary Learning Act. Retrieved from http://www.qp.gov.ab.ca/documents/Acts/P19P5.cfm. Athabasca University, Office of the President. (2003). Athabasca University Policy - Program Review Policy. Retrieved March 13, 2008, from http://www.athabascau.ca/policy/academic/programreviewpolicy.htm. Athabasca University. (2007). Athabasca university annual report 2006 - 2007, 30. Athabasca, Alberta Canada: Athabasca University. Retrieved from http://www.athabascau.ca/report2007/ Athabasca University. (2006). Athabasca university annual report 2005 - 2006, 30. Athabasca, Alberta Canada: Athabasca University. Retrieved from http://www.athabascau.ca/report2006/. Campus Alberta Quality Control Council (CAQC) - Program Assessment Standards, Campus Alberta Quality Council. Retrieved from http://www.caqc.gov.ab.ca/default.asp. Guohua Pan & Curtis J. Bonk. (2007). The emergence of open-source software in north America, The International Review of Research in Open and Distance Learning; Vol 8, No 3 (2007). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/496/938. Powell, R., & Keen, C. (2006). The axiomatic trap: stultifying myths in distance education, Higher Education, 52(2), 283-301. doi: 10.1007/s10734-004-4501-2.
AttachmentSize
Systems Analysis Jennifer Maddrell - Final.doc62 KB

Backchannel Interactions

The focus of this report is to review the literature for assessments of the effect of computer-mediated backchannel interaction during live instructional presentation. The goal is to consider the impact on the learner as both a receiver of instructional messages sent from the instructor, as well as an active participant within the learning process.

Backchannel Research Paper Jennifer Maddrell - Upload a Document to Scribd
Read this document on Scribd: Backchannel Research Paper Jennifer Maddrell

Backchannel Interactions Running head: THE EFFECT OF BACKCHANNEL INTERACTIONS 1 The Effect of Backchannel Interactions on Cognitive Load Jennifer Maddrell Old Dominion University IDT 895: Message Design June 25, 2008 Backchannel Interactions Backchannel Interactions Computer-mediated communication (CMC) technologies offer instructional designers new ways to design and deliver instructional material to learners. New forms of web conferencing technology allow live audio and visual presentation of instructional material. Beyond a one-way or single channel broadcast of the primary instructional message, these web conferencing technologies also support simultaneous multi-channel communication among all participants and support the learners’ real time interactions with the instructional content, with the instructor, and with peer learners. A by-product of the latest synchronous CMC technologies is the appearance of what are being termed backchannel interactions which occur simultaneously with the primary instructional presentation (Yardi, 2006). No longer a passive recipient of the single channel instructional message, a learner within a web conferencing session has the ability to interact directly with the content, with peer learners, and with the instructor during the instructional presentation. The interactive features included with the newest forms of web conferencing technologies allow learners to annotate directly on the presentation slides while the presenter is speaking, to route or receive files, to send and get links to web sites during the presentation, to type viewable notes to the class in the margins of the presentation window, or to conduct text based conversations while the live instructional presentation is being delivered. 2 While the term backchannel is used in other contexts and is spelled as backchannel, backchannel, or back channel, a consistent definition within the context of synchronous CMC does not exist. Cogdill, Fanderclai, Kilborn, and Williams (2001) suggest that backchannel interactions tend to fall into the following five categories: 1) process-oriented interactions which steer the main channel discourse, 2) content-oriented interactions which respond to the content in Backchannel Interactions 3 the main channel, 3) participation-enabling interactions which include assistance to participants, 4) tangential interactions which branch from or continue a completed main channel discussion , and 5) independent interactions which are private and unrelated to the main channel. These backchannel interactions are well outside the norm of learner behavior in traditional face to face lecture settings. However, the availability of this form of computermediated interaction, as well as ongoing discussion about the classroom role of the learner as either an active participant or passive recipient, is sparking debate among practitioners regarding what interactions learners should engage in during both face to face and computer-mediated instructional presentation (Fried, 2008). As written in an April 2008 article entitled Hey, You! Pay Attention! at InsideHigherEd.com and in the approximately 50 ensuing comment posts to the article, learners computer-mediated interactions during lecture are viewed by educators as both a bold step forward in instruction and a tremendous distraction to the learning task at hand (Guess, 2008). In what one commenter to the article called a “ridiculous debate”, one side views computer-mediated interactions during instructional presentation as nothing more than virtual note passing which is a distraction to the learning task at hand and a symbol of the growing lack of respect for teachers during lecture. In contrast, the other side views these backchannel features as a powerful opportunity to facilitate increased content and human interaction. The focus of this report is to review the literature for assessments of the effect of computer-mediated backchannel interaction during live instructional presentation. The goal is to consider the impact on the learner as both a receiver of instructional messages sent from the instructor, as well as an active participant within the learning process. Unfortunately, there has been little research conducted to specifically assess this relatively new phenomenon. In reviewing prior literature on computer-mediated backchannel Backchannel Interactions interactions in the classroom, Yardi (2006) found nothing beyond qualitative reviews assessing the use of text chat during live conference proceedings or essays considering the potential advantages and disadvantages of utilizing synchronous CMC to facilitate classroom discussion. While a body of theory and research exists assessing the effects of interacting in computermediated learning environments, the focus is largely on asynchronous computer supported interactions rather than synchronous interactions (Paulus, 2007). Further, as noted by Moore, Burton, and Myers (2004, p. 998) within their extensive review of multiple-channel communication research, “We feel that instructional designers, looking for simple rationale, methods, or guidelines for effective multimedia (multiple-channel) presentation will be disappointed in the relevant research” which they feel is “confusing at best.” While there is little research to report from direct studies on computer-mediated backchannel interactions in the classroom, the objective here is to glean information from other areas of research regarding learner interaction with instructional content, other learners, and the instructor to begin to assess how this new form of backchannel interaction could impact the student’s ability to learn from the instruction. The following presents a review of literature in both traditional and computer-mediated instructional settings. While multiple theories of learning, communication, and instruction are presented in the review of literature, this review is presented within the context of cognitive load theory (CLT). Cognitive Load Theory CLT Described CLT suggests that working memory faces important processing limitations which ultimately impact a learner’s ability to process, encode, and retrieve information (Sweller & Chandler, 1994). CLT has evolved over the past two decades and is concerned with a learner’s 4 Backchannel Interactions limited working memory processing capacity and the combined effect of intrinsic, extraneous, and germane cognitive load (Pociask & Morrison, 2004). Intrinsic cognitive load is imposed by the inherent nature of the to-be-learned information (van Merrienboer & Sweller, 2005). Extraneous cognitive load is imposed by inappropriate instructional design choices. This includes the instructional message design, the instructional presentation, and interface choices related to the delivery mode (visual or verbal), modality (text or narration), and spatial arrangements on the page or screen (Lee, Plass, & Homer, 2006). Germane cognitive load is associated with processes to assist in learning, including processes to facilitate schema acquisition and automation (van Merrienboer & Sweller). Fundamental to CLT is the notion, as summarized by Sweller and Chandler (1994, p. 5 192), that the learning environment should eliminate “irrelevant cognitive activities”, defined by them as “any activity not directed to schema acquisition and automation” which they deem to be significant learning mechanisms. They note that such irrelevant activities may unnecessarily increase cognitive load and hamper the processing of to-be-learned material. Kester, Kirschner, and van Merrienboer (2005, p. 168) suggest that the instructional design of the learning environment should “properly manage intrinsic load, minimize extraneous load, and optimize germane load within the boundaries of working memory capacity.” Framework for Review Given that cognitive load is a central consideration in multimedia learning (Mayer & Moreno, 2003), the primary task of this review is to assess where computer-mediated backchannel interactions during instructional presentation fall within the cognitive load equation. While the review is presented within the context of CLT, theories and findings from research in areas both inside and outside of learning and instruction are also considered. By taking into Backchannel Interactions account research in a range of areas, this review attempts to highlight prior findings which may shed light on the following questions. Extraneous cognitive load. Do backchannel interactions increase extraneous cognitive 6 load? Are these interactions unnecessary instructional activities imposed by poor instructional or message design that could and should be eliminated to reduce extraneous load? Germane cognitive load. Are backchannel interactions germane to the learning process as part of effective presentation, communication, and dialogue to support the learner? Do these interactions help learners reflect upon the material, create meaning from the presented content, and process the to-be-learning material within memory? Intrinsic cognitive load. Does interaction within the backchannel help presenters to more effectively sequence and segment instruction based on the cues of learner understanding found in the backchannel responses? In turn, could these interactions be used to manage intrinsic cognitive load? Extraneous Cognitive Load The focus of this section is to assess whether the incorporation of backchannel interactions during instructional presentation is a poor design choice that takes away from the processing of to-be-learned information, creates unnecessary interactivity, and results in high extraneous cognitive load. Given the similarity between backchannel interactions and practices which are outside acceptable norms within a traditional face to face classroom, such as note passing, whispering to peers in class, or talking while the presenter is speaking, it is understandable why some would predict that backchannel interactions are distraction to the learning task at hand. Beyond seemingly obvious violations of traditional classroom norms, there is evidence from research on interactivity, split attention and redundancy effects, and laptop use Backchannel Interactions in the classroom which may suggest how backchannel interactions impact extraneous cognitive load. Interactivity in Learning Environment Sweller and Chandler (1994) suggest that high cognitive load is directly related to 7 interactivity caused by either the nature of the to-be-learned material (intrinsic cognitive load) or by the presentation (extraneous cognitive load). The to-be-learned material is considered to have high interactivity if there are numerous elements which must be processed simultaneously (van Merrienboer & Sweller, 2003). If the element interactivity is low (hence the intrinsic cognitive load is low), then extraneous load may not be a concern; but in complex learning situations where the intrinsic element interactivity is high, it is necessary to carefully manage the learning environment to avoid unnecessary instructional interactivity in order to reduce extraneous cognitive load (Sweller & Chandler). Moreno and Mayer (2007) examined interactivity as a characteristic of the learning environment in which the interactivity results in a variation in the instruction based on the learners’ actions. They suggest five types of learner interactivity, including 1) dialoguing in which the learner asks questions and receives feedback, 2) controlling in which the learner establishes the pace or order of presentation, 3) manipulating in which the learner sets aspects of the presentation 4) searching in which the learner seeks new information, and 5) navigating in which the learner selects from among content choices. They suggest the interactivity can be considered a continuum of no interactivity to high interactivity. Moreno and Mayer note that the challenge for designers working in interactive multimodal learning environments with ever increasing opportunities for interactivity is to reduce extraneous cognitive load imposed by the interactivity while at the same time using the interactivity to increase generative cognitive Backchannel Interactions processing, as discussed below in the section on germane cognitive load. Therefore, the unanswered question becomes whether the interactivity involved with backchannel interactions is extraneous load within the learning environment or germane to the process of learning? Cognitive Load Effects 8 Decades of research have provided findings that suggest a number of instructional effects which increase extraneous cognitive load. Three effects which may be most applicable to backchannel interactions found within the synchronous computer-mediated learning environment are 1) split attention effects, 2) redundancy effects, and 3) expert reversal effects. Split attention effect. The learners’ text based backchannel interactions which occur concurrently with the instructor’s audio and visual presentation may result in a split attention effect. While research suggests that dual presentation from both auditory and visual sources may distribute the processing of information and increase working memory capacity, other research suggest that instruction requiring learners to devote their attention to multiple sources of information may unnecessarily cause extraneous cognitive load (Sweller & Chandler, 1994). Redundancy effect. The discussion about the instruction content within the backchannel occurring concurrently with the instructional presentation may result in a redundancy effect. Research suggests that as learners must attend to and integrate sources of overlapping or redundant information, unnecessarily extraneous load is imposed (Sweller & Chandler, 1994). Expertise reversal effect. Cognitive load research findings also that suggests an expertise reversal effect in which the conditions which are appropriate for a novice learner may not be appropriate for a more experienced learner (Kalyuga, Ayres, Chandler, & Sweller, 2003). Kalyuga et al. note that many CLT effects, including split attention and redundancy effects, are not applicable to experts who possess schemas in the domain being presented. These learners Backchannel Interactions may find the instruction to be redundant with their existing schemas and the integration of the redundant information is seen to be a source of extraneous cognitive load. 9 Research on split attention, redundancy, and reversal effects suggest that instructional design choices should be appropriate for the expertise level of the intended learners and that methods must change as learners’ expertise increases (van Merrienboer & Sweller, 2005). While backchannel interactions could increase extraneous load for some learners, could backchannel interactions be used as a means for the presenter to gauge the level of expertise of the learners during instructional presentation? If so, is it possible that the same backchannel interactions which may cause extraneous cognitive load effects in novice learners could act to reduce extraneous cognitive load as the learners advance by providing signals to the presenter of the learners’ level of expertise? Laptops in the Classroom Research on laptop use in the classroom lecture setting may provide one of the closest bodies of research to backchannel interactions. It may be possible to draw a parallel between backchannel interactions in a synchronous computer-mediate instructional presentation with laptop use in face to face classroom lecture settings. As noted in a recent review of classroom laptop literature by Fried (2008), contradictory research results abound. Yet, there is a body of research which suggests that laptop use in the classroom lecture setting is a source of overload and distraction. Included in Fried’s review are her own research findings which suggest that students using laptops during classroom lectures regularly use the laptop for things other than taking notes. Further, the students’ laptop use was negatively related to several measures of learning and was reported to be a distraction from fellow students. Backchannel Interactions 10 Fried (2005) viewed the results as clear support for prior research that suggests classroom performance is negatively related to the learners’ laptop use within the classroom. However, it is important to note that in Fried’s research the students’ laptop use was in no way integrated into the classroom lecture. The students were informed that the laptops would not be needed during the semester in lectures, the presenter made no attempts to guide the learners’ use of the laptops, nor were their laptops used to display instructional presentation. Apparently, the assumed sole purpose of the laptops in the studied classroom was as a note taking device given that any other activity outside of note taking, including the 45% of the students in the study who reported regularly using instant messaging, was dismissed within the study as an unnecessary and distracting activity. However, Fried did acknowledge that the primary limitation to the generalization of the findings was that laptop use was not integrated into the lecture. Further, as Fried suggests, the findings associated with learning measures may also reflect that struggling students are more likely to be diverted from the lecture. Germane Cognitive Load Instructional activities that encourage mental effort in schema construction and automation are viewed as processes that increase germane cognitive load (van Merrienboer & Sweller, 2005). As suggested by Winn (2004), advances in computer-mediated technologies make it possible to do more than direct teaching and to use the technology to assist learners as they actively select, organize, and integrate new information. Some suggest that synchronous computer-mediated discussion helps learners to move from surface understanding to more deep learning as they reflect and respond to questions from peers and the instructor (Havard, Jianxia & Olinzock, 2005). Moreno and Mayer (2007) view this as a difference between facilitating information acquisition and supporting knowledge construction. Could backchannel interactions Backchannel Interactions optimize germane cognitive load by aiding the learners’ understanding of the instructional 11 content, adding context to the presentation narrative, providing opportunities for reflection, and promoting engagement? Laptops in the Classroom - Revisited In contrast to the laptops in the classroom research cited above, other research suggests that computer use during classroom presentation can facilitate classroom interactions and class participation which, in turn, increases engagement, motivation, and active learning (Fitch, Partee, Stephens, & Driver, as cited in Fried, 2008). In summarizing their research on laptop use during classroom instruction, Barak, Lipson, and Lerman (2006) suggest that computer use by students during class facilitates construction of understanding of the learning material, immediate feedback and help, multiple interactions among learners and instructors, and the ability to share work, ideas, and learner interpretations. Computer Mediated Communication In a review of literature related to CMC processes, Marshall and Novick (1995) suggest that CMC differs from face to face communication and is generally characterized by longer turns, fewer interruptions, less overlaps, and increased formality in switching among speakers. DeSanctis and Monge (1998) report research that suggests electronic communication tends to decrease levels of communication as compared to face to face communication. They note that this may be the result of reduced use of speech acknowledgements, such as “Uh-hmm”, or typical social greetings. DeSanctis and Monge also cite findings that suggest participants engaging in CMC conversation may experience difficulty in establishing meaning of information and managing feedback in conversation which may negatively affect message understanding, but that attention to maintaining mutual understanding across the group can help to ensure effective Backchannel Interactions communication. Could synchronous backchannel interactions help to overcome some of these obstacles associated with CMC and foster mutual understanding across the group? Marshall and Novick (1995) also note that the characteristics of CMC may affect conversational effectiveness which they describe as the degree to which the mutual conversational goals are achieved. They cite a large body of research which supports a collaborative theory of conversation which focuses on the joint construction of conversation in 12 which interactive and collaborative aspects of the conversation help to support full understanding and to achieve the overall expectations for the conversation. In summarizing their own research findings, Marshall and Novick (p. 75) suggest CMC is “enhanced by the addition of a channel which allows conversant to share relevant visual context, particularly where visual context is relevant to the task” thereby allowing users more control over the social distance or presence. Do backchannel interactions offer learners more control over social distance and help to improve CMC effectiveness? Pelowski, Frissell, Cabral, and Yu (2005) conducted research to identify various immediacy behaviors within synchronous text chat logs with the hope of shedding light on learners’ feelings of social presence and the impact on learning. The authors indicate that while a positive relationship has been found between perceptions of immediacy and performance in face to face environments, little immediacy research within synchronous computer-mediated instruction has been studied. Citing various research findings from traditional face to face classrooms, Pelowski et al. note that immediacy behaviors, such as calling others by name, smiling or engaging in eye content, have been shown to enhance perceptions of closeness or immediacy to others. Backchannel Interactions 13 Pelowski, et al (2005) found significant variation in overall chat participation, as well as in immediacy behaviors. Acknowledgement, salutations, and questions were observed in nearly all students at least once. Agreement or disagreement was shown at least once by over 80% of the students. Humor, self-discloser, and value statements appeared less frequently, but at least once by over 60% of students. However, no significant correlation was found between immediacy behaviors in the text chat environment and learner performance. Could this be an indication that while backchannel interactions may facilitate more effective communication, the communication may mean nothing in terms of learner performance? Constructing Meaning Do learners gain context and insight from the commentary of students within the backchannel interactions? Some social constructivists view synchronous CMC technologies as vehicles to support student to student co-creation of meaning and understanding, including Gunawardena, Lowe, and Anderson (as cited in Paulus, 2007) who suggest knowledge construction via CMC consisting of five phases: 1) sharing and comparing of information, 2) discovery and exploration of cognitive dissonance, 3) negotiation of meaning and coconstruction of knowledge, 4) testing and modification of proposed co-construction, and 5) agreement and applications of newly constructed meaning. Yet, as Paulus notes, the research literature suggests that learners in most CMC supported environments, which tend to rely heavily on asynchronous interactions, rarely move beyond sharing and comparing of information. Could the synchronous backchannel provide support for more immediate meaningful reflection and cocreation of knowledge? In noting the small, but growing body of research on synchronous CMC tools in learning, Stein, Wanstreet, Glazer, Engle, Harris, and Johnston (2007) investigated if and how shared Backchannel Interactions meaning is achieved in a synchronous text based chat. Their review of formal small group synchronous text chat logs suggest that text chat can lead to a shared understanding from a pattern of interaction which establishes a) social presence, characterized by group inquiry and integration, b) teaching presence, characterized by the teacher’s efforts to focus and organize, 14 and c) cognitive presence characterized by the learners’ patterns of reflection and revision. Stein et al. observed: In a more casual, immediate environment than asynchronous discussion boards, chats give learners the opportunity to transform their personal meaning into shared solutions through a nonlinear process of asking questions, exchanging information, connecting ideas, and defending solutions … In addition, the group as a whole has the ability to see the progression of logic and higher-order thinking as the text unfolds on the members' computer screens and is revised, amplified, and integrated into shared understanding through feedback. (p. 113) Would synchronous text based backchannel interactions during instructional presentation result in similar findings? Or would the larger group size and split attention from the presentation to the screen alter the results? Learners as Presentation Co-narrators Research in dialogue and communication suggests a joint role for learners as co-narrators in the instructional presentation. Could learner responses in the backchannel enhance the main channel message of the presentation? Does the backchannel provide on-the-fly reflection which the instructor can monitor to check for learners’ understanding and adjust the presentation based on the learners’ responses? Backchannel Interactions Bavelas, Coates and Johnson (2000) explore the various conceptions of information 15 communication models beginning with the classic Shannon and Weaver model which focuses in on a single channel from sender to receiver. They cite Schober and Clark who referred to this conception as an autonomous view of conversation in which the listener passively receives information delivered from the speaker. In contrast to this view, Bavelas et al. note other conceptions and research which focus on dialogue as a joint activity, including Yngve’s focus on a reciprocal effect of a backchannel which recognizes the impact of listener responses. In this view, communication is not just for information transmission, but also for co-construction of the message wherein dialogue is considered collaborative and evolves from the reciprocal influence between narrators and listeners (Bavelas et al). Generic and specific listener responses within in the reciprocal dialogue was the focus of research for Bavelas et al., (2000) in which they studied what listeners do (backchannel) during narration to form an integrated message with the narrator. Table 1 compares the generic responses to specific responses that were observed. Table 1. Generic versus Specific Listener Response. (Bavelas et al., 2000) Generic Responses Listening Made to or at the story or narrator Generally related to narrative External to the narrative Respond to the narrative Communicate general understanding Indicate understanding of the Specific Responses Co-telling Made with the story or narrator Specific to the narrative Internal to the narrative Add to the narrative Communicate specific understanding Indicate understanding of the words implications of the words As represented within Table 1, generic listener responses (discussed in the context of project markers below), do not convey narrative content, but allow the speaker to track the listener’s comprehension. In contrast, specific listener responses closely relate to the speaker’s Backchannel Interactions content and allow the listeners to become co-narrators who add to the narrative as they 16 communicate comments regarding their understanding. If learners were encouraged to contribute responses of confusion or understanding in the backchannel, could their responses help to conarrate the message being delivered by allowing the presenter to tailor the message to the audience, as is suggested by this research? Task Engagement Given the lack of research on backchannel interactions, it is unclear whether learners chatting in the backchannel are engaged in the presentation at hand. Do their comments reflect that they are receiving the intended message or that they are heading off in another direction? Zimbardo (as cited by Coleman, Paternite, & Sherman, 1999) suggests that due to factors such as increased anonymity, a sense of altered responsibility, and novel or unstructured situations, participants in synchronous CMC tend to become more engaged in the task at hand and less concerned with self-monitoring. Coleman et al. report similar findings from their research in which some (but not all) participants in synchronous CMC were more group focused, more selfdisclosing, and reported feeling that the physical separation provided a freedom from distraction! Do these findings suggest the text based backchannel may lead to greater task engagement? Intrinsic Cognitive Load The focus of this section is to assess whether the dialogue and interaction within backchannel interactions could help to manage intrinsic cognitive load. Research suggests intrinsic cognitive load can be more effectively managed if content is presented in segments (Mayer & Moreno, 2003). Further, presenting declarative information separately, either during presentation or during practice, from procedural information has been shown to increases the effectiveness and efficiency of learning (Kester et al., 2006). Research findings also indicate that Backchannel Interactions 17 content sequencing should be based on the learners’ level of expertise and that the preplanning of content sequencing becomes less important if the sequencing can be continuously adapted during the instructional presentation based upon observation of the learners’ expertise (van Merrienboer & Sweller, 2005). Therefore, could cues from the learners’ dialogue in the backchannel help the presenter to segment and sequence the presentation of content based on the learners’ responses of either understanding or confusion thereby helping to manage intrinsic cognitive load? Also, could the backchannel be used to segment presentation and practice opportunities though the use of formal problem statements, learner responses, and feedback? Based on dialogue analysis research it seems feasible that the backchannel can provide presenters with signals or markers from the learner to gauge their level of understanding which would allow an adjustment to the presentation based on the cues from the learners. Tied to the research noted above, research on self and other monitoring during dialogue suggests that speakers monitor their own speech and adjust their presentation based on their assessment of the listener’s level of understanding (Clark & Krych, 2004). As such, dialogue includes two activities, including support for the primary presentation of information and management of the dialogue itself. As described by Bangerter and Clark (2003), dialogue exists in both the front (or main) channel which includes the primary speaker and in the backchannel which includes the speech and signals from others occurring at same time as primary speaker’s turn. As discussed above, these backchannel responses, also known as project markers, play a role in shaping the presentation and include a) acknowledgement tokens in which the listener acknowledges the presentation through utterances, such as “uh-huh”, b) agreement tokens in which the listener Backchannel Interactions 18 agrees with the presenter’s position, such as “right”, and c) consent tokens in which the listener approves of the presenter’s comments, such as “okay”. Bangerter and Clark suggest that these project markers provide the primary speaker with marks to chart progress and signal to the presenter that the listener is ready to transition with the presentation. For example, the listener can offer the speaker a) continuers, such as “yes”, which signal the listener is ready to hear more, b) assessments, such as reactions of “wow” or “gosh”, which signal comprehension and evaluation of what has been said, or c) recipiency markers which signal the listener wants to speak. If backchannel interactions are considered signals from the learner as listener, it is conceivable that the presenter could use the responses as project markers to gauge how to segment and sequence the presentation. By monitoring the learners’ backchannel conversations and by assessing when the learners are ready to make transitions within the presentation, the presenter may be able to use the backchannel interactions to manage intrinsic cognitive load. Summary While no research was found that specifically evaluates backchannel interactions in the computer-mediated classroom, findings in areas that share key features with this relatively new instructional phenomenon may shed light on the effects the backchannel has on cognitive load. In evaluating this prior research from synchronous text based discussions, laptop use during live face to face classes, CMC, and dialogue analysis, the findings seem to suggest support for both negative and positive effects on cognitive load. The potential for distraction, split attention, and redundancy effects may indicate backchannel interactions place unnecessary extraneous cognitive load on learners. However, findings may also suggest that the backchannel interactions directly facilitate learning through more effective and efficient processing of the to-be-learned Backchannel Interactions material. Further, the signals and cues within the dialogue may help presenters to more 19 effectively and efficiently sequence and transition within the presentation of content which may help to manage intrinsic cognitive load. These findings have implications for both instructional designers and researchers. Clearly, the new features of synchronous computer-mediated classrooms necessitate a closer review of these new types of interactions. The noted findings offer many stepping stones for future research and suggest a host of research questions. Do backchannel interactions distract the learner from the task at hand and interfere with their receipt of the instructional message? Could backchannel interactions be used as a means for the presenter to gauge the level of expertise of the learners during instructional presentation? Could the synchronous backchannel provide support for immediate meaningful reflection? Do backchannel interactions help to foster mutual understanding and co-creation of knowledge across the group? Does this mutual understanding ultimately lead to better individual performance? Do backchannel interactions offer learners more control over social distance and help to improve CMC effectiveness? Do backchannel responses help to co-narrate the message being delivered and allow the presenter to tailor the message to the audience? Do these findings suggest the text based backchannel may lead to greater task engagement? Answers to all of these questions may help us to one day address the primary question raised at the beginning of this report. Is the interactivity involved with backchannel interactions extraneous load within the learning environment, germane to the process of learning, or helpful in managing intrinsic cognitive load? As we gain more insight into these backchannel interactions, a new set of heuristics and online classroom norms (netiquette) will evolve. Teachers in traditional classes are already trying Backchannel Interactions 20 laptop up / laptop down procedures where the instructor asks for uninterrupted attention during presentation of material and then invite increased computer-mediated interaction and dialogue from learners during breaks in the formal presentation (Levine, as cited in Fried, 2008). In the same way learners in traditional classrooms know when it is time to speak in class and when it is time to listen, learners and instructors will one day know when it is appropriate to backchannel in class. Backchannel Interactions 21 Bangerter, A., & Clark, H. H. (2003). Navigating joint projects with dialogue. Cognitive Science, 27(2), 195. doi: 10.1016/S0364-0213(02)00118-0. Barak, M., Lipson, A., & Lerman, S. (2006). Wireless Laptops as Means For Promoting Active Learning In Large Lecture Halls. Journal of Research on Technology in Education, 38(3), 245-263. Bavelas, J. B., Coates, L., & Johnson, T. (2000). Listeners as co-narrators. Journal of Personality and Social Psychology, 79(6), 941-952. Clark, H. H., & Krych, M. A. (2004). Speaking while monitoring addressees for understanding. Journal of Memory and Language, 50(1), 62-81. Cogdill, S., Fanderclai, T., Kilborn, J., & Williams, M. (2001). Backchannel: whispering in digital conversation. In System Sciences, 2001. Proceedings of the 34th Annual Hawaii International Conference on System Sciences. Coleman, L. H., Paternite, C. E., & Sherman, R. C. (1999). A reexamination of deindividuation in synchronous computer-mediated communication. Computers in Human Behavior, 15, 51-65. DeSanctis, G., & Monge, P. (1998). Communication Processes for Virtual Organizations. Journal of Computer-Mediated Communication, 3(4), 0-0. Fried, C. B. (2008). In-Class Laptop Use and Its Effects on Student Learning. Computers & Education, 50(3), 906. Guess, A. (2008, April 18). Hey, You! Pay Attention! :: Inside Higher Ed: Higher Education's Source for News, Views and Jobs. Inside Higher Ed. Retrieved June 10, 2008, from http://insidehighered.com/news/2008/04/18/laptops. Backchannel Interactions Havard, B., Jianxia Du, & Olinzock, A. (2005). DEEP LEARNING The Knowledge, Methods, 22 and Cognition Process in Instructor-led Online Discussion. Quarterly Review of Distance Education, 6(2), 125-135. Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003). The Expertise Reversal Effect. Educational Psychologist, 38(1), 23-31. Kester, L.; Kirschner, P. A.; van Merrienboer, J. J. G. (2006). Just-in-Time Information Presentation: Improving Learning a Troubleshooting Skill. Contemporary Educational Psychology, 31 (2), 167-185. Lee, H., Plass, J., & Homer, B. (2006). Optimizing Cognitive Load for Learning from ComputerBased Science Simulations. Journal of Educational Psychology, 98(4), 902-913. Marshall, C. R., & Novick, D. G. (1995). Conversational effectiveness in multimedia communications. Information Technology & People, 8(1), 54 - 79. doi: 10.1108/09593849510081602. Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38, 43–52. Moore, D. M., Burton, J. K., & Myers, R. J. (2004). Multiple channel communication: The theoretical and research foundations of multimedia. In D. Jonassen (Ed.), Handbook of Research on Educational Communications and Technology, 2nd Ed. Chapter 36, pp. 9791005. Moreno, R., & Mayer, R. (2007). Interactive multimodal learning environments. EDUCATIONAL PSYCHOLOGY REVIEW, 19(3), 309-326. Paulus, T. M. (2007). CMC Modes for Learning Tasks at a Distance. Journal of ComputerMediated Communication, 12(4), 1322-1345. doi: 10.1111/j.1083-6101.2007.00375.x. Backchannel Interactions Pelowski, S., Frissell, L., Cabral, K., & Yu, T. (2005). So Far But Yet So Close: Student Chat Room Immediacy, Learning, and Performance in an Online Course. Journal of Interactive Learning Research, 16(4), 395-407. 23 Pociask, F. D., Morrison, G. (2004). The Effects of Split-Attention and Redundancy on Cognitive Load When Learning Cognitive and Psychomotor Tasks. Association for Educational Communications and Technology. Retrieved June 17, 2008, from http://www.aect.org. Stein, D. S., Wanstreet, C. E., Glazer, H. R., Engle, C. L., Harris, R. A., Johnston, S. M., et al. (2007). Creating shared understanding through chats in a community of inquiry. The Internet and Higher Education, 10(2), 103-115. Sweller, J. & Chandler, P. (1994). Why some material is difficult to learn. Cognition and Instruction, 12(30, 184-233. van Merrienboer, J., & Sweller, J. (2005). Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions. Educational Psychology Review, 17(2), 147. Winn, W. (2004). Cognitive perspectives in psychology. In D. Jonassen (Ed.), Handbook of Research on Educational Communications and Technology, 2nd Ed. Chapter 4, pp. 179112. Yardi, S. (2006). The role of the backchannel in collaborative learning environments. In Proceedings of the 7th international conference on Learning sciences (pp. 852-858). Bloomington, Indiana: International Society of the Learning Sciences. Retrieved June 11, 2008, from http://crlt.indiana.edu/iclsvideo/index.html and http://dream.sims.berkeley.edu/groups/classchat/papers/SaritaYardi_ISLS2....
AttachmentSize
Backchannel Research Paper.doc120 KB

Cognitive Task Analysis Example

IDT873 CTA Maddrell - Upload a Document to Scribd

Cognitive Task Analysis Running head: COGNITIVE TASK ANALYSIS 1 Cognitive Task Analysis Jennifer Maddrell Old Dominion University IDT 873 Advanced Instructional Design Techniques Dr. Gary Morrison October 15, 2008 Cognitive Task Analysis Traditional Task Analysis A traditional procedural task analysis describes a task as a series of discrete actions (Jonassen, Tessmer, & Hannum, 1999). Figure 1 diagrams a procedural task analysis for the insurance underwriting submission review task. Within this triage task, the underwriter must evaluate various aspects of the new submission and decide whether to quote or decline the submission. Figure 1. Procedural Analysis of Insurance Underwriting Submission Review Task. 2 Guide to symbols: = Input and exit point; = Mental operation; = Decision Point; = Direction in Step Cognitive Task Analysis 3 As depicted in Figure 1, in completing the submission review task, the underwriter must make a series of mental operations and decisions in route to a conclusion to either a) decline the submission or b) quote the submission. These mental operations and subsequent decisions include the following: Assessing the viability of the opportunity. Upon receipt of the submission, the underwriter must make a quick review of the information provided to assess the viability of the opportunity. Given the information presented within the submission and discussions with the broker, the underwriter must judge the likelihood the account will actually leave the incumbent carrier. Critical cues to consider include prior service and claims handling problems with the incumbent carrier, time to transition the account, and completeness of the submission. If the relationship with the prior carrier has been good, there is little time to transition the account, or the broker only provided enough information to provide a price (not service) quote, it is likely the insured is not serious about moving from the incumbent carrier and the broker is just seeking comparative price quotes. However, if the insured is dissatisfied with the incumbent carrier’s service, there is ample time to transition the servicing of the account, or the submission provides a comprehensive overview of both price and service requirements, it is likely the opportunity is viable. If the assessment of the information leads to a conclusion that the chances are slim the account will move, the underwriter makes the decision to decline the account. However, if the assessments leads to a conclusion that there is a good chance of writing the account, the underwriter makes the decision to continue working on the account. Examining the employee concentrations. Given the potentially catastrophic exposure of providing casualty insurance at locations with high employee concentrations, the underwriter’s triage of the submission includes an examination of employee concentrations. If the insured has employee concentrations at any one location above company guidelines, the underwriter makes the decision to decline the account. Otherwise, the underwriter makes the decision to continue working on the account. Comparing the account’s exposures to the company’s underwriting guidelines. Upon receipt of the submission, the underwriter must compare the prospective account’s exposures to the insurance company’s underwriting guidelines. Critical to this comparison is a review of the insured’s current and prior operations. If the company is involved in any operations which result in exposures that are against the underwriting guidelines, the underwriter makes the decision to decline the account. Otherwise, the underwriter makes the decision to move forward with the quotation task (beyond the scope of this submission triage task analysis). Cognitive Task Analysis A cognitive task analysis (CTA) offers an alternative means of describing the cognitive elements of the evaluation and decision making processes involved in the task. The following provides the results of an Applied Cognitive Task Analysis (ACTA) based on interviews conducted with an underwriting subject matter expert (SME) to gain information about cognitive strategies used to complete the submission triage task (Militello & Hutton, 1998). The ACTA includes a task diagram, knowledge audit table, simulation interview, and cognitive demands table. Cognitive Task Analysis 4 Task diagram Figure 2 is the task diagram generated after an initial interview with the underwriting SME. The task diagram offers a high level overview of the submission triage task which focuses on the most difficult cognitive aspects. The SME was asked, “Think about what you do when you triage a new prospect. Can you break this task down into less than six, but more than three steps?” The SME mentioned five steps, but one was eliminated (financial approval) as it is not task performed by underwriter. Figure 2. Task Diagram for New Account Prospect Triage. Knowledge Audit Table During interviews with the SME, the interviewer probed for concrete examples, cues and strategies, and reasons why the task is often difficult for novices. The interviewer asked the SME to focus on specific examples for each aspect of expertise. Table 1 summarizes the results of the knowledge audit for the submission triage task. Simulation Interview During a simulation interview with the SME, the interviewer asked the SME to focus on the challenging aspects of a specific representative scenario associated with new submission triage. Table 2 summarizes the results of the simulation interview, including the actions, assessments, cues, and potential errors identified for each central event. Cognitive Demands Table Table 3 consolidates and synthesizes the data collected during the interview process. The cognitive demands table centers on the common themes that came from the interviews and identifies the difficult cognitive elements, common errors, and cues or strategies used by experts to overcome these challenges. Cognitive Task Analysis Table 1. Knowledge Audit Table. Aspect of expertise Past and future Example: Call from broker about account where incumbent carrier messed up on claim and insured’s legal department insisting the account must move. 5 • • Cues and strategies High level nature of incumbent mess up Level of people involved in decision (low level versus high level) • • Why Difficult? Novice may not recognize significance of messed up claim handling Novice may not link level of insured to severity of problem Novice may not link severity of problem to increased chance of writing account. Novices may not consider other issues beyond price that influence buying decision Novices do not have relationship with broker to know when you are getting the “straight” facts versus a “sales pitch” Novices may get into the minutia of the account specifics and not step back and realize the timeframe is not feasible to actually move the account Novices are focused on details within submission Novices are familiar with “outside” considerations that affect the likelihood of writing the account • • • • Big picture Example: Steps back from all the facts about the account presented by the broker to consider what is the “real” motivation behind looking for a quote? Is this prospect a true opportunity or does the broker just need a competing price quote? If it is only a need to get competing price quotes, highly unlikely the account will move. Noticing Example: Broker not soliciting TPA quotes for claim handling which would be a #1 condition of actually moving the account. Job Smarts Example: Focus on what broker said in conversation versus purely what is presented in the quote. Opportunities Example: Our unit can’t work on this account, but other units in company can. Anomalies Example: Broker doesn’t return phone calls. Shows a lack of interest. • • • • Beyond price, there service issues with prior carrier Your personal history with that broker. Time frame to release quote What other carriers are quoting • • • • • Going beyond underwriting information presented in the submission Considering conditional things that impact your quote Timeframes Others carriers being asked to quote. Reasons for leaving Understanding of underwriting appetite of other units Knowing how to access those people Timing of returned phone calls Extent of response to questions • • • • • • • • • Novices tend to be preoccupied with verifying details within submission Novices not aware of situational issues that can be “deal breakers” or “deal makers” Novices don’t know underwriting appetite of other units Novices don’t know people outside of the unit Novices may not recognize they are “getting blown off” and they continue working on submission • • Cognitive Task Analysis (either lacking or detailed) 6 • Novices don’t recognize significance of “out of sight / out of mind” which is signal if you are alive or dead Table 2. Simulation Interview. Events Discussion about prospect with broker Actions Ask probing questions about opportunity Sensing tone from broker of urgency and desire to have you quote. Assessment Answers to question make sense or not with what is in the submission Broker wants to work with you or just wants a quote for comparison purposes How much time is there between now and effective date? Are the exposures inherent in risk acceptable under our underwriting guidelines? Critical Cues Can you meet the issued There is disaffection with incumbent Openness of the broker Willingness to provide additional information Too much time signals the broker is “shopping” for an early quote. Too little time signals that broker just wants to keep current carrier “honest” “Red flag” exposures that we cannot write “Go” classes of business that we are targeting Potential Errors Being overly optimistic about any opportunity Not probing deeply for hidden facts about situation Not reading the verbal and nonverbal cues the broker is giving you. • • • • • • • • • • • Deciding whether to quote • • Evaluating time frame between quote deadline and effective date Assessing if account meets underwriting guidelines • • • • • • • • • Being so excited about the opportunity that you rush to judgment Spin wheels on accounts where there isn’t a true opportunity Don’t dig deeply enough into what the account really does or did in the past that could represent “hidden” exposures Cognitive Task Analysis 7 Cognitive Task Analysis 8 Table 3. Cognitive Demands Table. Difficult cognitive elements Assessing whether broker’s answers make sense or not with what is in the submission Considering the “real” opportunity and exposures beyond the obvious information given in the submission Comparing account’s exposure information with underwriting guidelines Why difficult Common errors Cues and strategies used • • Consider if you really know the story behind the story Get and keep the broker talking to elicit information beyond the submission Ask about reasons why account would move Consider whether timeframe to move account is realistic • • • • • • • Considering and suggesting alternatives • • Novice underwriters tend to focus on basic facts in the submission versus what the broker is telling them Brokers reluctant to voluntarily air dirty laundry about account Novices underwriters tend to focus on information given versus information needed to make decision Can be uncomfortable situation for novice underwriters to probe for answers Companies often have many types of operations which cross several classes of business Novice underwriters tend to focus on the primary business operations Novice underwriters often have difficult assigning an account to the appropriate business classification within the guidelines. Novice underwriters tend to focus on what broker is asking you to do Novice underwriters often fail to identify ways to adjust quotation options to meet guidelines • • Don’t recognize or probe for hidden “red flags” Focus exclusively on information in submission Taking the submission at “face value” Failing to engage in uncomfortable probing conversations with the broker Failing to fully capture exposures Getting lost in the details Misinterpreting underwriting data Misinterpreting the underwriting guidelines • • • • • • • • • Review account with senior underwriter Check multiple sources to evaluate exposures • • • Quote only what is asked by broker Failing to probe for alternate opportunities with the broker • • Consider ways to adjust quotation options to fit within underwriting guidelines. Consider other coverages and limits that you or other departments could quote Cognitive Task Analysis Comparison of Approaches 9 Analysis Comparison In comparing the results of the traditional task analysis with the cognitive task analysis, significant differences emerge in following areas: a) the identification and analysis of hidden cognitive processes, b) the relative level of elaboration regarding the central task elements, c) the focus on expert and novice differences. Overt behaviors versus cognitive processes. The key strength of the traditional task analysis is the ability to examine overt behaviors required to complete a task. However, as seen in this example, additional critical cognitive processes and actions were uncovered within the ACTA. Further, the ACTA offered a means of analyzing the relative significance and difficulty of the required task elements. Level of elaboration. The traditional task analysis identified the relevant processes and decision points in the submission triage task. However, by focusing on the difficult cognitive aspects of the task, the ACTA provided greater elaboration with regard to the knowledge and cognitive processes required to perform the task. As the cognitive demands table highlights, the ACTA focused attention on the difficult cognitive elements, common errors, and strategies to overcome those difficulties and errors. Unfortunately, these elements were not unearthed within the traditional task analysis. Focus on expert and novice differences. Unlike the traditional task analysis, the ACTA analysis focused on the central differences between how an expert and a novice perform the submission triage task. The result is a comparison of current state (novices) and desired state (experts), as well as strategies to take the novice to an expert level. Implications for Practice Traditional task analysis allows practitioners to target the inputs, central operations, and decision points involved in carrying out a task. While this provides a good overview of what happens as the task is carried out, it does not provide the designer with an understanding of the nature of the cognitive processes required to complete the task. Further, following a traditional task analysis, the practitioner cannot gage the relative importance of the various tasks elements or which aspect(s) of the task are harder for the novice. As seen in the results between the two analyses, the cognitive task analysis provides practitioners with a better understanding of the difficult and critical cognitive processes, as well as the and cues and strategies, which are central to successful completion of the task. When to use Traditional Task Analysis versus Cognitive Task Analysis Both a traditional task analysis and cognitive task analysis highlight key aspects of the task. However, as seen in the two analyses above, each produces different results. As noted, the cognitive task analysis offers a better analysis of the central knowledge and decision making cognitive processes. Given that each task is different, the following provides a comparison of which analysis is more appropriate based on the degree of observable behaviors, the degree of required expertise, and the relative cognitive difficulty of the task. Cognitive Task Analysis 10 Degree of observable behaviors. The difference in outcomes between the two approaches is likely less significant when the task involves primarily observable behaviors. However, if the task involves primarily mental actions that result in less observable behaviors, a cognitive task analysis is the more appropriate option. Expert versus novice differences. When little task related expertise is required to perform the task, the results of both analyses would likely be similar. However, if successful completion of the task requires knowledge that a novice would not possess, a cognitive task analysis allows the practitioner to uncover or drill down on the difficult cognitive elements. As noted, these cognitive elements are less likely to be adequately analyzed in a traditional task analysis. Relative cognitive difficulty. While a traditional task analysis provides a comprehensive outline of the steps in the task, it does not offer a relative assessment of which steps are harder or more critical to successful completion. Instead, each step in the task is considered equally. However, as seen in the cognitive demands table, some tasks hinge on a smaller number of critical or difficult elements. Therefore, the ACTA is more appropriate when successful task outcomes depend upon cognitively difficult judgments or decision. Cognitive Task Analysis 11 References Jonassen, D. H., Tessmer, M., & Hannum, W. H. (1999). Task analysis methods for instructional design. Mahwah, N.J.: L. Erlbaum Associates. Militello, L. G., & Hutton, R. J. B. (1998). Applied cognitive task analysis (ACTA): a practitioner’s toolkit for understanding cognitive task demands. Ergonomics, 41(11), 1618-1641.
AttachmentSize
IDT873 CTA Maddrell.doc222.5 KB

Critique of OECD Innovation in the Knowledge Economy

The following is a critique of the 2004 publication Innovation in the knowledge economy: implications for education and learning from the Organisation for Economic Co-operation and Development (OECD). The following assesses the strengths and weaknesses of the publication and concludes with a proposed outline for a similar report for instructional designers.

Critique of OECD Innovation in the Knowledge Economy - Upload a Document to Scribd
Read this document on Scribd: Critique of OECD Innovation in the Knowledge Economy

Design Critique Running head: Personal Critique 1 Personal Critique Jennifer Maddrell Old Dominion University IDT 895: Knowledge Management June 1, 2008 Design Critique Innovation in the Knowledge Economy The following is a critique of the 2004 publication Innovation in the knowledge economy: implications for education and learning from the Organisation for Economic Co- 2 operation and Development (OECD). The following assesses the strengths and weaknesses of the publication and concludes with a proposed outline for a similar report for instructional designers. Strengths of Report Assessment of knowledge-based communities. A key strength of the report is the detailed assessment of new forms of knowledge-based communities in sectors outside of education. The report highlights the possibility for innovation that is created when unrestricted access and a free flow of information exists within knowledge-based communities. The overriding premise is that through open access to people, technologies, and information, new and exciting avenues for knowledge generation, innovation, and sharing are possible. The report provides an effective argument that these interactions and connections are far different from knowledge sharing and collaborations of the past. Through the use of open information and communication technologies, there has been a democratization of the knowledge generation and sharing process. All users, not just “experts”, are able to participate, share, and debate issues. In addition, these same information and communication technologies offer the ability to rapidly and inexpensively codify and transmit information which further energizes innovation. No longer must participants rely on formal networks and commercial publishers to produce and disseminate information. The report also highlights an important characteristic of these new forms of knowledgebased communities which has been shown to rapidly stimulate innovation and foster a sense of community around a topic. Participation is based on what is described as “general reciprocity Design Critique obligations”. An assumed condition of membership is the sharing of knowledge. In other words, the cost of participation is participation! These assumed reciprocal obligations fuel the network and, in turn, discourage lurkers (takers, but not contributors). Coverage of drivers of innovation. The report also effectively highlights the drivers that are likely to propel innovation in education. At the forefront are advances in information and communication technologies which allow ever increasing access to information and people. Through examples in other sectors, the report effectively demonstrates how technology is helping to overcome physical, social, and cultural barriers to reach previously isolated or excluded participants. With expanded access, more individual can connect and contribute. In addition, the report effectively argues that the ability to “learn by doing” spurs innovation. No longer do users need to wait for producers to create and deliver a product. With greater access to tools, information, people, and resources, users are empowered to innovate to solve their own, but likely shared, problems. In turn, the innovations they create can be contributed back to the community to continue the cycle of “general reciprocity obligations”, described above. Coverage of barriers to innovation. The report also highlights important barriers that must be overcome. At the forefront is unequal access. While there has been a noted democratization of the knowledge generation and sharing process, only a very small percentage of the world’s population is able to participate due to limited access to the information and communication technologies highlighted in the report. In addition, the rapid innovation described in the report has occurred only in pockets. While examples of computer technology innovation abound, many sectors operate in much the same way they have for generations. Therefore, not all sectors will be as willing or able to 3 Design Critique embrace change. The field of education is described as one such sector which tends to rely on tradition and generally resists change. The report effectively argues that educational institutions 4 and practices that exist today are not significantly different than they were hundreds of years ago and that many prevailing “best practices” have been developed and passed down from one practitioner to the next. While the report may be criticized for discrediting the vast body of existing educational research (discussed below) and the experience of practitioners, the report effectively describes the struggle within the field of education between what is termed “scientific” and “humanistic” approaches. Coming to terms with this issue will be central to future education reform. This is particularly the case within the United States where No Child Left Behind proponents, who favor educational standards based on what the report terms “scientific based research”, are facing off with opponents who favor empowering practitioners to rely on time tested “best practices” based on their judgment and experience. While the report clearly advocates a “scientific” approach, it is likely that the debate between scientific and humanistic approaches will rage on for some time to come. The report also addresses the fact that effective knowledge-based networks require a high degree of open access to information and people. Copyright to protect intellectual property rights or access fees in the form of tuition, membership fees, or journal subscriptions can all be barriers to this free flow of open access to information and people. However, there is no easy solution to remove these barriers. While revenue generation can be a barrier to access, it is also an incentive for producers to innovate. Likewise, while copyright limits access, it also affords important protections to producers who have invested their time and recourses into creating the material. Design Critique Weaknesses of Report As noted, the report provides a very compelling vision for the future; one in which expanded access, free flows of information, and knowledge-based networks propel innovation. However, in tackling the very complex topic of generating and sharing knowledge and innovation in the field of education, the report leaves many unanswered questions. Why the disregard for previous educational research and practice? A clear message in the report is that the field of education lacks a sufficient body of existing scientific research to 5 propel innovation in education and learning. Is this a valid assertion? It is likely that many of the thousands of members of the American Educational Research Association and other professional research organizations would welcome the opportunity to pose an argument against this position. While there are many avenues of new research to pursue and the field of education struggles to transfer prior research into effective practices, it seems unwarranted to disregard (or at best to discredit) decades of existing educational and instructional research and practice. How will knowledge-based networks support innovation in education? The report focused heavily on the transformative power of knowledge-based networks. Yet, is unclear how the authors propose knowledge-based networks should support the field of education. Is the intent to bring learners into the networks (as a means of providing instruction and education) or is the intent to use knowledge-based networks to support the knowledge generation and sharing among “thought leaders” as a means of driving innovative practices in education? If the intent is to use knowledge-based networks to support educators within a globally connected professional development community, then many of the examples in the book are applicable, including using the open forms of connection to generate and share new innovative practices. However, if the Design Critique 6 intent is to use knowledge-based networks as means of providing and delivering education, then there are numerous barriers to consider that are not addressed in this report, as discussed below. What about other factors and barriers in the education sector? As noted, the report effectively summarizes examples of innovation in other sectors and attempts to argue that these same opportunities and practices will be drivers for education. However, the education sector faces many barriers that were either not addressed within the report or only given passing mention. Yet, these barriers make transfer of many of the innovation drivers very difficult for the field of education. Most importantly, education in many countries is compulsory. Therefore, access cannot be limited to pockets of a fortunate few. A condition of educational delivery in most countries is that access must be universal. As such, knowledge generation and sharing strategies which can only be supported by advanced forms of information and communication technologies are not feasible for the vast majority of the world’s population, including teachers and learners in many developed countries. What are the suggestions to reach this “unconnected” majority? In addition, beyond access, education must provide guidance and context around information through effective instructional practices for all learners; not just some learners or those intrinsically motivated to learn-by-doing. Are the hypothetical participants in the cited knowledge-based communities assumed to be high achieving early adopters? If so, what is the prescription to reach and engage teachers and learners of all levels of ability and motivation? In this new world of open access, who will be responsible for providing the required universal access, instructional guidance and context, assessment of performance, and credit for the experience? Formal educational institutions? Informal knowledge networks? Who will pay for this access? Individual learners? Governments? Private foundations? While the report Design Critique effectively argues that much of the innovation in other sectors has come from free and open informal knowledge networks, it is far less clear how free and open informal networks can provide the necessary universal access, context, assessment, and credit for the experience. Is the take-away message that existing formal educational institutions should become more agile and nimble like informal knowledge networks? If so, the report falls short of describing how that major miracle can happen. Does access lead to knowledge generation or transfer? The report provides numerous examples of how information and communication technology can expand access to people and 7 information. Unfortunately, the report leaves to future research any prescriptions for instructional practices and processes to facilitate learning. As such, the focus of the report becomes the transformative power of the delivery medium. Most instructional designers would argue that content and interaction are important, but not sufficient conditions for instruction. Effective presentation, practice, and guidance strategies are also needed to facilitate learning. While the writers of this report forcefully stressed the need for research into effective instructional practices, many well intentioned open access programs, such as the One Laptop per Child project and numerous open educational resource (OER) projects, are founded on an “if you build it / share it, they will come” premise. By the report’s focus on the transformative power of the delivery medium, readers may be left with the notion that free flows of information and access to communication technologies will naturally lead to learning. However, is offering learners access to an information technology and an open educational resource significantly different than offering learners a bus pass and a library card? While both options would likely benefit the learners, few would consider either to be instruction or models for the future of education. Design Critique Innovation through Effective Instruction: From Information Transfer to Knowledge Generation and Management In the section that follows, an outline is provided which proposes instructional design practices to support and foster innovation. The presented instructional design considerations go beyond basic information transfer to practices which foster effective knowledge generation and management. Move from Problems to be Corrected to Opportunity Identification Problem to be corrected. Most instructional design plans begin with an identification of instructional problems. The identified problems form the reason for undertaking instruction. Unfortunately, when viewed as problem correction, instruction becomes an intervention to correct deficiencies. Opportunity identification. In contrast, instruction conceived of as opportunity identification focuses on answering three important questions which are central to any planning activity, including: 1)”Where we are today?” 2) “Where we want to be in the future?” and 3) “What do we need to do to get there?” While there is a subtle difference between the identification of problems to be corrected and opportunity identification, the impact on the instructional objectives can be profound. The focus of the instructional objectives and, in turn, 8 the design plan shifts from making the learner or organization whole today (by filling in existing skill and knowledge gaps) to creating learning experiences tied directly to long term goals for the future. Leverage Learner Experiences and Knowledge through Co-creation of Knowledge Build upon what learners know. Learner analysis is one of the primary steps in most instructional design plans. By ensuring that the learner analysis includes the learners’ entry Design Critique 9 competencies, their level of expertise, and their background knowledge an instructional designer is able to create and facilitate instructional strategies which are authentic and build upon the existing knowledge of the learners. In turn, learners will be more engaged in the instruction and contribute to the knowledge creation and sharing process. Ground in authentic tasks. Tied to above, it is important to consider the context in which the learners will use the to-be-learned knowledge. The design plan should incorporate instructional strategies which are grounded in authentic tasks and situations that the learner faces now and will face in the future. By doing so, it is more likely that the learners will integrate the instruction and contribute to future innovation after the instructional event is over. Re-think Traditional Instructional Roles Instructors as facilitators versus transmitters. The instructor role is often conceived of as a transmitter of information. However, in order to foster knowledge generation among learner participants, it is necessary to re-think the traditional role of the instructor from transmitter of information to facilitator of knowledge co-creation. Learners as Co-creators. In order to foster knowledge generation among participants, it is important to go beyond a notion of learners as sponges who absorb information transmitted by the instructor. Instead, learners must take on active roles as co-creators of knowledge. As noted, learners have experiences to build upon which can not only add to given instructional sessions, but also to knowledge generation and sharing beyond the classroom. Re-assess Instructional Time Horizon The instructional event. When instruction or training is considered as an intervention to fix or address a specific problem or need, instructional design plans tend to be limited to the Design Critique instructional event. However, it is shortsighted for a designer to not contemplate knowledge creation and sharing opportunities after the instructional event is over. Beyond the instructional event. An overriding goal of instruction should be integration. The benefit of gaining knowledge is the ability to use it. If learners do not integrate the newly formed knowledge into their lives, there is not much benefit to be derived from conducting the 10 instruction in the first place. Therefore, instruction should contemplate what the learners will do with the instruction and attempt to extend the knowledge generation and sharing beyond the instructional event. One way to accomplish this is to effectively support the learners’ integration into formal and information networks, as discussed below. Support Knowledge Networks Formal Networks. Formal networks are formed to support a shared goal or vision. Instruction is typically undertaken to support the needs of formal networks; to train employees or educate members to be more productive within the greater formal network. Therefore, it is a traditional practice within instructional design to fully consider the needs, characteristics, and context of the formal network. Who are the players? What are the roles? How will the instruction support the knowledge generation and management needs of the formal network? Informal Networks. Beyond support of formal networks, instruction should also recognize and foster knowledge creation and sharing within informal networks. In contrast to formal networks, informal networks are formed by individuals who hold common, but not necessarily shared, needs and goals. Informal networks tend to be loosely joined, but are often very influential and powerful innovators. While informal networks are often hard to identify, it is important to consider ways to contemplate existing and potential informal networks within the design of instruction and to help the network members recognize their common needs and goals. Design Critique Open Lines of Communication 11 For any formal or informal knowledge network to function, the members must be able to communicate. An important step in the instructional design process is ensuring all members of the learning community have access to communication channels and are versed in the shared language. However, beyond access and knowledge of important terminology, it is important for learners to know the people who hold expertise in key areas and how to connect with them. Address Barriers to Knowledge Generation and Sharing Barriers to Accessing People. As discussed above, participation among individuals is central to the notion of knowledge co-creation. However, barriers among participants can impede the knowledge generation and sharing among participants. The barriers may be intentional or unintentional. Some participants may not want to engage with others, due a lack of incentive or to conceal information and knowledge, while others may simply not be aware of the existence of others with a particular expertise. Instructional designers can help learners form connections and, as noted above, establish a shared language and platform from which to communicate. Barriers to Accessing Information. Information is fuel for a knowledge network. Barriers to a free flow of information can mean that participants will not be able to leverage the information during knowledge generation. However, the free flow of information can be impeded, again either intentionally or unintentionally. Unintentional barriers are often created when someone holds information without knowing others would benefit from it or when there is too much information to sift through (the “firehouse” effect), validate, or synthesize. In contrast, intentional barriers are created when individuals or groups attempt to protect the value of the information they possess through copyright or other access fees. It is complicated balance Design Critique between protecting intellectual property and trade secrets while also ensuring that participants are benefiting from a free flow of information. Instructional designers can help learners overcome these barriers by identifying or providing vetted information sources. Barriers to Accessing Tools. Tools are the medium with which information and knowledge are codified and disseminated. Without access to and knowledge of how to use the 12 tools, a barrier exists. Again, this barrier can be intentional, such as in the form of access fees or patents, or unintentional, such as in a lack of awareness that the tool exists or knowledge of how to use the tool. Instructional designers should contemplate the tools available to learners and ensure that learners have the necessary access and skills to use the tools. Design Critique References 13 Centre for Educational Research and Innovation, & Organisation for Economic Co-operation and Development. (2004). Innovation in the knowledge economy: implications for education and learning. Knowledge management. Paris, France: OECD.
AttachmentSize
OECD Critiquel.doc85.5 KB

Drupal Presentation from the Indiana University IST Conference

Attached is the presentation material from the Drupal workshop I hosted today during the 2007 Indiana University IST Conference. Please leave any comments below or use the contact form (on the menu bar above) if you have any questions ... or ... better, yet ... join us on Monday nights at 9:00 p.m. ET for live web casts at the Drupal CMS Academy!
AttachmentSize
Drupal Workshop - IU IST 2007 Final.pptx1.25 MB

Drupal as a Personal Learning Environment

AttachmentSize
519 Project 2 Jennifer Maddrell Final.ppt1.76 MB

Games: Facilitated Online

Here is a recap of a Framegame (by Thiagi) that I conducted toward the end of last semester. The book provides great insights into facilitating an educational game ... I amended the core approaches to work within an online setting.

Audience: The audience for the session included a group of educators who meet online Thursday nights to discuss and share ideas about various topics in the field of education during an informal peer learning session. On the night of the Framegame, 7 participants played in the game and a few others lurked in the virtual "corner". While many of the weekly attendees are k-12 teachers, some are educational technology specialists in college or corporate settings. Nearly all of the participants are using Internet based technologies to support learning activities. A growing concern is how to foster appropriate participant interactions within the online learning environment.

Topic - Tactics to promote positive online interactions: While most would agree that the goal is to create and support positive interactions (free of "flame wars" or "cyber bullying"), many are unsure how to go about it. Is it a matter of just setting strict online codes of conduct? Is it about modeling good behavior? Is it about discussion moderation and tossing out the bad apples?

Framegame - Take Five: I selected the Take Five Framegame to generate possible tactics which educators could use to create and support positive interactions in their online environments.

Online Communication: This group is made up of technology geeks who love new online learning challenges, so I was not too concerned about running this online versus f2f. While I ran into a few glitches, the following online communications tools provided and effective and efficient means of facilitating the game:

Game Play: The following outlines the planned script (talking points and actions) for the session. The "Notes" sections in italics below highlight deviations from either the basic Framegame or the script.

  • Brief players: The topic for this brainstorm is tactics to use as educators to foster positive interactions within online learning environments. In the next half hour, we will explore this topic by coming up with a list of effective tactics to take back to the classroom to both foster appropriate participant interactions and address inappropriate conduct should it arise.
  • Individual brainstorm: For the next few minutes, please reflect on the topic and come up with a short list of effective techniques that you would use to foster appropriate and positive participant interactions in an online learning environment. Try to keep your list of solutions short and to the point as we will be discussing them in more detail in the next step.

[Note: Given 7 attendees joined the session, I ran this version of Take Five as an individual version (per the suggestion on p. 261 in Framegames). However, if I had been faced with a group of 10 or more, my plan was to ask for volunteers to pair up and use the private text chat function to communicate with a partner.]

  • Group Brainstorm on Whiteboard: Let us now move over to the whiteboard and begin forming a combined list of possible techniques. Using the text tool, take turns typing in your list of suggested techniques in the left hand column. Try to keep an eye on the list to avoid adding an item already offered by another player. Duplicate entries will be combined before we move to the next step. Let's try to get a combined list of 10 to 12 good possible tactics on the whiteboard. Also, please speak up if you would like clarification about a possible solution.

[Note: This process prompted participants to share lengthy descriptions about each of the tactics ("Here is what I do with my students ..." , which ate into the time previously allocated for the final debrief. However, it didn't seem to make any sense to stifle the brainstorming conversation (the point of the game) just to stick to the game script.]

  • Voting - Round 1: We will now begin the process of voting for the most effective approach. Using the pen tool, select the blue color and place a check mark next to the recommendation that you feel is the most effective tactic.
  • Scoring - Round 1: Now that we have all made our top choices, we will score this round. The most popular response for this round was "**". Therefore, those who selected this response should score 1 points. As "**" suggested this tactic, s/he should score 5 points. As a friendly reminder, all scoring is on the honor system. Therefore, as I read out the score for each round, please keep a running tally of your points.
  • Voting - Round 2 - 5: Consider this list again (minus any item that is crossed out) and use the pen tool (with the red color) and place a check mark next to the recommendation that you feel is the most effective tactic. It can be the same item you selected in a previous round, as long as that item is not already in our top choices. [Repeat through round 5]
  • Scoring - Round 2 - 5: Now that we have all made our top choices, we will score this round. The most popular response for this round was "**". Therefore, those who selected this response should score 1 points and "**" who suggested the tactic should score 5 points.

[Note regarding scoring: For ease of facilitation in this online environment, I made slight adjustments to the scoring scheme from the original Framegame model.]

  • Conclusion of the Game: We now have a list of the top 5 techniques. Please add up your personal score and share it with the group. Congratulations to our winner!
  • Debrief: Let's more fully consider the list and discuss the merits of not only our top 5 choices, but how we arrived at this list. Do you think through this method we arrived at a good working list of 5 effective techniques? What surprises you about the list? Would you like to make a case for or against items that were selected or any that were not selected in the top 5?

[Note: Given the time we spent discussing the recommended tactics during the brainstorm, we did not have time for a full debrief. Instead, I offered to compile the list form the session so that the group can pick up their discussion next time.]

Critique / Reflection:

  • Time: We spent about 40 minutes playing the game. As noted above, we spent more time than I had originally allocated for the brainstorm portion, which left us out of time for a full debrief. If I had more time, I would like to have heard more from the group about what they thought about the process (effectiveness, efficiency, etc).
  • Scoring / Voting: The participants were not that interested in the scoring and voting aspects. They were far more interested in discussing the topic than coming up with the most "popular" vote. Therefore, I'm not sure if the scoring or voting is a crucial element when you have highly motivated participants. However, I can see how it could add interest with less motivated participants and when you have enough participants to make it a team based game.
  • Quality of Participant Recommendations: The list of participant recommendations, as well as the ensuing discussion was great. I think this was due to the participants' interest in the topic, as well as the participatory nature of the brainstorm on the whiteboard. Each recommendation seemed to build on another until it seemed the group fleshed out the key tactics.
  • Interest / Engagement: Participant interest level and engagement was great! However, I purposely chose a topic that I knew the group would find interesting. Coincidently, this group had been criticized in a discussion board comment about some dialog that a listener found less than positive the week before. We were able to kick off