USIBrazil Learning Technologies Network (LTNet) Final Evaluation Report December 30,2001 Barbara Fillip Drawing by Gabriel, a student in Group 401, E. M. Rose Kablin School, Brazil. Gabriel participated in the MultiRio Internet Generation Project in collaboration with LTNet. More details about the project and LTNet's involvement are provided u. EXECUTIVE SUMMARY Objectives of the Project For the past three years, fiom October 1998-December 2001, the USIBrazil Learning Technologies Network (LTNet) project has supported and stren-4ened efforts in Brazil to make effective use of educational technologies, thereby contributing to improvements in Brazilian public education. Specifically, LTNet successfully accomplished the following objectives to: 9 Build and enhance, over the course of the project, an easy-to-use web site, bilingual in Portuguese and ~nilish and encompassing information, professional networking services, and teacher development resources for Brazilian and US educators;' > Support and enhance other UsBrazil Education Partnerships activities, especially exchanges between Brazilian and the US educators and actively participate in Partnership meetings; > Establish and strengthen links between multiple Brazilian educational programs and encourage improved use of educational technologies within these activities; 9 Organize, carry out and participate in conferences, seminars and workshop in the US and Brazil that increase an understanding of the effective use of computer and Internet technology in education; 9 Seek out and enable partnerships among US corporations and Brazilian counter part institutions and the Brazilian education sector; and > Reach out to and expose US educators to Brazilian experiences with educational technology applications and facilitate collaborative links between US and Brazilian educators to exchange experiences and perceptions about using computers and the Internet to improve teaching and learning. LTNet was funded by USAID's Latin American and Caribbean Bureau for three years staning in October 1998. The idea for LTNet originated at the first US.-Brazil Binational Dialo, we on education, held in early 1998. The Brazilian Ministry of Education @EC) was establishing a Centre for Experimentation with Educational Technologies (CETE) as a national resource to promote and research the effective use of educational technology and to support ProInfo, a national school computerization project. The Ministry suggested that a similar center or clearinghouse in the United States could be linked to CETE so that U.S. and Brazilian educators, researchers and policy makers could share what they were learning about using technologies in schools. As LTNet was icveloped: the initial partnership with CETE evolved ro encompass a strong partnership between ProInfo and LTNet. I LTNet was mandated to encourage and enable coliai~oratior! among US and Braziliar: educe:'::.. A! 11x same rime. most of LTNet's project work was focus on collaborarin~ with Brvilian organizations m6 xh301.- ;c enhance the use of computers and the Internet to imp:evr sducarisr: ir 3razilia.r public schools. t I The US response to this request was LTNet, funded by the US. Agency for International Development's Latin America and Caribbean bureau and the Human Capacity and Development Center. The project was designed by USAID in cooperation with the US. Department of Education, US. Information Agency (now part of the US. State Department), and the Brazilian government. The Academy for Educational Development (AED), through the USAID funded Leadink project was contracted to implement and administer this collaborative effort. At USAID, David Evans, the Education Program Officer, oversaw this initiative and provided important leadership and advice to LTNet staff and was a strong supporter of this collaborative initiative. In Brazil, staff at the Cultural Affairs section of the US Embassy, specifically Michael Hahn and Marcia Mio, provided significant assistance to LTNet staff in planning and carrying out activities and projects in Brazil. At times, the US Embassy through the Cultural Affairs office provided critical funding assistance to Brazilian participants in LTNet and ProInfo collaborative activities. On the Brazil side, the leadership provided by Pedro Paulo Poppovic, the Secretary for Distance Education at the Ministry of Education, and the support to LTNet provided by Claudio Salles, the Director of ProInfo, was instrumental in enabling LTNet to grow. evolve and become successful. The pattern of partnership demonstrate by these two men was imitated by their staff and colleagues at the Ministry and across Brazil. This enabled LTNet to be quickly integrated into several aspects of ProInfo and created opportunities for collaboration with states and municipal secretaries of education. Without the blessing and support of the Ministry of Education and ProInfo it would have been impossible to work directly with state and municipal schools and NTEs. And therefore, much of what LTNet has been able to accomplish .sould not have happened. Achievements Over the past three years, LTNet staff, often in partnership with the ProInfo staff.' developed and implemented, activities that improved the promotion and use of computers and thc Internet in education. The adoption of new technologies within education systems is often a slow and challenging process that was nurtured effectively by LTNet's Project Director, Eric Rusten. and other project staffwho worked very closely with their Brazilian partners, particularly with ProInfo's pedagogical coordinator Vera Lucia Suguri. Through this close partnership, LTNet staff gained an understanding of the information culture among Brazilian educators. which enabled the project to develop and adapt activities to the specific needs and circumstances of Brazilian teachers and students. Brazil does not lack experts in educational technologies and in making effective use of computers and the Internet in schools. In fact, make of the leaders in this field globally are from Brazil and have contributed to ProInfo's and LTNet's work. LTNet was able to draw on this local expertise to strengthen its work and in turn occasionally facilitated I Prolnfo is Brazil's nationa! school computerilation and education change progam within the Minisr;! or Education (http://\vr~v.proicfo.mec.gov.br). interrelationships among educational technology specialists aod schools. Relying on sound educational theories, LTNet in collaboration with ProInfo contiibuted knowledge and skills for improving the way educators use computer and Internet tzchnology in teaching and learning. In addition, the LTNetRroInfo collaboration was able to 1) excite educators, especially at the classroom level, about the potential of educational technologies; 2) instill a belief in their own abilities; 3) show them how to achieve their goals; and 4) provide a web￾based collaborative environment for using different technology in educational activities. Once an educational technolow "comfort level" was reached. educators were able to link analytically initially-intimidating theory and practice. ~lso, the approach developed and promoted by LTNet and ProInfo imparted practical solutions to problems teachers faced and enabled teachers to immediately engage their students in online collaborative projects. The first two years of the project were spent primarily building relationships, testing new approaches, developing the LTNet web site and an integrated set of virtual communication and collaborative tools, developing and applying a rapid training approach that best fit the needs of Brazilian educators. The third year was marked by a 50 percent reduction in funding and a rapid expansion in demands for LTNet services, specifically the use of LTNet's web site and the virtual collaboration and communication tools. This increase in demand forced staff to reline existing tools and identify and install new fictions to make the collaborative learning environments as user-friendly as possible. The funding decline led to a reduction of paid-staff time that could be dedicated to managing LTNet. LTNet's Director was allocated 50 percent time on LTNet, while the other two staff were allocated 40 percent and 30 percent respectively. To compensate for this loss of paid staff, LTNet had to increasingly rely on staff from Brazil's ProInfo program and volunteers at Brazilian schools and NTEs. LTNet, in collaboration with ProInfo, raised the level of interest in educational technology encouraged educators to network with each other and to experiment with creative uses of technology to improve teaching and learning. In addition, LTNet helped to change perceptions among many Brzizilian educators about their capabilities and roles as educaiors. LTNet and ProInfo demonstrated with Brazilian educators what could be done with technology. Educators learned new ways to share learning experiences, build learning communities, and become innovators themselves. These achievements and the success of LTNet become even more impressive when the relative lack of resources for developing and maintaining LlXet's web site and creating the collaborative learning tools and environments is factored in. Much of LTNet's success is directly attributed to the personal dedication of LThlet's Project Director Eric Rusten and LTNet partner at ProInfo Vera Suguri. Although LTNet's funding ended in December 3 1, 2001. LTNet's future wili continuing under LTNet-Brazil, a newly-created NGI) that was created by Eric Rusten and Vera Suguri. ' Y Ven Suguri will be LTNet-Brazi!'~ Executive Director and Eric Rusten will serve as a volunteer board rncn~'wr ai~d chief technical advisor. lrri . . . Ill Evaluation History In early November 1999, after one year of activity, Dr. Joan Dassin was hired to conduct a mid￾term assessment of LTNet. In June 2000, LTNet contracted with Dr. Barbara Fillip to update the mid-year assessment, since the project was seeking a funded extension beyond the initial two years. At the end of year three of project activities, LTNet again hired Dr. Fillip to canyout the final project evaluation presented in this document. This report refers to an analysis of information on project activities fiom November 20,2000 through-December 28,2001. Much of this information was gathered from face-to-face meetings in Brazil and in the US with people involved in LTNet and those who benefited from participating in LTNet sponsored activities. The evaluation also assessed the LTNet web site, key project documents including quarterly reports, published papers, and PowerPoint presentations, and many in-depth discussions with LTNet and ProInfo staff. The first part of the report focuses on an assessment of the third year of project activities. The second part of the report presents a broader perspective on the overall project results and lessons learned throughout LTNet's three years of activity. Table of Contents Part I: KEY ACTIVITIES DURING 2001 This first part of the evaluation report provides a description of key project activities, focusing on the last of the project's three years of existence. A. The LTNet Web Site B. Presentations and Papers C. Training Part 11. RESULTS AND LESSONS LEARNED DURING 1999 - 2001 This second part of the evaluation report provides an overview of results achieved by the project and lessons learned over three year's of project activities. A. Partnerships B. Innovations Part 111. CONCLUSIONS APPENDICES Appendix A: Yahoo Group Discussion Lists to facilitate Vial Exchanges Appendix B: Screen shot of the Links to AACs on the LTNet Web Site ~Duendix C: Screen shot of the Sinop/FUST AAC Photo Gallery showing the President of Brazil Appendix D: Screen Shot of the SchoolLi Chat Pilot Web Page Appendix E: Screen shot of the RiverWalk Program's Chat room access p%e Appendix F: Screen shot of the advanced web folio used for the RiverWalk Project Appendix G: List of Documents Reviewed Ap~endix H: List of Individuals Contacted Part I. KEY ACTIVITIES DURING 2001 LTNet objectives during year three inc~ude:~ 0' Strengthen the shared agenda of priority issues of the US. and Brazilian Education Partnership (EPIC); *:* Strengthen the network of relevant and interested participants in the U.S. and Brazil Education Partnenhip; Continue to strengthen and use the LTNet web site to maximize access to relevant U.S. Educational Technology Resources; *% Serve as a primary English-language information resource on Brazil's educational technology efforts; 0:. Expand knowledge about the use of online learning for teacher training and professional development with specific emphasis on ESJJEFL language instruction; 0% Strengthen knowledge and understanding of research, monitoring, and evaluation of educational technology initiatives; *:* Foster links between the US educational technology business sectors with the Brazilian education sector; and *:* Work toward enacting strategies to sustain LTNet and the LTNet web site beyond USAID core funding. These goals were fulfilled through an integrated combination of activities. This part of the report describes these activities by organizing them into in three specific areas: +:* The LTNet web site; *:* Presentations and papers developed and delivered by LTNet staff in collaboration with ProInfo; and 0' Training activities facilitated by LTNet. The LTNet Web Site: A Transformation for the Better Originally, the LTNet web site was designed to primarily be a web-based clearinghouse for reports, case studies, web resources and other information (predominately from the US) on the use of educational technology to enhance teaching and learning in primary and secondary schools. As the project evolved and staff learned more about the needs of Brazilian educators. staff concluded that a web-based clearing house was not the most effective use for the LREet web site. Few Brazilian teachers know English well enough to benefit from the majority of available resources because they were primarily in .Furthermore, at the start of the project. few public schools with computer labs had access to the Internet, and teachers with Internet access did not spend much time searching for reports and case studies on ICTs were used in US schools. Because of these conditions and an emerging understanding of how best to support Brazilian efforts to improve education with technology, LTNet staff in collaboration with staff from ProInfo, transformed the LTNet web site into a virtual space for collaboration and leaminp and encouraged Brazilian teachers t~ network with each other and with teachers in the US. This change gave LTNet's web site a vibrant life, made LTNet more responsive to the needs of teachers, and greatly enhanced LTNet's impact on Brazilian education. 4 These objectives were copied from the project contract. 1 The transformation of the initial web site to an interactive collaborative leaning environment was accomplished within a project that lacked an explicit budget to support the design, consrruction. and maintenance of the web site. A.1. Web Site Develo~ments and Use ' A New "Cookie" In December 2001, Eric Rusten added "cookie" technology to the start pages of the LTNet web site, which allowed visitors to bypass the configuration page after their first visit to the site. The configuration page was needed to ensure that the "text-only" version of the site would be properly displayed on different computer monitors. A Low-Graphic Version of the Web Site Speeds Access By October 2001, Eric Rusten and a volunteer web designer, Cheryl Hoffman, completed the development of a low-graphic version of LTN~~.~ Beforethis, many teachers in Brazil had difficulty accessing LTNet because of the graphics that were used for menus and banners. The low-graphics version made it possible for nearly all educators with Internet access to easily and quickly use LTNet. It is important to note, that this was accomplished while maintaining the same look and feel present in the graphics version of the web site. Most To correct this problem the Usage Both the size of the site and the number of people using LTNet increased dramatically over the three years and very rapidly during the fall and winter of 2001. During the first year of the project, LTNet received 3 to 5 help-desk inquiries per week, while during the October-December 2001 LTNet was contacted about 24 times a week, primarily by Brazilian teachers. Several reasons explain why Brazilians started using LTNet's help desk more in the last year than in earlier years. Fit, as more teachers became aware of LTNet and met Eric Rusten at numerous conferences, workshops and seminars, the site became familiar, and teachers overcame reservations about contacting LTNet directly. Also, as LTNet's e-mail discussion list gee\\ in popularity, teachers became comfortable with e-mail and other electronic communication means and accustomed to communicating with LTNet staff. Also as time passed, more teachers gained easy access to the Internet. Finally, LTNet experimented with a variety of communication methods that allowed users to communicate easily with LTNet staff and other educators using the LTNet web site. This section coven on::; inp:ovements made durins :kc I=: ;cz 2:r.i ;r;je:. 6 This low-graphics version was nearly completely text-only. The on1 gaphic used on the site were the &:, ::I:;: photographs of project activities. And a special pop-up system for photographs was implemented re imp-:.:-: performance. One such method, collaborative learning environments (AAcs),~ was added to the site during the spring and summer of 2001. Consequently, visits to the site increased rapidly during this period, over 360,000 visits to LTNet were recorded for the first half of April (see table below). The table below provides some data on user "hits" or visits to the LTNet web site from the fourth quarter of 2000 and through of the forth quarters of 2001. Activity peaked around April 2001 as shown the highlighted quarter below.' Instant Internet Publishing Tool for the AACs LTNet's director continuously searched for, experimented with, modified and incorporated multide. new Web-based collaborative and communication tools into the -4~~s.~ One -, especially useful tool offers file management, allowing AAC users to quickly and easily publish their documents online on LTNet. This free tool was modified so that all menu items and instructions are available in both English and Portuguese. Preparing the LTNet website for use and transfer to LTh'eZ-Brazil The business of transferring the LTNet site to LTNet-Brazil required additional time, energy and commitment from the project director to document and clean up the site for management by staff of LTNet-Brazil. ' AAC is the Portuguese acronym for "Ambiente de Aprendizagem Colaborative". or Collaborative Learning Environment in English. ' This peak occurred at this time because LTNet ?as being used as the foundation for a stare-wide training activit) for c;: 1,000 school principals and 3CC multip!iers to21 :k Z:r ;:!2:: T:-:x. The challenxe of finding, modifying and installing appropriate tools was complicated by the need to only use free public domain tool so that others in Brazil could incorporate them into their web sites and to translate these rods tc English and Portuguese so that Brazilian educators and students could us? ducation program. LTNet developed the AAC, setup a listserv and with ProInfo carried out two training workshops in Parana for TVEscola coordinators and ProInfo multipliers in Parana. Lessons Learned about AACs AACs represent a very successfid component of the LTNet project. They were in great demand towards the end of the project and were increasingly being used creatively by educators across Brazil. As a result of the intensive work on ACC design by Eric Rusten and Vera Suguri, educators received ongoing support and accessed a user-friendly online environment. Now educators are starting to innovate in their use of the AACs, and the pool of users and "hits" are rising. LTNet-Brazil also has a long and growing list of requests from states, municipalities and special projects for new AACs. This young NGO believes that within a year all or nearly all states in Brazil will each have an AAC. Presentations and Papers B.1. Oualitv and Imuact of Presentations Presentations made by LTNet in cooperation with ProInfo had great promotional value and educational value, they also offered encouragement, providing a context for Brazilian educators to learn about and discuss their use of technology, and allowed LTNet and ProInfo staff to visit schools to learn first-hand how teachers and students across Brazil were uslng technology to enhance teaching and learning. School visits were important for enhancing. the self-worth among teachers unaccustomed to outside support and enlarging educators' realm cf contacts outside their schools. The ProInfoiLTNet joint presentations demonstrate the power of partnersbps and Brazil's commitment to IT learning and exchange. Also, due to the content and context-in locations nor often receiving international Brazilian government visitors, presentations introduced educators to valuable concepts in IT and education, addressed critical local needs, and offered evaluation and impact feedback. The presentations opened up the possibility of schools connecting to the Internet, catalyzed plans for infrastructure development, and stimulated dijcussior! of connectivity and equipment either in anticipation or as a result of the presentation. More than 11 formal face-to-face presentations were made &om October 2000 and December 2001. All presentations were the result of a very close collaboration between Lmet2s Eric Rusten and ProInfo's Vera Suguri both in the preparation of the PowerPoint slides, their translation, id the delivery of the presentation itself, whether in English, Portuguese, or a combination of both. Often state and municipal secretaries of education covered local costs for these visits including the costs for hotels and meals and local transport. In all cases, the states and municipalities covered the cost of air travel for Vera Suguri. Finally, in all cases, Eric Rusten and Vera Suguri traveled to different states and cities in response to formal invitations. A selection of these presentation are briefly discussed below. 1. Fulbright Math and Science Orientation in Brasilia, September 15", 2000. 2. Math and Science educators' workshop at the Ministry of Education, September 2000. 3. "Virtual Educational Exchanges: What Makes Them Work," given at an internationzl conference in Rio de Janeiro, Brazil on using the Internet for Educational collaborative activities on November 13,2000, an EPIC sponsored event to commemorate US International Education Week. 4. "Better Education Through Exchange and Collaboration" presented by Rusten, Wilderson, and Suguri at two high schools in Montes Claros, December 10-14,2000. 5. An intensive three-day workshop on "Advanced Web Technologies to :Enhance Education" (December 10-14) LTNet, jointly sponsored with ProInfo and the NTE in Montes Claros for a select group of 15 teachers, multipliers, and students at the NTE computer lab in Montes Claros. 6. InfoSol Congress in Fortaleza, Brazil, April 12-15,2001, keynote addrt:ss "Avdiando o Impacto de Novas Tecnologias nos Sistemas Educacionais" (Evaluating the Impact of New Technologies on Education), at the invitation of the Ministry of Education. Rusten discussed the impact that computer and Internet technologies are having on teaching and learning in Brazil. 7. Ledi TAG (Technology Advisory Group) Conference, March 2001 in Washington. DC: LTNet conducted a live chat session with the Pedagogical Coordinator of Brazil's Ministry of Education, a member of Partners for the Americas, and a newspaper reporter from the Brazilian media. LTNet's Gi Wilderson facilitated the chat, while USA111 staff and other TAG participants observed and asked questions online. Translation software was used to facilitate communication in English and Portuguese. 8. The Pernambuco State meeting of Multipliers in the city of Garanhum, May 3 1 st to June jd, 2001, on integrating Internet technologies in the State's school computer pro-m.. 9. Partnerships for Education: Abordagens, Impactos R Desafios. I Congresso Intewacional de Telematica na Educac&/ 1'11 Encontro Naciona: do ProInfo, October 26,2001. Fvnaieza. Brazil. At this rneering Eric and Vera made a keyno:e address on the Power of Panr:;r&p in 16 Strengthening Education. Also, Eric made a presentation on the US of collaborative on-line tools in LTNet's AAC in project based learning. In this presentation he focused on the results of the Riverwalk program activity. At this congress, which was attended by about 5,000 educators from across Brazil, two LTNet collaborators; Lourdes Matos and Noara Resende (with a teacher and two >mdents) organized and ran a series of training workshops on how to use the collaborative tools in LTNet's AACs. These two collaborators had organized these workshops on their own. 10. "Multiple Mechanisms for Collaborating, Exchanging and Learning Through Technolo,& (Power Point presentation), I Congresso International de Telematica na Educapio/ VII Enconrro Nacional do ProInfo, October 26,2001. 1 1. "Enhancing ESL and Strengthening Brazil's BNC Network through Computer & Internet Technologies," given with PowerPoint slides at the Annual Meeting of Presidents of Bradl Binational Centers (BNCs), October 2001in Sao Paulo. This presentation was given at the request of the US Embassy. The number of presentations far exceeds what was required under the contract for 2001. In addition, the volume of presentations does not reflect the impact on furthering the project goals, contributing to the UsBrazil Partnership for Education and enhancing an understanding of how technology can improve teaching and learning in Brazil. Its impact is best understood on direct observation. B. 2. Paaers written through LTNet suaaort Two papers, written primarily by Rusten and Suguri and both published orline in the January￾March 2002 issue of TechKnowLogis.org, illustrate two learning activities. The first paper focused on a collaborative activity among LTNet, ProInfo, and 4 multiplies and teachers involved in the Chat Pilot activity. The second paper documents LTNet's and ProInfo's experience supporting the Riverwalk project in which 14 Brazilian schools participated. 03 "The Pedagogical Uses of Web-Based Chat: A pilot Activity to explore the pedagogical uses of Web-based Chat," by Vera Suguri, Lourdes Matos, Noara Castro. Ieda Castro, Lurdes Marilene Jung and Eric Rusten, April 2001. *3 "RiverWaJk-Brazil: Virtual Journey, Real Learning,'' by Arati Singh, Eric Rusten and Vera Suguri, December 2001 (?) The Chat Pilot paper provided an opportunity for four teach-rs to take pride in their work and promote both nationally and internationally how Chat can be used a pedagogical tool. These teachers successfully participated in communication activities within and beyond Brazil that the\ had been deeply involved in. The writing process forced the teachers to think analytically and to gain a better understmdiq of their investment in IT and education. Presented at a national conference, the paper gave thie teachers an opportunity to hone their speaking skills. The process of the action research and the presentation by teachers set an important precedent demonstrating that Brazilian teachers can cany out impdrtant action research and & important resources fir national and International events. At the congress in Fortaleza where the Chat Pilot paper was presenr, the two teachers making the resenta at ion were the onlv teacherl~resenters at the entire eveti:. The publication in ~echl<;lowLo~ia (hn~://www.techknbwlogia.oig) also gives the teachers international exposure and recognition and enabled Brazil's ProInfo program to share a valuable experience with a global audience. The second article on the Riverwalk oroiect . enabled all of the schools and individuals invoIved > in the project to take pride in their work and be recognized nationally and internationally for their achievements. In addition, the online international exposure reflects well on LTNet and USAID for funding this initiative. Training Rapid Experiential Learning Approach Through the collaborative effort between LTNet and ProInfo, Rusten and Sum developed a rapid gaining method-referred to as Rapid Experiential Learning @E~)%at allo& participants to acquire essential technology skills within very short periods of training and start using the tools immediately in collaborative learning activities with peers. 'The training also requires that participants be directly engaged in developing learning projects that will later be used in the classroom with their own students. REL evolved from constraints and opportunities that presented themselves during the implementation of the project. Financial and time constraints prevented LTNet's project director fiom visiting Brazil more than four or five times a year and from staying longer than 5 weeks at a time. There were also significant costs involved in getting training participants to specific training sites. The result was that the training had to be carried out in one to three days to enable teachers and multipliers from states and municipalities to participate and for LTNer and ProInfo staff to be able to provide such training. While other approaches to training teachers in the use of IT for education tend to focus on theoretical aspects of technology for education, the REL approach focuses on providing essential skills that educators need to immediately start usins IT within education. The key to the success of this approach is developing an enabling environment in which educators start using IT tools immediately. To maximize the benefits, this approach requires a strong ongoing support system and collaborative environments (-he AACs) that teachers own and can use to apply their new skills. LTNet and ProInfo used the LTNet website for this purpose. Tools such as the very responsive help-desk system as \veil as peer support through listsews met the evolving needs of educators. Examples of Training Activities Principars' Training Program As mentioned above. in the spring of 2000,27 principals from 7-7 diKerent Brazilian states were selected from the best-administered schools. These principals traveled to the US for a two-weel, study tour to learn about innovative strategies for school management and school community partnerships. Although one of the goals of this USAID-funded activity was to maintain ongoing exchanges of information after returning to Brazil, unfortunately, the principals lacked the technical skills in computers and Internet use for collaborative exchanges. In early December 2000, LTNet and ProInfo organized the necessary principal training in collaboration with CONSED'~, ~e~aneste'~ and three State Secretaries of Education, the three NTEs and the US Embassy in Brazil. The LTNet team of Rusten and Wilderson, with Suguri and two of her ProInfo colleagues worked together to train over 30 multipliers (8-12 from each NTE) in the use of Intemet communication tools for virtual collaboration. The multipliers then proceeded to train the school principals in their respective NTEs with the technical and pedagogical support of LTNet and ProInfo staff. The REL approach was cost effective in time, resources and money. Traking took place over one week--one day for each group of multipliers and principals in three different cities (Recife, Rio de Janeiro and Niteroi) located in three different regions of Brazil. If the training had requited more than on day, most, if not all, of the principals would not have been able to participate. Workshop on Advanced Internet Tools & Collaborative Activities for Multipliers Also, LTNet's Rusten and Wilderson in collaboration with Suguri develop-d and delivered a three-day workshop that provided participants with hands-on training in the use of advanced Internet technologies, who already had taken an online ProInfo course on web page development. The participants included multipliers, teachers, and students from the NTE in Montes Claros and Belo Horezonte. The goal was to develop a template for a series of workshops that the Brazilian multipliers could then give to other groups of teachers in multipliers around the country. As a consequence of that course and based on participants' observation of LTNet's site, demand increased for additional technical training in web development for educational web sites. While this was not one of LTNet's priorities, Lmct provided the assistance requested. Annual State Technology and Education meeting in Fortaleza, (Ceara) In June 2001, Eric Rusten with Vera Suguri and other ProInfo staff participated in a collaborative training activity that involved over 120 teachers, principals and multipliers from across the state of Ceara, who were attending an annual State Technology and Education Meeting. This meeting is a time when NTEs and schools come together to share what they have been doing with IT and education project experiences. LTNet and ProInfo were invited to participate and run an AAC workshop and develop an AAC for the participants. Training sessions focused on. email and listserv, chat rooms, and online publishing and projects. 1: The National Council for State Secretaries of Education in Brazil. "A nationa! network operating under CONSEC to improve school manaKement. 15 Part 11. RESULTS AND LESSONS LEARNED The combination of activities described in Part I of the report created synergies that resulted in important project impacts. While these activities have been described above, the impacts achieved as a result of these activities are highIighted below. Two key concepts are the focus of this section: A) the importance of partnerships and LTNet's ability to wors with, foster and continuously nurture such partnerships for successful integration of technology into education; B) the crucial role of innovation and the importance of encouraging innovation in the use of available technological tools. Partnerships One of LTNet's strengths has been its ability to carefully foster and nurture a web of partnerships with a variety of actors in the US and in Brazil. At the center of this web of partnerships are LTNet and ProInfo. This core partnership has been symbolized by the close professional relationship between LTNet's Director, Eric Rusten, Vera Suguri the pedagogical consultant and Claudio Salles the director of ProInfo. The partnership has grown over the three years of the project and enabled additional partners to benefit and contribute to common goals of integrating technology into learning and teaching and innovating, both in the US and in Brazil. At the start of the third year of activity, the Ministry of Education, through the ProInfo project provided funding support for LTNet in terms of Vera Su,griYs salary and her ability to commit considerable time and resources to being ProInfo's representative to LTNet. Minisby funds from ProInfo also supported many LTNetlProInfo training activities. In addition, different ProInfo staff provided logistical and technical support to LTNet. Without this level of support and commitment to the Partnership in general and LTNet in particular, the success that was achieved over the three years and especially during the last year of the project would not have been possible. The first principal's training that took pIace in 2000 is a good example of the kinds of partnerships that LTNet was able to foster. This training was part of EPIC and undertaken through the US Embassy. In Brazil, the Association of State Secretaries of Education (CONSED) was very much involved in identifjmg the principals that would take part in the program, encouraging individual State Secretaries of Education to send their principals to the training event, and facilitating local logistic support in the cities where the training took place. CONSED's involvement was also critical to increasing the visibility and unportance of this effort in the minds of the participating principals and State Secretaries of Fducation. Without the partnerships with CONSED, the principals' training activity would not have been possible. The training for the principals took place in three locations. At each location. the multipliers from the three ProInfo NTEs participated in the training activity, the ProInfo State Coordinators, and the municipal and State Secretaries of Education were involved in planning, orpnizing and implementing these training events and in some cases paying for high-speed connections to the Internet. In addition, REGANESTE-a network of school manager~-~upp~rted ihii effort and the Director of REGANESTE helped plan the event and was present to assist in activities in hw of the three cities. REGANESTE's involvement also made it possible to add aspects of IT uses for school management in to the training program. There was also a funding partnership with the US Embassy which paid the per diem and travel costs for LTNet staff and two ProInfo staff from the Ministry. The Ministry of Education in Brazil paid for the transport of one other ProInfo staff member and paid staff salaries and provided critical logistical and political support. LTNet also provided funcling to cover a variety of workshop expenses and LTNet staff salaries. Each State Secretariat for Education paid their principal's travel, lodging and per diem costs and provided access to NTEs in the three training locations. School principals at the three training locations were involved in coordinating lunches and local logistical support. Also, it is important to note that during the second and third years of the project, all events LTNet was involved in were based on invitations from local partners-State and Municipal Secretaries of Education-who voluntarily co-funded local expenses (hotel's and meals) for LTNet and ProInfo staff. This local cost-sharing had not been a formal part of the agreement between the project and the Government of Brazil. This voluntary willingness to share expenses demonstrates how much educators valued these LTNet and ProInfo training events and presentations. LTNet's success in building robust partnerships enhanced i5e value of LMet's work in Brazil and the US. Starting fiom a base of suspicion and misperceptions on both sides ar the beginning of the project, LTNet was able to build trust and work with all partners. Brazilian confidence in LTNet is demonstrated by a variety of collaborative activities initiated by ProInfo. For instance, Rusten was invited on several occasions to represent ProInfo at events in the US and elsewhere. Innovations Innovation was a key element in the project's overall success and impact. It was LTNet's spirit of innovation that inspired teachers to try new tools, experiment, and to come up with new uses for the tools that LTNet provided. The cycle of innovation, training and leaning had a mutually reinforcing effect among all partners. In many cases, a culture of local innovation has been instilled at the school and NTE level and teachers and multipliers will continue with this work and move forward with new ideas. LTNet has been a constant and continuing source of support to help make teachers' and students' ideas a reality. One more ingredient in this process is LTNet's and ProInfo's efforts to change educators' perceptions and attitudes and convince them of their own capabilities, resulting in a strong sense of local ownership and capacity to achieve. Two activities that exemp!ify innovation and local owners!ip are described below. SchoolLinks Chat dot In collaboration with Vera Suguri of Prolnfo, LTNet launched a new progmn designed to foster virtual exchanges between schools in Brazil and betbyeen Brazil and the US. At the beginnins of the program, Vera asked Eric if it would be possible for a: ~n-line chat tool to be added io LTNet so that teachers could "talk" real time with each other across the country. Eric agreed that this could easily be done. Before this discussion with Vera: Eric had identified a selection of free online chat tools and installed several in the testing section of the LTNet web site. This was done to see which one would be best for use with Brazilian teachers. Three days after talking with Vera about adding a chat tool to LTNet, Eric selected one of these tools, Ralf s Chat, had translated most of the English menu and instructional items to Portuguese creating a bilin-pal environment, added some additional features, and constructed a web framework in which the chat room could be easily used. As a result, this new hction was created on the LTNet web site to support online chat activities among Brazilian teachers and students. This new environment was first tested in a pilot, action research effort by a team of three ProInfo multipliers and one teacher working in four different schools in different cities in Brazil. This team of teacher-researchers had been selected bv Vera. After two months of testing the - Chat tool with students of various ages engaged in a variety of educational activities, the multipliers met with Vera, Eric and Gini Wilderson to discuss the most appropriate ways to present the results of -- - the pilot activity. One of the multipliers, Lourdes Matos and one of thd teachers, Noara Resende, who were involved in the pilot created a web site hosted by LTNet, describing the pilot activity and the results. (See A~pendix C for a screen shot of the web page or visit the site itself at h~:/lwww.ltnet.orplSchoolLink~IChatPilo~index.h~I~. In addition to the web site, the teachers and multipliers involved in the pilot, Vera Su-rmri of ProInfo and LTNet's Eric Rusten wrote a paper that was produced in Engbsh and Portuguese, to capture the lessons learned from this experiment with web-based chat so that educators across Brazil and the world could benefit from this work. This paper, "The Pedagogical Uses of Web￾Based Chat: A pilot Activity to explore the pedagogical uses of Web-based Chat," by Vera Suguri, Lourdes Matos, Noara Castro, Ieda Castro, Lurdes Marilene Jung 2nd Eric Rusten, was presented at a national congress in Fortaleza Brazil and published in Techh3zowlogia, an internationally recognized electronic journal on educational technology . 15 The paper describes how teachers and multipliers in four different schools in Brazil implemented a pilot project using Web-based chat with the assistance of ProInfo and LTNet. The Chat tool provided by LTNet was used in several different innovative ways includi::: 1) To enable students in two different regions of Brazil to learn about different aspects of their respective regions; 2) To enable students to discuss issues surrounding sexuality that were difficult for teachers to address on their own by allowing outside experts to contribute their knowledge and communicate with the students; 3) To enable students to obtain advice regarding their professional future but allowing them to discuss with a professor from a local university; 4) To enable teachers to communicate with each other regarding effective uses of computers and Internet technologies; is The paper can be downloaded in Portuguese and English from h~:l!wwu~.Imet.or~'SchoolLinksIChatPilot/es~dosereflexoes.htm 5) Finally, to enable handicapped and special needs students to cornmunixte with students far away, opening up their horizons. Two of the researcher-educators involved in the pilot submitted the paper to the selection committee of the Brazil Computer Society for presentation at the Society's annual meeting. The committee selected the paper and LTNet funded the participation of these hvo educators at the conference so that they could present the results at a national technology and education forum. Vera Suguri and Eric Rusten were also present at this event. Toward the end of the year, Eric submitted the Chat Pilot paper to Techla2owlogia (httu:llwww.techknowlo~, an online technology and education journal for publication. The paper was accepted by TechKnowvLogia and will appear in the January 2002 issue. Lessons: This is particularly interesting effort because "chat" is often not regarded as a usell pedagogical tool. The teachers who enthusiastically participated in this pilot should be commended for their willingness to try untested approaches and their eagerness to reflect and learn fiom their own experience and share this with others. LTNet and ProInfo's joint support of these teachers is a good example of what LTNet and ProInfo's achievements in terms of transformations in thinking among teachers. RiverWalk The RiverWalk project is a collaborative project in which students and teachers fiom six countries (US, Brazil, Taiwan, Canada, Japan and Israel) research and share information about rivers in their communities. This project, managed by the University of Michigan's Interactive Communications and Simulations Group (ICS) was funded by Japan's Ministry of Land, Infrastructure and Transport and launched in November 2000. The project already had participants from the US, Taiwan, Canada, Japan and Israel when Brazil was invited to participate. ProInfo's Vera Suguri helped to strategically select schools that would participate in the project and then called on LTNet's Eric Rusten to help develop a web￾based collaborative environment (an AAC) for use by the Brazilian educators participating in the project. The idea was to supplement the existing RiverWalk web site, which is used by students to publish their river projects, with a separate web environment that would aliow Brazilian educators to work as a group and learn collaboratively from their participadon in RiverWalk. The site, as all other AACs, is accessible on the LTNet web site. h~:llwww.ltnet.org/SchoolLinksNEE/RiverWal~-AAC-RW-Base.h~ Unlike the RiverWalk site itself, the LTNet based Riverwalk-AAC is entirely accessible to all visitors and not restricted to participants in the RiverWalk program. makin3 it a valuable resource for a broader range of educators in Brazil and elsewhere. (See a Slreen Shot of the Chat room's login page for LTNet's RiverWalk AAC, Avoendix D) CONCLUSIONS LTNet represents: A project whose greatest value emerged out of its ability to be organically transformed based on expanding and developing partnerships, emerging and evolving needs of the various partners, and most importantly, responding to the actual needs of Brazilian educators, while encouraging them to explore, experiment and lean] fiom their own activities that were linked to LTNet's training and web-based collal~orative tools. A project that is likely to survive through the continued use of tools that were developed and provided by LTNet, and through the continued impact of the training provided to multipliers and teachers across Brazil. An example of this comes fiom a multiplier interviewed at an NTE in Brasilia who mentioned that she was writing her thesis on using and adapting LTNet's AAC environment for visual arts teachers. LTNet's impact may expand under the auspices of the Brazilian NGO, LTNet-Brazil because of the tremendously increased need for the types of services and tools that LTNet provided during its three year tenure. In late December, a new set of partnerships was in the process of being established between schools in Brazil and in Africa, using LTNet￾Brazil. This is a clear indicator of LTNet's success in creating rewarding collaborative processes and tools that will continue to benefit educators globally. In spite of very limited financial and staffresources, this project was able to self-adjust, innovate, learn, expand its reach, and impact large numbers of multipliers, teachers, and school principals in Brazil. This was made possible because of: Quick response and flexibility on the part of LTNet staff. One multiplier in Monte Claros, Minas Gerais, who was inte~ewed over the phone from Brasilia noted that Lmet's Project Director, Eric Rusten, was always able to provide very help511 and timely assistance and that his support from a pedagogical and technical perspective has helped them to "change their way of working." She also noted that Washington, D.C. (meaning Eric Rusten) was able to provide assistance much faster than anyone she had access to in Brazil. Demand driven approach based on a good understanding of the information culture facing Brazilian educators. Instead of pushing for the implementati;,i of hat ma) have been initially thought to be needed, i.e., a web-based clearinghouse of information about educational technologies, LTNet listened and responded to the needs af Srazilian educators and open up opportunities for them based on a good undestanding of the in-feym.?tinr! clvlturr and pedagogice! e-~+?mec? facing teeches in 4rrz711 Flexibility within USAID's Global LAC Bureau, especially that of the project's USAID officer, David Evans, allowed the project to transform itself and evolve based on demand rather than some preset objectives. LTNet staffs ability to develop and nurture durable partnerships both with US and Brazilian institutions. Important Results include: Thousands of educators trained in use of technologies for teaching and learning. Some estimates include: +:* 5,000 participants at the International ProInfo Congress in Fortaleza; 8 2,000 participants at training activities in Faxinal (Parana) and Santa Catarina; *:* 1,419 multipliers at 263 NTEs who use LTNet on a regular basis; *:* 60,000+ teachers and coordinators (primary beneficiaries) a public primary and secondary schools across Brazil; *:* many more who participated at presentations and workshops; and Q thousands of students who use the LTNet chat rooms with rheir teachers. At many training events and presentations, LTNet received a lot of media attention in the form of live television coverage and newspaper articles. This resulted in a shadow audience that is difficult to estimate but potentially very large. Q More important than the numbers listed above, LTNet developed and implemented a training approach that works with Brazilian educators and can be scaled up to address thz growing and continuing needs of Brazil. This training approach could also likely be used in other countries. LTNet's training works because it is experience-based, grounded in practice and is carried out within the context of a collaborative on-line environment that the trainees continue using after the event is finished. It also works because of the ongoing support that is made available to educators by LTNet and ProInfo staff and the network of people using LTNet. This effective training approach leads to immediate and actual use of technologies by the teachers in their classroom environment to improve learning and for their professional development. Q Brazilian ownership and expected continuation of LTNet's work through LTNet-Erazil (a Brazilian NGO created to canyon this work). While LTNet was originally meant as a network between Brazilian and US educators, and it has, indeed, fitlfilled that mission. it has also emerged as a network to greatly facilitate learning among Brazilian educators. Responding to where the needs were greatest, LTNet tumed a lot of its attention to supporting Brazilian educators. This attention was very much needed, very well received, and resulted in clear Brazilian ownership of most of LTKet's sewices and activities. *:* Filling an important niche in Brazil's technology and education context. While Brazil has extensive expertise in educational technology, there is a gap between theon and ri 1 w rrrl I d *I Y 'dd mi @ kd w "ex~ertise". and local school teacher's ~racticai a~~lication. L.TNet develo~ed and . . imilementid an approach that is beginning to fill this gap by providing tools for ongoing use of technology for educational applications, ongoing support, and collaboration nith - .. teachers, and encouragement and guidance duringthe application process. +% A large amount of learning on the part of LTNet staff and ProInfo partners about what works and doesn't work in training and enabling Brazilian educators to use technologies. This learning was partly the result of ongoing activities to satisfy the project's objectives, and partly the result of LTNet and ProInfo staff's willingness and eagerness to experiment, adapt, adjust and involve as many educators and others as possible in their activities, and even in some cases, facilitating experiments suggested by educators themselves and facilitating the learning process based on these expr:riments with technology. Appendix A: Yahoo Group Discussion Lists set up by LTNet to facilitate Virtual Exchanges AU-UFPR-Exchange - AU-UFPR Virtual Exchange Discussion List (48 members) List started August 2001 This discussion list is meant to enable the staff and students in the EFL program at the American Univ. and the Fed. Univ. of Parana to participate in a virtual exchange BNC-AcademicCoordinators (24 members) List started August 2001 This discussion list is meant to enable the BNC Academic Coordinators to share experiences, ideas and challenges with developing and coordinating English language programs. BNC-Brasil-ESL List started October 2001 This discussion list was established to enable educators working at all BNCs in Brasil to participate in e-mail discussions with their peers at other BNCs. This can be used to address pedagogical issues, the review of books, CD-ROMs and other educational materials, to share creative approaches to ESL, and plan collaborative activities. BNC-Brasil-Tech List started October 2001 This discussion list will enable staff from all BNCs in Brasil who are interested in applying technology to the teaching of English to share ideas, experiences and ask quesrims. BNC-Presidents . BNC-Presidents Discussion List List started October 2001 This discussion list is for the Presidents of ALL BNCs in Brazil. They ail! share knowledge, exchange ideas and seek answers to challenges they face. BNC-TechEdGroup . BNC Technology & Education Group (25 members) List started August 2001 This discussion list is dedicated to enabling staff of the BNCs in Brazil to discuss experiencest ideas and challenges with using technology in the teaching & learning of English. Coligacao-Coordinators . Coliga@o Coordinators Discussion List (40 members) List started October 2001 The Coliga@o Coordinators e-mail discussion list will enable staff from all BNCs to communicate easily with each other, share ideas, experiences, and challenges. DFListadeDiscussao (24 members) List started August 2001 This discussion list will enable teachers and multipliers in the Federal Dist-ict of Brazil to share experiences, ideas and chalienges ~vith integrating the use of computers and the Internet into teaching & learning. DiretoresFU3ME - DiretoresREME de Campo Grande-MS (87 members) This Portuguese language discussion list is meant for school principais in Campo Grande. Partners-DC-Brasilia . Partners-DC-Brasilia Discussion List (1 3 members) List started August 2001 This discussion list will enable the participants in the Partners DC-Brasilia exchange to share experiences, ideas and plan exchange activities. RiverWalkBrasil . Riverwalk-Brasil (28 members) List started September 2001 This is a Portuguese language list meant to facilitate discussions and the planning of project activities for participants in the Riverwalk project. SchoolLinks-TVEscola - SchoolLinks/TV Escola Lista de Discuss50 (41 members) List started August 2001 This discussion list is for the staff of TV Escola Brad. US-Brasil-IEW - US-Brasil-International Education Week (4 members:\ List started November 2001 This list enabled participants in the event to celebrate USlBrazil International Education Week to get to know each other, plan for the event and explore on-going exchange activities. Appendix B: Screen shot of the Links to AACs on the LTNet Web Site ~-- LTNet R Pmlnfo's Ambiente de @redzapern Cdabmariva or MC is designed to help Educators in Brasil and the United States participate in virtual exchanges and collaborative pmjscts with other educators. The AACs are also used during training activities to help educators learn about Internet communication and collaboration. . ~~ ~~~ ~ ~ ~~ ~~~~ ~~ ~ i Municioio Camno { i Grande j Sin"D-FU= i, DisJritoFederal I Estadodo 1 P Pernambuco I Manawe I Oxon Hill .~~~ -. ~~~ . ~~ . ~ ~ , Riverwalk Estado ational Educam de iJntem Minas Gerias Week Event : ~ ~ ~~~~ , Nov. 14.2102 mirito Santa Lrmet R Pmlnfo's M5 lndude access to: 1 O~s~usSlO" Lists *here educators can use emal to easily share . . ... . - . . . . . . . .- . . . . . . . . . . . . . . %J~?T..c:: . . . . . . .. . . r- . 2.: . .:!~~a,~:~:.t~~~.~~~;~~.~~~~~~~-~je-~~ . . - g;- . . ,'A II .. ..... . . .. $ ; . .. ........ . . . ... . . ..... .. Appendix C: Screen shot of the Sinop/FUST ACC photo gallery showing the President of Brazil. Appendix D: Screen Shot of the SchoolLii Chat Pilot Web Page on the LTNet Web Site Appendix E: Screen shot of the Riverwalk Program's Chat room access page within the LTNet AAC Note the On-Line Translation button on the top left and the Log File Request button on the top right. A multiplier interviewed in Brasilia mentioned that machine translations sometimes provide "funny results that help to break the ice" in the context of real time and asynchronous email exchanges. L TNet/Proolnfo Sch oolLinks Bate-PapoKhat Program Rivm Walk I Lo* Appendix F: Screen shot of the advanced web folio used for the Riverwalk Project. Appendix G: List of Documents Reviewed - Quarterly reports - Powerpoint presentations - Papers written by and with LTNet participation - Web site (English and Portuguese versions) - Web site access statistical data Appendix H: List of Individuals Contacted (Face-to-face meetings, phone interviews and email communications) LTNet: Eric Rusten Pro1nfo:Vera Suguri Multiplers and others in Brazil Ms. Lucia Bazzarella Training coordinator Mr. Credine Menezes General Coordinator Ms. Marcia Alves Multiplier, Espirito Santo State Multi~liers from Esnirito Santo State Ms. SBnia Alcantara Ms. Yara Pontine Ms. Mage Borgo Ms. Luciane Negrini Ms. Carla Santos Ms. SheilIa Campelo Multiplier in Brasilia's NTE Bruna Ribeira Student 8" grader (phone interview) Naora Resende Lab Coordinator in Hilda Rabello School. in Bela Horizonte (phone interview)