pdf version - The New Educational Review
Transcription
pdf version - The New Educational Review
2014 Vol. 37. No. 3 © Copyright by Wydawnictwo Adam Marszałek Toruń 2014 ISSN 1732-6729 Prenumeratę instytucjonalną można zamawiać w oddziałach firmy Kolporter S.A. na terenie całego kraju. Informacje pod numerem infolinii 801 205 555 lub na stronie internetowej http://www.kolporter-spolka-akcyjna.com.pl/prenumerata.asp WYDAWNICTWO ADAM MARSZAŁEK, ul. Lubicka 44, 87-100 Toruń tel./fax 56 648 50 70; tel. 56 660 81 60, 56 664 22 35 e-mail: info@marszalek.com.pl www.marszalek.com.pl Drukarnia nr 1, ul. Lubicka 46, 87-100 Toruń, tel. 56 659 98 96 CONTENTS Stanisław Juszczyk Editor’s Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 GENERAL DIDACTICS Ana María Ortiz Colón, Jairo Pontes de Oliveira, Juan Manuel Trujillo Torres Implementation of the M@IVES Website in Postgraduate Education . . . . . 19 Ivo Machar, Jan Činčera,Olga Vránová, Vilém Pechanec, Helena Kiliánová, Jitka Málková Innovation in Biology and Environmental Education Didactics in Pre-Graduate Training of Secondary Biology Teachers in the Context of Current Changes in the Education System . . . . . . . . . . . . . . . . . . 31 Zoran Kalinic, Slavko Arsovski, Zora Arsovski, Vladimir Rankovic The Effectiveness and Students’ Perception of an Adaptive Mobile Learning System based on Personalized Content and Mobile Web . . . . . . . 43 Moon Hyoung-jin, Nam Jong-ho, Kim Yong-deog New Measures for the Improvement of History Education for Chinese Students in South Korea . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54 Enrique Sánchez Acosta, Juan José Escribano Otero, Gabriela Christie Toletti Peer Review Experiences for MOOC. Development and Testing of a Peer Review System for a Massive Online Course . . . . . . . . . . . . . . . . . . . . 66 Yun Eun Kyeong Teaching Arabic to Korean Students Using Films . . . . . . . . . . . . . . . . . . . . . . 80 SOCIAL PEDAGOGY Shwu Ming Wu, Cheng Hong Yang, Wan Chen Hsu Validation of School Core Competence Scale for Undergraduates: Empirical Findings of Taiwan Case . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95 4 Contents Anna Młynarczuk-Sokołowska Intercultural Non-formal Education Issues on the Agenda of Polish Non-governmental Organizations – a research report . . . . . . . . . . . . . . . . . 106 Vincent Charles, Tatiana Gherman Factors influencing students’ choice of a B-school . . . . . . . . . . . . . . . . . . . . 117 Eva Machů, Hana Červinková Social Intelligence of Gifted Pupils . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130 Dalliane Vanessa Pires Andrade, Jamerson Viegas Queiroz, Fernanda Cristina Barbosa Pereira Queiroz, Gustavo Henrique Silva de Souza, Nilton Cesar Lima, Jamil Ramsi Farkat Diógenes The Importance of Total Quality Management Systems for Managers of Brazilian Universities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140 Mariola Chomczyńska-Rubacha Psychosocial and Organizational Aspects of Didactic Achievement: Sex, School-type, and Self-esteem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150 Bing-Yuh Lu, Jin-Shin Lai, Ming-Chia Lin An Experience of the Evergreen Elder University in Taiwan: Perspectives On The Mobile Users . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161 PEDEUTOLOGY Katja Depolli Steiner Teachers’ Pedagogical Beliefs as Predictors of Teacher Burnout . . . . . . . . . 177 E. Martínez-Figueira, M. Raposo-Rivas Mentoring Student Training: What do mentors do? . . . . . . . . . . . . . . . . . . . 188 Ahmet Tekbıyık Science Teachers’ Expectatitons from Parents: To What Degree Do Parents Think They Satisfy Such Expectations? . . . . . . . . . . . . . . . . . . . . . . . 202 Maja Matrić, Katja Košir Perceived Autonomy Levels among Elementary School Students and Their Teachers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215 Šárka Portešová, Marie Budíková, Dana Juhová Myths about Gifted Learners from the Perspective of Teachers . . . . . . . . . 229 Contents 5 Beata Pituła, Agnieszka Wilczyńska Teacher as an Authority? Supporting the Student’s Sense of Belonging to the School Community as a Condition for Their Development and the Teacher’s Success in Educating . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 243 CHOSEN ASPECTS OF PSYCHOLOGY Lada Kaliská First Results from Verification of Psychometric Properties of D. Lennick’s and F. Kiel’s MCI Questionnaire for Measuring Moral Intelligence in Slovak Conditions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 257 Liliana Ciascai, Lavinia Haiduc Thinking Metacognitively: Metacognitive Skills and Science Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269 Lenka Kollerová, Pavlína Janošová, Pavel Říčan Moral Disengagement from Bullying: The Effects of Gender and Classroom . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 280 Simona Prosen, Helena Smrtnik Vitulić Strategies of emotion regulation in students – future human relations professionals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 292 Rode Danuta, Bolek Magdalena, Cugowski Mikołaj Individual and Educational Risk Factors for Violence Perpetration. Prophylactic Aspects of Pedagogization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303 CONTRIBUTORS Arsovski Slavko (Prof., PhD.) Faculty of Engineering, University of Kragujevac, Sestre Janjic 6, 34000 Kragujevac, Serbia e-mail: cqm@kg.ac.rs Arsovski Zora (Prof., Faculty of Engineering, University of PhD.) Kragujevac, Sestre Janjic 6, 34000 Kragujevac, Serbia e-mail: zora@kg.ac.rs Bing-Yuh Lu (PhD.) Department of Electronic Engineering, Tungnan Universtity 152, Sec. 3, Bai-Sheng Road, Sheng-Keng Dist. New Taipei City, Taiwan, (ROC) e-mail: franklinlu888@ hotmail.com Bolek Magdalena (MA) Institute of Psychology, University of Silesia, e-mail: magdalena.bolek@us. Katowice, Poland edu.pl Budíková Marie (PhD.) Department of Mathematics and Statistics, Faculty of Science, Masaryk University, Kotlářská 2, Brno, Czech Republic Červinková Hana (Bc.) Department of Pedagogical Sciences, Faculty of Humanities, Tomas Bata University in Zlín, Czech Republic Cheng Hong Yang (Prof.) National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan e-mail: chyang@cc.kuas. edu.tw Chomczyńska-Rubacha Mariola (Prof. PhD. Dr Sc) Faculty of Educational Sciences, Nicolaus Copernicus University, Gagarina Street No 9, 87-100 Toruń, Poland e-mail: maja@umk.pl Ciascai Liliana (Prof.) Associate Professor, Department of Psychology and Educational Science, Babes-Bolyai University, Cluj-Napoca, Romania e-mail: liliana.ciascai@mail. ubbcluj.ro Činčera Jan Faculty of Education, Technical University of Liberec, Voroněžská 1329/13, 460 01 Liberec, Czech Republic e-mail: jan.cincera@tul.cz Cugowski Mikołaj (MA) Institute of Psychology, University of Silesia, e-mail: mikolaj.cugowski@us. Katowice, Poland edu.pl Depolli Steiner Katja University of Ljubljana, Faculty of Arts, (PhD.) Ljubljana, Slovenia, Department of Psychology, Aškerčeva 2, 1000 Ljubljana, SI-Slovenia e-mail: budikova@math. muni.cz website: http://www.math. muni.cz/~budikova e-mail: katja.depolli-steiner@ ff.uni-lj.si 8 Contributors Escribano Otero Juan Division of Languages, Mathematics, and José (PhD.) Sciences – Tidewater Community College, Spain e-mail: juanjose.escribano@ uem.es Eun-Kyeong Yun (PhD.) Department of Arabic, Hankuk University of Foreign Studies, 270 Imun-Dong, Dongdaemun-Gu Seoul 130-791, Korea e-mail: nabilayun@hufs.ac.kr Farkat Diógenes Jamil Ramsi (M.Sc) Federal University of Rio Grande do Norte, e-mail: farkatt@gmail.com Rio Grande do Norte, Brazil Gherman Tatiana School of Business and Economics, Loughborough University, Leicestershire LE11 3TU, UK e-mail: tatiana.gherman@ gmail.com Haiduc Lavinia (MA) Department of Psychology and Educational e-mail: lavinia_haiduc@ Science, Babes-Bolyai University, Clujyahoo.com Napoca, Romania Hyoung-jin: Moon (PhD.) Hankuk University of Foreign Studies, 81, Oedae-ro, Mohyeon-myeon, Cheoingu,Yongin-si, Gyeonggi-do, 449-791, Korea e-mail: subugwi@hanmail.net Janošová Pavlína (PhD. Dr. hab.) Institute of Psychology, Academy of Sciences of the Czech Republic, Prague, Czech Republic e-mail: janosova@praha.psu. cas.cz website: http://www.psu.cas. cz/people-contacts/index. html Jin-Shin Lai (Prof.) Department of Rehabilitation, National e- mail: jslai@ntu.edu.tw Taiwan University Hospital, Taipei, Taiwan, ROC 7, Chung Shan S. Rd. (Zhongshan S. Rd.), Zhongzheng Dist., Taipei City 10002, Taiwan (ROC) Jong-ho: Nam (PhD.) Hankuk University of Foreign Studies, 81, Oedae-ro, Mohyeon-myeon, Cheoin-gu,Yongin-si, Gyeonggi-do, 449–791, Korea Juhová Dana Faculty of Social Studies, Masaryk e-mail: dana.juhova@mail. University, Joštova 10, Brno, Czech Republic muni.cz Kalinic Zoran (PhD.) Faculty of Economics, University of Kragujevac, Djure Pucara 3, 34000 Kragujevac, Serbia Kaliská Lada (PhD. PaedDr) Department of Psychology, Faculty of e-mail: lada.kaliska@umb.sk Education, Matej Bel University, Ružová 13, Banská Bystrica 974 11 Kiliánová Helena Faculty of Education, Palacky University, tř. 17. listopadu 1192/12 771 40 Olomouc, Czech Republic e-mail: leopard3@hanmail.net e-mail: zkalinic@kg.ac.rs e-mail: helena.kilianova@ upol.cz Contributors 9 Kollerová Lenka (PhD., PhDr.) Institute of Psychology, Academy of Sciences of the Czech Republic, Prague, Czech Republic, Hybernská 8, Prague 1, 110 00, Czech Republic Košir Katja (PhD.) Faculty of Education, University of Maribor, Koroška cesta 160, 2000 Maribor, Slovenia Lima Nilton Cesar (PhD.) Federal University of Uberlândia, Brazil e-mail: cesarlim@yahoo.com, website: http://www.facic. ufu.br/ Machar Ivo Faculty of Education, Palacky University, Žižkovo nám. 5, 771 40 Olomouc, Czech Republic, e-mail: ivo.machar@upol.cz Machů Eva (PhD., MA) Department of School Pedagogy, Faculty of Humanities, Tomas Bata University in Zlín, Czech Republic Málková Jitka Faculty of Science, University of Hradec Králové, Jana Koziny 1237, 500 03 Hradec Králové, Czech Republic Martínez-Figueira E. Faculty of Education and Sport Sciences, (PhD.) University of Vigo, Campus A Xunqueira s/n 36005 – Pontevedra, Spain e-mail: kollerova@praha.psu. cas.cz e-mail: jitka.malkova@uhk.cz e-mail: esthermf@uvigo.es Matrić Maja Faculty of Education, University of Maribor, Koroška cesta 160, 2000 Maribor, Slovenia Ming-Chia Lin (MBA) Center of General Education, Catholic St. e- mail: mellissa@smc.edu.tw Mary’s Junior College of Medicine, Nursing, and Management, Yi-Lan, Taiwan (ROC) 100, Ln. 265, Sec. 2, Sanxing Rd., Sanxing Township, Yilan County 266, Taiwan (ROC) MłynarczukSokołowska Anna (MA) University of Białystok, Faculty of Pedagogy e-mail: annamlynarczuk@ and Psychology, Chair of Intercultural tlen.pl Education Ortiz Colón Ana María (Pro.f) Vicerrectora de la Universidad de Jaén. e-mail: aortiz@ujaen.es, Campus Las Lagunillas, 23071, Jaén, España website: http://www4.ujaen. es/~aortiz/index.html Pechanec Vilém Faculty of Science, Palacky University, tř. 17. listopadu 1192/12, 771 46 Olomouc, Czech Republic Pereira Queiroz Fernanda Cristina Barbosa (PhD.) Federal University of Rio Grande do Norte, e-mail: fernandacbpereira@ Rio Grande do Norte, Brazil gmail.com website: www.ufrn.br Pires Andrade Dalliane Vanessa (M.Sc) Federal University of Rio Grande do Norte, e-mail: dallianevanessa@ Rio Grande do Norte, Brazil yahoo.com.br website: www.ufrn.br e-mail: vilem.pechanec@ upol.cz 10 Contributors Pituła Beata (PhD. Hab) Silesian University, Faculty of Pedagogy and e-mail: bpitula@o2.pl Psychology, Department of General Didactics and Pedeutology, ul. Grażyńskiego 53, 40-126 Katowice, Poland, tel.: +48 605 601 065 Pontes de Oliveira, Jairo (Prof.) Instituto Federal de Educação, Ciência e-mail: gabinete@ifma.edu.br e Tecnologia do Maranhão, Avenida Getúlio website: http://www.ifma. Vargas, 04 Monte Castelo, edu.br São Luís-Maranhão – Brasil CEP: 65030-005 Portešová Šárka (PhD., doc.) Institute for Research on Children, Youth and Family, Faculty of Social Studies, Masaryk University, Joštova 10, Brno, Czech Republic Raposo-Rivas M. (PhD.) Faculty of Education Sciences, University of e-mail: mraposo@uvigo.es Vigo, Campus As Lagoas s/n 32004 – Ourense, Spain Říčan Pavel (CSc. Prof. PhD.) Institute of Psychology, Academy of Sciences of the Czech Republic, Prague, Czech Republic Rode Danuta (PhD. Hab.) Institute of Psychology, University of Silesia, e-mail: rode.dan_xl@wp.pl Katowice, Poland Sánchez Acosta Enrique (PhD.) Department of Information Technology, Automation, and Communications, European University, Spain e-mail: esacosta@gmail.com Shwu Ming Wu (Prof.) National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan e-mail: mingwu@cc.kuas. edu.tw Silva de Souza Gustavo Henrique (M.Sc) Researcher at Federal University of Alagoas, e-mail: souza.g.h.s@hotmail. Brazil com.br website: www.ufal.br Simona Prosen (PhD.) University of Ljubljana, Faculty of Education, Kardeljeva ploščad 16, 1000 Ljubljana, Slovenia e-mail: simona.prosen@pef. uni-lj.si Smrtnik Vitulić Helena (PhD.) University of Ljubljana, Faculty of Education, Kardeljeva ploščad 16, 1000 Ljubljana, Slovenia e-mail: helena.smrtnik@pef. uni-lj.si Tekbiyik Ahmet (PhD.) Department of Elementary Science Education, Recep Tayyip Erdogan University, Faculty of Education, Cayeli – Rize, Turkey, Tel.: +90 0 464 5328454 / 2302, Fax: +90 0 464 5328612, e-mail: ahmet.tekbiyik@ erdogan.edu.tr atekbiyik@gmail.com website: http://akademisyen. erdogan.edu.tr/akademisyen. php?uyeid=p9y0b3g0e2o4r3a 3u3n6d0f5 e-mail: 2024@mail.muni.cz website: http://www. nadanedeti.cz e-mail: rican@praha.psu. cas.cz website: http://www.psu.cas. cz/people-contacts/index. html Contributors 11 Toletti Gabriela Christie (PhD.) Foreign Languages and Literatures Department – Old Dominion University, Spain e-mail: gtoletti@tcc.edu Trujillo Torres, Juan Manuel (Prof.) Universidad de Granada, Campus de Cartuja s/n. 18071, Granada, España e-mail: jttorres@ugr.es, Website: www.jttorres.es Viegas Queiroz Jamerson (PhD.) Adjuntc Professor at Federal University of e-mail: viegasqueiroz@ Rio Grande do Norte, Rio Grande do Norte, gmail.com, Brazil website: www.ufrn.br Charles Vincent CENTRUM Católica Graduate Business School, PUCP, Lima, Peru, Calle Daniel Alomía Robles 125-129, Los Álamos de Monterrico, Santiago de Surco, Lima 33, Peru e-mail: vcharles@pucp.pe Vránová Olga Faculty of Education, Palacky University, Žižkovo nám. 5, 771 40 Olomouc, Czech Republic e-mail: olga.vranova@upol.cz Wan Chen Hsu (PhD.) Center for Teaching & Learning Development, National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan e-mail: wanchen@kuas.edu.tw Wilczyńska Agnieszka (PhD.) Institute of Psychology, University of Silesia, ul. Grażyńskiego 53, 40-126 Katowice, Poland Yong-deog: Kim (Prof., PhD.) Hankuk University of Foreign Studies, 81, Oedae-ro, Mohyeon-myeon, Cheoin-gu,Yongin-si, Gyeonggi-do, 449-791, Korea, e-mail: kimwielki@hanmail. net Stanisław Juszczyk Editor’s Preface The third number of The New Educational Review in 2014 is the thirty-seventh issue of our journal since the start of its foundation in 2003. In this issue there are mainly papers from: Brazil, the Czech Republic, Peru, Poland, Romania, Serbia, the Slovak Republic, Slovenia, South Korea, Spain, Taiwan, and Turkey, because our journal is open for presentation of scientific papers from all over the world. In the present issue the Editors’ Board have proposed the following subject sessions: General Didactics, Social Pedagogy, Pedeutology, and Chosen Aspects of Psychology. In the subject session “General Didactics” we publish six articles. The article by Ana Maria Ortiz Colón and her co-workers describes implementation of the M@IVES website in postgraduate education of students in Brazil. Ivo Machar and his co-workers analyse the results of a survey conducted among graduates of Master’s courses in Teacher Education in Biology to determine their opinions on the importance of biology and environmental education didactics during their pre-graduate studies. The study by Ahmet Tekbıyık aims to determine teachers’ expectations from parents for effective science teaching and reveal parents’ beliefs on how much they satisfy such expectations. The paper by Zoran Kalinic and his co-workers presents the implementation and evaluation of the effectiveness and students’ attitudes toward an adaptive mobile learning system based on personalized content and mobile web. The objective of the research by Hyoung-jin Moon, Jong-ho Nam and Yong-deog Kim is to find a more effective method for the teaching of history to Chinese students studying in South Korea universities. The paper by Enrique Sánchez Acosta and his co-workers discusses the results obtained by the most commonly used massive online course platforms, detailing their features and limitations, as well as the experience in the implementation and use of a peer review system for a course of more than 7300 students. The research described by Eun-Kyeong Yun aims to study the application of using films in teaching the Arabic language to Korean students. 14 Stanisław Juszczyk The subject session “Social Pedagogy” consists of seven articles. The study by Shwu Ming Wu and his co-workers aims to validate the 25-items School Core Competence Scale of the National Kaohsiung University of Applied Sciences in Taiwan. The purpose of the article by Anna Młynarczuk-Sokołowska is to present the results of the research on the issue discussed in the educational initiatives undertaken by Polish non-governmental organizations. The research described by Vincent Charles and Tatiana Gherman is a primary initiative in the Peruvian literature for understanding the factors which influence undergraduate students’ choice of a B-school offering a Master’s Degree in Business Administration. The article by Eva Machů and Hana Červinková describes research whose aim was to find differences between the social intelligence structure of gifted children and children with no diagnosed giftedness. The purpose of the paper by Dalliane Vanessa Pires Andrade and her co-workers is to analyse, from the perspective of the manager, the importance of the use of tools and concepts of quality management in the Brazilian federal universities. The results of empirical studies presented by Mariola Chomczyńska-Rubacha concern the relation between academic achievement and sex, type of school, and self-esteem, as well as self-esteem and sex, school level, and academic achievement. Bing-Yuh Lu, Jin-Shin Lai and Ming-Chia Lin describe the compared results of empirical research on senior persons in the UK and in Taiwan who used the advanced mobile technologies to get the conveniences of the elder’s living. In the subject session “Pedeutology” we publish six articles. The study described by Katja Depoli Stainer examines the relationship between teachers’ pedagogical beliefs and their experience of burnout. In their paper, E. Martinez-Figueira and M. Paposo-Rivas look into the role of mentors in student training given it is of paramount importance and at times both unknown and undefined. In order to estimate perceived autonomy levels in the classroom, Maja Matrić and Katja Košir decided to compare teachers’ perceptions with students’ ones, gaining a more accurate idea of the autonomy levels present in the classroom. The aim of the paper presented by Šárka Portešova and her co-workers is to find out whether Czech and Slovak teachers are affected by myths about gifted learners. Beata Pituła and Agnieszka Wilczyńska show the importance of the teacher’s authority in the modern school. In the subject session “Chosen Aspects of Psychology” we publish five articles. Lada Kaliská describes the theoretical and empirical studies that verify the new construct of moral intelligence. The study presented by Liliana Ciascai and Lavinia Haiduc aims to identify the relations between metacognitive skills and science performance. Lenka Kollerová and her co-workers examine the effects of Editor’s Preface 15 gender and classroom membership on moral disengagement cognitive justifications of detrimental conduct. In their article, Simona Prosen and Helena Smrtnik Vitulić describe selected emotion regulation strategies in students of primary education in Slovenian schools. Danuta Rode and her co-workers explain the issue of risk factors for high aggression of women taking action of a violent nature. We hope that this edition, like previous ones, will encourage new readers not only from the Central European countries to participate in an open international discussion. On behalf of the Editors’ Board I would like to invite representatives of different pedagogical sub-disciplines and related sciences to publish their texts in The New Educational Review, according to the formal requirements placed on our website: www.educationalrev.us.edu.pl – Guide for Authors. General Didactics Ana María Ortiz Colón, Jairo Pontes de Oliveira, Juan Manuel Trujillo Torres Spain & Brazil Implementation of the M@IVES Website in Postgraduate Education Abstract M@IVES research addresses the trajectory of Brazilian graduate students and their attitude to the development of educational technology through a pretestposttest quasi-experimental process with experimental and control groups. It has included the design methodology of research since the establishment of the problem posed by the institutions of graduate work in guidance to course work. It analyzes data gathered in the field of research and in light of Brazilian reality. It enhances the development of a new teaching methodology, supported by educational technology – M@ IVES – for research specialization courses Education Area offered in the city of São Luís. It demonstrates, by building Site M@IVES and study developed, the limits and educational opportunities offered by the new methodology presented. Keywords: postgraduate studies, educational technology, teaching methodology, multimedia Introduction Over the last few years Brazilian universities have been facing a sharp growth of mass education. This phenomenon has negatively influenced specialization courses and has caused a significant increase in the number of students per counselor. In order to find a response to the problem outside the political arena, a solution was suggested from the area of pedagogy, with the use of new teaching methodology and supported by virtual technologies. 20 Ana María Ortiz Colón, Jairo Pontes de Oliveira, Juan Manuel Trujillo Torres The purpose of the investigation was analysis of the Methodology of Postgraduate Education supported by Educational Technology in order to solve problems that arise during the orientation stage of final course projects in Brazil. The investigation is centered around three main areas, where different plans of action are considered (Amador y Dorado, 2006) to address the objective: the area of scientific investigation methodology, the area of web design in the framework of educational technology and finally, the area of the educational process – learning through virtual models (Ballesteros et al., 2010). In this paper we present the most relevant conclusions of the research conducted on two groups (experimental and control) and a pretest-posttest, with the new methodology in postgraduate education utilized with one of the groups. In terms of the area of methodology in scientific investigation, numerous studies can be found (Rusavin, 1990; Baptista, Fernández y Hernández, 2003) showing a tendency towards quantitative investigation – methodology, hypothesis, variables, tables, graphs and epistemological models of investigation. Recently, however, new models of a more qualitative nature have been observed, as in the case of the studies by Fazenda (2002). An adaptation of the model proposed by Area (2005) was decided upon during the creation of M@IVES in reference to the construction and use of websites in university teaching. Building on line of multimedia work, a website has been worked upon, with important advances made, particularly related to the graphical layout in sequential forms of icons and the adaptation of the website to Brazilian reality (Nó, 2005). For Area (2005), various means of information technology represent the combination of what is referred to as new technologies, which are characterized by developing, using and combining indistinctly any modality of symbolic codification of information. The most salient point of the study is the historical recovery of the project of Gros (1987), in reference to the evolution of computer programs, the procedures of learning and the design of software and its application in education (Area, 2005). On the other hand, it is important to note that the large investment made in universities to train professors in the field of technology in educational practice has not managed to fill in large gaps in training among professors. In general, training continues to be deficient, and not just in the handling of technology or devices, but more fundamentally in their didactic or educational use (Ballesteros et al., 2010). The main innovations in postgraduate education that the internet makes possible are related to the possibility of allowing students who for any reason can- Implementation of the M@IVES Website in Postgraduate Education 21 not attend classes in person to enroll in academic studies. The instruction gains dynamism since the knowledge is constructed from different sources, selected and mediated by students and teachers. A temporal discontinuity is allowed among the individuals involved in the process of teaching and learning through the internet; the physical limits of the university are extrapolated, favoring both internationalization and study promoted and mediated by the internet, giving students more autonomy (Area, 2005). In regard to the teaching-learning process through virtual models, the most significant advances in this area come from the perspective of the teacher, in its application in courses of the investigative component of the curriculum in a postgraduate degree in education (Salinas, 2008). This allows courses such as Methodology of Scientific Investigation, Introduction to Pedagogical Investigation, Investigative Methods and Skills and Workshops I and II to focus on the development of the Final Course Project (TCC). As designed, the website will allow for the development of activities that assess student autonomy, establish resources banks, make it possible to resolve doubts in real time, or not in real time, break the traditional models of education that are constrained by the geographical space of the university, allow virtual interaction (chat, forums, email, etc.) bringing us closer to face-to-face models of virtual education (Casas y Stojanovic, 2013). In reference to the construction of the M@IVES website, the proposal that was developed is similar to the extensive work of important authors in similar fields: Proença (1990), Area (2002), Cano (2001), Salinas (2005) y Ortiz (2011). Thus, the M@IVES is grouped with the programs of Computer-Assisted Education and, more precisely, the programs of demonstration (Cano, 2001), given its character of education personalized to the real needs of each pupil in the developmental phase of the TCC and, in some cases, those of simulation. The theoretical basis that supports M@IVES is, in the perspective of the levels established by Area (2005), between level III of blended courses and level IV of Virtual Education. The nature of M@IVES is that of training with pedagogical simulations, didactic materials, review activities, teaching programs and other elements. The activities of Project M@IVES address the concepts of Amador and Dorado (2006) in terms of the evaluation phases of the diagnosis of training needs, the concept of the technological model to develop the psycho-pedagogical guidelines that support the creation of the M@IVES website, the analysis of both the viability and social impact, the supervision of the design process and the production and evaluation of the technological model. 22 Ana María Ortiz Colón, Jairo Pontes de Oliveira, Juan Manuel Trujillo Torres From the approaches described and analysis of problems experienced in departments of postgraduate studies in education in Institutions of Higher Education (IES), the following research problem was settled upon: Does educational technology improve the orientation phase of Final Course Projects (TCC) in the postgraduate courses in the field of education? Based on the aspects that were analyzed, the general aim of our study consisted of designing and applying a new methodology of instruction supported by educational technology for the TCC stage of postgraduate courses. Along these lines, the specific aims are: (1) to analyze the theoretical basis of the postgraduate courses of study supported by virtual models in Brazil; (2) to design the M@IVES website on the methodology of higher education; (3) to implement the new methodology of education with the M@IVES website at the Instituto de Enseñanza Superior Franciscano (IESF). To reach the general aim, we suggest a hypothesis that postgraduate students exposed to the educational actions supported by the M@IVES website present better epistemological foundation in the production of Final Course Projects (TCC) than those within the traditional system. Research Methodology Procedure The investigation can be characterized, on the one hand, as a document study and on the other hand as a semi-experimental pretest-posttest with experimental and control groups. The study consists of the comparison of two methods of postgraduate education: the traditional methodology and the new methodology supported by educational technology. A multivariate study has been outlined, which establishes two independent variables (systemization of the set of operations of monographic orientation (x), technological – educational web applications (y)) and four dependent variables (command of creation of the theoretical foundations (a), command of the methods and skills of scientific investigation (b), command of the standards of the development of the TCC (c), speed in completing the TCC (d)). Once the variables were defined in their conceptual definition, working definition, markers and scale, the presentation of a codebook and its matrix was necessary in order to show the principal theoretical and/or practical elements of every variable, as a guide to the data collection tools used with the subjects of the investigation. Implementation of the M@IVES Website in Postgraduate Education 23 Sampling The taxonomy of Gresller (2003) was chosen for the definition of the sampling, selecting a random-probability sampling type among professors, students and alumni of the Institutos de Educación Superior (IES), which offers postgraduate courses in Ciudad de San Luis (Brazil). The size of the sample was defined in accordance with the formula proposed by Labes (1998) for the phase of diagnosis, the invited Institutions were: FAMA, IESF, FSF, UNICEUMA, FACAM – MA, UFMA and UEMA, with the resulting sample consisting of 66 teachers, 196 students and 284 alumni, with a margin of reliability of 95%, out of a total study population of 79 teachers, 382 students and 973 alumni. The sampling of the students in the semi-experimental study in the Instituto de Educación Superior Franciscano (IESF), in the phase of application of the methodology of education, answered to intentional and not probabilistic selection, due fundamentally to the accessibility of the group composed by 42 students, divided into two subgroups, the experimental and control group, the students signed up in a voluntary way, according to their knowledge of information technology, so two subgroups of 21 students were formed. Instruments A diagnosis questionnaire of the data collection tools was applied to the selected sample in order to analyze the principal difficulties of the teachers in the work of TCC’s orientation. In the case of the students and alumni the purpose was to detect the control of methods and necessary skills to elaborate the TCC. The questionnaire is composed of 12 items in order to determine its reliability and validity by means of the coefficient of Cronbach’s internal consistency (. 90) and reliability (. 93) across the test retest. A Likert-type scale was developed to apply to the control and experimental groups of the IESF at different moments of the research: a) Pre-test, b) a test before the experiment c) a test during the experiment (even with the control group) and d) a post-experimental test) and to the specialized teachers of the Methodology of the Investigation groups. The scale is composed of 22 items with the validity obtained by Cronbach’s coefficient (.89) and the reliability of the test-retest of 0.92. The fundamental aim of the scale was to check the independent variable (y) of the technological-educational website applied. For document analysis, an information sheet of document observation composed of 22 items was developed, which was designed to identify existing Ana María Ortiz Colón, Jairo Pontes de Oliveira, Juan Manuel Trujillo Torres 24 foundations as to gather information that had already been disseminated as the normalization of monographic work, the development of ongoing projects and investigations, the methodology of the scientific work, didactics of higher education and multimedia technology. Research Results Firstly, the testing of the variables and the hypothesis are presented, collecting the values of each variable yielded by the research tools and then each of the items that these tools contain. This allows for a contrast with the proposed hypothesis to be seen. Next, we present the results obtained in the development of the epistemological foundations related to the investigation, the construction of the M@IVES website, and finish with the new teaching methodology based on the M@IVES website and the results obtained in the pretest-posttest performed on the experimental and control groups at the IESF. Table 1. Values for tabulation and calculation of reliability variable (a). (Prepared by authors) Item Correct answer Incorrect answer Concept FT Value 1 Value 0 Function FT Value 1 Value 0 Relevance FT Value 1 Value 0 Item 4 Use of classics Item 5 Update of the theoretical Foundation Item 6 Coherence of the FT Item 7 Use of non-specialized dictionaries Item 8 Inappropriate sources Item 9 < 2 Classics From 2 to 4 Classics > 4 Classics 20 10 20 50% (Equal to or less than 5 years) 50% (more than 5 years) 10 20 Coherent + 70% Coherent – 70% 10 20 Less than or equal to 1 More than 1 10 20 Less than 2 More than or equal to 2 20 10 More than 8 references Equal to or less than 8 references 25 Implementation of the M@IVES Website in Postgraduate Education Item Correct answer Incorrect answer 10 20 Excessive reference to theory Item 10 Excessive use of citations More than 50% (text) Between 50% and 20% (text) Less than 20% (text) 10 20 10 The following table gives detailed responses given by the students in the control group (1 to 3) and the analysis of finished TCCs (4-10) relative to variable “a.” The analysis of the behavior of the variable as well as the relationship between the results of the experimental group and the control group are shown, with an observed improvement of over 80% in the experimental group, which shows that the variable is true. Table 2. Model for variable testing, Theoretical and Practical dimension (a). (Prepared by authors) Items Group Average percentage of correct answers Result 1 to 10 Experimental group 91 True variable 1 to 10 Control group 68 False variable Conditions = or > 80% True variable < 80% False variable Next, a transposition of the average value achieved by the experimental group and the control group was conducted. This can be observed in the following table, according to the predetermined condition that variable “b” be considered a correct answer on obtaining a value over 80%. Table 3. Test of Theoretical and Practical dimension of variable (b). (Prepared by authors) Items Group Average percentage of correct answers Result 1 to 20 Experimental group 86.4 True variable 1 to 20 Control group 58.8 Condition = or > 80% True variable < 80% False variable Ana María Ortiz Colón, Jairo Pontes de Oliveira, Juan Manuel Trujillo Torres 26 Additionally, a transposition of the average value achieved by the experimental group and by the control group was performed. In the following table, based on the predetermined condition, variable “c” was confirmed as true, as the median percentages obtained by the experimental group was averaged at over 80%. Table 4. Test of the variable theoretical and practical dimension (c). (Own elaboration) Items Group Average percentage of correct answers Result 1 to 20 Experimental group 86 True variable 1 to 20 Control group 67 Condition = or > 80% True variable < 80% False variable Subsequently, we contrasted variable “d,” as shown in the following table, observing changes in the variable in relation to the experimental and control groups. These changes allow for the statement that the Final Course Projects of the experimental group, which were completed in less time, were superior to those of the control group. Therefore the variable is true. Table 5. Contrast of the variable (d). (Prepared by authors) Group Average time Average mark of TCC Result Experimental 262 9.0 Superior 295 8.4 Inferior Table 6. Synthesis of the results of the tests of variables. (Prepared by authors) Variables Experimental G. Control G. x 94.5 69.2 Exp. G > Control G. (+) result No difference Internal contrast teachers and students (+) result (Scale from 0 to 1000) y 810 Result a 91 68 Exp. G > Control G. (+) result b 86.4 58.8 Exp. G > Control G. (+) result c 86 67 Exp. G > Control G. (+) result d 262 295 Exp. G< Control G. (+) result Implementation of the M@IVES Website in Postgraduate Education 27 Following the application of M@IVES, the median of the answers from the experimental group was 89.4, with a standard deviation of 11.82, and from the control group 65.8, with a standard deviation of 14.21. Comparing both groups by means of an ANOVA analysis, there were statistically significant differences (p<0.0001). In the study, we wanted to find out if statistically significant differences between the object of the study groups really exist at the moments of the pretest and the posttest. In the first place, Leve’s Test was realized to analyze the possible existence of differences in the variance of the experimental and control groups. In the pretest of the experimental group, p = 0.057 and in the control group, p = 0.595, in both cases p > 0.01. In the posttest of the experimental group, p = 0.268 and of the control group, p = 0.105, also p> 0.01, for which there are no significant differences in the homogeneity of the variance. In this way, both the control group and the experimental group can be considered homogeneous. The test for the independent variable X, of a practical and theoretical character, was designed in order to obtain the perceptions of the students about the teaching methodology applied in the experimental and control groups in relation to the instruction and workshops on the Final Course Project in the didactics of higher education course at the IESF. Regarding variable Y, the test was not given to the control group, as the students were not exposed to instruction through the M@IVES website. In terms of the students of the experimental group, the test can be considered satisfactory. Additionally, the tests performed with dependent variables a, b, c and d were positive, confirming the suggested hypothesis in this study. It should also be emphasized that the description of the methods of study, the presentation of the reliability of the sample based on a defined population, as well as the test related to the reliability and validity of the data collection methods, with rigorous control of the common sources of mistakes in the experimentation, all contribute in a significant way to the results of this study. As for the study of the methodology of education applied, we kept to the methodology that would be applied in the experiment in terms of instruction and workshops related to the investigation of the postgraduate course in didactics of higher education at the IESF, with the main objective of improving the quality of orientation in the TCC. The following courses of action stand out: a) development of new plans and programs for fields of study, b) adaptation of the curriculum from a multidisciplinary point of view, c) specification of the methods and skills to be applied, with special value placed on practical research, d) presentation of the final design of the teaching methodology, from diagnosis, 28 Ana María Ortiz Colón, Jairo Pontes de Oliveira, Juan Manuel Trujillo Torres in reference to the aims, content, skills, capabilities, references, timelines and other elements. All the variables obtained results of over 80%, much higher than the results obtained by the control group and quite significant in relation to the information collected in the diagnostic study. The improvements shown in the study of the variables and the experiences of the students exposed to epistemological educational activities based on the website demonstrate a better epistemological foundation in the development of the TCC. Conclusions In conclusion, we can affirm that the students exposed to the epistemological and educational actions, in the form of Systemization of the set of operations of monographic orientation – (variable x), supported by the technological-educational M@IVES website – (variable Y), demonstrate a better epistemological foundation in the development of the TCC, with this premise being demonstrated by control of the construction of the theoretical foundations (variable a); control of the methods and skills of scientific investigation (variable b); control of the procedure for the development of the TCC (variable c); and the speed in completing the TCC (variable d). In sum, the study presents the following significant advances: from the theoretical point of view its principal contribution resides in presenting a plan of action for postgraduate education aimed at the orientation and development of a TCC in the specialized courses. From the methodological point of view, the study represents an advancement in the conception of an innovative methodology of teaching and learning by means of educational technology. In reference to the tools of the M@IVES website, the forum and the chat, they suppose a differential for the methodology of education, considering its potentials of exchange of experiences, orientations and training for every work of conclusions of developed course. The study tries to open the way for another more general study that involves other Brazilian Institutions and that confirms the findings exposed with a methodology and a web support relied on the educational Technology similar to the exposed ones. It is considered necessary to continue research, going into detail about each of the components of the M@IVES website, adapting it to the new legislation both at the European level and international level. Implementation of the M@IVES Website in Postgraduate Education 29 References Amador, M. y Dorado, C. (2006). Acciones y funciones en estructuras de diseño y producción de materiales educativos multimedia en la teleformación. Retrieved 20/03/13, from http://mem.uab.cat/cdorado/Articulos/acciones_funciones_en_ diseno_y_produccion.pdf Area, M. (2005). La educación en el laberinto tecnológico: de la escritura a las máquinas digitales. Barcelona: Octaedro. -(2002). Manual de estudio de Tecnología Educativa. Tenerife: Univ. Laguna. Ballesteros, C., Cabero, J., Llorente, M.C. y Morales, J.A. (2010). Usos del e-learning en las universidades andaluzas: estado de la situación y análisis de buenas prácticas. Pixel-Bit., 37, 7–18. Baptista, M.P., Fernández, C., Hernández, R. (2003). Metodología de la Investigación. (3ª Ed.) México: McGraw-Hill / Interamericana Edit. Cano, C. (2001). Los recursos de informática en los procesos de enseñanzaaprendizaje. En Juana María Sancho (coord.) Para una tecnología educacional. Porto Alegre: Artmed. Casas, M. y Stojanovic, L. (2013). Innovación en la universidad iberoamericana. Revista de Universidad y Sociedad del Conocimiento (RUSC). 10–1, 61–74. UOC. Retrieved 3/03/13, from http://rusc.uoc.edu/ojs/index.php/rusc/article/view/v10n1casas/v10n1casasstojanovic-es. Fazenda, I. (coord.). (2002). Metodología de investigación Educacional (8ª Ed.) São Paulo: Cortez. Gros, B. (1987). Aprender mediante el ordenador. Barcelona: PPU. Labes, E. (1998). El cuestionario: de la planificación a la ejecución en la investigación. Chapecó: Grifos. Llorente, M. y Cabero, J. (2013). B-learning: attitudes, satisfaction, academic performance and online communication in processes of University Training. The New Educational Review, 31–1, 28-39. Nó, J. (2005). Planificación de la enseñanza semipresencial: una experiencia con posgrado. En Duart, J. y Lupiáñez, F. (coords.). Las TIC en la universidad: estrategia y transformación institucional. Revista de Universidad y Sociedad del Conocimiento (RUSC). Vol. 2, nº 1. UOC. Retrieved 8/03/13, from http://www. uoc.edu/rusc/dt/esp/nó0405.pdf Ortiz, A.M. (2011). Diseño y elaboración de materiales didácticos. En Cebrián, M. y Gallego, M.J. (2011). Procesos educativos con TIC en la Sociedad del Conocimiento. Madrid: Pirámide. 30 Ana María Ortiz Colón, Jairo Pontes de Oliveira, Juan Manuel Trujillo Torres Proença, M. (1990). Enseñar/aprender historia. Lisboa: Libros Horizontes. Salinas, J. (coord.) (2008). Modelos didácticos en los campus virtuales universitarios. Proyecto Estudios y Análisis. Ref. EA2007-0121. Ivo Machar, Jan Činčera, Olga Vránová, Vilém Pechanec, Helena Kiliánová, Jitka Málková Czech Republic Innovation in Biology and Environmental Education Didactics in Pre-Graduate Training of Secondary Biology Teachers in the Context of Current Changes in the Education System Abstract The authors conducted a survey among graduates of Master’s courses in Teacher Education in Biology to determine their opinions on the importance of biology and environmental education didactics during their pre-graduate studies. Results of the survey indicated some existing deficiencies in pre-graduate teaching of biology and environmental education didactics and raised suggestions for innovation. The survey of 119 respondents was conducted in 2009. Most respondents considered the benefit of their pre-graduate Teacher Education in Biology degree sufficient for their own knowledge in biology, while considering the benefit of a pre-graduate course for their own pedagogic and didactic competencies a small one. The survey proved that most graduates of Teacher Education in Biology studies ranked the subject of biology didactics among the key modules of their pre-graduate degree course and identified several strengths and weaknesses in the teaching of biology didactics. The respondents who were professionally involved in Environmental Education viewed the absence of special didactics of environmental education and limited time allocation for teaching practice as shortcomings of their pregraduate course structure. Based on this research, two educational projects were designed, allowing for the implementation of innovated didactics of biology and environmental education together with specialized teaching practice for biology teacher education students in collaboration with several Czech universities and participating foreign lecturers. Ivo Machar, Jan Činčera, Olga Vránová, Vilém Pechanec, et al. 32 Keywords: didactics of biology and environmental education, innovation, biology teachers. Introduction Subject-matter didactics plays an integral part in the curriculum of teacher education (Shulman 1987), as the level of didactic knowledge of the curriculum content and methods of its interpretation to students significantly determine the quality of a given teacher. Didactics of biology has seen, among other things, a growing emphasis on the importance of research-oriented teaching of biology and ecology (Činčera 2007). In addition to their didactic knowledge of curriculum content, the effectiveness and quality of the teacher’s work is conditioned by their teaching skills which reflect didactics to a significant degree (Kyriacou 1996). Teachers should learn the basics of their teaching skills during their pre-graduate studies. It is therefore requisite to continually look for teaching practice innovation throughout the pregraduate training of future teachers. The authors, motivated by their efforts to look for optimum means of innovation in the didactics of biology and environmental education, conducted a survey among graduates of Teacher Education in Biology to determine their opinions on the importance of biology and environmental education didactics during their pre-graduate studies. The aim of the paper is to present results of this research and their application in project innovation of didactics of biology and environmental education at Palacky University in Olomouc. The paper also discusses feedback received from the participants in this project innovation in the context of current changes in the education system. Methods Research on the target group of graduates of Master’s courses in Teacher Education in Biology at Palacky University Olomouc was conducted in 2009 in the form of a questionnaire survey (Chráska 2007). The primary aim of the research was to evaluate the benefit of pre-graduate didactics of biology and environmental education (EE) for teaching practice from the perspective of Master’s degree graduates who work as secondary biology teachers teaching the 11 – 15 age range, Innovation in Biology and Environmental Education Didactics 33 exceptionally also as biology teachers teaching the 16 – 19 age range, or working as lecturers of Environmental Education (hereinafter EE). A questionnaire with closed-ended questions was applied in the research (Gnitecki 1993). The questionnaire was divided into two parts: (1) Basic information about the respondent, (2) Evaluation of the content and benefit of the completed courses of biology and EE didactics during the pre-graduate Teacher Education in Biology studies with respect to its significance for the current teaching practice of the respondent. The respondents were given the option to add their own commentary to the closed-ended questions used in the questionnaire. The questionnaire response rate was 64%. A total of 119 respondents took part in the survey; all of them graduated from Teacher Education in Biology at Palacky University Olomouc between 1999 and 2008. To determine the degree of reliability of the questionnaire data, comparison of data obtained from two equal samples, formed from the basic sample as a representative selection, was conducted. The rate of agreement between respondent responses in both randomly generated samples was expressed using Cohen’s coefficient (Mareš 1983): κ= p p − p0 1 − p0 (1) where κ is the Cohen coefficient, pp is the observed agreement and po is the expected agreement. The test of statistical significance of the calculated coefficient κ was calculated by a standardized normal variable using a criterion according to the following formula: u= κ p0 n.(1 − p p ) (2) where u is the value of the standardized normal variable and the remaining symbols correspond to those in formula (1). The analyzed survey results were used to design a project of innovation in didactics of biology and environmental education under the Operational Programme Education for Competitiveness (OPEC) called “Environmental Education in Practice” (Machar 2011). Preparation of new study subjects (referred to as “courses” in project terminology) drew on the accentuating activating teaching methods and enhancing research-oriented instruction of biology in teaching practice. 34 Ivo Machar, Jan Činčera, Olga Vránová, Vilém Pechanec, et al. At the end of every project course the course was evaluated by its participants – pre-graduate students of Teacher Education in Biology – in the form of evaluation questionnaires with closed-ended questions. The output of these evaluations served as inspiration for the design of a follow-up project “Partnership for Enhancing Communication in Nature Conservation (KONEV)” under OPEC. This project facilitated the enhancement of pre-graduate courses in both Teacher Education in Biology and Biological Sciences, specifically by including wider application of subject-matter didactics in students’ teaching practice with potential employers. Results Determination of reliability of the survey results proved to be satisfactory, as the calculated value of the Cohen coefficient for the survey results obtained was 0.811 and as such may be considered satisfactory with respect to the agreement between randomly selected respondents. This finding therefore meets the requirement for reliability of the research methods applied. The value of standardized normal variable 6.01 upon significance level 0.01was higher than the critical value (2.58) for the two-tailed test, it may be therefore noted that the calculated coefficient reveals a statistically significant agreement between respondent responses in the conducted survey. Out of the set of 119 Teacher Education in Biology graduates who studied during the monitored period 1999 – 2008 (Figure 1), most (72%) work in education at present. 69 persons (80%) work as biology teachers at lower secondary schools, 5 persons (6%) work as EE coordinators and 12 persons (14%) work as EE lecturers in non-profit educational organizations. A relatively low number of the respondents (12%) are out of work at present, yet had had a minimum of three years of teaching practice prior to completing the questionnaire. A smaller part of the respondents (16%) work outside the field of their degree, mostly in jobs requiring a university degree as a basic qualification. This group of persons has had no teaching practice since graduating and as such their responses in the questionnaire section relevant to the evaluation of benefits of pre-graduate courses for teaching practice were not included in the research. The benefits of pre-graduate Teacher Education in Biology courses for knowledge competency in biology are considered sufficient by the majority of the respondents (78%). In their comments on this question, the respondents (34%) stated that the knowledge of biological terminology obtained during pre-graduate studies is significantly more extensive than the knowledge applicable in teaching 35 Innovation in Biology and Environmental Education Didactics Absolute number of respondents 30 25 20 15 10 5 0 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 Year of graduation from pre-graduate studies Figure 1. Structure of the studied respondent sample based on the questionnaire response rate and the graduation date in Teacher Education in Biology practice at lower secondary schools. The most obvious weakness of their knowledge competency in biology, as the respondents see it, is the fact they have virtually no opportunity to follow the latest trends in biological subjects. The following reasons are considered key ones: a) lack of time in the working hours of lower secondary school teachers, b) insufficient funds at lower secondary schools limiting the possibility of journal subscription. The evaluation of the benefits which pre-graduate studies brought to the respondents’ teaching and didactic competencies was altogether different (Figure 2). Only 4.2% of the respondents stated that pre-graduate studies in Teacher Education in Biology provided them with all the necessary teaching and didactic competencies for the profession of a biology teacher or EE lecturer. Most respondents considered the benefit of pre-graduate studies for their own teaching and didactic competencies as limited (73.2%) or virtually non-existent (22.6% of the respondents), requiring additional self-study. Respondent evaluation of the importance of Didactics of Biology module in pre-graduate courses was relatively unambiguous: most respondents (77.3%) considered Didactics of Biology to be one of the key modules of their university programme in Teacher Education in Biology. In their comments on this question, Opinions of graduates in Teacher Education in Biology on the shortcomings of Didactics of Biology in their pre-graduate studies 36 Ivo Machar, Jan Činčera, Olga Vránová, Vilém Pechanec, et al. Absence of EEARC issues in the teaching practice undertaken 27 Insufficient time allocated to observations and teaching practice 6 Lack of opportunities to test how didactic theory actually works in teaching practice. 30 Absence of courses on the methodology of school project design 15 Limited attention paid to the didactics of project-based learning 19 Absence of courses on internet info database operation 6 Absence of subject-matter didactics of EEARC 15 Insufficient time allocated to Didactics of Biology 17 0 5 10 15 20 25 30 35 Account of respondents Figure 2. Analysis of shortcomings of the Didactics of Biology module in pre-graduate studies in Teacher Education in Biology as viewed by the graduates the respondents (34%) considered the Environmental Education and Science Experiment Practice modules highly contributing. All the three modules listed above are didactics-oriented. Four respondents gave identical comments, saying that knowledge of manuals for laboratory science exercises gained in the Science Experiment Practice module together with the knowledge of basic principles of textbook evaluation provided by Didactics of Biology were greatly contributing to their teaching practice. The remaining comments contained a wide range of the respondents’ opinions about lecturers of individual modules. These opinions were probably laden with subjective memories of unique personal experiences of individual respondents and as such were not subject to evaluation. Comments focusing on content deficiencies of the Didactics of Biology module provided valuable information (Figure 2). A total of 17% respondents more or less agreed in their 37 Innovation in Biology and Environmental Education Didactics responses that Didactics of Biology received insufficient time allocation in their pre-graduate course and that they would like this module to “be more in-depth oriented”. Virtually all the respondents who are professionally involved in EE would have welcomed special subject-matter didactics focusing on environmental education during their studies. In their comments, the respondents also pointed out that little attention was paid to educational projects, including the methodology of preparing school educational projects, seeing this as a shortcoming of Didactics of Biology. In their comments regarding the importance of Didactics of Biology, the respondents mentioned the teaching practice undertaken, where didactics of biology was reflected. They considered the limited time allocated to teaching practice in their pre-graduate course to be a shortcoming of the teaching practice structure, saying that they would consider teaching practice more focused on immediate application of biology didactics greatly beneficial. Application of the research results in the project innovation of subject-matter didactics of biology and environmental education in biology teaching is shown in Figure 3. Results of questionnaire survey Identified shortcomings of Didactics of Biology Identified deficiencies in knowledge of biology Identified teaching practice shortcomings Innovation in the ENVIRUP project New courses (Didactics of Forest Pedagogy, etc.) New textbooks New courses (Modern Trends in Biology, etc.) New courses (Preparation for Practice, etc.) Evaluation of innovated courses Innovation in the follow-up KONEV project Involvement of foreign experts in education Prolongation of well-established courses Extending internships Figure 3. Application of survey results in the project innovation in subject-matter didactics of biology and environmental education in the Teacher Education in Biology at Palacky University Olomouc 38 Ivo Machar, Jan Činčera, Olga Vránová, Vilém Pechanec, et al. The deficiencies in pre-graduate modules of biology didactics identified by the research resulted in the introduction of four new subject-matter didactics courses for students of Teaching Education in Biology: Didactics of Forest Pedagogy, The introduction of Didactics of EEARC, Didactics of Care for the Environment and Didactics of Nature Conservation. Deficiencies in the biology teachers’ expert knowledge of new trends in biological sciences, as identified in our survey, inspired the publication of new study materials and introduction of new courses: Modern Trends in Biology, Environmental Ethics and Global Learning and Development Education. The respondents’ additional comments on the closed-ended questions of the survey yielded interesting suggestions regarding teaching practice in pre-graduate courses. Informed by them, a set of several modules was prepared under the project innovation, significantly extending the practical competencies of pregraduate students towards enhancing their future employability. The Preparation for Practice module is a set of seminars led by experts from nature conservation institutions and non-governmental organizations focusing on EE. This course is popular with pre-graduate students. It is followed by the course EE in Practice, which includes a long-term internship (4 weeks) with potential future employers at EE centres. The second follow-up course EE and Forest Pedagogy Practice is a two-week group workshop for pre-graduate students of Teacher Education in Biology. It offers them the chance to become acquainted with the basic principles of forest pedagogy under the tuition of forest pedagogy lecturers. Evaluation of student feedback on the innovated didactic modules informed the design of the follow-up KONEV project. This project, whose primary focus is to establish a collaboration network of six Czech universities with professional practice, extends pre-graduate courses in both Teacher Education in Biology and Biological Sciences, specifically by including new possibilities of subjectmatter didactics application in students’ teaching and professional practice. They are given the opportunity to take long-term individual or team internships in renowned nature conservation institutions which are actively involved in EE and collaborate primarily with lower secondary schools. These internships focusing on environmental education are mostly taken in national parks. Discussion The ongoing changes in education are naturally also reflected in subject-matter didactics through curriculum changes (Walterová 1994). In relation to the trans- Innovation in Biology and Environmental Education Didactics 39 formation of the education system, conceptual and content changes affect biology education significantly as well. The pedagogical and psychological constructivist and psycho-genetic principle must act as the cornerstone of biology education, bearing in mind that far from all scientific biology findings may be applied in the lower secondary biology curriculum (Švecová 2001). Owing to this, modelbased teaching will be increasingly applied in science education, demonstrating biological knowledge on specific, didactically suitable selected examples while applying activating teaching methods (Grecmanová, Urbanovská 2007). Future teachers, however, need to learn how to use activating teaching methods in their pre-graduate courses (Oravcová 2004). With the onset of a new millennium, learning and education cannot be properly implemented at schools without paying attention to their environmental aspects (Orr 2004). The results of the presented survey indicate that some biology teachers lack knowledge competencies in environmental education didactics. Didactics of environmental education stresses the importance of the educational role of story-telling, play and project-based education (Eilam, Trop 2011). Some researchers (Gallová, Švecová 1996) indicate that biology is the key subject in environmental education. The results of our survey revealed that pre-graduate students of Teacher Education in Biology are aware of their knowledge deficiencies with respect to the latest trends in the field. With this in mind, our project innovations deliberately focused on introducing new modules and study materials which present students with the latest findings in the modern biological applications in education and the corresponding subject-matter didactics (Papáček 2006). Nevertheless, the issue of the significance and position of biology within environmental education remains a subject of discussion. The evolution of environmental education abroad followed approaches which aspired to pass on the knowledge about nature, education in nature or education towards nature protection (Disinger 2005). Starting with the 1970s, however, we have been able to witness the trend of a gradual shift of environmental education focus “away from nature” “towards society”. Environmental education traditionally understands ecological knowledge as one of its “target levels”, whereby the target attainment of this level should be to “provide learners with sufficient ecological knowledge to permit them to make ecologically sound decisions with respect to environmental issues” (Hungerford, Volk 1990). The existing definition of horizontal issues in framework education programmes stresses the importance of ecological knowledge. Future development of the field in the Czech Republic will probably take place in the context of a nation-wide discussion about the curriculum reform. 40 Ivo Machar, Jan Činčera, Olga Vránová, Vilém Pechanec, et al. The accelerating process of globalization faces new challenges in conceptualizing biology education, which the didactics of global learning and education is trying to reflect (Carvalho 2008). Our project innovation in didactics of biology and environmental education echoes this process by introducing a new course called “Global Learning”, for which new study support was prepared (Máchal et al. 2012). The conducted survey on the opinions of Teacher Education in Biology graduates helped to support the respondents’ professional self-reflection, which is an integral skill of the teaching profession (Urbanovská 2004). The participants in the research presented in this paper positively valued the importance of knowledge of didactics of science laboratory work. The project innovation which followed the research endeavoured to follow the modern trend of shifting the traditional concept of science laboratory work towards research-oriented learning (Papáček 2010). It is probable that without the possibility of financial support from OPEC projects the implementation of the relatively costly innovation in subject-matter didactics would not have been possible. The same may be generally said about all innovations in university education which primarily focus on enhancing the employability of university graduates (Ryška et al. 2012). Educational projects similar to those presented in this paper are being implemented at other universities as well. Yet, the real effectiveness of such projects has been very rarely evaluated in expert publications (Koucký et al. 2008). The required sustainability of OPEC projects after the termination of their funding will lead to a gradual downturn in individual project activities. In this context, the importance of lifelong learning should be stressed, as it may support the sustainable maintenance of teachers’ didactic competencies. Conclusions The current development of biological sciences steers towards gradual integration, which is reflected in the trend favouring modular teaching in the didactics of biological subjects. Increasing demand for new attractive forms of biology learning at lower secondary schools (research-oriented learning, cross-curricular projects) together with accentuated horizontal application of environmental education increases the demand for didactic skills in teachers. The results of the presented research revealed that lower secondary biology teachers and EE lecturers view didactics-oriented disciplines as key ones in their field. The presented project Innovation in Biology and Environmental Education Didactics 41 innovation in subject-matter didactics was implemented by a multi-disciplinary team driven by their effort to enhance the teaching competencies of future natural science and environmental education teachers. The authors would appreciate it if the results of their work contributed to the discussion about subject-matter didactics of biological disciplines. Acknowledgements The paper was supported by the grant No. CZ.1.07/2.4.00/17.0073 at Palacky University Olomouc. References Broukalová, L.; Broukal, V.; Činčera, J. (2012). Objectives and Indicators for Environmental Education, Awareness Raising and Consulting in the Czech Republic. Prague: Ministry of Environment. Carvalho, M. (2008). Global Education Guidelines. Lisbon: North-South Centre of the Council of Europe. Činčera, J. (2007). Environmental Education: From Goals to Means. Brno: Paido. Disinger, J.F. (2005). Environmental Education’s Definitional Problem. In Hungerford, Harold H.; Bluhm, William J.; Volk, Trudi L.; Ramsey, John M. Essential Readings in Environmental Education (pp. 17–32). Champaign: Stipes. Eilam, E.; Trop, T. (2011). ESD Pedagogy: A Guide for the Perplexed. The Journal of Environmental Education, 42 (1), 43–64. Gallová, M.; Švecová, M. (1996). Concepts of Biology Teaching at Grammar Schools in CR. Biologie, chemie, zeměpis, 5(5): 202–204. Gnitecki, J. (1993). Zarys metodologii badań w pedagogice empirycznej. Zielona Góra: Wyższa Szkoła Pedagogiczna. Grecmanová, H.; Urbanovská, E. (2007). Activating Teaching Methods and School Educational Programme Tools. Olomouc: Hanex. Hungerford, H.R.; Volk, T.L. (1990). Changing Learner Behavior Through Environmental Education. The Journal of Environmental Education, 21(3): 8–21. Chráska, M. (2007). Methods of Educational Research. Praha: Grada. Jakab, I; Kopcová, O. (2004). Didactics of Environmental Ecology. Nitra: Univerzita Konštantína Filozofa. Kyriacou, CH. (1996). Key Teaching Skills. Praha: Portál. 42 Ivo Machar, Jan Činčera, Olga Vránová, Vilém Pechanec, et al. Koucký, J., Voříšek, P., Zelenka, M. (2008). University Graduates on the Labour Market. AULA, 16(2): 1–10. Machar, I. (2011). Environmental education for success in practice – an innovative project focused on preparing students of Palacky University in Olomouc. Journal of Landscape Ecology, 4, 3: 92–94. Mareš, J. (1983). How to Determine Reliability of Observation? Pedagogika, 2: 35–42. Máchal, A.; Nováčková, H.; Sobotová, L. (2012). Introduction to Environmental Education and Global Development Learning. Lipka: Brno. Oravcová, J. (2004). Active Learning in the Preparation of Future Pedagogues. In Oravcová, J. (ed) Evalvácia v edukačnom procese vysokých škol (pp. 83–93). Banská Bystrica: Univerzita Mateja Bela. Orr, D.W. (2004). Earth in Mind. On Education, Environment, and Human Prospect. Washington: Island Press. Papáček, M. (2006). Demands for Contemporary Didactics of Biology. In Dargová, J. & Darák, M. (eds) Didaktika v dimenziách vedy a praxe (pp. 330–335). Prešov: Euroeducation. Papáček, M. (2010). Research-oriented Science Learning – a Road for Biological Education of Generations Y, Z and Alpha? Scientia in Educatione, 1(1): 33–49. Ryška, R., Zelenka, M., Lepič, M., Koucký, J. (2012). Employability and Placement of Charles University Graduates. Studie, Pedagogická fakulta, Univerzita Karlova v Praze, 18 pp. Shulman, L.S. (1987). Knowledge and Teaching. Foundation of the New Reform. Harvard Educational Review, 57: 1–22. Švecová, M. (2001). Possibilities of Curriculum Innovation in Relation to Dynamic Development of Natural Sciences. Pedagogika, 51(3): 227–265. Urbanovská, E. (2004). Evaluation as Part of Professional Self-Reflection. In Oravcová, J. (ed) Evalvácia v edukačnom procese vysokých škol (pp. 24–33). Banská Bystrica: Univerzita Mateja Bela. Walterová, E. (1994). Curriculum. Transformations and Trends in an International Perspective. Brno: Komenium. Zoran Kalinic, Slavko Arsovski, Zora Arsovski, Vladimir Rankovic Serbia The Effectiveness and Students’ Perception of an Adaptive Mobile Learning System based on Personalized Content and Mobile Web Abstract As the whole world is going mobile, application of mobile devices in education, also known as m-learning, is becoming one of the most popular areas of educational research. This paper presents the implementation and evaluation of the effectiveness and students’ attitudes toward an adaptive mobile learning system based on personalized content and mobile web. Personalization of learning materials is based on the Felder-Silverman learning style model and the features of the accessing mobile device were identified using the device library. The results of the study confirm students’ positive attitudes toward mobile learning and the developed adaptive m-learning system. They also prove the effectiveness of the system and m-learning as an additional educational tool in terms of increasing students’ knowledge and scores. Keywords: personalized mobile learning, device adaptation, mobile web, content adaptation. Introduction M-learning is usually defined as a form of e-learning which can take place anywhere, anytime, using mobile devices such as mobile phones and PDA devices (Quin, 2000; Kadirere, 2009). Mobile learning has come to people’s attention because mobile devices are portable, ubiquitous, accessible, and used by many people (Keskin and Metcalf, 2011). Lower cost, transportability, and flexibility are the advantages of 44 Zoran Kalinic, Slavko Arsovski, Zora Arsovski, Vladimir Rankovic m-learning over the traditional and more expensive computer lab set-up e-learning (Zurita and Nussbaum, 2004; Nedugandi and Raman, 2012). The need for adaptation and profiling of the content for mobile use has been widely recognized among researchers (Yang et al., 2004; Kinshuk et al., 2009; Franklin, 2011; Nedugandi and Raman, 2012). By adapting course presentations to individuals, students can learn more in less time because the materials comply with their preferences (Paredes and Rodriguez, 2002). In addition to a great variety of mobile devices, learners have different preferences, motivations, abilities, and knowledge, therefore different learner profiles (learning styles and knowledge levels) should be considered in designing personalized learning assistance. An adaptive mobile learning system based on personalized content and mobile web is presented in this paper. Personalization of the learning content is based on students’ learning styles and the identified features of the accessing mobile device. A study on the effectiveness of the m-learning system and students’ attitudes toward mobile learning has also been done. The remainder of the paper is organized as follows: Section 2 gives literature review of similar studies. In Section 3, a design of an adaptive mobile learning system and the implementation of the learning experiment are presented. Section 4 discusses the results of the study on the effectiveness and students’ attitudes toward the tested m-learning system and m-learning in general. In the final section, conclusions, limitations of the study, and further research directions are presented. Literature review Adaptation and personalization of the learning content in an e-learning environment is usually performed in accordance with students’ learning styles and preferences. However, due to limitations of the mobile devices in the m-learning environment, it is usually necessary to perform content adaptation based on the features of the accessing mobile device. Learning styles have been recognized as being an important human factor affecting students’ learning performance (Kinshuk and Lin, 2004; Filippidis and Tsoukalas, 2009; Hwang et al., 2012; Dorca et al., 2013). In the literature, different learning style models can be found (Paredes and Rodriguez, 2002), but the dominant and widely accepted one is the Felder-Silverman model (Felder and Silverman, 1998). Huang et al. (2012) proposed an adaptive m-learning system, which exploited Bayesian networks (for the identification of individual learning styles based on The Effectiveness and Students’ Perception 45 the Felder-Silverman model) and content adaptation technologies to support both learner and device adaptation, which allows each learner to construct a personalized and adaptive learning environment. Using the Felder-Silverman learning style model, Park and Chungbuk (2005) described the design and development of a mobile learning management system adaptive to students’ learning styles. Carver et al. (1999) developed an adaptive learning system based on the sensing/intuitive, visual/verbal, and sequential/global dimensions of the Felder–Silverman learning style theory. Filippidis and Tsoukalas (2009) developed a web-based adaptive educational system based on the sequential–global dimension of the Felder–Silverman model, which provided different versions of images to present the same content with different levels of details. The Felder-Silverman learning style model in m-learning was also used by Kinshuk and Lin (2004), Huang and Hsieh (2008) and Nagella and Govindarajulu (2008). Dynamic adaptation in real-time generates the desired content based on the specifications of heterogeneous devices. The major advantages of the dynamic adaptation approach include great flexibility in the support of different learning devices and avoidance of inconsistent contents that almost certainly appear in multiple versions made for different devices (Huang et al., 2012). Zhao et al. (2008) presented a personalized adaptive content system based on the learner’s experience, mobile device profiles, and characteristics derived from the device repository, and concluded that the context-aware adaptive mobile learning system could increase learning efficiency and interest. Similar results were presented by Jung, Park and Chung (2006). Yang (2012) reported positive attitudes of students of English toward m-learning. Al-Fahad (2009) investigated students’ attitudes and perceptions of the effectiveness of m-learning among students in Saudi Arabia and discovered that m-learning was widely embraced by the student community and that m-learning activities enabled students’ better involvement in the learning process. The students in this study changed from passive to engaged learners, who were intellectually, emotionally, behaviorally involved in their learning tasks. The study Design of adaptive mobile learning system Although native mobile applications developed for specific mobile platforms (such as Android or iPhone) are quite popular and offer the best-in-class user experience, it is not easy to port them to other mobile platforms (Fling, 2009). 46 Zoran Kalinic, Slavko Arsovski, Zora Arsovski, Vladimir Rankovic On the other hand, almost all modern mobile phones have built-in mobile web browsers and mobile websites and applications are easy to create, maintain, and publish (Fling, 2009). Since the mobile web appears as the most scalable way to develop and support multiple platforms (Nedugandi and Raman, 2012), it was chosen as the platform for the development of the system, which was done at the University of Kragujevac, Serbia. The learning materials were structured in courses, modules, and lessons. The lesson model allowed for the adaptation of the lesson structure in accordance with the adaptation rules derived from the student learning style, which was determined using the Felder-Silverman model. According to the characteristics of each dimension and category (Felder and Silverman, 1998), the adaptation rules were defined and implemented in the system, so each student could get a personally tailored lesson based on his/her learning style. The lesson contained either mainly visual or mainly verbal materials, gave examples first and then theory, or vice versa, started from easier to harder examples or opposite, gave summary at the beginning or at the end of the lesson, etc. The system also incorporated content adaptation in accordance with the mobile device characteristics. Mobile devices come in a variety of forms and with completely different main characteristics (operational system, screen size, support to multimedia formats, etc.), hence it is almost impossible to create a single mobile web solution suitable for them all (Fling, 2009; Firtman, 2010). The full dynamic server-side content adaptation starts with the device detection and is followed by adaptation of the content based on the identified characteristics and adopted adaptation rules (Fling, 2009). To identify the important features of a mobile device, it is common to use some of the device libraries (Zhao et al., 2008; Firtman, 2010), and in this system, one of the most famous device libraries, WURFL (WURFL, 2011), was implemented. The content was adapted in accordance with identified characteristics and the adaptation rules. For example, all the pictures were dynamically resized to fit the screen size and resolution, only supported multimedia files were presented in order to avoid the download of unsupported formats, the hyperlink font size was changed depending on whether the device has a touch screen or not, etc. The two-step adaptation process is shown in Figure 1. In addition to lessons, students were able to access self-assessment tests. All student activities (lesson readings, self-assessment tests and learning style tests taken) were monitored and saved in the system database as user logs. More details on the system development and implementation can be found in Kalinic (2011). The Effectiveness and Students’ Perception 47 Figure 1. Two-step content adaptation process Implementation of the learning experiment The study population was composed of the first-year undergraduate students taking the course in Information Technology at the University of Kragujevac, Serbia. Originally, 63 students joined the study voluntarily, but only 41 of them actually took part in it. In order to evaluate the effectiveness of the system, a control group of 41 students who did not use the system was formed. In this way, it was possible to evaluate the mobile learning as an additional learning tool by comparing the results of the experimental and control groups. Having registered to the system, the students had one month to use the m-learning system to prepare for the second exam test. Inside the university building, the students had free Wi-Fi access, while in other locations they usually used mobile networks for data transfer. The learning material was the same as the off-line learning material and it consisted of two modules: Computer Networks and the Internet. It included texts, images, audio (lesson readings), and video materials (PowerPoint presentations with narration, converted into videos), in formats typically supported by mobile devices. Self-assessment tests for each lesson were also available to the students to help them monitor their progress. When the learning experiment ended, a satisfaction survey was performed using a questionnaire with 5-point Likert scale questions, numerical assessments of the system, and open questions on user attitudes. The objective of this survey Zoran Kalinic, Slavko Arsovski, Zora Arsovski, Vladimir Rankovic 48 was to evaluate the students’ perceptions of the m-learning system and m-learning in general, and to provide some information about their experiences during the experiment. All the participants filled in the questionnaire at the end of the experiment. Research Results The data collected in this study include two test scores of the students from both groups and the satisfaction questionnaire results of the students from the experimental group. In order to determine whether the two groups are comparable, first the results of test 1, which both groups did under the same conditions, using only traditional learning methods, were analyzed. The results of test 1 are presented in Table 1. Table 1. T-test results of test 1 Experimental group (n = 41) Control group (n = 41) Test Mean SD Mean SD No. 1 14.98 3.36 15.07 2.65 p t 0.8842 –0.1461 The t test results (t = –0.1461, p>>.05) show that there was no significant difference between these two groups, so it can be assumed that the groups comprise similar students and therefore can be compared. Test 2 was taken after the learning period. The scores of the experimental and the control groups were then analyzed again using the t-test in order to determine whether there were significant differences between them, which would suggest that the use of the developed m-learning system improved the test scores. Since the learning materials were organized in two modules, the scores were calculated independently for each of them and the results of the analysis are shown in Table 2. Table 2. T-test results for test 2 Experimental group (n = 41) Test No. 2 * p < .05 Control group (n = 41) Mean SD p t Module Mean SD Module 1 5.49 1.58 4.63 1.93 0.0158* 2.1875 Module 2 5.56 2.35 4.61 2.38 0.0359* 1.1843 49 The Effectiveness and Students’ Perception The t-tests produced statistically significant results (p<.05), indicating that there was a considerable difference in the scores of the two groups. The improvement in the mean score was +18.4% for Module 1 and +20.6% for Module 2, which confirms the effectiveness of the proposed m-learning system and is compliant with the findings of Jung, Park and Chung (2006). Since both groups attended the same lectures and had the same tests, the only difference being that the experimental group used the m-learning system while the control group did not, it may be concluded that personalized m-learning can be effectively used to support other forms of learning. Analysis of the students’ activity showed that most of them used the system at least once a day (29%) or a few times a week (56%), while the length of the session was usually 5-15 minutes (58% of the students), which is compliant with the general recommendations for m-learning design (Trifonova, 2006). Most of the students used news (76%), texts with images (98%), and self-assessment tests (83%). Due to relatively large files, no free Wi-Fi signal available outside of the university building and slow and expensive data transfer via a mobile network in developing countries, the use of audio (only 15% of the students) and video materials (17% of the students) was limited. After the second test had been taken, a survey on the students’ satisfaction was carried out using a questionnaire designed to measure he students’ attitudes and perceptions of the effectiveness of mobile learning. It consisted of seven questions evaluated based on a 5-point Likert scale (1 = strongly disagree to 5 = strongly agree), and the results are shown in Table 3. Table 3. The students’ attitudes toward m-learning and the tested system Statement 1. 2. 3. 4. 5. 6. 7. Mean SD The m-learning system can be a good supplement to traditional learning. 4.85 0.42 The system enables access to learning materials anytime, anywhere. 5.00 0.00 The m-learning system helped me to easier prepare myself for the test. 4.02 0.99 It would be nice if I could use the same system for other courses. 4.71 0.64 The m-learning system was easy to use. 4.88 0.33 I did not have any problems with the connection. 4.73 0.63 All materials were clear and precise. 4.93 0.26 The expressed positive attitudes toward mobile learning are in compliance with the findings of Al-Fahad (2009), Huang et al. (2012) and Yang (2012). The students also evaluated the quality of the materials presented in the two modules, 50 Zoran Kalinic, Slavko Arsovski, Zora Arsovski, Vladimir Rankovic functionality of the system (menus, navigation, etc.) and general impression of the system, and the marks (all ranging from 4.63 to 4.68) showed that they were very satisfied with the tested m-learning system. The Cronbach alpha value of .814 indicates a good reliability of the questionnaire. The questionnaire contained two open questions concerning the students’ positive experiences and the problems they encountered during the learning experiment. As the main advantages of the system, they stressed the opportunity to access the learning materials anytime, anywhere (e.g. “I could learn on the bus without a book or a bunch of papers”), the easiness of use, the possibility of learning during short breaks (e.g. “I used it even during TV commercials”), the fast way to get notifications, etc. Only a few of the students said that they had experienced some problems with the system. The complaints were mostly related to the unavailability of WLAN signal, temporary problems in connections, problems in accessing audio and video materials, etc. Conclusions The presented paper investigates the effectiveness and students’ perceptions of the adaptive mobile learning system based on personalized content and mobile web. The adaptation mechanism of the system presented in this study was based on adaptation rules derived from the Felder-Silverman learning style model and technical specifications of the mobile devices used to access the system. The study results confirm that personalized m-learning may increase the test scores of the students who use it as an additional form of learning. The analysis of the students’ perceptions reveals their positive attitudes toward m-learning in general and their willingness to accept the introduction of m-learning to their education system. The findings of this study are consistent with the findings of Al-Fahad (2009),Yang (2012) and Huang et al. (2012). The study was limited to only a group of students taking an undergraduate course. Although the proposed personalized m-learning system has shown significant effectiveness in learning performance improvement, more experiments are needed to extend the findings of this study to other study programs and courses. The students’ learning styles were determined using the Index of Learning Styles. Further improvement would be achieved by the introduction of an adaptive learner model, which would enable dynamic determination (or at least adaptation) of learning styles based on learners’ behavior during the learning process and based on the learning results (Kinshuk et al., 2009; Huang et al., 2012). In The Effectiveness and Students’ Perception 51 addition, in order to provide a more effective learning environment, additional factors related to personalization (e.g. prior knowledge, learning context, online learning behavior, etc.) need to be taken into account. Further improvements of the m-learning system may include introduction of location-based services and SCORM standards for organization and transfer of learning materials. In the near future, better mobile devices (primarily smart phones and tablets) and cheaper and faster data transfer via Wi-Fi will enable the use of more interactive and multimedia learning materials. In addition, a deeper analysis of students’ perceptions of specific details of m-learning may be performed. Acknowledgement The research presented in this paper was supported by the Ministry of Education, Science and Technological Development of the Republic of Serbia, Grant III-44010, Title: Intelligent Systems for Software Product Development and Business Support based on Models. References Al-Fahad, F.N. (2009). Students’ attitudes and perceptions towards the effectiveness of mobile learning in King Saud University, Saudi Arabia. The Turkish Online Journal of Edu.Techn. (TOJET), 8 (2), 111–119. Carver, C.A., Howard, R.A. & Lane, W.D. (1999). Enhancing Student Learning Through Hypermedia Courseware and Incorporation of Student Learning Styles. IEEE Transactions on Education, 42(1), 33–38. Dorca, F.A., Lima, L.V., Fernandes, M.A. & Lopes, C.R. (2013). Comparing strategies for modeling students learning styles through reinforcement learning in adaptive and intelligent educational systems: An experimental analysis. Expert Systems with Applications, 40 (2013), 2092–2101. Felder, R.M. & Silverman, L.K. (1988). Learning Styles and Teaching Styles in Engineering Education. Engineering Education, 78(7), 674-681. Felder, R. & Spulin, J. (2005). Applications, Reliability and Validity of the Index of Learning Styles. International Journal of Engineering Education, 21(1), 103–112. Filippidis, S.K. & Tsoukalas, L.A. (2009). On the use of adaptive instructional images based on the sequential-global dimension of the Felder–Silverman learning style theory. Interactive Learning Environments, 17(2), 135–150. Firtman M. (2010). Programming the Mobile Web. O’Reilly 52 Zoran Kalinic, Slavko Arsovski, Zora Arsovski, Vladimir Rankovic Fling B. (2009). Mobile Design and Development. O’Reilly. Frankin, T. (2011). Mobile learning: at the tipping point. The Turkish Online Journal of Educational Technology (TOJET), 10(4), 261–275. Huang, H.-C. & Hsieh, F.-M. (2008). An Adaptive Mobile Learning System with the Support of Learning Diagnosis. Proceedings of the 16t Int.Conference on Computers in Education (ICCE 2008), Taiwan, 189-190. Huang, H.-C., Wang, T-Y. & Hsieh, F-M. (2012). Constructing an Adaptive Mobile Learning System for the Support of Personalized Learning and Device Adaptation. Procedia – Social and Behavioral Sciences, 64 (2012), 332–341. Hwang, G-J., Sung, H-Y., Hung, C-M., Huang, I. & Tsai, C-C. (2012). Development of a personalized educational computer game based on students’ learning styles. Education Technology Research and Development, 60 (2012), 623–638. Jung, H., Park, S., & Chung K.S. (2006). An Architecture for Adaptive Mobile Learning. Proc.of 20tIEEE Int. Conference on Advanced Information and Networking Applications (AINA’06), Vienna, Austria. Kadirere, J. (2009). Mobile Learning DeMystified. in R. Guy (Ed.) The Evolution of Mobile Teaching and Learning, California, USA: Informing Science Press. Kalinic, Z. (2011). Design of m-learning information system based on quality aspects. University of Kragujevac, Serbia. Published Dissertation. Keskin, N.O. & Metcalf, D. (2011). The current perspectives, theories and practices of mobile learning, The Turkish Online Journal of Educational Technology (TOJET), 10(2), 202–208. Kinshuk, Chang, M., Graf, S. & Yang, G. (2009). Adaptivity and Personalization in Mobile Learning, Proc. of the American Educational Research Association Annual Meeting (AERA 2009), San Diego, USA Kinshuk, Lin, T. (2004). Application of Learning Styles Adaptivity in Mobile Learning Environments. Third Pan-Commonwealth Forum on Open Learning, Dunedin, New Zealand. Nagella, U.B. & Govindarajulu, P. (2008). Adaptive Approaches to Context Aware Mobile Learning Applications, Int. Journal of Computer Science and Security (IJCSS), 2(2), 15–26. Nedugandi, P.& Raman, R. (2012). A new approach to personalization: integrating e-learning and m-learning. Education Technology Research and Development, 60 (2012), 659-678. Noble, B. (2000). System Support for Mobile, Adaptive Applications, IEEE Personal Commun.,7(1), 44–49. Paredes, P. & Rodriuez, P. (2002). Considering Learning Styles in Adaptive Webbased Education. Systemics, Cybernetics and Informatics, II, 481–485. The Effectiveness and Students’ Perception 53 Park, H. & Chungbuk, G-M.C-G.(2005). Design and development of a mobile learning management system adaptive to learning style of students. Proc. of the 2005 IEEE Int.Workshop on Wireless and Mobile Technologies in Education (WMTE’05), Tokushima, Japan. Quin, C. (2000), M-Learning: Mobile, wireless, in-your-pocket learning, LINE Zine, Retrieved on January 15, 2013, from http://www.linezine.com/2.1/features/cqmmwiyp.htm Soloman, B.A. & Felder, R.M. (2003). Index of Learning Styles Questionnaire. Retrieved on February 12, 2013, from http://www.engr.ncsu.edu/learningstyles/ ilsweb.html Trifonova, A. (2006). Mobile Learning: Wireless and Mobile Technologies in Education – Towards Hoarding Content in M-Learning Context. University of Trento, Italy, Published Dissertation. WURFL, (2011), WURFL device database, Retrieved on February 16, 2011, http:// wurfl.sourceforge.net/ Yang, S-H. (2012). Exploring college students’ attitudes and self-efficacy of mobile learning. The Turkish Online Journal of Educational Technology (TOJET), 11(4), 148–154. Yang, S.J.H., Shao, N.W.Y. & Sue, A.Y.S. (2004). Personalized metadata mechanism applied to adaptive mobile learning. Proc. of the 2ⁿd IEEE Int. Workshop on Wireless and Mobile Technologies in Education (WMTE’04). Zhao, X., Anma, F., Ninimiya, T. & Okamoto, T. (2008). Personalized Adaptive Content System for Context-Aware Mobile Learning, Int. Journal of Computer Science and Network Security, 8(8), 153–161. Zurita, G. & Nussbaum, M. (2004). Computer supported collaborative learning using wirelessly interconnected hand-held computers. Computers & Education, 42(3), 289–314. Moon Hyoung-jin, Nam Jong-ho, Kim Yong-deog Korea New Measures for the Improvement of History Education for Chinese Students in South Korea* Abstract The objective of this research was to find a more effective method for the teaching of history to Chinese students studying in South Korean universities. Questionnaire surveys and interviews were conducted to investigate those students’ level of knowledge and perceptions of Korean history. Then, in history classes, four teaching methods (comparative-historical, audiovisual, history and language, and rote memorization) were applied over two weeks. Before the treatment, Chinese students said that they liked the audiovisual teaching method the most, but after taking the classes, they preferred the teaching method comparing Korean and Chinese histories. Besides the finding that the comparative method was the most popular, the responses also showed that it was the most effective one in teaching history to Chinese students. Keywords: Chinese students, history knowledge, history teaching methods, Korean history Introduction The number of Chinese students of university age studying in South Korea has been rapidly increasing in recent years. Only 33,650 Chinese students were study* This paper was supported by the Hankuk University of Foreign Studies Research Fund of 2014. New Measures for the Improvement of History Education 55 ing in Korea in 2007, but this number had increased to 55,025 by 2009 and 60,935 by 2011 (Korean Educational Development Institute, 2012). These increases can be attributed to the hallyu or “Korean cultural wave” and to the popularity of K-pop (Korean pop music) in China. As of 2013, Chinese students accounted for 72.5% of the total number of foreign students studying in Korea (Ministry of Justice, Republic of Korea, 2012). Chinese students studying in Korea can expect that they will need some basic contextual knowledge of a social-scientific kind when learning the Korean language and that background knowledge about Korean history in particular will help them communicate better with the Koreans and understand both Korean society and the Korean language. Despite this need, Korean history education has not been offered systematically to these students. As a result, some 80% of Chinese students in one study expressed the opinion that Korean history was not interesting (Moon, 2013). They thought that Korean history textbooks were very subjective, meaning that history education tended to be offered from the Korean perspective only, failing to consider the viewpoints of adjacent countries. Due to such perceptions, Chinese students may devalue and lose interest in learning about Korean culture as a whole, and their learning may be less effective as a result. For these reasons, it is urgent that Korean history education for Chinese (and other foreign) students be improved. Therefore, this study aims to identify the teaching method that most effectively increases these students’ learning in Korean history by reducing conflicts between their prior knowledge acquired from their history lessons and cultural background in their own country and Korean history as taught in South Korea. According to previous studies (Moon, 2011), Chinese students tend to experience cultural conflicts in internalizing knowledge about Korea. This can be attributed to a discrepancy between the students’ prior knowledge and the education that they receive in Korea. Given these points, what kind of teaching method will be best able to offer a balanced form of history education for these students and contribute to reducing such conflicts? This study was conducted to determine this, and to find effective approaches to Korean history education for Chinese students. Several studies have been conducted on this topic in relation to various education areas and methods. They have mainly focused on methods of teaching Korean as a second language (Oh & Gyo, 2011) and the cultural and audiovisual educational methods (Lee, 2004). A few studies have been conducted in the context of history education (Moon, 2011; 2012), but this area of investigation is still at the beginning stage. Despite some insights garnered by previous studies, they share the limitation that they have not presented analytical data showing what 56 Moon Hyoung-jin, Nam Jong-ho,Kim Yong-deog kind of educational method was the most effective. To resolve this limitation, the presented study was conducted with the goal of identifying the most effective educational method for Chinese students of Korean history based on the analysis of data collected from an actual educational setting. Both quantitative and qualitative approaches were used in this study. Four teaching methods were implemented in different classroom settings to determine which was the most effective for Chinese students in each of the four years of undergraduate study in Korean universities. Methodology Data was gathered on two different occasions using two approaches: (1) a questionnaire survey and a qualitative investigation were conducted over one month, November 2013; and (2) after this primary investigation, lectures were offered to students using four teaching methods (comparative-historical, audiovisual, history and language, and rote memorization) over two weeks during December 2013. The goal was to identify any change in students’ preferred teaching methods. The rationale for this approach was to overcome the limitations of survey research alone. In other words, this study assumes that students’ preferred educational method as found by the analysis of survey results is more likely based on their past experiences, and therefore it is difficult to assert that such a teaching method is the most effective. Accordingly, after implementing four teaching methods over two weeks, this study asked students once again which teaching method they preferred the most. A total of 200 Chinese students studying in universities in Seoul were selected for this study. To investigate the students’ preferences regarding teaching methods, 50 students were selected from each academic year (first, second, third, and fourth). However, 20 subjects who did not answer all the items in the questionnaire or those who chose the same alternative consistently were excluded from the analysis, and so, ultimately, data obtained from 180 students were analyzed. In the quantitative investigation, nine items were used to get a sense of the students’ knowledge of Korean history in general, the effectiveness of the Korean history education they had experienced, and their preferred teaching methods. For the qualitative investigation, six items assessed the students’ opinions on these matters, yielding four preferred teaching methods. Each of these was used to teach the students over two weeks, after which the students’ preferred teaching method was again investigated. 57 New Measures for the Improvement of History Education Analysis: Chinese students’ knowledge of Korean history Given the preponderance of Chinese students in Korean universities, how Korean history education should be offered to these students is a pressing question, but before optimum methods can be identified, a picture of Chinese students’ general perceptions and knowledge of Korean history are needed. We investigated them through a survey. Table 1. Chinese students’ general perceptions of Korean history ( n=180) ① Very Much ② Somewhat ③ Not Much ④ Little 1. Korea was subordinate to China in ancient times. 58% 32% 10% – 2. China influenced Korea in ancient times. 56% 38% 6% – Korea and China were closely related to each other 3. historically. 60% 32% 8% – 4. Your level of knowledge about Korean history is high. 8% 10% 65% 17% There is a discrepancy between education in Korea and 5. China in teaching the same historical facts. 38% 43% 19% – 32% 45% 20% 3% 3% 17% 55% 25% Question 6. There is a discrepancy between Korean and Chinese history textbooks in describing the same historical facts. 7. How much do you enjoy Korean history classes? Table 1 shows that Chinese students tend to look at Korean history from the perspective of Chinese history (Kim & Jeong, 2004; Yu, 2005). Nearly 90% of the respondents thought that China had influenced Korea greatly in ancient times (94%) and that Korea and China had been closely related historically (92%). Some 90% of the respondents thought Korea had been subordinate to China in ancient times, and thus perceived the relationship between Korea and China as hierarchical rather than equal. This perception is attributable to the Chinese worldview, which asserts that China is in the center of East Asia and that the surrounding countries are influenced by it (Oh, 2001; Park, 2003). In terms of the perceptions of Korean history education, the respondents thought that there was a discrepancy between Korean and Chinese history textbooks (77%) and teachers (81%) describing the same historical facts. They experienced mental conflict accepting Korean history due to this perceived discrepancy (National History Compilation Committee, 2007; Renmin Educational Publisher History Office, 2004). As a result, the number of students who thought Korean history classes were not interesting (80%) was higher than the number of those Moon Hyoung-jin, Nam Jong-ho,Kim Yong-deog 58 who thought they were interesting (20%). These are possible reasons for the low understanding of Korean history (demonstrated below). To investigate the students’ understanding of Korean history in depth, 48 students were selected for individual interviews. They were asked to express their opinions about Question 6 and the reasons for their opinions. Table 2. Interviews on Korean history in general ( n=48). Question Correct Answer Incorrect Answer 1. How long a history does Korea have? 15% 85% 2. How long did each Korean dynasty last on average? 30% 70% 3. What was Korea’s original religion? 30% 70% 4. What was the name of the war between Korea and the Qing Dynasty? 58% 42% 5. What was the March 1st Independence Movement? 53% 47% 6. What was the Anti-American Pro–North Korean War? 65% 35% As seen in Table 2, the Chinese students’ knowledge about Korean history was found to be very low. In Question 1, the proportion of the students who answered correctly by replying “5,000 years” was only 15%, while the proportion of students who answered incorrectly by replying “4,000 years” or “3,000 years” was 85%. Similar trends were found in Question 2: only 30% of the students correctly answered “500 years,” while 70% answered incorrectly, choosing “300 years.” This may be because the longest-lasting Chinese dynasty was around 300 years; the respondents may have applied their Chinese preconceptions to Korean history. Last, in Question 3, the proportion of the students who correctly answered “shamanism” (30%) was lower than the proportion of those who incorrectly answered “Confucianism” (34%) or “Buddhism” (32%), hinting again that their Sinocentrism had skewed their perspective on Korean history (Sim, 1997; Lee, 2005). These findings show that the Chinese students in Korea tend to understand Korean history based on their prior knowledge acquired in China and they lack understanding of or exposure to the Korean perspective on Chinese history (Shin, 2005). However, the remaining answers indicate that the students did demonstrate a reasonably high understanding of the aspects of Korean history covered in detail in Chinese history textbooks. For instance, in Question 4, 58% of the students knew the name of the war between the Korean Joseon Dynasty (1392–1910) and the Chinese (strictly speaking, Manchu) Qing Dynasty (1636–1912). In Questions 5 and 6, respectively, regarding the March 1st Independence Movement (against 59 New Measures for the Improvement of History Education the Japanese occupation of Korea) and the Korean War, more than half of the respondents also gave correct answers. The term “Anti-American Pro-North Korean War,” which is used in Chinese history textbooks to reflect that China helped North Korea in its fight against the United States, again reflects a Chinese perspective. Next, quantitative and qualitative investigations were conducted to explore more effective teaching methods for the Chinese students of Korean history. Table 3 shows the results of this investigation on four such methods: a comparativehistorical teaching method (CHTM), an audiovisual teaching method (AVTM); a history and language teaching method (HLTM); and a rote memorization teaching method (RMTM). Table 3. Which teaching method was most effective for you? (n=180). Category % CHTM 30% AVTM 38% HLTM 27% RMTM 5% As seen in Table 3, the respondents preferred the AVTM (38%) and the CHTM (30%) and did not prefer the RMTM. In other words, the students understood Korean history and culture through the lens of their prior knowledge acquired in China; also, they liked vivid audiovisual materials (Moon, 2013). Table 4 shows the respondents’ preferences regarding the teaching methods broken down by year. Table 4. Which teaching method did you like most? ( n=180). Category First-Year Students Second-Year Students Third-Year Students Fourth-Year Students CHTM 19% 32% 33% 35% AVTM 34% 43% 38% 33% HLTM 37% 17% 25% 27% RMTM 10% 8% 4% 4% The first-year students liked the HLTM most, possibly because this teaching method helped improve their communication ability, whereas the second- and third-year students preferred the AVTM, which perhaps stimulated their interest in Korean history. These contrasting results are likely attributable to the fact that the second- and third-year students were relatively confident in communicating in 60 Moon Hyoung-jin, Nam Jong-ho,Kim Yong-deog Korean and thus preferred a teaching method that incorporated language education as well. In contrast, the fourth-year students preferred the CHTM, which can highlight similarities and dissimilarities in views of history and history education between countries, perhaps reflecting a desire to accommodate Korean attitudes and reducing cultural conflicts between the two countries. Results: The most effective teaching method To determine which of the four teaching methods was most effective and to investigate changes in the Chinese students’ preferences for the methods after exposure to them, each method was used in a single two-hour class for the students of each academic year. For example, for the CHTM, a lecture was offered on each of the following four topics: (1) the Imjinweran or Japanese invasion of Korea in 1592, as described in Korean and Chinese history textbooks (Choi & Moon, 2006); (2) the Donhak movement, a literary movement against European disciplines in East Asia; (3) the March 1st Independence Movement; and (4) the Korean War. For the AVTM, videos were presented on (1) Gyeongbokgung (a palace of the Joseon) and Zǐjìnchéng (a palace of the Qing); (2) a war between Goguryeo (a dynasty in the northern part of the Korean Peninsula) and the Sui Dynasty (in China); (3) the Opium War and Byeongin Yangyo (the French invasion of Joseon in 1864); and (4) the Byeongja-Horan War (the Qing invasion of Joseon in 1626) and Crown Prince Sohyun (Joseon’s prince, who was taken hostage to the Qing capital, Beijing). After the videos were viewed, their learning effects were evaluated. For the HLTM, the areas of politics (specifically, political structures), economy (land systems), society (changes in social classes), and culture (initiation ceremonies) were selected. Finally, for the RMTM, the ancient dynasties of Korea were divided into four periods: the Three Kingdoms Period (57 BCE–918 CE), the Goryeo Period (918–1392 CE), the Joseon Period (1392–1910), and the Japanese Occupation Period (during which Japan occupied Joseon/Korea, 1910–1945), and the characteristics of each dynasty and the life of the people within them were described. Thus, for a total of 32 hours over two weeks, four teaching methods were used in teaching Korean history. Afterwards, the students were asked which method was most effective. 61 New Measures for the Improvement of History Education Table 5. Which teaching method was most effective for you? ( n=180). % Category Before the Study After the Study CHTM 30% 41% AVTM 38% 30% HLTM 27% 26% RMTM 5% 3% What is interesting here is that the students’ opinions on which teaching method was most effective changed as a result of the treatment. Beforehand, the students had chosen the AVTM as the most effective method (38%) for understanding Korean history, while afterwards they chose the CHTM as most effective (41%) and the AVTM as second most effective (30%). Table 6. Which teaching method did you like most? (n=180). Category CHTM First-Year Students Second-Year Students Third-Year Students Fourth-Year Students b a b a b a b a 19% 30% 32% 45% 33% 42% 35% 46% AVTM 34% 23% 43% 30% 38% 34% 33% 32% HLTM 37% 42% 17% 22% 25% 20% 27% 19% RMTM 10% 5% 8% 3% 4% 4% 4% 3% Note: b = before the study, a = after the study A similar change to that found in the students’ views of the most effective teaching method was also found in their preference regarding the teaching methods. Among the first-year students, the HLTM was preferred (42%), as before the study. However, the initial second choice, AVTM, was reduced from 34% to 23%, whereas the CHTM increased from 19% to 30%, i.e., 11%, bringing it into second place and constituting a larger increase than that for the HLTM (5%). Both the second- and third-year students saw bigger changes: before the treatment, they liked the AVTM most (second-year students: 43%; third-year students: 38%). Afterward, they preferred the CHTM (second-year students: 45%; third-year students: 42%). Thus, while the AVTM appears to stimulate these students’ interest to some degree, the CHTM seems most effective in helping them understand both Korean and Chinese history. The fourth-year students also preferred the CHTM on the posttest, with a rise of 11% to 46% from 35% before the study. Moon Hyoung-jin, Nam Jong-ho,Kim Yong-deog 62 Thus, the results of this study show that the comparative teaching method, which compares the histories of two countries from both countries’ perspectives, was found to be most effective in helping the students understand the history of neighboring countries, with which they may have had conflicts in the past, and thereby it seems to raise hope for reducing cultural conflicts between countries. According to the qualitative investigation, the Chinese students tended to express an adverse reaction to the Korean history teaching method that emphasizes the superiority of Korean history, as their prior knowledge acquired in China had led them to different beliefs. However, after being taught with the use of the CHTM, they became aware of discrepancies in the versions of Korean history taught in Korea and in China, and as a result their understanding of Korean history was enhanced. These positive outcomes may have contributed to reducing mental conflict regarding class material among the respondents and facilitated their acquisition of the knowledge of Korean history. To find out more about the effects of the CHTM, this study therefore asked the students why they preferred this method. Table 7. Why do you like the comparative teaching method most? ( n=180). Category % The method helps me see discrepancies 21% The method can reduce cultural conflicts 35% The method helps me see history objectively 38% The method broadens my viewpoint 6% Table 7 shows that the respondents thought that the CHTM helped them understand history more objectively rather than seeing it from a subjective perspective that reflected national ideology; in this way, it expanded their viewpoint to accommodate the perspectives of other countries. In summary, the comparative teaching method seems to have led to positive outcomes for these Chinese students’ understanding of Korean history. Conclusions This study was conducted to identify more effective teaching methods for improving Chinese students’ knowledge of Korean history, after a survey investigating the respondents’ knowledge of Korean history (and showing gaps in it) and their preferred teaching methods. After the students (of all academic years) New Measures for the Improvement of History Education 63 had had two weeks of lectures using each of the four teaching methods, an investigation was conducted to find out (on the basis of pre- and post-data) which teaching method the students preferred and which they felt was the most effective in helping them understand Korean history. The results showed that the AVTM (for second- and third-year students), the HLTM (first-year students), and the CHTM (fourth-year students) were initially preferred. However, after two weeks, the second- and fourth-year groups preferred the CHTM; the first-year students also showed an increased preference for the CHTM, although the HLTM remained their favorite. This seems to indicate that the CHTM was most effective in helping these Chinese students to understand Korean history and accommodate the Korean viewpoint. As discussed above, history textbooks tend to describe a country’s own history from a self-centered perspective, and history education also tends to emphasize the superiority of “native” history. These approaches may lead to the delivery of conflicting information from the perspective of foreign students. This phenomenon can be observed more often in countries that have or have had antagonistic relationships. Thus, the results of this study also imply that discretion should be used when teaching Korean history to non-Korean students, particularly from the countries in the same cultural sphere as Korea, which may have their own long-established perspectives on historical events. In ancient times, China and Korea sometimes had a cooperative relationship and sometimes a relationship of conflict, even war. As a result, each country’s ways of recording and telling this history have come to emphasize its own superiority, which may hamper students from the other country (or third countries) from accommodating the history at issue. According to this study, the CHTM holds the most promise out of several teaching methods in helping Chinese students accommodate the Korean view on history. References Baildon, M., Loh, K.S., Lim, I.M., Inanç, G., & Jaffar, J. (2013). Controversial history education in Asian contexts. New York: Routledge. Beauchamp, E.R. (2002). Comparative education reader. New York: Routledge. Choi, G., & Moon, H. (2006). Descriptions of modern Korean history in Chinese history textbooks (1949–2003). History & Culture Research, 24, 392–399. Hans, N.A. (2012). Comparative education: A study of educational factors and traditions. New York: Routledge. 64 Moon Hyoung-jin, Nam Jong-ho,Kim Yong-deog Kandel, I.L. (1959). The methodology of comparative education. International Review of Education, 5 (3), 270–273. Kim, J., & Jeong, Y. (2004). Korea and Korean history in recent Chinese history textbooks for middle and high schools. Research on Contemporary Chinese History, 23, 178–179. Lange, M. (2013). Comparative-historical methods, Washington DC: Sage Publications Ltd. Lee, H. (2004). History education using audiovisual materials. Seoul: Hyeahn. Lee, G. (2005). The trend of research on modern Chinese history, China’s Northeast project and Sinocentrism. Seoul: Goguryeo Research Foundation. Moon, H. (2011). Exploration of various educational measures for Chinese students in teaching modern and contemporary Korean history. Chinese Research, 51, 66. Moon, H. (2012). The necessity and effectiveness of teaching the history of Joseon Dynasty to Chinese students studying in Korea. Chinese Research, 54, 66. Moon, H. (2013). An investigation of diverse educational measures for the teaching of Korean history to Chinese students studying in Korea. History and Culture Research, 45, 300–301. Ministry of Justice, Republic of Korea. (2013). Monthly statistical report on immigration foreign policy. Seoul: Ministry of Justice. National History Compilation Committee. (2007). Korean history for high school. Seoul: Gyohaksa. Oh, B. (2001). Description styles and perception of history in history textbooks for middle schools in China. History Education, 80. Oh, J., & Gyo, J. (2011). Comparative linguistic research: Korean and Chinese languages as foreign languages. Seoul: Parkyijeong. Park, J. (2003). History education on modern and contemporary Chinese history and Sinocentrism 2: Focusing on the issue of integrating the nation during the People’s Republic of China period. Research on Modern and Contemporary Chinese History, 20. Renmin Educational Publisher History Office. (2003). Modern and contemporary world history (Vol. 1). Yanbian: Yanbian Educational Publisher. Renmin Educational Publisher History Office. (2004). Modern and contemporary world history (Vol. 1). Beijing: Renmin Educational Publisher. Sim, H. (1997). Lectures on Korean Annuals of Legislation. Seoul: Samyoungsa. Shin, J. (2005). Three countries’ perception of colonization: development or exploitation? The perception of modern history and history education by Korea, China, and Japan. Seoul: Goguryeo Research Foundation. New Measures for the Improvement of History Education 65 Yu, Y. (2005). Perception of Korean history and Sinocentrism in history textbooks for universities in China. China’s Northeast project and Sinocentrism. Seoul: Goguryeo Research Foundation. Enrique Sánchez Acosta, Juan José Escribano Otero, Gabriela Christie Toletti Spain Peer Review Experiences for MOOC. Development and Testing of a Peer Review System for a Massive Online Course Abstract Although at first MOOC (Massive Open Online Courses) did not use peer reviews, this kind of assessment has increasingly demonstrated the benefits that it can contribute to this type of course by improving the learning process, increasing decisions making abilities, and developing several other academic skills. Other MOOC assessment instruments do not provide students with these opportunities. This paper discusses the results obtained by the most commonly used massive online course platforms, detailing their features and limitations, as well as the experience in the implementation and use of a peer review system for a course of more than 7300 students. This study also comments on how evaluation rubrics are created, along with the final results, and the impact of the inclusion of this type of evaluation in MOOC. Keywords: MOOC, evaluation, peer, automatism, massive It is first necessary to define and frame the concept of peer review, currently used by most scientific journals in the context of massive online courses. The evaluation system of scientific work by community members called peer review or referee system is a process that begins when a scientist submits an article to a magazine editor with the intent of it being published. Then selected specialists (referees) evaluate the quality of the work and determine if the product of research has potential for the stated purpose, or if some additional work has to be done before publication. (Mestaza and Cuevas, 2002) Peer Review Experiences for MOOC 67 However, in massive online courses such types of assessment have been distorted. It can be seen from the above definition given by Cuevas and Mestaza, how the word “specialist” is specified; however, in online courses students themselves are often the ones who try to evaluate their peers. To demonstrate that these evaluations are equally valid as if they were conducted by a specialist, current MOOC supported platforms are based on the large number of evaluations of an exercise that these students can perform to determine a more accurate rating. Thus, virtually all platforms support these types of assessment, and they all allow for increasing the number of times some work is evaluated to a number superior to two. It is difficult to frame peer reviews within the assessment instruments used in MOOC, therefore in order to better define the peer evaluation process, a division of assessment instruments into three basic types is proposed: Automation based tools These tools or assessment instruments are based on automatic programs that analyze the responses with tools that implement a default correction algorithm. With these tools, reliability of correction is pursued so that the same answer will receive the same evaluation every time it is subjected to automation. There are different types of instruments that can fit in this category, but the key feature is that they do not require human intervention, making them particularly suitable to be used in MOOC. Examples might be: multiple choice tests, automatic evaluation of problem sets, programming tasks, surveys and questionnaires, attitudes rating scales, written exams, troubleshooting, comparison charts, and images. In free writing responses, semantic analyzers can be used with or without dictionaries and thesauruses. MIT (Massachusetts Institute of Technology) is conducting research (for their Edx platform) on various Text Analysis Systems or AEG (Automated Essay Grading) (Markoff, 2013) to allow for essays and written tests to be also automatically evaluated. This approach, of course, also has plenty of detractors like those grouped within HumanReaders.org. This group has already gathered more than 4,000 signatures of professionals from different universities around the world. They are carrying out a call to all schools and universities to stop using automatic correction tools for written work, especially in the case of written exams or tests that are critical for student graduation. Their main argument is that computers cannot read and cannot measure the essential elements of written communication such as: 68 Enrique Sánchez Acosta, Juan José Escribano Otero, Gabriela Christie Toletti accuracy, reasoning, matching evidence, common sense, ethical stance, deciding if an argument is compelling, organization of concepts, clarity, and accuracy, among other things. (“Human Readers,” 2013) However, there are several of these types of systems currently on the market and we should not forget that machines are much more consistent and can evaluate a larger number of items in a shorter period of time (Ezeiza, A, 2013). Currently, these systems combine algorithmic methods of grammatical analysis with sematic analysis, and holistic methods based on word searches. For example, the Summary Street System (Steinhart, 2000) compares summaries with the original text, or the Computer Learner Corpora (Granger, Hung, and Petch-Tyson, 2002) compiles a database of students’ texts to compare and analyze other written work. The e-rater (Attali and Burstein, 2006) combines statistical analysis and natural language processing to contrast the results with its database; it examines grammar issues, discourse markers, and lexical content using about 100 indicators. The results are supposed to have a success rate between 84% and 94% compared to human evaluators. This system is driven by ETS (Educational Testing Service) to develop the Criterion program. ETS uses this system in well-known TOEFL tests (Test of English as a Foreign Language), matching machine with human evaluator only for some specific tests, which saves a significant amount of money (Knoch, 2009). Tools based on authority These are the tools which involve a professional or a person skilled in the field. They are very difficult to implement in a MOOC, mainly due to the large number of students enrolled in the course, so this type of evaluation would require an enormous amount of time from a professor or professors. However, sometimes these corrections are delegated to dynamic adjunct instructors who energize and support students. The problem of evaluation criteria disparity appears when a large group of professors is in charge of correcting instead of just one professor, this could make the same response receive very different evaluations depending on the faculty member evaluating and even depending on when the faculty member performs the evaluation. To alleviate this problem, it is possible to apply very sophisticated evaluation rubrics that determine more objective corrections, parameters, and descriptors. But in the end, human beings evaluate largely based on intuition. Some authors argue that evaluators’ previous experience and knowledge are more valuable and relevant than any descriptor or rubric. Therefore, rather than spending hours and studies to build reliable and valid rubrics, they Peer Review Experiences for MOOC 69 believe that it is more profitable to spend that money and effort on preparing people who can evaluate tests, reach a degree of agreement, and handle scales (Ezeiza, A, 2013). Some assessment activities that require evaluation tools based on authority are: seminars, workshops, practice exams, interviews, debates, and co-evaluation of activities in cMOOC. Tools based on social interaction Undoubtedly, the communication potential of social networks is still largely undiscovered and should be studied more in depth (Guerrero, 2010). Currently, this potential is being introduced in the education system, maximizing the opportunities offered by social networks not only in terms of MOOC, but also as a support tool for traditional classes. Some instruments that fit in this system of social interaction are: anecdotal evidence, portfolios, collaborative Wiki, gamification or motivation based on collaborative games, surveys and questionnaires, chats and forums, projects, workshops, tasks, exercises, activities, and generated knowledge or collaborative learning in cMOOC and xMOOC. Based on this data, peer review based tools could be placed between social interaction tools and authority-based tools. However, given that a key part of authority-based tools is that the evaluator should be skilled in the subject matter, it would be more accurate to say that peer review systems constitute MOOC assessment tools based on social interaction. Students are peers and therefore cannot be considered authority. Furthermore, in the experience that will be detailed in this study, many of the students commented on the forum about the difficulty involved in evaluating work about something they were learning. Need for the study The MOOC high dropout rate makes it necessary to study how to keep those students throughout the course and ensure their learning. But the question that comes into play is whether it is better to decrease the dropout rate or to improve the quality of learning, a question asked by most of the institutions that venture into online teaching. The current abandonment rate of MOOC is hovering around 95%, but this may also be due to the “curiosity” that these online courses are generating. Many students register because they want to know what MOOC is and current statistics do not show this data. It would be interesting to include in the 70 Enrique Sánchez Acosta, Juan José Escribano Otero, Gabriela Christie Toletti records a checkbox to indicate if the student just wants to try or audit the course. This could improve statistics, at least at these early stages in which MOOCs are giving rise to so many expectations (Acosta, 2013). Hypothesis This experiment was performed to determine whether the use of the peer assessment tool is useful or not to reduce the high dropout rate currently experienced in massive online courses. Methodology In order to find a valid answer to the question in the hypothesis, a peer review task was included in a MOOC about videogames with more than 7300 students. Thanks to this broad and diverse sample of students (cf., Figures 1, 2, 3 and 4) the possible extension of these results to other massive online courses can be ratified. The experiment was conducted on a platform where many other Spanish massive courses exist, some with tasks in pairs and others not. Studies on other platforms (Jordan, 2013) show that most MOOC feature self-assessment (usually relegated to a single type of assessment tool, such as multiple choice tests) and/or peer reviews. • 24 - MCQ (Multiple Choice Questions) and evaluation by peers • 114 - MCQ (Multiple Choice Questions) only • 10 – Evaluation by peers only • 7 – Other The course was divided into 6 modules with a series of about 10 lessons for each module accompanied by a video for each lesson. The peer review task was introduced in the second module and even though it was mentioned in the initial plan of study or syllabus, several students had not noticed it and therefore they were taken by surprise, which emphasized a decline in the performance of these tasks during the first weeks of the course. Students were warned that completion and grading would be held during the next two weeks following the beginning of a module and they had to assess at least a student to be graded within the platform. Yet, there were many completion problems because they thought they would have to complete the evaluation until the end of the course. Peer Review Experiences for MOOC 71 One of the main comments made by the students in the community of the course concerned how to evaluate peers. Perhaps the assessment rubric was not entirely precise and many options were left to interpretation. It is very important for the rubric to be as specific as possible so that students are able to effectively evaluate their peers. During week 6 course statistics were recorded to see the evolution of the activity over time and a final survey was conducted. Over 1200 students answered the survey. Results Having seen the methodology used in the experiment and that the sample was large enough to refute its reliability, the next step was to detail the most relevant statistical data of the experiment in terms of the peer evaluation tool that was being studied. First, it seems relevant to compare the completion of the modules among each other, because, as stated above, only one peer review technique was introduced in Module 2. This may give an idea of the difference between this type of assessment and others used in the course, such as multiple-choice questions (cf., Table 1). It can be observed graphically (cf., Figure 5) how that type of evaluation causes a slight deviation in the completion of the module. Still, it is much more interesting to look closely at this tool within Module 2, because if all modules are mixed, it is possible that other lessons that do not contain peer reviews may mask the statistics of this assessment instrument. During the last week of the course, substantial differences could be observed between the rest of the lessons and the one which contains the peer review (cf., Table 2), although perhaps more detail can be observed in Figure 6. From this data, one can already draw interesting conclusions regarding this type of assessment tool in relation to the completion rate of MOOC. Throughout the various stages at which the students had been completing the studied activities, there had been a significant decrease in the completion of peer evaluation activities. Upon completion, this course granted two types of certificates supported by the platform and by the university offering the course. One of them was the certificate of participation, granted to all the students who exceeded 75% of the course, while the other certificate of achievement was given to those who completed 100% of all the activities. Therefore, all those who were unable to complete the peer review task on time were left out of this certificate 72 Enrique Sánchez Acosta, Juan José Escribano Otero, Gabriela Christie Toletti of achievement, decreasing by far what would have happened if this type of evaluation had not been included. It should be noted that this certificate had cost 40 euros. These fees could fund course costs; therefore a decline could greatly affect the financing of MOOC. With all these results one can get an idea of what students are willing to do in order to complete a massive online course, however at the end of this experiment a survey was sent with different questions about the course and some were highly significant (cf., Figure 7 and 8), these questions were answered by over 1200 students. Conclusions From the data obtained in the above study, one can respond negatively to the hypothesis of this experiment. That is to say, the use of peer reviews adversely affects the completion rate of MOOC. This does not mean that learning is of a higher or lower quality, but rather that if the objective is only to increase the completion rate, it is best to avoid these types of assessment instruments. This experiment also served to improve some course implementation guidelines that are currently being considered for the next version of the course that will begin shortly. For example, peer review activities should be maintained throughout the course as a way to accept and include students who get more interested in the course during subsequent weeks. Many students began at weeks 3 and 4 and therefore had basically no choice to perform the peer review task. Furthermore, platforms should improve this type of assessment instruments. Many of them are not taking into account that some students were not assessed because on some occasions the students who were supposed to conduct the review did not do it. When that happens the task should be given immediately to another student until the work is assessed. It should not happen that students who perform a task are not assessed. Another point to consider is that the assessment rubric should be very accurate; many students relied on their intuition to assess rather than using the rubric. Many tasks were not properly evaluated because the students were not skilled in the subject matter. The student should take the role of a “robot” that does not know anything and needs to receive all the guidelines necessary to perform a proper assessment. It must be assumed that the student is learning and therefore does not know much. Better than a rubric, the student could receive a small algorithm to be followed step by step to allow careful evaluation of the content, indicating, e.g., what Peer Review Experiences for MOOC 73 constitutes minimum content, in how many parts content should be divided, what to do if any of the main parts are missing, and what score to assign to each section. References Attali, Y., & Burstein, J. (2006). Automated essay scoring with e-rater® V. 2. The Journal of Technology, Learning and Assessment, 4(3). Cuevas, R.F., & Mestaza, M. (2002). La evaluación científica y el sistema de revisión por pares. CSI Boletín, 46. Ezeiza, A. (2013). ¡Horror! ¡Me evalúa un Robot! Boletín SCOPEO No 85. Retrieved from http://scopeo.usal.es/horror-me-evalua-un-robot/ Granger, S., Hung, J., & Petch-Tyson, S. (2002). Computer learner corpora, second language acquisition, and foreign language teaching (Vol. 6). John Benjamins. Guerrero, C.S. (2010). Aprendizaje cooperativo e interacción asincrónica textual en contextos educativos virtuales. Pixel-Bit: Revista de Medios Y Educación, (36), 53–67. Human Readers. (2013). Retrieved November 6, 2013, from http://humanreaders. org/petition/index.php Jordan, K. (2013). Synthesising MOOC completion rates. MoocMoocher. Retrieved July 24, 2013, from http://moocmoocher.wordpress.com/2013/02/13/synthesising-mooc-completion-rates/ Knoch, U. (2009). Diagnostic writing assessment: The development and validation of a rating scale (Vol. 17). Peter Lang. Sánchez Acosta, E. (2013). MOOC: Resultados reales. Elearningeuropa.info. Retrieved from http://elearningeuropa.info/en/article/MOOC:-Resultadosreales Steinhart, D. (2000). Summary street: An LSA based intelligent tutoring system for writing and revising summaries. Unpublished Doctoral Dissertation, University of Colorado. 74 Enrique Sánchez Acosta, Juan José Escribano Otero, Gabriela Christie Toletti Tables Table 1. Completion Statistics by Module Design, Organization and Evaluation: Evaluation of videogames and gamification. There were 7,386 registered users 5689 people started the course and 807 completed it Number of students who started Number of students who finished Mo 0. Presentation of the course 4826 4825 Mo 1. History and development of videogames 5373 4211 Mo 2. Designing a videogame 4004 1349 Module Mo 3. Roles within the industry 2782 2365 Mo 4. Funding and distribution: The long road 2254 1996 Mo 5. Game review and evaluation. Game as art 1929 1671 Mo 6. Gamification and current trends 1521 1249 Table 2. Module 2 lesson statistics Activity Started Approved Average Grade Topic 1: A reasonable doubt 3873 3870 100 Questionnaire: A reasonable doubt 3848 3776 99.683 Topic 2: What is NOT game design? 3833 3831 100 Questionnaire: What is NOT game design? 3773 3728 99.706 Topic 3: Establishing forms 3771 3769 100 Questionnaire: Establishing forms 3705 3662 99.836 Topic 4: What can we do with all this? 3674 3673 100 Questionnaire: What can we do with all this? 3624 3583 99.833 Topic 5: Generating decision making 3602 3599 100 Questionnaire: How to generate decision making 3565 3525 99.887 Topic 6: Let’s talk about design with a theoretician: Keith Burgun 3562 3561 100 Topic 7: Levels; the other side of design 3456 3456 100 Questionnaire: Levels; the other side of design 3421 3380 99.941 Topic 8: Miyamoto-San’s Master class 3425 3424 100 Questionnaire: Miyamoto-San’s Master class 3384 3348 99.91 75 Peer Review Experiences for MOOC Activity Started Approved Average Grade Interview with Raúl Rubio 3378 3376 Interview with Lucas González 3209 3208 100 Peer2Peer Activity 1406 1360 86.186 Additional Documentation 2950 2947 100 Figures Profile: Professor/ University researcher 8% Profile: I still have not started my University studies 13% Profile: Administration staff and University services 1% Profile: University student 40% my University studies 38% Figure 1. Profile of students to whom the peer review was directed 100 76 Enrique Sánchez Acosta, Juan José Escribano Otero, Gabriela Christie Toletti 0% 0% 5% 3% 25–34 18% 39% 18–24 35–44 45–54 0–17 55–64 65–+ 35% Figure 2. Age of students to whom the peer review was directed 2% 3% 1% 3% 6% Spain Colombia 8% Mexico Peru Venezuela 8% Argentina Ecuador 69% Others Figure 3. Nationality of students to whom the peer review was directed 77 Peer Review Experiences for MOOC Women 18% Men 82% Figure 4. Gender of students to whom the peer review was directed. 6000 5000 4000 3000 2000 1000 0 1 2 3 How many started 4 5 How many finished Figure 5. Module completion comparison 6 7 Enrique Sánchez Acosta, Juan José Escribano Otero, Gabriela Christie Toletti 78 4500 4000 3500 3000 2500 2000 1500 1000 500 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 Started 3873 3848 3833 3773 3771 3705 3674 3624 3602 3565 3562 3456 3421 3425 3384 3378 3209 1406 2950 Finished 3870 3776 3831 3728 3769 3662 3673 3583 3599 3525 3561 3456 3380 3424 3348 3376 3208 1360 2947 Figure 6. Peer assessment comparison within the module Summary or essay 6% Multiple choice Matching Short answer True/False 67% 4% 9% 15% Figure 7. Survey results regarding types of exercises. 79 Peer Review Experiences for MOOC 38% Massive course with little professor interaction (38%) 62% Limited course with direct professor interaction (62%) Figure 8. Which types of online course do students prefer? Yun Eun Kyeong Korea Teaching Arabic to Korean Students Using Films* Abstract This research aims to study the application of using films in teaching the Arabic language to Korean students. Recently, level based classes and developing communication skills are becoming important goals in foriegn language education. The most effective way to develop the student’s communication skills is to expose them to real life situations and related resources. Films are replicas of real life situations and thus are effective especially in teaching spoken language. This research implies the following things to Arabic education. First, it is best to provide realistic data to students to improve their communication skills. Selecting films that contain conversations and expressions that are used every day, while avoiding violence or contents of too much slang, will allow students to continuously remain interested and focused. Second, a program that connects films to CD-ROM for textbooks needs to be created. Additionally, there is a need to increase the understanding of spoken language through various study programs for Korean teachers. Finally, using interesting films to motivate students will have positive effects and will allow them to approach Arabic through understanding of the language rather than pure memorization. Keywords: Arabic language, teaching method, films, communicative skills Introduction With the rapid globalization of society in Korea, an easier flow of foreign cultures has led to an increase in the importance of foreign language education. * This paper was supported by the Hankuk University of Foreign Studies Research Fund. Teaching Arabic to Korean Students Using Films 81 Furthermore, the Korean Ministry of Education has recently revised the 7t Education Curriculum in the effort to increase the communication skills of learners based on language education. However, the field of Arabic education has been slow to adapt to these changes, and to this day, the main methods of education have been based on grammar-translation and audio-lingual methods. The primary purpose of language is to communicate. When a person communicates, they do not speak as if reading a book. Rather, they would speak in a tone varying according to the situation and the listener. However, this process does not come naturally for someone who is learning a foreign language, and it requires continuous practice and training. From this, we can see that learning spoken language is an important aspect of communication skills and that the contemporary education system, which is focused more on grammar, has limits in providing solutions to problems concerning communication. Learning written language is also an important part; however, the main problem arises when there is no balance between teaching written and spoken language. Therefore, creating a teacher-student model and continuously studying for even a short amount of time a day may partially solve the problem of communication skills. Porter and Roberts (1981) said that in order to increase communication skills, it is best to expose the learner to real life situations. However, it is not easy to expose students to such environments. Although films may not expose one to such environments in real life, they provide a replica of real life situations and can be an effective tool in teaching foreign languages. Furthermore, watching films can be a fun way to learn, which makes students interested and focused, and this will positively influence their learning of foreign languages. This research aims to study the application of films in teaching foreign languages in Arabic education. Recently, level based classes and developing communication skills are becoming important goals of foreign language education. However, classes related to spoken language are not being offered. Therefore, Korean students are unable to speak even the basic sentences, despite the long term of foreign language education. The most effective way to develop the student’s communication skills is to expose them to real life situations and related resources. Films are replicas of real life situations and thus are effective especially in teaching spoken language. Therefore, the goal of this research is to provide teaching methods focused on utilizing films in a multimedia education environment to teach the Arabic language to Korean students and develop their communication skills. 82 Yun Eun Kyeong Theoretical background Films are widely used as teaching material, because they include everyday conversations that occur between native speakers and these conversations give us a sense of the environment. Furthermore, with the advancement in computer technology, media, and DVDs, it has become easier to use films in the field. Therefore, through films, students can understand the society and culture of the country through first-hand experience and develop their communication skills with the understanding of the environment they can be in. Geddes and White (1978) stated that if the realistic data contain everyday conversations or expressions, then the conversations can be categorized into 2 types. The first type is ‘unmodified’ conversation, which occurs in everyday life. The second type is ‘simulated’ conversation, which is used for education purposes and has a high chance of occurring in daily life. Porter and Roberts (1981) stated that in order to expose the learner to real-life conversations, it is crucial to use credible data to help students avoid the imbalance between spoken language and listening skills. It is also hard to expect students to exercise the types of conversation they have never been exposed to before. Both types of conversation which Geddes and White mentioned are included in films, therefore selecting the right films is important and it will be an excellent resource for the conversation education. Kim Hyun Sook (2004) pointed out that for a more desirable method of language education films have the following characteristics. • First, films not only allow students to be exposed to a variety of views and characteristics of different situations, but they make them adapt. • Second, similar situations appear in different films, so watching films allows for the accumulation of language and information. • Third, there is a consistent progression of development in culture, and watching films will help students to keep up with the change. • Fourth, they help students build mobile communication skills, as mobile communication is being increasingly used in business settings as it transcends space and time. • Fifth, speed control allows students to watch again the scenes that might have been missed. • Sixth, composition in a chronological time frame helps students to understand the full situations. • Seventh, accumulating new information is made easier. • Eighth, images act as a strong emotional stimulant providing realism and liveliness. Teaching Arabic to Korean Students Using Films 83 With such characteristics, Butler-Pascoe and Wiburg (2003) presented specific examples of teaching and learning. For instance, with the students learning English, we can start by showing the first scene of the movie, ‘The River Runs through It’. The teacher can show a scene to the students and ask them to predict what will happen next. In the first scene, where the children ride a boat on the top of the waterfall, the teacher can turn the sound off and ask one group of students, who have already seen the scene, to guess what the characters were saying. Then, the teacher can ask another group of students, who have only previously heard the sound without any images, to guess what is going on. The students who have watched the scene will give better responses compared to the students who have only heard the sound. This can explain the positive effects of using images in language learning. Additionally, Bumpass (1963) said that if the linguistic level of students hinders them to absorb a large amount of language information, it would be more effective to choose a film with the story that can easily be understood just by looking at the images. Therefore, the selection of films must be made in accordance with students’ level of advancement. Advantages and disadvantages of using films as teaching material Advantages Using films for educational purposes has the following advantages: • The characters that appear in films use realistic language. • The stimulating effects provide students with motivation to stay focused. • Images allow for maximizing the effects of learning. • Other, non-verbal, forms of communication can be learned (gesture, culture, etc.) • Understanding the film itself can help with understanding the culture. • Sharing similar experiences will help students to learn the proper language used in those situations. Disadvantages Using films for educational purposes can have the following disadvantages: • There is a high possibility that students will focus on the fun aspect of watching the movie, and not the learning one. • The film director’s subjective thinking may influence students. • A long preparation time is required to provide effective teaching. 84 Yun Eun Kyeong Methods to overcome disadvantages To overcome the limits of films used as a teaching tool, the teacher must pick a film in advance and consider the student’s language skills, culture, and connections between the learning processes. To prevent students from becoming distracted, teachers must insist on their active participation. After watching a film, in order to reinforce the contents of the film, students should summarize the story of the film or it can be watched again. It is crucial to assess whether students have acquired linguistic, grammatical, or cultural information. Based on these, the teacher can coordinate the quantity and contents to assess the students’ achievement. For effective teaching, the teacher should edit and process the resources which will allow students to acquire language information in a less passive manner. An example could be selecting several scenes which will draw students’ attention, in order for the students to understand and to actively participate. Furthermore, to overcome the problems that arise from listening skills and difficult contents, the script can be provided to prevent lack of understanding and distraction. Films as reflection of reality There is no doubt that a film will provide motivation and allow students to acquire information on language, society, and culture. Also, considering that films are created for the understanding of culture and its members, the cultural ‘reality’ cannot be questioned. However, as all fiction carries a subjective view of reality, films may or may not support realism. Furthermore, films are not created for the purpose of education, thus preparation is required to use selective material for educational purposes. During the preparation stage, a discussion is needed in order to select the right film to use, and the main purpose would be to aid students with speaking and acting in a proper manner. Additionally, it needs to be considered whether students can relate the story with their surroundings. In foreign language teaching, the realism of a film refers to whether it can be used for education or not. Here, the expressions and understanding through the film is more important than grammar and structure. Teaching Arabic to Korean Students Using Films 85 Using films in teaching Arabic To be considered in advance Regarding Arabic learning, a course titled ‘Screen Arabic’ may be created and films can be used as reference data. However, we must always remember the following two things in using the variety of methods: • Films have independent characteristics (imagery and sound collaboration, characters, scenery, etc.) • If films can be used for educational purposes, it is because people enjoy watching them. (Baddock, 1996) Films draw attention through their linguistic information, storyline, subject, culture, and social aspects. In any case, our decisions regarding the use of films in class must be in coordination with our goals, and they must be appropriate to the students and set within our time frame. Written Arabic & Spoken Arabic The languages used in films also differ by their genre. In other words, the lines used in comedy and drama will not be the same. Different nuances will exist, and moreover, the relationship between spoken and written language must be considered. Spoken language differs depending on its formality. However, the conversations in films use spoken language and we can find a complex relationship of spoken and written language within them. In reference to Gregory and Carroll’s (1979) language varieties and their social contexts, we can see the following: (a) Text which imitates spoken language as if it has never been transcribed (b) Text with both spoken language characteristics and written language characteristics (c) Text not written for dictation purposes, such as diaries or letters (d) Text written to be read in grammatical form (letter dictation) (e) Text written to be read (Interview or discussion transcription) (a) and (b) are the most common types of conversation that occur in films. Scripts such as (e) suffice the conditions of (a), and scripts such as (d) are close to (b) but without fully removing the grammatical nuances. (c) and (d) are not that hard to find in films, but on the other hand, (e) is a result of transcribed media. In conclusion, whilst preparing a film to be used as teaching material, planning and studying of the various linguistic situations needs to be considered. 86 Yun Eun Kyeong Using subtitles Using subtitles is always a question arising in class. Without subtitles, it would be difficult to understand a film. It would also lead students to concentrate more on the images of the film and make conclusions through imagination. However, it will allow for noticing of the characteristics of languages, which would have been easily dismissed if subtitles were present. Watching films with subtitles might interfere with the understanding of the spoken language, because students will focus on the grammatical structure. However, for scenes which are difficult to understand, subtitles could be useful and the teacher can ask the students what they have understood. If Korean subtitles were shown to students, they will naturally compare them with the spoken language and it will thus increase their interest in the language. However, this could be both an advantage and a disadvantage. In exceptional cases, films with original language subtitles can be used. Using transcribed spoken language in class allows students to understand the expressions and linguistic styles more easily. However, the effort of understanding must precede this. Example of using films in Arabic teaching Arabic film title applied language study model A model based on the previous theory has been created, which can be used in actual lectures. Figure 1 is based on Lee Choong Hyun’s (2005) CALL lecture model, and it was modified for this purpose. Lee Choong Hyun (2005) stated that multimedia alone cannot be used as lecture data or as a replacement of teachers, and thus it emphasizes the importance of teaching methods. First, before watching a film, students need to prepare by revising the previous material and getting used to certain expressions. The students will watch a part of the film, acquire information, and practice pronunciation, which will improve their communication skills. Video study is more effective if it is done repetitively and if audio and video can be separately presented to students without subtitles. Individual study and partner/group study can be used appropriately, and for intensive and revision studying, expressions can be learned through related web-sites. At this point, students must be encouraged and all questions must be answered. Finally, in order to organize what they have learned after watching the film, students can conduct role plays and simulations to apply it to real life situations. 87 Teaching Arabic to Korean Students Using Films Student Pre-film watching Film watching Teacher Suggest topic, brainstorming etc Expressions and keyword studying Film watching Video study Acuire information Individual study Pronunciation practice Partner/Croup form Post-film watching Role play, simulation, debate, evaluation, assignment Figure 1. Arabic film title applied language study model. Through this activity, the students can store the information they have added through the film to their existing knowledge. Teachers will need to prepare related web-sites beforehand and conduct the class smoothly. Guide plan for Arabic lessons using the film ‘Paradise Now’ Based on Figure 1, a guide plan example is shown in Table 1 below. Table 1. Guide plan for Arabic lessons using the film ‘Paradise Now’. Purpose of study – Familiarize with communication skills through spoken language used in film. – Increase listening skills through authentic data – Based on listening, improve the 4 language skills through post activities. Preparation Hardware: PC, Projection TV, internet installation Software: Power point, ‘Paradise Now’, linguistic learning machine Stage Learning content Time/tool Pre–film watching – – – – – – – 15 minutes/ Power point, Projection TV Attendance check Unit introduction and proposal of lesson aim Propose lesson aim Brainstorming: personal experiences related to topic Learn expressions and idioms: related to topic Introduce activities Propose specific instructions and contents through PPT Yun Eun Kyeong 88 Film watching Listening to conversation (group or individual study) Film watching – Watching video without audio: guess overall story – Listen to audio without video: confirm whether guesses were correct – Watch video with audio: Understand general and specific conversation contents – Check for any misunderstanding Film watching Acquiring information (individual study) Film watching – Acquire information related to video: leave blanks for useful expressions and fill them out after watching – Propose subtitles: After acquiring information, propose English and Korean subtitles simultaneously Film watching Pronunciation practice (Whole study –> Group study) Film watching – Explanation of pronunciation: Explaining pronunciation of words in focus – Listening to pronunciation: Repetitively hearing pronunciation from video – Pronunciation practice: Record and listen to their pronunciation and practice Film watching Intensive and supplementary study (Individual study) Film watching – Using the internet: Using various listening web–sites and listening to appropriate texts according to each student’s level 15 minutes/ PC Post film watching – Role play and simulation: Apply script from film or modify to one’s situation, and conduct role play or simulation – Internet activity: Search for topic–related data on the internet and use for reading or writing – Evaluation: evaluate personal study 15 minutes/ PC, Projection TV 15 minutes/ Projection TV 15 minutes/ PC 15 minutes/ PC Recording wizard Recommended films for each level a) Beginner – ‘Kingdom of Heaven’ This movie triggers interest and is helpful for basic conversation. It is Ridley Scott’s 2005 debut film, which was directed in the US as a standard Hollywood blockbuster. But due to the appearance of Salah Al-Din, an Arab hero, basic Arabic is used. For beginner students, it is easy to learn basic phrases. Teaching Arabic to Korean Students Using Films 89 b) Intermediate – ‘Paradise Now’ This is a cheerful approach to serious reality, based on the Israeli-Palestinian conflict. The story is about two Palestinian suicide bombers, depicting a very serious matter. It shows that suicide bombers are not different from ordinary young men. c) Advanced – ‘The Band’s Visit’ It is a collaboration of English audio and Arabic subtitles. This film is about an Egyptian band inviting Israel to perform, and it shows what they encounter during their travel. Failing to reach their destination, they spend a night at a residence with people of different cultures and languages. The members use English in order to communicate. This is an interesting film for the students who understand both English and Arabic. Conclusions A film depicts the culture of a country, and as it is made with the use of its native language, it allows for effective learning of culture and language. Another strong advantage of using films in foreign language teaching is that you are able to learn spoken language without having to go to a given country. Therefore, it is necessary for us to prepare to use Arabic films efficiently to teach Arabic. Also, through such methods, while overcoming the disadvantages, more research needs to be conducted. This research implies the following things to Arabic teaching. First, it is best to provide realistic data to students to improve their communication skills. Selecting the films that contain conversations and expressions that are used every day, while avoiding violence or contents of too much slang, will allow students to continuously remain interested and focused. Second, a program that connects films to CD-ROM for textbooks needs to be created. This will save time for teachers to prepare and edit films, and it will improve the communication skills of students. Additionally, there is a need to increase the understanding of spoken language through various study programs for Korean teachers. Finally, using interesting films to motivate students will have positive effects and will allow them to approach Arabic through understanding of the language rather than pure memo- 90 Yun Eun Kyeong rization. Especially students can effectively enhance personal studying through multimedia and the internet to practice listening, speaking, reading, and writing. Furthermore, a systematic teaching method is important; detailed models can be applied to the field of teaching, and continuous research needs to be conducted in the future. References Abd Alfataah Albajjah (2007). Ta‘ liim talaamidh mahaaraat qiraa’iayyah (Teaching reading skill to the students), Cairo: Daar fikr. Bae, Doobon (2006). A Curriculum of foreign language Education, Seoul: Hankukmoonhwa sa. Brown, H.D. (2001). Teaching by principles, New York: Longman, Inc. Brumfit, C.J. & Johnson, K. (1979). The communicative approach to language teaching, Oxford: Oxford University Press. Bumpass, F.L. (1963). Teaching young students English as a foreign language, New York: American Book Company. Butler-Pascoe, M.E. & Wiburg, K.M. (2003). Technology and teaching English language learners, New Jersey: Pearson Education, Inc. Chomsky, N. (1965). Aspects of the theory of syntax, MIT: MIT Press. Fakhr Aldiin Qabaawah (1999). Maharaat lughawiyyah wa ‘uruubat lisaan(Linguistic skills and Arabization of the tongue), Beirut: Daar fikr mu’aasir. Geddes, M. & White, H. (1978). The use of semi-scripted simulated authentic speech in listening comprehension, Audiovisual Language Journal. 16(3), 137 – 145. Hasan Shahaatah (1993). Ta‘liim lughah ‘arabiyyah bayna nazariyyah wa tatbiiq (Teaching Arabic, theory and application), Beirut: Daar misriyyah lubnaaniyyah. Hymes, D. (1972). On Communitive Competence. In J.B. Pride & J. Holmes (Eds.), Sociolinguistics, London: Harmondsworth Penguin. Jack C. Richards (2008). Curriculum Development in Language Teaching, Cambridg: Cambridg Press. Kim, Hyun Sook (2004). A study of teaching English listening skill using movies, M.A. thesis, Hankuk Univ. of Foreign Studies. Seoul. Larsen-Freeman, Diane (2011). Techniques and Principles in Language Teaching, Oxford: Oxford University Press. Teaching Arabic to Korean Students Using Films 91 Lee, C.H. (1998). The use of computers in foreign language teaching and learning effectively: Rethinking key issues, Journal of The Applied Linguistics Association of Korea, 14(1), 87 – 115. Lee, C.H. (1999). Why use or not use computers? Multimedia-Assisted Language Learning, 2(2), 9 – 46. Muhammad Bu Najmah (2005). Tadriis lughah ‘arabiyyah linaatiqiin bighayriha (Teaching Arabic to the non-native speakers), Rabat: Jaami‘at ’Akhawayn. Porter, D. & Roberts, J. (1981). Authentic Listening activities, ELT Journal, 36 (1), 37 – 47. Rushdi Ta’iimah (1998). Manaahij tadriis lughah ‘arabiyyah bita‘liim lassasi (Curriculum of teaching Arabic for the elementary level), Cairo: Daar fikr ‘arabi. Taha ‘Ali Husayn Dalimi (2003). Taraa’iq ‘amaliyyah fi tadriis lughah ‘arabiyyah (Practical methods of teaching Arabic), Cairo: Daar shuruuq linashr wa tawzii‘. Social Pedagogy Shwu Ming Wu, Cheng Hong Yang, Wan Chen Hsu Taiwan Validation of School Core Competence Scale for Undergraduates: Empirical Findings of Taiwan Case Abstract This study aimed to validate the 25-item School Core Competence Scale (SCCS) of the National Kaohsiung University of Applied Sciences. Item analysis and exploratory factor analysis were utilized with 368 undergraduates and confirmatory factor analysis with another 384 undergraduates. The SCSS had eight subscales, including Communication and Expression, International Perspective, Humanity, Civics and Morals, Professional Knowledge and Skills, Integrative Learning, Passion and Anti-stress, and Self-discipline. Results indicated that the SCCS is a valid and reliable instrument among undergraduates. Particularly, women scored higher on Communication and Expression, Civics and Morals, Self-discipline as well as the total scale. Keywords: School Core Competence Scale, validation studies, Taiwanese undergraduates. Introduction The term “core competence” is common in education literature as well as in economics and management (Holmes and Hooper, 2000). Core competence is defined by a set of learning outcomes (skills, competences, or qualifications) that each student should acquire during, and demonstrate at the end of, their period of studying at a higher education institution. Furthermore, when applied to education as a whole, core competence refers to facilitating the empowerment of people through learning how to acquire information (i.e., data), turning it into knowledge and skills (i.e., 96 Shwu Ming Wu, Cheng Hong Yang,Wan Chen Hsu useful, assessed, applied, ordered, and structured information), and applying such knowledge and skills to solve unique problems (Hu and Lin, 2011; Stewart, 1999). Thus, higher education should equip students with the core competences necessary to successfully compete in the job market and excel in their careers. However, according to a report from the Directorate General of Budget, Accounting and Statistics (DGBAS) of Executive Yuan (2013), 37.34% of all unemployed citizens in Taiwan hold a Bachelor’s degree. This represents the highest proportion of the unemployed population in Taiwan. Clearly, there is cause for concern over the function of higher education. In recent years, the Higher Education Evaluation and Accreditation Council of Taiwan have emphasized core competence acquisition as an important tool for evaluating school effectiveness (Higher Education Evaluation and Accreditation Council of Taiwan, 2010). The Ministry of Education (of the Republic of China [ROC]) (2009) enacted the University Teaching Excellence Project in order to move all institutions toward a student-centered environment, to promote student learning as the primary goal, and to nurture the development of core competences. In order for the project to succeed and according to school vision, it is essential to properly define the indicators of core competences. Core competence indicators constitute a method for testing and understanding students’ learning outcomes. Learning outcomes represent what a learner knows, understands, and is able to do after completion of learning. In order to develop core competences, educational institutions should focus on developing relationships with their students rather than supplying a single course curriculum. By providing the “best total experience,” institutions can develop solutions that suit the future learning needs of each student (Holmes and Hooper, 2000). Through the explicit promotion of learning outcomes, many schools have begun to develop instruments for measuring core competences in Taiwan. The Ministry of Education has been conducting the Teaching Excellence program since 2005. The Teaching Excellence program is a competitive program that aims to ensure that universities adhere to the guidelines of the Ministry of Education. It states that each university should seek to improve its own education program in accordance with the stringent standards of the Ministry of Education, by focusing on students’ core competences and then improving the university education program as a whole. Each project planning application process spans four years. Following approval from the Ministry, the university is awarded with excellence in university teaching grant. The National Kaohsiung University of Applied Sciences (KUAS) has received subsidies for nine consecutive years from 2006 to 2014 and ranked first among the technology universities of Southern Taiwan. 97 Validation of School Core Competence Scale for Undergraduates In recent years, promoting student learning outcomes has become an important policy at KUAS. To date, KUAS has developed appropriate validation measurements. According to the criteria of the Taiwan Training Quality System (TTQS), KUAS would be suitable for creating a measure of student learning outcomes, which made it a natural choice for the development of our School Core Competence Scale (SCCS). The TTQS for vocational education and training includes five factors (plan, design, do, review, and outcome) for implementing initiatives to enhance learning outcomes (Bureau of Employment and Vocational Training, Council of Labor Affairs, 2007). The authors used the five steps outlined above as the foundation of student learning outcome assessment. In this study, the authors reviewed background literature to develop the SCCS, and then conducted a survey using the SCCS to confirm its validity and reliability. Figure 1 shows the specific research process, represented by the dashed line section to the right. Education plays a significant role in ensuring that students acquire the key competences necessary to enable them to flexibly adapt to such changes. At present, however, a consensus school level student core competence framework in Taiwan needs to be clearly defined (Chanyang, 2011). In 2010, the European Centre for the Development of Vocational Training (CEDEFOP) explored the development of a competence-based learning outcome assessment method during vocational Vision Plan Goal Measure of School Core Competence Outcome Develop School Core Competence Scale Teaching Strategy Review Need for Curriculum M aterialIdentified Design Evaluation Survey and Feedback Curriculum Design Curriculum Implementation Do Figure 1. Framework for Developing the School Core Competence Scale. Shwu Ming Wu, Cheng Hong Yang,Wan Chen Hsu 98 education and training courses. As the vocational education system considers the effectiveness of learning when determining curriculum reform considerations, learning strategies developed from this perspective would not only assist in strengthening general school education and links to the labor market, but also would contribute to the school’s goals of achieving student-centered teaching (European Commission, 2010). In Europe, the origin and development of outcome statements is clear. As part of the 2010 Education and Training Program, the EU has also developed a set of key competences, working through expert groups representing the member states (European Commission, 2004). The descriptors used for the eight key competences are based on three categories, namely, knowledge, skills, and attitudes. Thus, competences were defined herein as a combination of the context of the KUAS school vision with the acquisition of necessary skills, knowledge, and attitudes. The EU has, for many years, developed key competence indicators for diverse student learning assessments. The presented study referred to and drew upon the competences from CEDEFOP (2009) and the EU (2004) to develop a number of dimensions of core competences for undergraduates at KUAS (cf., Table 1). Core Table 1. Dimensions of school core competence. CEDEFOP (2009) Instrumental competence EU(2004)/European key competencies 1. Learning how to learn 2. Mathematical literacy and basic competencies in science and technology KUAS school vision Dimensions of SCCS, KUAS Professional knowledge 1. Professional knowledge and skills 2. Integrative learning Macro-level perspective 1. Communication and expression 2. International perspective Work ethic Humanity Civics and morals Healthy personality Passion and anti-stress Self-discipline 3. Digital competence 4. Communication in mother tongue 5. Communication in a foreign language Interpersonal competence Cultural expression Interpersonal and civic competencies Systemic competence Entrepreneurship CEDEFOP = European Centre for the Development of Vocational Training; KUAS = National Kaohsiung University of Applied Sciences; SCCS = School Core Competence Scale Validation of School Core Competence Scale for Undergraduates 99 competences are multi-dimensional in nature. The purpose of this study was to utilize the KUAS school vision and the CEDEFOP (2009) and EU (2004) frameworks to develop the SCCS. In short, the main purpose of this study was to construct, test, and verify the SCCS developed at KUAS and then to evaluate the core competences of undergraduates. Methods Generating Items for the SCCS With consideration to the study purpose, all the items of the scale should reflect the latent variable that the scale aims to address. The student learning assessment committee at KUAS generated scale items. The authors reviewed a number of relevant reports (e.g., CEDEFOP, 2009; EU, 2004). In addition, three databases (ERIC, ProQuest, and Web of Knowledge) were searched to locate appropriate articles for review using the key word “core competence.” Only peer-reviewed articles written in English were included. Following the school core competences desired at KUAS, the student learning assessment committee selected 25 items to serve as SCCS content during the item generation stage. Items were rated on a 9-point Likert-type scale, ranging from strongly disagree (1) to strongly agree (9). Students were asked to select the response that most accurately described their self-concept. Most items were generated with a positive tone and started with “I can…” (cf., Table 2). Table 2. Items of the School Core Competence Scale. No. Item 1. I can communicate with others and effectively understand others’ thoughts. 2. I can speak/write Chinese or English, as well as other languages. 3. I can interact with others in harmony. 4. I can understand international issues and trends. 5. I can pay attention to environmental protection and the development of mankind. 6. I can respect disadvantaged groups and multicultural differences. 7. I can sustain attention or participation in arts and cultural activities. 8. I can realize the value of self-progress and stimulate motivation. 9. I can have the spirit to serve others, care for society, and help others. 10. I can uphold integrity and have the courage to promote good and combat evil. Shwu Ming Wu, Cheng Hong Yang,Wan Chen Hsu 100 No. Item 11. I can be cautious in distinguishing between right and wrong and always abide by ethical legal norms. 12. I can have a benevolent and courageous spirit and join with others to do good things, such as help the weak. 13. I can actively seek general knowledge, professional knowledge, and skills. 14. I can use technological knowledge and seek innovation. 15. I can collect, analyze, and integrate information in order to deal with professional issues. 16. I can dare to put forward my own unique insights and innovative solutions to solve problems. 17. I can think diversely and ask questions humbly. 18. I like to read extracurricular books to broaden my view. 19. I can continue to learn and cultivate lifelong learning habits. 20. I can perceive and make use of resources to control my emotions. 21. I can face my problems and frustration and participate in healthy leisure activities. 22. I can motivate others and myself and face external challenges optimistically. 23. I can plan everything in detail and complete the tasks as directed by my organization. 24. I can be self-reliant and properly plan to carry out independent-study or life plans. 25. I can work actively and responsibly. Sample and Data Analysis In this study, random cluster sampling was used to select two group samples from 7,515 undergraduates between January and June 2013. In study 1, data from the first sample (N = 368) were analyzed using item analysis and exploratory factor analysis (EFA). In study 2, data from the second sample (N = 1384) were analyzed with confirmatory factor analysis (CFA) using AMOS 6.0 in order to determine an optimum measurement model. The undergraduates were all from KUAS, and came from various academic backgrounds spanning 18 departments and four colleges. The second sample was composed of 839 male undergraduates and 545 female undergraduates. A t-test was conducted to understand the effect of gender on school core competence. Results Study 1: Item Analysis and Exploratory Factor Analysis For item analysis, the data were separated into two independent groups according to their scores for each item. The participants who had scored above 27% 101 Validation of School Core Competence Scale for Undergraduates formed a high-scoring group, while those who had scored under 27% formed a low-scoring group. A t-test was conducted to investigate the difference between the numbers of items in the high- and low-scoring groups. If p <.05, discrimination power was observed, and thus the item had to be kept. Ultimately, t-values ranged from 19.88 to 31.73 (p <.001); thus, all items were kept. The mean interitem correlation of the SCCS was 0.77, with values ranging from 0.65 to 0.81. To understand the internal consistency of the scale items more comprehensively, an inter-item correlation matrix was computed. The value for each item was positive, indicating that the items were measuring the same underlying characteristic. The corrected item-total correlation values for all the items shown in the item-total statistics were significantly greater than 0.30, indicating that all of the items were adequate and appeared to measure the same latent construct (Pallant, 2010). The Kaiser–Meyer–Olkin (KMO) measure of sampling adequacy index was found to be 0.97, well above the recommended value of 0.6 (Kaiser, 1974). Bartlett’s test of sphericity yielded a highly significant result (p <.001), suggesting the factor ability of the correlation matrix (Pallant, 2010). Taken together, these results indicate that a factor analysis could be performed (Tabachnick and Fidell, 2007). Items were retained only when they exceeded +0.40 or were less than –0.40 for relevant factors, and they were less than the absolute value of ±0.40 for non-relevant factors. Furthermore, the authors excluded items with factor loadings of less than 0.7, or if one item had factor loadings greater than 0.7 on two or more factors. The factor loadings for each item and the common validity coefficients were above 0.4, demonstrating that the scale had excellent structure validity. The final scale contained eight factors and the cumulative explained variance was approximately 82.29%. Table 3 shows the reliability of the SCCS. Before undertaking any further measures, reliability was estimated with Cronbach’s alpha coefficient; the SCCS demonstrated a strong alpha value of 0.97. This indicates a high level of internal consistency, well above the acceptable threshold of 0.70 (Gable and Wolf, 1993). Table 3. Factor names and internal consistency reliabilities. Factor Items Definition Cronbach’s alpha Communication and expression 3 Skills in English or other languages to interact with others. .81 International perspective 3 Skills that demonstrate people’s attention to international issues and cultural diversity. .83 Humanity 3 Skills that demonstrate people’s respect for the value of life and concern for others. .85 Shwu Ming Wu, Cheng Hong Yang,Wan Chen Hsu 102 Factor Items Definition Cronbach’s alpha Civics and morals 3 Skills regarding civic and moral literacy; i.e., skills enabling people to be good citizens. .92 Professional knowledge and skills 3 Skills demonstrating the knowledge and ability to function professionally. .92 Integrative learning 4 Skills in learning new knowledge, understanding technology by oneself, and gathering information. .88 Passion and anti-stress 3 Skills in using resources and methods to manage emotions, stress, and promote physical and mental health. .89 Self-discipline 3 Skills in self-management and organizing personal matters. SCCS 25 .91 .97 Study 2: Confirmatory Factor Analysis and T-test The 25-item test was administered to a second sample of students in order to validate the factor structure. First, the authors calculated the fit indices, which showed a chi-squared value of 1693.45 (p <.05). In general, the larger the sample size, the more likely a model will fail the chi-squared goodness-of-fit test (Barrett, 2007). Thus, it referred to other fit indicators as the following: goodness-of-fit index (GFI),.91; confirmatory fit index (CFI),.95; normed fit index (NFI),.95; relative fit index (RFI),.94; incremental fit index (IFI),.95; parsimonious normed fit index (PNFI),.78; critical N (CN),.233; and root mean square error of approximation (RMSEA), 0.07. All regression weights had statistically significant critical ratios (α =.05) and correlations greater than.67 were statistically significant (α =.05). The recommended values for each fit index are GIF ≥.90, CFI ≥.90, NFI ≥.90, RFI ≥.90, IFI ≥. 90, PNFI ≥.60, CN value ≥.200, and RMSEA ≤.05 (Bagozzi and Yi, 1988). Among the eight factors, undergraduates scored highest on “Civics and Morals” followed by “Passion and Anti-stress.” “International Perspective” scored the lowest. These results implied that these undergraduates had a strong conception of civic responsibilities and had strong moral sense. The lower scores for “International Perspective” suggest that some undergraduates might have difficulty attending to international issues and maintaining awareness of cultural diversity. Then, in the comparison between genders of the eight factor scores, the authors noted significant associations between males and females in “Communication and Expression,” “Civics and Morals,” “Self-discipline,” and the total scale scores (cf., Table 4). 103 Validation of School Core Competence Scale for Undergraduates Table 4. Means, standard deviations, and t-test for the School Core Competence Scale. Factor Total Mean Male SD Mean Female SD Mean t-value SD Communication and expression 6.16 1.33 6.09 1.36 6.28 1.26 –2.63** International perspective 6.08 1.38 6.07 1.38 6.08 1.36 –.11 Humanity 6.15 1.41 6.11 1.42 6.24 1.43 –1.75 Civics and morals 6.53 1.38 6.42 1.39 6.69 1.35 –3.55*** Professional knowledge and skills 6.30 1.40 6.26 1.42 6.38 1.35 –1.53 Integrative learning 6.32 1.35 6.30 1.36 6.39 1.32 –1.27 Passion and anti-stress 6.45 1.39 6.42 1.40 6.54 1.37 –1.54 Self-discipline 6.28 1.41 6.23 1.40 6.41 1.41 –2.29* Total scale 6.29 1.19 6.24 1.19 6.38 1.17 –2.10* *p <.05; ** p <.01; *** p <.001; N = 1384. Discussion The aim of this study was to construct, test, and verify the SCCS among undergraduates at KUAS. The reliability values for each competence perspective ranged between.81 and.92, and the cumulative total explained variance was 82.29%. Thus, it is evident that the SCCS for KUAS has excellent reliability and validity. This study revealed eight perspectives and 25 key questions in total. In terms of the CFA, Barrett (2007) has argued that even statistically non-significant overall chisquared values can indicate good fit. The GFI is an absolute fit index and provides a measure of the amount of variance/covariance in the sample matrix that is predicted by the model implied variance/covariance matrix (Teo and Khine, 2009). The GFI value should approximate 1 to demonstrate the best fit of the model. Browne and Cudeck (1993) demonstrated that models had reasonable fit when RMSEA was between.05 and.08. CFI represents incremental fit indices and tests the proportionate improvement in fit by comparing the target model to a baseline model with no correlations among observed variables. CFI values approximating 0.95 indicate good fit (Bagozzi and Yi, 1988). In this study, the measurement model results showed an adequate fit to the data. Furthermore, gender differences existed in “Communication and Expression,” “Civics and Morals,” “Self-discipline,” and the total scale scores. It is possible that, in order to align with higher social expectations, females can better understand and express emotions (Wang and Lo, 2008). 104 Shwu Ming Wu, Cheng Hong Yang,Wan Chen Hsu However, further studies must be conducted to explore the gender differences in “Civics and Morals,” “Self-discipline,” and the total scale. Conclusion The SCCS showed high validity and reliability, indicating that it would be useful as a reference tool for other schools employing similar initiatives. As only KUAS undergraduates were tested, it is unknown whether the findings could be generalized to other samples. To increase external validity, studies with different samples should be conducted. Core competences, to be effective, must shift through continuous organizational learning. In this study, female undergraduates showed higher scores on some dimensions of the SCCS. The implication for universities is to provide some strategies for enhancing the core competences of male undergraduates. Acknowledgments This paper was supported by the Ministry of Education, R.O.C., under the grant Teaching Excellence Project for KUAS, during 2013 to 2014. References Bagozzi, R.P., & Yi, Y. (1988). On the evaluation of structural equation models. Academic of Marketing Science, 16(1), 74–94. Barrett, P. (2007). Structural equation modeling: Adjudging model fit. Personality and Individual Differences, 42, 815–824. Browne, M.W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K.A. Bollen & J.S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage. Bureau of Employment and Vocational Training, Council of Labor Affairs. (2007). Taiwan Training Quality System. Retrieved from http://ttqs.evta.gov.tw/Default. aspx CEDEFOP. (2009). The shift to learning outcomes: Policies and practices in Europe. Luxembourg: Office for Official Publications of the European Communities. Chanyang, Y. (2011). The assessment focus on student learning outcomes of Euro- Validation of School Core Competence Scale for Undergraduates 105 pean Union higher education quality assurance policy. Evaluation Bimonthly, 30, 27–34. European Centre for the Development of Vocational Training. (2008). The shift to learning outcomes: Conceptual, political and practical developments in Europe. Luxembourg: Office for Official Publications of the European Communities. European Commission. (2004). Key competences for lifelong learning-European reference framework. Retrieved from http://ec.europa.eu/dgs/education_culture/ publ/pdf/ll-learning/keycomp_en.pdf European Commission. (2010). The European qualifications framework for lifelong learning. Retrieved from http://ec.europa.eu/education/policies/educ/eqf/ eqf08_en.pdf Gable, R.K., & Wolf, M.B. (1993). Instrument development in the affective domain: Measuring attitudes and values in corporate and school settings. Boston: Kluwer Academic Publishers. Higher Education Evaluation and Accreditation Council of Taiwan. (2010). 100 annual school evaluation implementation plan. Retrieved from http://www. heeact.edu.tw/ct.asp?xItem=9839&ctNode=1370&mp=2 Holmes, G., & Nick, H. (2000). Core competence and education. Higher Education, 40, 247–258. Hu, T.C., & Lin, C.C. (2011). The creation of pharmacists’ core competence assessment scale. African Journal of Business Management, 5(11), 4226–4231. Kaiser, H. (1974). An index of factorial simplicity. Psychometrika, 39, 31–37. Pallant, J. (2010). SPSS survival manual (4t ed.). Berkshire, England: Open University Press. Stewart, T.A. (1999). Intellectual capital. London: Brealey. Tabachnick, B.G., & Fidell, L.S. (2007). Using multivariate statistics (5t ed.). Boston: Pearson/Allyn & Bacon. Teo, T., & Khine, M.S. (2009). Structural equation modeling in educational research: Concepts and applications. Boston: Sense Publishers. The Directorate General of Budget, Accounting and Statistics of Executive Yuan. (2013). Unemployed by gender and educational level. Retrieved from http://www. dgbas.gov.tw/public/data/dgbas04/bc4/timeser/table14.XLS The Ministry of Education. (2009). 98 Annual Application for Teaching Excellence Project of Ministry of Education. Ministry of Education, R.O.C., Taipei. Wang, C.K., & Lo, K.Y. (2008). Cognitive representation of emotional intelligence: Similarity and difference between genders and cohorts. Research in Applied Psychology, 39, 215–251. Anna Młynarczuk-Sokołowska Poland Intercultural Non-formal Education Issues on the Agenda of Polish Non-governmental Organizations – a research report Abstract The purpose of this article is to present the results of the research on the issues discussed in the educational initiatives undertaken by Polish non-governmental organizations. The results of the scientific explorations presented in the paper are the outcome of the PhD research project Intercultural Non-formal Education in Poland on the Example of Non-governmental organizations activity. The project included surveying 65 leaders of different non-governmental organizations from three cities with different cultural make-ups, i.e. Bialystok, Poznan and Warsaw. The study was conducted in 2010 – 2012 according to the eclectic research approach, which allowed gathering quantitative and qualitative data. Based on the analysis of the empirical material, the author of the article presents: the issues tackled in the initiatives carried out by Polish non-governmental organizations, the structure of their implementation and the types of activities undertaken (in view of the issues analysed). An outline of the research problems precedes the discussion on the research results. Keywords: non-governmental organizations, cultural diversity, intercultural non-formal education Introduction Due to the systemic transformation in Poland and the consequent application of the rule of social personalism – a characteristic of any democratic country, accord- Intercultural Non-formal Education Issues 107 ing to which establishing space for communities ideologically, professionally or regionally close to the human being is a priority- non-governmental organizations are becoming an increasingly important “social actor” (Lewenstein, Palska, 2004, 80). Therefore, they form the basis for a civil society. For over twenty years in democratic Poland, people from various foundations and associations have engaged in different types of initiatives such as educational, charity or cultural initiatives. They have sought social change and many times performed significant tasks that should have been the responsibility of governmental and municipal organizations. Non-governmental organizations are also important agents, in many cases leading ones, as to the implementation of intercultural non-formal education. Thus, they meet the needs stemming from the socio-cultural diversity of local, Polish, European or global environments. We are witnessing dynamic transitions in this realm of education. Intercultural non-formal education is expanding the range of issues it is concerned with, which results from the ongoing cultural diversification of the country. Projects and programmes dealing with the issues about cultural, social, economic or biological types of otherness of the Aliens/Others, the close and distant ones, are conducted. In this article, I will present the results of the study on the contents of the initiatives undertaken by Polish non-governmental organisations. The study is one of the elements of the PhD research project Intercultural Non-formal Education in Poland on the Example of Non-governmental organizations activity1. The Characteristic of the Research Problem To different extents, the role of non-governmental organisations has been the subject of numerous social studies in Poland. However, the case of non-governmental organisations as implementers of intercultural non-formal education has not been discussed yet. In designing my research I followed the assumption that the cultural diversification of Polish society has been a dynamic process. The process was brought about by the transitions in the final decade of the 20t century, i.e. the systemic transformation, recognition of the rights of minorities, Polish accession to the European Union and the Council of Europe and, consequently, opening the 1 This research project has been funded by the National Science Centre (contract no 4193/B/ H03/2011/40). 108 Anna Młynarczuk-Sokołowska borders for immigrants from different countries. I made an assumption that the coexistence of numerous culturally different groups may be an advantage but it may well turn into a source of overt or covert conflicts. It is intercultural education above all that shapes intercultural relations. Therefore, it is an educational priority to prepare society for living in a multicultural environment, not only with the indigenous minorities who have lived in Poland for years, but also with foreigners who leave their homelands for various reasons. Hence, it is essential to develop intercultural non-formal education, i.e. a planned process of intercultural competence acquisition, taking place outside formal and obligatory education programmes, and, due to its character, enabling learning through experience and active participation.2 In my study, I focused on the cyclical activities3 in the field of intercultural non-formal education conducted in 2008 – 2010. The activities were to foster sensitivity to otherness, teach to tolerate and accept it, as well as to develop the ability to establish positive relations with the Alien/Other in the cultural, economic and biological domains. They dealt with the issue of cultural differences on local, regional, national and transnational levels: starting with local communities and concluding with the cultures of remote societies. The analysed projects and programmes helped individuals shape their cultural identities, taking into consideration indigenous values of their families, parish communities and the like. The activities were conducted in cooperation between educational institutions on local, regional, national and transnational levels.4 In this article, I attempt to answer one of the numerous research questions posed in my PhD research project: What are the intercultural non-formal education issues5 implemented by Polish non-governmental organisations? In 2010 – 20126, the research was conducted among the promoters of intercultural non-formal education from deliberately selected types of non-governmental 2 The definition is the result of the analysis of Polish and English literature on the subject, e.g. the assumptions of the lifelong education concept, central to modern thinking about education, as well as features of non-formal education, the essence of culture (treated as a natural space for educational activities), and the idea of intercultural education. 3 These were the programs and projects implemented in different organizational forms such as educational workshops, training, international exchanges, study visits. 4 The subject of my research also included the assessment of the initiatives by the participants. In this article, I only present the core methodological assumption for the problem in question. 5 The term ‘issue’ is understood as the knowledge transmitted, acquired and created during educational activity. 6 The research started in the other half of 2010, and was completed in February 2012. Intercultural Non-formal Education Issues 109 organizations – foundations and associations7 – in three cities with different cultural make-ups, i.e. Bialystok, Poznan and Warsaw. The study mostly included institutions whose statutory activity presupposed the implementation of intercultural education and encompassed topics such as education and upbringing, arts and culture, integration and social mobilization, and human rights. In the choice of a target group, random purposeful sampling was employed. The direct involvement in the initiatives as an initiator, as a coordinator or as a coach was the main criterion for the purposeful selection of the study sample. In the research, the eclectic approach was adopted, which allowed for gathering quantitative and qualitative data. A diagnostic survey was the core research method. The techniques used included a two-part interview, a document content analysis, overt and covert participant observation, and non-participant observation. In the first part of the interview, a structured close-ended interview was employed and quantitative data about the actions taken by non-governmental organisations in the realm of intercultural non-formal education was aggregated. The other part of the interview contained open-ended questions, which complemented the information gathered through the close-ended interview. In the course of the research, 65 interviews were carried out. 115 documents about the target initiatives were collected: paper and electronic versions of the programmes and projects, information folders, information retrieved from the Internet. 20 observations of the initiatives from Bialystok, Poznan and Warsaw were completed. The research findings are presented in this article for descriptive purposes, and to a lesser degree for the purpose of a statistical and quantitative inference. Intercultural Non-formal Education Issues Introduced by Polish Non-governmental Organizations All the leaders engaged in the Polish third sector declared that the idea of cultural otherness was included in the contents of the initiatives the leaders implemented. It entailed discussing the issues about having and expressing the minority identity by groups and individuals and the differences connected with it. 87% of the declarations confirmed working on the issues concerning social other7 The choice of the leaders of Polish foundations and associations as my study sample resulted from the fact that they accounted for the majority of non-governmental entities, and thus formed its core. 110 Anna Młynarczuk-Sokołowska ness resulting from one’s nationality or ethnicity and the social status it involves. 45% of the topics discussed were about biological otherness based on sex, age, eye, hair and skin colours, or physical/intellectual (dis)abilities. 75% of the declarations indicated that the topic of economic otherness, manifested by economic status and its consequences, was put forward. 35% of the interviewed leaders confirmed that their organizations introduced in the initiatives the issue of political otherness, i.e. the preferred worldview, ideology, doctrine. As to the issues related to cultural and social otherness, 65% of the interviewed activists claimed that the implemented activities related to selected elements of the culture and identity of immigrants, e.g. the Africans, Vietnamese, Hindus, Chinese, and Japanese. This group of interviewees was mainly from Warsaw, which points to the fact that the above-mentioned issues were not popular in Bialystok or Poznan. 50% of the interviewed leaders declared that the intercultural non-formal education initiatives they carried out included issues relating to the cultures of selected indigenous national minorities, e.g. Belorussian, Lithuanian, or Ukrainian minorities. 40% of the interviewees confirmed dealing with the cultures of ethnic minorities, mainly the culture of the Romani and Tartars. It is noteworthy that most activists from non-governmental organizations in Bialystok declared that they were concerned with the cultures of national and ethnic minorities, which may have stemmed from the genuinely multicultural character of the city. 35% of the interviewed leaders said that they embraced the problem of refugee culture and the status of a forced migrant. This group mainly comprised people from Bialystok and Warsaw. The contents of the initiatives referred to the situation and culture of Chechen people. In 32% of the cases, the initiatives dealt with faiths and religions, e.g. Islam, Eastern Orthodox Christianity, Protestantism, Buddhism, and Hinduism. 10% of the answers gave evidence for the interest in the specificity of foreign languages (Spanish, Arabic, Georgian, and Romani) and the artificial Esperanto language. The interest in the issue of attitudes towards otherness, including discrimination mechanisms and prevention, was declared by 48% of the interviewees. 22% of the NGO activists said that the initiatives carried out by their organisations included the issues about intercultural education methodology and counteracting discrimination. The statements of the interviewed leaders, the content analysis of the initiatives and the observation of the initiatives indicate that the issues relating to other cultures, religions and faiths as well as the identities connected with them, together with the issues about foreign languages and attitudes towards otherness constituted the thematic core of the initiatives conducted and determined their character. The issues concerning biological, economic or political otherness played a supporting Intercultural Non-formal Education Issues 111 role. They served for a more in-depth explanation of discussed problems. For instance, the organizers of the teacher training Vietnamese Children and Young People in the Polish Education System – a part of the project Five Flavours Cinema organized by the Arteria Foundation – discussed the issue of cultural identity of Vietnamese immigrants, paying attention to their anthropological features and socio-economic standing as a supplementary analysis. The question of economic, biological and psychological aspects of otherness was an important element of initiatives devoted to refugees (mainly from Chechnya, but also from Afghanistan, Pakistan or Nigeria). It was also one of the core issues in the preparations for participation in international voluntary service programmes (EVS, missionary voluntary service). The analysis of the empirical data has shown that although leaders declared that they had covered numerous topics about cultural otherness or the otherness of faith and religion, not all the topics underwent an in-depth examination. As the surveyed NGO leaders pointed out, some of the issues were only hinted at, which was due to time restrictions or the character of the initiatives. The situation was slightly different in the case of initiatives on attitudes that involved presenting participants with the mechanisms of discrimination and ways of counteracting discrimination. These initiatives dealt with the issues about attitudes towards otherness in the first place. The subject of biological, economic or cultural differences constituted the background for discussion. As to the international activities (international exchange programmes, international volunteer service, or work camps), beside the issues purposefully undertaken in the initiatives, spontaneously evolving topics about participants’ religious or cultural affiliations created an essential background for discussion. Types of Initiatives Based on the empirical data, the issues prevailing in particular initiatives, and in relation to the Holistic Concept of Intercultural Education of J. Nikitorowicz (Nikitorowicz, 2005, 200 – 232), which in a comprehensive manner determines the thematic areas in the field of intercultural education, the following types of initiatives on the agenda of Polish non-governmental organisations can be distinguished: 112 Anna Młynarczuk-Sokołowska Initiatives concerning the identity and cultural heritage of minority groups This includes activities that focus on the issues relating to the symbolic and material heritage of national, ethnic, religious or language minority groups (including immigrants and refugees). The activities help to develop, in Poland and abroad, the minority identity and all the competence required for participation in the life of a particular national, ethnic, religious and language community. They also serve to create a ground for an intercultural encounter, which increases sensitivity towards the otherness of the majority group. The examples of this type of initiatives are: The Multicultural Club (The Society of Friends of the Maharaja Jam Sahib Digvijay Sinhji Public High School); “The Stories of the Terek Valley” (Cultural Practitioners’ Association); integration and educational activities for the Romani community (The Bahtale Roma Foundation) Initiatives connected with the culture of the close Alien / Other This group of initiatives deals with the issues concerning the culture and cultural heritage of the close Alien/Other, i.e. a member of a particular community (local, of a city, region or of Poland). The above-mentioned initiatives are mostly aimed at selected elements of culture, identity, faith and religion of indigenous minorities, who have lived in different regions of Poland for years. The initiatives concentrate on selected elements of the dominant culture and encompass the local, regional, national and international execution planes. Examples of the initiatives are: The Meet Your Neighbour Project (The Poland-Ukraine Socio-Cultural Association); The Chronicles of Podlasie Region (The Ab-ba Association for Children and Young People Learning Belorussian); Multicultural Warsaw (The ProHumanum Association for the Development of Civic Society). Initiatives focusing on the culture and position of the distant Alien/ Other This group of initiatives includes activities whose contents relate to the culture of the distant Alien/Other, who is a citizen of another country, continent, or an immigrant or a refugee with entirely diverse cultural affiliation. The activities show similarities and differences between the culture of the distant Alien/Other and the local, regional or national cultures. Examples of initiatives falling within this group are: activities introducing the culture and position of African people (The Hear Africa Foundation) workshops on cultural diversity for children (The Foundation of Intercultural Education); Hindu song classes (The House of Lotus Foundation). Intercultural Non-formal Education Issues 113 Initiatives relating to the cultures of the close and distant Aliens/Others This group of initiatives focuses on the close and distant Aliens/Others. This set of activities involves implementation of issues relating to different cultures, religions, faiths and the like. The implementation follows the pattern from close to distant otherness, but it also happens at random. Projects that belong to this group of initiatives are Mobile School Intercultural Workshop Part II (The Culture House Foundation); The Living Library of the Greater Poland (The Institute for Research and Development of Social Initiative); the Programme for the Development of Sensitivity Toward Otherness The Adventures of the Other (The Foundation of Education and Creativity, The University of Bialystok Foundation). Initiatives concerning the attitudes towards the distant and close Aliens/ Others This set comprises the initiatives that deal with the problem of discrimination against the distant and close Aliens/Others and ways of counteracting it. The initiatives focus on the mechanisms of stereotypes, prejudice and discrimination. They also discuss the consequences of any discriminatory acts and the ways of counteracting discrimination. The issues about cultural, religious, biological or economic types of otherness are the plane for consideration. Examples of this type of initiatives are: anti-discrimination workshops for school children (The 9/12 Association for Dialogue); Hominem Quaro – a quest for a human (The StopKlatka Association of Culture Practitioners); and anti-discrimination workshops organized by The Konsola Women Association. Initiatives on Jewish history and culture and Polish-Jewish relations This group of initiatives focuses on the subject of the Polish-Jewish past and heritage, the Holocaust, Jewish culture and cultural ties resulting from the process of cultural interpenetration. They discuss the issue of Polish-Israeli relations and the character of the State of Israel. This set of initiatives includes projects such as Restoring Matzeva (The Association of Creative Initiatives “Ę”); The School of Dialogue (The Forum for Dialogue among Nations); International Summer Camp (the Poland-Israel Centre for Civic Education). Initiatives focusing on the cultural affiliations of the participants This is a set of activities discussing the elements of cultures of the people who participate in the initiatives. The main purpose of this kind of initiatives is mutual understanding and integration. Discussing the cultural affiliation of the 114 Anna Młynarczuk-Sokołowska participants usually happens in the case of international initiatives (exchange programmes, work camps, volunteer work programmes). Initiatives include the following projects: Let’s meet in the kitchen (the Aeege European Forum of Students); the Polish-German encounters (the Polish-German Society for Social Education); We love eating (the Foundation for Freedom). Initiatives focusing on the role of language in communication and promotion of other cultures In this group of initiatives, the role of language in the process of intercultural communication and learning about other cultures is the centre of attention. Language is considered to be an intercultural communication tool and facilitator in the process of gaining knowledge of other cultures, nations as well as Polish history and culture. The activities are concerned with a particular language, a language family (e.g. Romance languages, or Slavonic languages), or the artificial Esperanto language. Example projects that belong to this group of initiatives are Femina Republic (The Sfera Foundation for Languages and Culture); European Voluntary Service (The Bialystok Society for Esperanto Speakers); educational activities carried out by The En-senco Socio-cultural Society of Ludwik Zamenhof. Initiatives on interculturality and multiculturalism and the methodology of working with particular groups This group of activities focuses on the culture, religion and position of the close and/or distant Aliens/Others, as well as intercultural education methodology. Its contents pertain to selected elements of the cultural canon/canons of minority groups, minorities’ religions, methods of designing education activities, ways of addressing otherness, etc. Projects that can serve as examples of this type of initiatives are Refugee Culture: cultural differences and ways of addressing them (The Foundation of Culture and Creativity); The Workshop of an Aspiring Teacher (The Institute for Research and Development of Social Initiative). Based on the research results analysis, it may be concluded that the contents of the intercultural non-formal education initiatives follow the holistic understanding of the concept of intercultural education. The activities undertaken dealt with many topics ranging from the cultures and problems of the close Aliens/Others to the issues of the distant Aliens/Others. The choice of the issues discussed in the initiatives was determined by the cultural character of a particular city. The initiatives focused on the cultures and problems existing in the given area but were not limited to these subjects only. The thematically widest range of initiatives e.g. initiatives focusing on the cultures of national and ethnic minorities, immigrants, Intercultural Non-formal Education Issues 115 refugees, or other religions was developed by Warsaw non-governmental organizations that operate in the so-called Polish “multikulti” centre. Bialystok NGOs explored the topics about minority groups living in the city. They sometimes showed their interest in the issues concerning refugees, less often in the issues about immigrants or the distant Aliens/Others. The topics discussed in the Poznan initiatives were diverse, and structurally they resembled a mosaic. Therefore, it is difficult to discern the dominant ones. NGOs in all the cities included in their initiatives the issues about discrimination, its consequences, and ways of counteracting it. The situation was similar in the case of initiatives treating language as an intercultural communication tool that helps to learn about other cultures. Moreover, it was also the case with the international initiatives that facilitated the encounter with otherness and promotion of one’s own culture. The initiatives concerning Jewish culture, Polish-Jewish and Polish-Israeli relations were mainly introduced in Bialystok and Warsaw. All the issues enclosed in the initiatives of Polish non-governmental organisations gave the opportunity to develop multifaceted identity of the initiatives participants. Conclusion In Poland, intercultural non-formal education has been developing dynamically since the 1990s. Thanks to the social activeness of citizens themselves, a wide range of initiatives has been developed in the field of intercultural education. The character of intercultural education that assumes learning through experience and active participation, allows for the implementation of tasks on a number of topics, which in turn facilitates the intercultural dialogue. As the results of my research indicate, Polish non-governmental organisations introduced thematically diverse initiatives that alluded to the needs relating to the intercultural education on local, regional, national and transnational levels. The initiatives dealt with the issues about the Aliens/Others who live in the local community, Poland, Europe or the world as well as with the issues about attitudes towards otherness. In the course of the implementation of non-governmental initiatives the topic of non-ethnically conditioned types of otherness, i.e. biological, social or economic ones was raised. Although it was of supplementary character, it allowed for a more detailed analysis of the subject in question. The issues explored by Polish non-governmental organisations constituted a factor enabling the development of intercultural competence and readiness for encounter with the close and/or distant Aliens/Others. 116 Anna Młynarczuk-Sokołowska References Dietz G., (2009), Multiculturalism, interculturality and diversity in education. An anthropological approach, Münster, New York, München, Berlin: Waxman. Grzybowski P.P. (2009), Edukacja europejska – od wielokulturowości ku międzykulturowości. Koncepcje edukacji wielokulturowej i międzykulturowej w kontekście europejskim ze szczególnym uwzględnieniem środowiska frankofońskiego, Kraków, Oficyna Wydawnicza Impuls. Lewenstein B., Palska H. (2004), Organizacje pozarządowe na scenie publicznej okresu transformacji: dynamika rozwojowa i relacje z władzą – analiza badań jakościowych, In: P. Gliński, B. Lewenstein, A. Siciński (eds.) Samoregulacja społeczeństwa polskiego III sektor i wspólnoty lokalne w jednoczącej się Europie, Warszawa: Wyd. IFiS PAN, p. 80. Lewowicki T. (2000), W poszukiwaniu modelu edukacji międzykulturowej, In: T. Lewowicki, E. Ogrodzka-Mazur, A. Szczurek-Boruta, Katowice (eds.) Edukacja międzykulturowa w Polsce i na świecie, Wydawnictwo Uniwersytetu Śląskiego. Nikitorowicz J. (2005), Kreowanie tożsamości dziecka. Wyzwania edukacji międzykulturowej, Gdańskie Wydawnictwo Psychologiczne: Gdańsk 2005, pp. 200 – 232. Rogers A. (2004), Non-formal education. Flexible schooling or participatory education? Hong Kong: Comparative Education Research Centre, The University of Hong Kong. Vincent Charles*, Tatiana Gherman Peru Factors influencing students’ choice of a B-school Abstract The presented study is a primary initiative in the Peruvian literature for understanding the factors which influence undergraduate students´ choice of a B-school offering a Master´s Degree in Business Administration. A self-administered questionnaire and focus group discussions were used in order to collect data from 700 respondents, with a usable response rate of 92%. Analysis of the data was carried on through exploratory factor analysis. The seven revealed factors which accounted for 63.2082% of the total variance were: Corporate Social Responsibility, Essentials of an MBA Program, Quality Yardsticks, Entrepreneurship, Location, MBA Technical Specifications, and Physical Facilities. Entrepreneurship education should be addressed primarily, as entrepreneurship is vital for economic growth in Peru. In order to raise their value proposition, B-schools are expected to take true initiatives in the CSR area and promote entrepreneurship education in their curricula, through both business-skills training and practical support given by the B-school. Keywords: business schools, business studies, curricula, emerging markets, factor analysis, higher education * Corresponding Author 118 Vincent Charles, Tatiana Gherman Introduction The Master´s Degree in Business Administration (MBA) is nowadays one of the most popular, desired, and valuable post-graduate degrees available worldwide. It is believed that an MBA degree provides its holders an added advantage to get promoted to upper management positions, as well as a premium salary in industry. As Sharkey and Beeman (2008) assessed, the MBA market will only tend to become a hypercompetitive market, given its connectedness to business. Despite various achievements, the evolution of the education system in Peru is relatively insufficient to meet the social needs of society. Moreover, little attention has been paid to education, and the authors of this study identified limited published research, in general, with regard to this topic. In the light of this situation, it is obvious that in order to improve the management education, it is necessary to understand the needs of the student and his decision-making process. B-schools have to dedicate themselves to finding out what the student is really looking for and hoping to accomplish as an MBA graduate and business professional, and to design MBA programs that emphasize just how they will meet those expectations. Literature Review Choosing a particular MBA program from so many options available on the market is definitely not an easy task. Some studies (Galotti, 1999; Simpson, 2001) indicated subjective elements as major criteria for undergraduates in choosing an MBA program in a particular B-school, such as: perception of self, individual interests, values and abilities, parental influence, and the student´s gender role identification, among other things. Kurst (1984) found placement office statistics, accreditation, supporting facilities, faculty make-up, and student/faculty ratio; Miller (1988) found accreditation, teaching methods, program duration, fields of specialization, school ranking, and cost; Powers (1988) found academic quality, quality and reputation of the faculty, and placement opportunities; Parker, C