Rasch Model Validity for Robotics Learning Survey in Technical and Vocational Education System

Irdayanti Mat Nashir, Ramlee Mustapha, Abdullah Yusoff

Abstract


ABSTRACT: This study aimed to explore the personality of student for robotic based learning in Technical and Vocational Education System. The RLS (Robotics Learning Survey) consists of 48 items before going through the purified process by using Winstep software for Rasch Analysis.  This RLS was adapted and modified from John L. Holland (1960)’s Theory (realistic, investigate, artistic, social and enterprising, and conventional) and modified referred to the school learning environment in Malaysia. Then, the RLS was distributed randomly to the 223 student’s school in Malaysia. After going through the purified process, the six items was removed refereed polarity item by PTMEA CORR (Point Measure Correlation) value and item fit measure for constructs. During these activities, students are asked to explain the behaviours of a robot constructed in advance by the teacher or teacher assistant, rather than having to construct or program a robot themselves. These programmed will in line with STEM (Sciences, Technology, Education, and Mathematics), which is a curriculum based on the idea of educating students in four specific disciplines — science, technology, engineering, and mathematics — in an interdisciplinary and applied approach. Rather than teach the four disciplines as separate and discrete subjects, STEM integrates them into a cohesive learning paradigm based on real-world applications. Other than STEM programmed, these activities also involves TVE (Technical and Vocational Education), which is these educational robots is the education and training that provides the necessary knowledge and skills for employment.

KEY WORDS: Rasch Analysis; Educational Robots; Sciences, Technology, Education, and Mathematics; Technical and Vocational Education.

    

About the Authors: Dr. Irdayanti Mat Nashir and Prof. Dr. Ramlee Mustapha are the Lecturers at the UPSI (Universiti Pendidikan Sultan Idris or Sultan Idris University of Education) in Tanjong Malim, Perak, Malaysia. Dr. Abdullah Yusoff is a Lecturer at the Polytechnics of Sultan Azlan Shah in Behrang, Perak, Malaysia. For academic interests, the Authors are able to be contacted via e-mail address at: irdayanti@ftv.upsi.edu.my 

Suggested Citation: Nashir, Irdayanti Mat, Ramlee Mustapha & Abdullah Yusoff. (2019). “Rasch Model Validity for Robotics Learning Survey in Technical and Vocational Education System” in HONAI: International Journal for Educational, Social, Political & Cultural Studies, Volume 2(1), May, pp.47-58. Bandung, Indonesia: Minda Masagi Press owned by ASPENSI and STISIP Amal Ilmiah, Wamena, Papua, with ISSN 2621-1653 (print) and ISSN 2621-3621 (online).

Article Timeline: Accepted (March 2, 2019); Revised (April 21, 2019); and Published (May 30, 2019).


Keywords


Rasch Analysis; Educational Robots; Sciences, Technology, Education, and Mathematics; Technical and Vocational Education

Full Text:

PDF

References


Adams, N.E. (2015). “Bloom’s Taxonomy of Cognitive Learning Objectives” in JMLA: Journal of the Medical Library Association, Volume 103(3), July, pp.152-153. Available online also at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4511057/ [accessed in Tanjong Malim, Malaysia: August 3, 2018].

Afari, E. & M.S. Khine. (2017). “Robotics as an Educational Tool: Impact of Lego Mindstorms” in International Journal of Information and Education Technology, Vol.7, No.6 [June]. Available online also at: http://www.ijiet.org/vol7/908-T108.pdf [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Alimisis, Dimitris. (2013). “Educational Robotics: Open Questions and New Challenges” in Themes in Science & Technology Education, Volume 6(1), pp.63-71. Available online also at: https://files.eric.ed.gov/fulltext/EJ1130924.pdf [accessed in Tanjong Malim, Malaysia: August 17, 2018].

Altin, Heilo & Margus Pedaste. (2013). “Learning Approaches to Applying Robotics in Science Education” in Journal of Baltic Science Education, Vol.12, No.3. Available online also at: http://www.scientiasocialis.lt/jbse/files/pdf/vol12/365-377.Altin_JBSE_Vol.12.3.pdf [accessed in Tanjong Malim, Malaysia: August 3, 2018].

Anbumozhi, Venkatachalam & Fukunari Kimura [eds]. (2018). Industry 4.0: Empowering ASEAN for the Circular Economy. Jakarta: ERIA [Economic Research Institute for ASEAN and East Asia]. Available online also at: https://www.eria.org/uploads/media/ERIA-Books-2018-Industry4.0-Circular_Economy.pdf [accessed in Tanjong Malim, Malaysia: March 24, 2019].

Ariffin, Siti Rahayah et al. (2010). “Validity and Reliability Multiple Intelligent Item Using Rasch Measurement Model” in PROCEDIA: Social and Behavioral Sciences, Volume 9, pp.729-733. Available online also at: https://pdf.sciencedirectassets.com/277811/1-s2.0-S1877042810X00143/1-s2.0 [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Billet, Stephen. (2011). Vocational Education: Purposes, Traditions, and Prospects. Drodrecht: Springer.

Blazar, D. & M.A. Kraft. (2017). “Teacher and Teaching Effects on Students’ Attitudes and Behaviors” in Education and Evaluation Policy Analysis, Volume 39(1), March, pp.146-170. Available online also at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5602565/ [accessed in Tanjong Malim, Malaysia: August 3, 2018].

Bloom, B.S. (1956). Taxonomy of Educational Objectives: The Classification of Educational Goals. New York: Longmans.

Bolarinwa, O.A. (2015). “Principles and Methods of Validity and Reliability Testing of Questionnaires Used in Social and Health Science Researches” in Nigerian Postgraduate Medical Journal, Volume 22, Issue 4, pp.195-201. Available online also at: http://www.npmj.org/article.asp?issn=1117-1936;year=2015;volume=22;issue=4;spage=195;epage=201;aulast=Bolarinwa [accessed in Tanjong Malim, Malaysia: August 31, 2018].

Bond, Trevor G. & Christine M. Ford. (2015). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. Boston: Cengage Learning, third edition.

Boone, W.J. (2016). “Rasch Analysis for Instrument Development: Why, When, and How?” in CBE Life Sciences Education, Volume 15(4), Winter. Available online also at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5132390/ [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Boone, W.J. & A. Noltemeyer. (2017). “Rasch Analysis: A Primer for School Psychology Researchers and Practitioners” in Educational Psychology & Counselling, on December. Available online also at: https://www.cogentoa.com/article/10.1080/2331186X.2017.1416898 [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Coon, D., J.O. Mitterer & T. Martini. (2018). Psychology Modules for Active Learning. Boston: Cengage Learning.

Cronbach, L.J. (1951). “Coefficient Alpha and the Internal Structure of Tests” in Psychometrika, Volume 16(3), pp.297-334.

Darling-Hammond, Linda et al. (2019). “Implications for Educational Practice of the Science of Learning and Development” in Applied Developmental Science, on February. Available online also at: https://www.tandfonline.com/doi/10.1080/10888691.2018.1537791 [accessed in Tanjong Malim, Malaysia: March 24, 2019].

DeCastellarnau, Anna. (2018). “A Classification of Response Scale Characteristics that Affect Data Quality: A Literature Review” in Quality & Quantity, Volume 52, pp.1523-1559. Available online also at: https://link.springer.com/article/10.1007/s11135-017-0533-4 [accessed in Tanjong Malim, Malaysia: February 21, 2019].

Dommett, E.J. (2018). “Learner Ownership of Technology-Enhanced Learning” in Interactive Technology and Smart Education, Volume 15(1). Available online also at: https://doi.org/10.1108/ITSE-08-2017-0042 [accessed in Tanjong Malim, Malaysia: February 5, 2019].

Ellis, Jules L. (2017). “Factor Analysis and Item Analysis”. Available online at: https://www.applyingstatisticsinbehaviouralresearch.com/documenten/factor_analysis_and_item_analysis_version_11_.pdf [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Febrina, Bustami Usman & Asnawi Muslem. (2019). “Analysis of Reading Comprehension Questions by Using Revised Bloom’s Taxonomy on Higher Order Thinking Skill (HOTS)” in EEJ: English Education Journal, Volume 10(1), January, pp.1-15.

Frieman, J.S.R. (2016). Learning: A Behavioral, Cognitive, and Evolutionary Synthesis. London: Sage Publications, edited by Reid Hester.

Fry, Heather, Steve Ketteridge & Stephanie Marshall. (2009). A Handbook for Teaching and Learning in Higher Education: Enhancing Academic Practice. New York and London: Routledge, third edition. Available online also at: https://www.sun.ac.za/english/faculty/arts/Documents/HandbookTeachingLearningHigheEd.pdf [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Gerrin, Maria W., Kartono & Saiful Ridlo. (2018). “Development of Peer Assessment Social Behaviour Instrument on Learning Mathematics in Junior High School” in JERE: Journal of Educational Research and Evaluation, Volume 7(2), pp.139-146.

Gyebi, E.B.B., M. Hanheide & G. Cielniak. (2017). “The Effectiveness of Integrating Educational Robotic Activities into Higher Education Computer Science Curricula: A Case Study in a Developing Country”. Available online at: http://eprints.lincoln.ac.uk/id/eprint/25579/1/gyebi16edurobotics.pdf [accessed in Tanjong Malim, Malaysia: August 3, 2018].

Hasan, Azman. (2011). Kesahan dan Kebolehpercayaan Item Penilaian Pembimbing dalam Penbelajaran Berasaskan Kerja (PBK) Menggunakan Model Pengukuran Rasch. Pulau Pinang: USM [Universiti Sains Malaysia], Psychometrics Centre, MIMOS & Malaysian Examination Syndicate, MoE [Ministry of Education].

Hashim, Shahabuddin & Rohizani Yaakub. (2009). Pedagogi: Strategi dan Teknik Mengajar dengan Berkesan. Kuala Lumpur: PTS Publications & Distributors, Sdn Bhd.

Hogan, R. & R. Blake. (1999). “John Holland's Vocational Typology and Personality Theory” in Journal of Vocational Behavior, Volume 55, Issue 1 [August], pp.41-56. Available online also at: https://www.sciencedirect.com/science/article/abs/pii/S0001879199916962 [accessed in Tanjong Malim, Malaysia: August 17, 2018].

Holland, John L. (1960). “The Relation of the Vocational Preference Inventory to the Sixteen Personality Factor Questionnaire” in Journal of Applied Psychology, Volume 44(4), pp.291-296. Available online also at: https://doi.org/10.1037/h0049367 [accessed in Tanjong Malim, Malaysia: August 17, 2018].

Jailani, M.K.M. (2011). “Manual Pengenalan Pengukuran Rasch & Winsteps” in Pengukuran dan Penilaian dalam Pendidikan, published by FP UKM [Fakulti Pendidikan Universiti Kebangsaan Malaysia].

Jung, Sung Eun & Eun-Sok Won. (2018). “Systematic Review of Research Trends in Robotics Education for Young Children” in Sustainability, Volume 10:905, doi:10.3390/su10040905. Available online also at: www.mdpi.com/journal/sustainability [accessed in Tanjong Malim, Malaysia: January 10, 2019].

Karim, M.E., S. Lemaignan & F. Mondada. (2016). “A Review: Can Robots Reshape K-12 STEM Education?” in Proceedings of IEEE Workshop on Advanced Robotics and its Social Impacts, ARSO, on March 1-8. Available online also at: https://doi.org/10.1109/ARSO.2015.7428217 [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Kassim, Umi Kalsom & Phuah Kit Teng. (2018). “Conceptual Study on Enhancement of Education 4.0 from Management Perspective”. Paper presented in the 10th International Conference on Language, Education, and Innovation, on 14th – 15th April. Available online also at: https://pdfs.semanticscholar.org/aa60/93cc2d0e6b06e2fb31b2914b4dd3ce5f7888.pdf [accessed in Tanjong Malim, Malaysia: January 10, 2019].

Koca, Fatih. (2016). “Motivation to Learn and Teacher–Student Relationship” in Journal of International Education and Leadership, Volume 6, Issue 2 [Summer]. Available online also at: https://files.eric.ed.gov/fulltext/EJ1135209.pdf [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Langer, Karen [ed]. (2013). Technical and Vocational Skills Development in the Informal Sector: Contributions to the 4th Bonn Conference on Adult Education and Development (BoCAED). Bonn, Germany: DVV International. Available online also at: https://www.dvv-international.de/fileadmin/files/ipe_68_gb_web.pdf [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Likert, R. (1932). “A Technique for the Measurement of Attitudes” in Archives of Psychology, Volume 140, pp.1-55.

Linacre, J.M. (2015). Winsteps Rasch Measurement Computer Program User’s Guide. Beaverton, OR: Winsteps.Com.

Loubser, H.J., D. Casteleijn & J.C. Bruce. (2015). “The BETA® Nursing Measure: Calibrating Construct Validity with Rasch Analyses” in Health SA Gesondheid, Volume 20, pp.22-32.

Maclean, Rupert, Shanti Jagannathan & Jouko Sarvi [eds]. (2013). “Skills Development for Inclusive and Sustainable Growth in Developing Asia-Pacific” in Technical and Vocational Education and Training: Issues, Concerns, and Prospects, No.19 [Springer]. Available online also at: http://dx.doi.org/10.1007/978-94-007-5937-4 [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Manreka, Arjola. (2015). “Concept of Teacher Leaders and Creation of Friendly Climate in the Classroom: In Secondary Education (High School) in Albania” in Academic Journal of Interdisciplinary Studies, Vol.4, No.3 [December], pp.322-330.

Manyika, James et al. (2017). Jobs Lost, Jobs Gained: Workforce Transitions in a Time of Automation. USA [United States of America]: McKinsey Global Institute. Available online also at: https://www.mckinsey.com/~/media/mckinsey/featured%20insights/Future [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Marope, P.T.M., B. Chakroun & K.P. Holmes. (2015). Unleashing the Potential: Transforming Technical and Vocational Education and Training. Paris, France: UNESCO [United Nations Education, Scientific, and Cultural Organization]. Available online also at: https://unesdoc.unesco.org/ark:/48223/pf0000233030 [accessed in Tanjong Malim, Malaysia: August 3, 2018].

Mazlan, Alice Suriati et al. [eds]. (2017). Technical Vocational Education & Training (TVET) in Malaysia: Selected Works. Putrajaya, Malaysia: Ministry of Higher Education. Available online also at: http://mycc.my/document/files/PDF%20Dokumen/Technical%20Vocational%20Education [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Middleton, J., A. Ziderman & A.V. Adams. (1993). Skills for Productivity: Vocational Education and Training in Developing Countries. Washington, DC: World Bank.

MoE [Ministry of Education] Malaysia. (2015). Malaysia Education Blueprint, 2015-2025 (Higher Education). Putrajaya, Malaysia: Penerbit KPM [Kementerian Pendidikan Malaysia]. Available online also at: https://www.kooperation-international.de/uploads/media/3._Malaysia_Education_Blueprint_2015-2025Higher_Education.pdf [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Mohajan, Haradhan Kumar. (2017). “Two Criteria for Good Measurements in Research: Validity and Reliability” in Annals of Spiru Haret University, Volume 17(3), pp.58-82. Available online also at: https://mpra.ub.uni-muenchen.de/83458/1/MPRA_paper_83458.pdf [accessed in Tanjong Malim, Malaysia: August 31, 2018].

Mohammad, Maslawati, Naiman Ghazali & Harwati Hashim. (2017). “Secondary School Students’ Perceptions on the Use of Google+ towards Improving ESL Writing Skills”. Unpublished Paper. Available online at: https://pdfs.semanticscholar.org/a948/e68572b87a1f3f623dfe5b97b915414ddce7.pdf [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Nind, M., A. Curtin & K. Hall. (2016). Research Methods for Pedagogy. UK [United Kingdom]: Bloomsbury.

Osman, S.A. et al. (2011). “Assessment on Students Performance Using Rasch Model in Reinforced Concrete Design Course Examination” in Recent Researches in Education. Available online also at: http://www.wseas.us/e-library/conferences/2011/Penang/EDU/EDU-30.pdf [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Othman, Norasmah binti et al. (2014). “Assessing Construct Validity and Reliability of Competitiveness Scale Using Rasch Model Approach” in Proceedings of the WEI International Academic Conference, in Bali, Indonesia. Available online also at: https://www.westeastinstitute.com/wp-content/uploads/2014/06/Suria-Mohd-Salleh.pdf [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Piekkola, B. (2017). Conceptual and Historical Issues in Psychology. London: Sage Publications, edited by Luke Block.

Pirker, Johanna. (2017). “Immersive and Engaging Forms of Virtual Learning: New and Improved Approaches towards Engaging and Immersive Digital Learning”. Unpublished Doctoral Dissertation. Graz: Graz University of Technology. Available online also at: http://jpirker.com/wp-content/uploads/2013/09/dissertation-pirker.compressed.pdf [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Porres, G.T., D. Wildemeersch & M. Simons. (2014). “Reflections on the Emancipatory Potential of Vocational Education and Training Practices: Freire and Rancière in Dialogue” in Studies in Continuing Education, Volume 36(3), pp.275-289.

Prince, M. (2004). “Does Active Learning Work? A Review of the Research” in Journal of Engineering Education, Volume 93(3), pp.223-232.

Rachman, Taufiq & Darmawan Napitupulu. (2017). “Rasch Model for Validation a User Acceptance Instrument for Evaluating E-learning System” in CommIT (Communication & Information Technology) Journal, Volume 11(1), pp.9-16. Available online also at: https://pdfs.semanticscholar.org/9c3d/0928ba50000669f9ae0b876f06f0c4822c62.pdf [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Ramezankhani, Ali et al. (2015). “Design and Development of a Scale of Perceived Barriers to Self-Care in Patients with Type 2 Diabetes Mellitus: An Exploratory Factor Analysis” in Electronic Physician: Excellence in Constructive Peer Review, Volume 7(7), November, pp.1486-1493. Available online also at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4700894/ [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Sabudin, S. et al. (2018). “Validity and Reliability of Students’ Science and Technology Culture Instrument (BST-M) Using Rasch Measurement Model” in International Journal of Academic Research in Business and Social Sciences, Volume 8(5), pp.986-995. Available online also at: http://hrmars.com/hrmars_papers/Validity_and_Reliability_of_Students%E2%80%99_Science_and_Technology_Culture_Instrument_(BST-M)_using_Rasch_Measurement_Model.pdf [accessed in Tanjong Malim, Malaysia: February 21, 2019].

Savard, A. & V. Freiman. (2016). “Investigating Complexity to Assess Student Learning from a Robotics-Based Task” in Digital Experiences in Mathematics Education, Volume 2, Issue 2 [September], pp.93-114. Available online also at: https://link.springer.com/article/10.1007/s40751-016-0016-6 [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Scott, Kimberly S. (2017). “An Integrative Framework for Problem-Based Learning and Action Learning: Promoting Evidence-Based Design and Evaluation in Leadership Development” in Human Resource Development Review, Volume 16(1), pp.3-34. Available online also at: https://journals.sagepub.com/doi/pdf/10.1177/1534484317693090 [accessed in Tanjong Malim, Malaysia: August 3, 2018].

Sharif, M.S. et al. (2019). “Construct Validity and Reliability of Manufacturing Industry: A Rasch Measurement Model Approaches for Pilot Study” in International Journal of Academic Research in Business and Social Sciences, Volume 9(3), pp.654-665. Available online also at: http://hrmars.com/hrmars_papers/Construct_Validity_and_Reliability_of_Manufacturing_Industry_A_Rasch_Measurement_Model_Approaches_for_Pilot_Study.pdf [accessed in Tanjong Malim, Malaysia: March 24, 2019].

Smerling, N. (2017). “Why Teachers Will Never be Replaced by Robots”. Available online also at: https://www.studyinternational.com/news/robot-teachers/ [accessed in Tanjong Malim, Malaysia: August 10, 2018].

Souza, M.A.P. et al. (2017). “Rasch Analysis of the Participation Scale (P-Scale): Usefulness of the P-Scale to a Rehabilitation Services Network” in BMC Public Health, Volume 17:934. Available online also at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5721585/ [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Sumintono, B. & W. Widhiarso. (2015). Aplikasi Model Rasch untuk Penelitian Ilmu-ilmu Sosial. Cimahi, Jawa Barat, Indonesia: Trimkomunikata.

Taber, Keith S. (2018). “The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education” in Research in Science Education, Volume 48, pp.1273-1296. Available online also at: https://link.springer.com/article/10.1007/s11165-016-9602-2 [accessed in Tanjong Malim, Malaysia: February 21, 2019].

Tavakol, Mohsen & Reg Dennick. (2013). “Psychometric Evaluation of a Knowledge Based Examination Using Rasch Analysis: An Illustrative Guide, AMEE Guide No.72” in Medical Teacher, Volume 35(1), pp.e838-e848. Available online also at: https://doi.org/10.3109/0142159X.2012.737488 [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Willingham, Daniel T., Elizabeth M. Hughes & David G. Dobolyi. (2015). “The Scientific Status of Learning Styles Theories” in Teaching of Psychology, Volume 42(3), July, pp.266-271. doi: 10.1177/0098628315589505.

Yasin, Ruhizan Mohd et al. (2015). “Validity and Reliability Learning Transfer Item Using Rasch Measurement Model” in PROCEDIA: Social and Behavioral Sciences, Volume 204, pp.212-217. Available online also at: https://pdf.sciencedirectassets.com/277811/1-s2.0-S1877042815X00413 [accessed in Tanjong Malim, Malaysia: August 24, 2018].

Young, Michael. (2014). “Curriculum Theory: What it is and Why it is Important” in Cadernos de Pesquisa, Vol.44, No.151 [January-March]. Available online also at: http://www.scielo.br/scielo.php?pid=S0100-15742014000100010&script=sci_arttext&tlng=en [accessed in Tanjong Malim, Malaysia: August 3, 2018].




DOI: https://doi.org/10.2121/.v2i1.1255

DOI (PDF): https://doi.org/10.2121/.v2i1.1255.g1086

Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 HONAI

Creative Commons License
HONAI: International Journal for Educational, Social, Political & Cultural Studies. This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License

View My Stats