| Peer-Reviewed

Skill Assessment of Student in Learning Service Stations Mechanic Work and Petrol Engine Maintenance Work Through Evidenced-Based Test at the Technical College

Received: 25 May 2023    Accepted: 12 June 2023    Published: 4 August 2023
Views:       Downloads:
Abstract

The study focused on development and validation of evidenced-based test items as a means of improving the skill assessment of student in learning Service Station Mechanic work and Petrol Engine Maintenance work at the technical college. The study adopted instrumentation design and was carried out in Ekiti and Ondo states. The population of the is 125 technical three student (final year student) in the study area. A101 evidenced-based test items was developed and utilized by the study. The instrument was subjected to face and content validation by experts from Measurement and Evaluation and subject matter experts respectively from the University of Nigeria, Nsukka and Federal University of Technology, Minna. The psychometrics properties of the items were first determined by administering the instrument on a pilot sample drawn outside the study area. The reliability of the instrument was determined by using split-half technique and Kudder-Richardson KR-20, and it yielded a coefficient of 0.87 for service station mechanic work and 0.86 for petrol engine maintenance work. Percentages, indices of difficulty, discrimination, distractors and KR-20 were utilized in answering the research questions. It was revealed by the study that the items of the evidenced-based test had a difficulty indices between 0.30 and 0.70, discrimination of not less than 0.20, positive distraction. It was therefore recommended by the study that the examination bodies and classroom teachers should adopt the evidenced-based test in the certification of their student and also in assessing the level of the skill possessed by the student during classroom instruction.

Published in International Journal of Science, Technology and Society (Volume 11, Issue 4)
DOI 10.11648/j.ijsts.20231104.12
Page(s) 140-152
Creative Commons

This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.

Copyright

Copyright © The Author(s), 2024. Published by Science Publishing Group

Keywords

Development, Validation, Evidence-Based, Test Items, Assessment, Service Station Mechanics

References
[1] Airforce Handbook (2002). Information for Designers of Instructional Systems: Test and Measurement Handbook. Vol. 12 Retrieved February 25, 2009, from http://www.e-publishing.af.mil/shared/media/epubs/AFH36-2235V12.pdf
[2] Josep M Argimon-Pallàs, Gemma Flores-Mateo, Josep Jiménez-Villa, 1 and Enriqueta Pujol-Ribera (2010) Psychometric properties of a test in evidence based practice: the Spanish version of the Fresno test. BMC Education 10, 45.
[3] Agrimon-Pallas, M. J; Flores-Mateo, G,; Jimenev-Villa, J and Pujol-Ribera, J. (2011). Psychometric properties of a test in evidence based practice: the Spanish version of the Fresno test. Retrieved June 25 from http://www.biomedcentral.com/1472-6920/10/45
[4] Ali, A., Ezeadi, S., &Ogbazi, N. J. (1988). Introduction to Educational Measurement and Evaluation. Awka: Meks Unique Publishers.
[5] Aworefa, T. A. (2005). Designing Instruments for Measuring Students Educational Outcomes: The NABTEB Approach. Retrieved February 25, 2009 From http://www.curriculum.wcape.school.za/resource_files/22110445_28.doc.
[6] Berg, B. L. (2001). Qualitative Research Methods for the Social Sciences. (4thed). Needham Heights, M. A: Allyn and Bacon.
[7] Cohen, R. J &Swerdlik, M. E. (2003). Psychological Testing and Assessment: An Introduction to Test and Measurement. 5/e. New York: McGraoltill.
[8] Cohen, L., Manion, L., & Morrision, K (2011). Research Methods in Education 6/e. New York: Routldge Taylor &Francis.
[9] Daramola, C. O (1991). Nomadic Education: A reflection of Rural Development. Nigerian Journal of Educational Foundation 1 (1) 93-99.
[10] Edikpa, E. C. (2004). Development and Validation of Decision- Making Skill Inventory for Secondary School Principal in Anambra state. Unpublished Ph.D Thesis. University of Nigeria, Nsukka.
[11] Esterberg, K. G. (2002). Qualitative Methods in Social Sciences Research. New York: McGraw Hill.
[12] Erjavec, J (2010). Automotive Technology: A Systems Approach. 5/e United Kingdom: Delmar Cengage Learning.
[13] Federal Ministry of Education, Science and Technology (2013). National Policy on Education. Lagos: NERDC Press.
[14] Federal Government of Nigeria (2013). National Policy On Education. Abuja: NERDC.
[15] Federal Ministry of Education (2009) Draft: Roadmap for Nigerian Educational Sector. Abuja: Federal Ministry of Education.
[16] Fraenkel, J. R., &Wallen, N. E. (2012). How to Design and Evaluate Research in Education. 5/e. New York: McGraw Hill.
[17] Gall, M. D., Gall, J. P., & Borg, W. R (2007). Educational Research: An Introduction 8/e. New York: Pearson Education Inc.
[18] Gronlund, N. E (1993). How to make Achievement tests and Assessments. 5/e New York. Allyn and Bacon.
[19] Gronlund, N. E., & Linn, R. L. (1990). Measurement and Evaluation in teaching. 6/e New York: Macmillan.
[20] Haladyna, T. M., & Downing, S. M. (2004). Constructing Irrelevant Variance in High-Stakes Testing. Educational Measurement: Issues and Practice, 23 (1), 17-27.
[21] HendricsonWD, Rugh J. D, Hatch J. P, Stark D. L, Deahl T. Wallmann, E. R (2011). Validation of an instrument to assess evidence-based practice knowledge, attitudes, access, and confidence in the dental environment. Retrieved July 25 from http://www.biomedcentral.com/1472-6920/10/45/prepub
[22] Haladyna, T. M. (1999). Developing and Validating Multiple-choice items. (2nd Ed.) Mahwah, NJ: Lawrence Erlbaum Associates.
[23] Haladyna, T. M., & Downing, S. M (1989b). Validity of a taxonomy of Multiple-choice item-writing rules. Applied Measurement in Education, 2 (1), 37-50.
[24] Hillier, V. A. W., & Coombes, P (2004). Hilliers Fundamentals of Motor Vehicle Technology. 5/e United Kingdom: Nelson Thornes.
[25] Hillier, V. A. W., & Rogers, D. R. (2007). Hililer`s Fundamentals of Motor Vehicle Technology: Chasis and Body Electronics. Book 3. United Kingdom: Nelson Thornes Ltd.
[26] Hillier, V. A. W., Coombes, P., & Rogers, D. R. (2006) Hillier`sFundamentals of Motor Vehicle Technology: Power Train Electronics. Book 2. United Kingdom: Nelson Thornes Ltd.
[27] Karl, S. (2004). Motor Vehicle Maintenance. Retrieved on July 16, 2009, from http://www.findarticles.com/p/articles/mi-qa3828/ai_n9453105
[28] Kehoe, J (1995). Basic Item Analysis for Multiple-choice Test. Practical Assessment, Research and Evaluation, 4 (10) Retrieved February 25, 2009 from http://PAREonline.neg/getun.asp?v=4dn=10.
[29] Kehoe, J. (1995) Writing Multiple-choice test items. Practical Assessment, Research and Evaluation. 4 (9) Retrieved February 25, 2009 from http://pareonline.net/getvnasp?v=4dn=9
[30] Lawshe, C. H (1973). A quantitative approach to content Validity. Personnel Psychology, 28 (4) 563-575.
[31] Linguist, R. (1998). Quality Improvements of Teaching and Learning in Higher Education: A comparison with Developments in Industrial Setting. Teaching in Higher Education. 3 (1) 51-62.
[32] Linn, R. L., Baker, E. L., & Dunbar, S. B. (1991). Complex Performance-Based Assessment: Expectations and Validation Criteria. Retrieved July 16, 2009 from http://www.cse.ucla.edu/RESST/Report/TECH33/-pdf
[33] Ming, L; Wilkerson, L; Reuben, D & Ferrell, B. A (2004). Development and Validation of Geriatrics Knowledge test for medical student. Journal of the American Geriatrics Society. ISSN 0002-8614.
[34] Mehrens, W. A., & Lehman, I. J. (1991). Measurement and Evaluation in Education and Psycholoy. (4/e). Orlando, EL: Holt Reinhart and Winston Inc.
[35] Morris, L. L., Fitz-Gibbon, C. C., & Lindneim, E. (1987). How to Measure Performance and use tests. Newburg Park California: SAGE Publications, Lnc.
[36] Mayberry. P. W., & Carey, N. B. (1999). Job Performance Tests for Motor Transport Mechanics. Vol II: Administrative Duties and Job Knowledge Test. Retrieved August 18, 2009, from http://www.oai.dtic.mil/oai/oai?vert=getRecord&netadataprefix=htm.
[37] NBTE (2003). Motor Vehicle Mechanics Work-National Technical Certificate (NTC) and Advanced National Technical Certificate (ANTC). National Board for Technical Education. National Technical Certificate.
[38] NBTE. (2001). National Technical Certificate and Advanced National Technical Certificate Curriculum and Module Specifications in Motor Vehicle Mechanic Work. Kadunna: National Board for Technical Education. Retrieved on September 25, 2009 from http://www.unesco.unesco.org/images/001613/161378e.pdf
[39] Nworgu, B. G. (2006). Educational Research: Basic Issues and Methodology. Ibadan: Wisdom Publishers Ltd.
[40] Nwana, O. C. (2007). Textbook on Educational Measurement and Evaluation. Owerri: Bomaway Publishers.
[41] Odu, E. N &Ihejaimaizu, E. C (2001). Statistics and Basic Methods in Education and Social Sciences. Calabar: University of Calabar.
[42] Onyiliofe, M. P (2008). Development and Validation of Criterion reference Test for Assessing student Performance in Petrol Engine Maintenance. Unpublished M.Ed Thesis, University of Nigeria, Nsukka.
[43] Offorma, G. C (2002). Curriculum Theory and Planning. Enugu: Family Circle Publications.
[44] Okeme, I. (2011). Development and Validation of Pschoproductive skill multiple choice test items in Agricultural science for student in secondary schools. Unpublished Ph.D Thesis. University of Nigeria, Nsukka.
[45] Okoro, O. M. (2002). Measurement and Evaluation in EducationObosi: Pacific Publisher Ltd.
[46] Okpala, P. N., Onocha, C. O., & Oyedeji, O. A (1993). Measurement and Evaluation in Education. Ibadan: Stirling-Horden Publishers.
[47] Olaitan, S. O., & Ali, A. (1999). The Making of Curriculum: Theory, Process, and Product, and Evaluation. Owerri: Cape Publishers Ltd.
[48] Osterlind, S. J. (1989). Constructing Test Items. Norwell, M. A.: Kluwer Academic Publishers.
[49] Olubodun, O. J. (2007). Test Construction Techniques and Principles: Study Guide. Retrieved on August 20, 2009, from http://www.ebaringenropa.infor/out/?doc_id=12/53drsrid=13219.pdf.
[50] Okorie (2004). Introduction to Industrial Technical education. Onitsha: Cheston Publishers Limited.
[51] Okeke, E. U & Okoye (2007) Methodologies in Education. Awka: Spectrum Publishers.
[52] Salami, K. A. (2004). Auto-Technology Fundamentals. Series 1-3. Ibadan: University Press Plc.
[53] WEB (2011). Glossary of Keywords. Accessed on 23rd March, 2011 from http://writting.colstate.edu/guides/research/glossary
[54] Simpson, E. J (1972). The Classification of Educational Objectives in the Psychomotor Domain. The Psychomotor Domain 3 (2) 43-46.
Cite This Article
  • APA Style

    Olaitan Olawale Opeyemi, Ike Joshua Onyedikachi. (2023). Skill Assessment of Student in Learning Service Stations Mechanic Work and Petrol Engine Maintenance Work Through Evidenced-Based Test at the Technical College. International Journal of Science, Technology and Society, 11(4), 140-152. https://doi.org/10.11648/j.ijsts.20231104.12

    Copy | Download

    ACS Style

    Olaitan Olawale Opeyemi; Ike Joshua Onyedikachi. Skill Assessment of Student in Learning Service Stations Mechanic Work and Petrol Engine Maintenance Work Through Evidenced-Based Test at the Technical College. Int. J. Sci. Technol. Soc. 2023, 11(4), 140-152. doi: 10.11648/j.ijsts.20231104.12

    Copy | Download

    AMA Style

    Olaitan Olawale Opeyemi, Ike Joshua Onyedikachi. Skill Assessment of Student in Learning Service Stations Mechanic Work and Petrol Engine Maintenance Work Through Evidenced-Based Test at the Technical College. Int J Sci Technol Soc. 2023;11(4):140-152. doi: 10.11648/j.ijsts.20231104.12

    Copy | Download

  • @article{10.11648/j.ijsts.20231104.12,
      author = {Olaitan Olawale Opeyemi and Ike Joshua Onyedikachi},
      title = {Skill Assessment of Student in Learning Service Stations Mechanic Work and Petrol Engine Maintenance Work Through Evidenced-Based Test at the Technical College},
      journal = {International Journal of Science, Technology and Society},
      volume = {11},
      number = {4},
      pages = {140-152},
      doi = {10.11648/j.ijsts.20231104.12},
      url = {https://doi.org/10.11648/j.ijsts.20231104.12},
      eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ijsts.20231104.12},
      abstract = {The study focused on development and validation of evidenced-based test items as a means of improving the skill assessment of student in learning Service Station Mechanic work and Petrol Engine Maintenance work at the technical college. The study adopted instrumentation design and was carried out in Ekiti and Ondo states. The population of the is 125 technical three student (final year student) in the study area. A101 evidenced-based test items was developed and utilized by the study. The instrument was subjected to face and content validation by experts from Measurement and Evaluation and subject matter experts respectively from the University of Nigeria, Nsukka and Federal University of Technology, Minna. The psychometrics properties of the items were first determined by administering the instrument on a pilot sample drawn outside the study area. The reliability of the instrument was determined by using split-half technique and Kudder-Richardson KR-20, and it yielded a coefficient of 0.87 for service station mechanic work and 0.86 for petrol engine maintenance work. Percentages, indices of difficulty, discrimination, distractors and KR-20 were utilized in answering the research questions. It was revealed by the study that the items of the evidenced-based test had a difficulty indices between 0.30 and 0.70, discrimination of not less than 0.20, positive distraction. It was therefore recommended by the study that the examination bodies and classroom teachers should adopt the evidenced-based test in the certification of their student and also in assessing the level of the skill possessed by the student during classroom instruction.},
     year = {2023}
    }
    

    Copy | Download

  • TY  - JOUR
    T1  - Skill Assessment of Student in Learning Service Stations Mechanic Work and Petrol Engine Maintenance Work Through Evidenced-Based Test at the Technical College
    AU  - Olaitan Olawale Opeyemi
    AU  - Ike Joshua Onyedikachi
    Y1  - 2023/08/04
    PY  - 2023
    N1  - https://doi.org/10.11648/j.ijsts.20231104.12
    DO  - 10.11648/j.ijsts.20231104.12
    T2  - International Journal of Science, Technology and Society
    JF  - International Journal of Science, Technology and Society
    JO  - International Journal of Science, Technology and Society
    SP  - 140
    EP  - 152
    PB  - Science Publishing Group
    SN  - 2330-7420
    UR  - https://doi.org/10.11648/j.ijsts.20231104.12
    AB  - The study focused on development and validation of evidenced-based test items as a means of improving the skill assessment of student in learning Service Station Mechanic work and Petrol Engine Maintenance work at the technical college. The study adopted instrumentation design and was carried out in Ekiti and Ondo states. The population of the is 125 technical three student (final year student) in the study area. A101 evidenced-based test items was developed and utilized by the study. The instrument was subjected to face and content validation by experts from Measurement and Evaluation and subject matter experts respectively from the University of Nigeria, Nsukka and Federal University of Technology, Minna. The psychometrics properties of the items were first determined by administering the instrument on a pilot sample drawn outside the study area. The reliability of the instrument was determined by using split-half technique and Kudder-Richardson KR-20, and it yielded a coefficient of 0.87 for service station mechanic work and 0.86 for petrol engine maintenance work. Percentages, indices of difficulty, discrimination, distractors and KR-20 were utilized in answering the research questions. It was revealed by the study that the items of the evidenced-based test had a difficulty indices between 0.30 and 0.70, discrimination of not less than 0.20, positive distraction. It was therefore recommended by the study that the examination bodies and classroom teachers should adopt the evidenced-based test in the certification of their student and also in assessing the level of the skill possessed by the student during classroom instruction.
    VL  - 11
    IS  - 4
    ER  - 

    Copy | Download

Author Information
  • Department of Industrial Technical Education, University of Nigeria, Enugu, Nigeria

  • Department of Industrial Technical Education, University of Nigeria, Enugu, Nigeria

  • Sections