Protocol: How to measure teamwork and networking competencies

Juan A. Marin-Garcia, Maribel Martínez Villaescusa, Tomás Bonavía

Abstract

Our aim is present a protocol to develop a measurement questionnaire that allows a valid and reliable self-evaluation of the transversal competencies related to team work (TW) and networking (NW). It will be design to evaluate these competences among professionals from different organizations or job applicants. In this paper, we will focus on how to filter a bank of behavioral items, verifying that the items finally analysed: a) Represent one or several conceptual dimensions within TW or NW. b) Ensure the inter-agreement between independent evaluators to analyze the overlap between items and dimensions, and be able to classify the items in the correct dimension.c) Check that the set of items retained by agreement between evaluators represent all the subdimensions of team work and networking.


Keywords

protocol; learning; soft-skills; teamwork; networking; measurement model

Full Text:

PDF ES

References

Andreu-Andres, M.-A., Gonzalez-Ladron-de-Guevara, F. R., Garcia-Carbonell, A., & Watts-Hooge, F. (2018). Contrasting innovation competence FINCODA model in software engineering: Narrative review. Journal of Industrial Engineering and Management, 11(4), 715. https://doi.org/10.3926/jiem.2656

Andreu-Andrés, M. Á., Marin-Garcia, J. A., & García-Carbonell, A. (2017). El Barómetro INCODE como herramienta de autoevaluación de las competencias de innovación. REDU Revista de Educación Universitaria, 15(2), 275–294. https://doi.org/10.4995/redu.2017.7746

Andreu Andrés, M. A., & García-Casas, M. (2014). La evaluación de la participación en equipos de trabajo universitarios (Assessment of participation in higher education team working activities). WPOM-Working Papers on Operations Management, 5(1). https://doi.org/http://dx.doi.org/10.4995/wpom.v5i1.1758

ATLAS.ti Scientific Software Development GmbH. (2018). Atlas.ti vers 8.2.

Betta, M. (2016). Self and others in team-based learning: Acquiring teamwork skills for business. Journal of Education for Business, 91(2), 69–74. https://doi.org/10.1080/08832323.2015.1122562

Dibble, R., & Gibson, C. B. (2018). Crossing team boundaries: A theoretical model of team boundary permeability and a discussion of why it matters. Human Relations, 71(7), 925–950. https://doi.org/10.1177/0018726717735372

Diez, E. V, Zárraga-Rodríguez, M., & García, C. J. (2013). A tool to assess teamwork performance in higher education [Herramienta para evaluar el funcionamiento de los equipos de trabajo en entornos docentes]. Intangible Capital, 9(1), 281–304. https://doi.org/10.3926/ic.399

Francis, D., & Young, D. (1992). Improving work groups: A practical manual for team building. San Diego,CA: Pfeiffer.

Friese, S. (2018). Atlas.Ti 8 windows user manual. Updated for program version 8.2. Berlin: ATLAS.ti Scientific Software Development GmbH.

Gibson, C., Hardy III, J. H., & Buckley, M. R. (2014). Understanding the role of networking in organizations. CAREER DEVELOPMENT INTERNATIONAL, 19(2), 146–161. https://doi.org/10.1108/CDI-09-2013-0111

Gómez-Gasquet, P., Verdecho, M. J., Rodriguez-Rodriguez, R., & Alfaro-Saiz, J. J. (2018). Formative assessment framework proposal for transversal competencies: Application to analysis and problem-solving competence. Journal of Industrial Engineering and Management, 11(2), 334. https://doi.org/10.3926/jiem.2504

Huang, Y.-M. (2016). Networking behavior: from goal orientation to promotability. PERSONNEL REVIEW, 45(5), 907–927. https://doi.org/10.1108/PR-03-2014-0062

Itani, M., & Srour, I. (2016). Engineering Students’ Perceptions of Soft Skills, Industry Expectations, and Career Aspirations. Journal of Professional Issues in Engineering Education and Practice, 142(1). https://doi.org/10.1061/(ASCE)EI.1943-5541.0000247

Juárez Tarrega, A., Marin-Garcia, J. A., & Santandreu-Mascarell, C. (2019). What are the main concerns of Human Resource managers in organizations? Intangible Capital, In press. https://doi.org/10.3926/ic.1342

Keinanen, M., Ursin, J., & Nissinen, K. (2018). How to measure students’ innovation competences in higher education: Evaluation of an assessment tool in authentic learning environments. STUDIES IN EDUCATIONAL EVALUATION, 58, 30–36. https://doi.org/10.1016/j.stueduc.2018.05.007

Krippendorff, K. (2018). Content analysis : an introduction to its methodology. Thousand Oaks: SAGE Publications Inc.

Krippendorff, K., Mathet, Y., Bouvry, S., & Widlöcher, A. (2016). On the reliability of unitizing textual continua: Further developments. Quality & Quantity, 50(6), 2347–2364. https://doi.org/10.1007/s11135-015-0266-1

Lans, T., Blok, V., & Gulikers, J. (2015). Show me your network and I’ll tell you who you are: social competence and social capital of early-stage entrepreneurs. ENTREPRENEURSHIP AND REGIONAL DEVELOPMENT, 27(7–8, SI), 458–473. https://doi.org/10.1080/08985626.2015.1070537

Lawler III, E. E. (2005). From human resource management to organizational effectiveness. Human Resource Management, 44(2), 165–169. https://doi.org/10.1002/hrm.20059

Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x

Lukes, M., & Stephan, U. (2017). Measuring employee innovation: A review of existing scales and the development of the innovative behavior and innovation support inventories across cultures. International Journal of Entrepreneurial Behavior & Research, 23(1), 136–158. https://doi.org/10.1108/IJEBR-11-2015-0262

Luna-Arocas, R., & Camps, J. (2008). A model of high performance work practices and turnover intentions. Personnel Review, 37(1–2), 26–46. https://doi.org/10.1108/00483480810839950

Marin-Garcia, J. A. (2018). Development and validation of Spanish version of FINCODA: an instrument for self-assessment of innovation competence of workers or candidates for Jobs. WPOM-Working Papers on Operations Management, 9(2), 182–215. https://doi.org/10.4995/wpom.v9i2.10800

Marin-Garcia, J. A. (2019). Development and validation of Spanish version of Soft Skills Scale (SSS17sp). WPOM-Working Papers on Operations Management, 10(in press).

Marin-Garcia, J. A., Andreu Andres, M. A., Atares-Huerta, L., Aznar-Mas, L. E., Garcia-Carbonell, A., González-Ladrón-de-Guevara, F., … Watts, F. (2016a). Propossal of Framework for Innovation Competencies Development and Assessment (FINCODA). WPOM-Working Papers on Operations Management, 7(2), 119–126. https://doi.org/http://dx.doi.org/10.4995/wpom.v7i2.6472

Marin-Garcia, J. A., Aznar-Mas, L. E., & González-Ladrón-de-Gevara, F. (2011). Innovation types and talent managment for innovation. Working Papers on Operations Management, 2(2), 25–31. https://doi.org/10.4995/wpom.v2i2.926

Marin-Garcia, J. A., Betancour, E., & Giraldo-OMeara, M. (2018). Protocol: Literature review on the psychometric properties of the short versions of the scales of social desirability in the answers to competency self-assessment questionnaires. WPOM-Working Papers on Operations Management, 9(1), 16. https://doi.org/10.4995/wpom.v9i1.9172

Marin-Garcia, J. A., & Lloret, J. (2011). Industrial Engineering Higher Education in the European Area (EHEA). Journal of Industrial Engineering and Management, 4(1), 1–12. https://doi.org/10.3926/jiem..v4n1.p1-12

Marin-Garcia, J. A., Marin-Garcia, T., Perello-Marin, M. R., & Garcia-Sabater, J. J. (2010). Selección de plataformas para el trabajo colaborativo en grupos deslocalizados: formulación del problema. Working Papers on Operations Management, 1(1), 41–45. https://doi.org/10.4995/wpom.v1i1.798

Marin-Garcia, J. A., Miralles, C., & Marín, M.-P. (2008a). Oral presentation and assessment skills in engineering education. International Journal of Engineering Education, 24(5), 926–935.

Marin-Garcia, J. A., Miralles Insa, C., Garcia-Sabater, J. J., & Vidal Carreas, P. I. (2008b). Teaching management based on students teamwork: advantages, drawbacks and proposals for action. Intangible Capital, 4(2), 143–165. Retrieved from http://www.upv.es/i.grup/repositorio/own/MarinEtAl2008Teaching management based on students teamwork.pdf

Marin-Garcia, J. A., Santandreu-Mascarell, C., Maheut, J., Sorolla, G. R., Rius Sorolla, G., & Sorolla, G. R. (2016b). El efecto del empleo de anclas verbales o numéricas en una rúbrica para evaluar presentaciones orales, sobre la consistencia de las puntuaciones de los alumnos universitarios. In-Red 2016 - Congreso de Innovación Educativa y Docencia En Red de La Universitat Politècnica de València. Retrieved from http://ocs.editorial.upv.es/index.php/INRED/INRED2016/paper/view/4314

Marin-Garcia, J. A., & Zarate-Martinez, M. E. (2008). An integrative model of knowledge management and team work. Intangible Capital, 4(4), 255–280. https://doi.org/10.3926/ic.2008.v4n4.p255-280

Nesheim, T., Olsen, K. M., & Sandvik, A. M. (2017). Never walk alone: achieving work performance through networking ability and autonomy. Employee Relations, 39(2), 240–253. https://doi.org/10.1108/ER-09-2016-0185

Noonan, M. P., Mars, R. B., Sallet, J., Dunbar, R. I. M., & Fellows, L. K. (2018). The structural and functional brain networks that support human social networks. BEHAVIOURAL BRAIN RESEARCH, 355(SI), 12–23. https://doi.org/10.1016/j.bbr.2018.02.019

Penttilä, T., & Kairisto-Mertanene, L. (2012). Innovation competence barometer ICB - a tool for assessing students’ innovation competences as learning outcomes in higher education. INTED2012 Conference. 5th-7th March 2012, 6347–6351. Valencia, Spain.

Perello-Marin, M. R., Vidal-Carreras, P. I., & Marin-Garcia, J. A. (2016). What do undergraduates perceive about teamwork? International Journal of Engineering Education, 32(3).

Pérez Peñalver, M. J., Aznar Mas, L. E., & Montero Fleta, B. (2018). Identification and classification of behavioural indicators to assess innovation competence. Journal of Industrial Engineering and Management, 11(1), 87. https://doi.org/10.3926/jiem.2552

Porter, C. M., Woo, S. E., & Campion, M. A. (2016). INTERNAL AND EXTERNAL NETWORKING DIFFERENTIALLY PREDICT TURNOVER THROUGH. PERSONNEL PSYCHOLOGY, 69(3), 635–672. https://doi.org/10.1111/peps.12121

Rasdi, R. M., Garavan, T. N., & Ismail, M. (2013). Networking behaviours and managers’ career success in the Malaysian public service: The moderating effect of gender. Personnel Review, 42(6), 684–703. https://doi.org/10.1108/PR-07-2010-0117

Sanchez, L., Blanco, B., & Marin-Garcia, J. A. (2017). Protocol: validation of the INCODE barometer to measure the innovation competence through the Rasch Measurement Theory. WPOM-Working Papers on Operations Management, 8(Special Issue), 120–124. https://doi.org/10.4995/wpom.v8i0.7190

Soetanto, D., Huang, Q., & Jack, S. (2018). Obstacles, Networking Approaches and Entrepreneurial Network Changes. EUROPEAN MANAGEMENT REVIEW, 15(2), 171–189. https://doi.org/10.1111/emre.12183

Tehseen, S., & Sajilan, S. (2016). Network competence based on resource-based view and resource dependence theory. International Journal of Trade and Global Markets, 9(1), 60–82. https://doi.org/10.1504/IJTGM.2016.074138

Ter Haar, P. (2018). Measuring innovation: A state of the science review of existing approaches. Intangible Capital, 14(3), 409. https://doi.org/10.3926/ic.1254

Terrés Goena, J. I., Lleó de Nalda, Á., Viles Díez, E., & Santos García, J. (2018). Competencias profesionales 4.0. tecnun. Universidad de Navarra.

Tristan-Lopez, A. (2008). Modificación al modelo de Lawshe para el dictamen cuantitativo de la validez de contenido de un instrumento objetivo. Avances En Medición, 6(1), 37–48. Retrieved from https://dialnet.unirioja.es/servlet/articulo?codigo=2981185

Villa Sánchez, A., & Poblete, M. (2007). Aprendizaje basado en competencias. Una propuesta para la evaluación de las competencias genéricas. Bilbao: Universidad de Deusto.

World Economic Forum, & Forum, W. E. (2016). Global Challenge insight report: The Future of Jobs. Employment, Skills and Workforce Strategy for the Fourth Industrial Revolution. January 2016. Geneva: REF 010116.

Abstract Views

1490
Metrics Loading ...

Metrics powered by PLOS ALM

Refbacks

  • There are currently no refbacks.


 

Cited-By (articles included in Crossref)

This journal is a Crossref Cited-by Linking member. This list shows the references that citing the article automatically, if there are. For more information about the system please visit Crossref site

1. Avances de los investigadores españoles de Dirección de Operaciones en el año 2019: el caso de los miembros de ACEDEDOT
Lidia Sanchez-Ruiz, Elsa Diez-Busto
WPOM-Working Papers on Operations Management  vol: 11  issue: 1  first page: 54  year: 2020  
doi: 10.4995/wpom.v11i1.13637



This journal is licensed under a Creative Commons Attribution 4.0 International License.

Universitat Politècnica de València

e-ISSN: 1989-9068   https://doi.org/10.4995/wpom