Development and validation of Spanish version of FINCODA: an instrument for self-assessment of innovation competence of workers or candidates for Jobs
DOI:
https://doi.org/10.4995/wpom.v9i2.10800Keywords:
measurement model, composites, innovation, scale validation, soft skills, transversal competencies, creativity, critical thinking, initiative, PLS, teamwork, formative constructsAbstract
This work will take the innovation transversal competence a skill to create, introduce, adapt and/or apply a beneficial novelty anywhere in an organization. We consider that innovation competences are a multidimensional construct that represents the skills required in all main process steps, from devising ideas, filtering, modeling and selecting them, to putting them into practice and comparing to see if they add value.
In this research we aim to validate the long Spanish version (62 items) of the FINCODA innovation questionnaire (Andreu Andres et al., 2018; Marin-Garcia et al., 2016a) and to check if the medium-length version composition (34 items), that derive from a multi-cultural sample (Butter & van Beest, 2017), is stable with an independent sample of Spanish students. We will also propose a short version from the Soft Skills Scale (SSS17) (Marin-Garcia, 2019), based on single-items of all dimensions, which we will compare with other transversal competences by analyzing the relations among them. Data were obtained from self-perceptions (the evaluated person completes the questionnaire) with Likert/rating scales (Marin-Garcia et al., 2015) of innovation competence dimensions. This questionnaire is devised to be used for processes that select/evaluate the people who opt for a job post, regardless of them recently obtaining university degrees or being professionals.
We examined the main published questionnaires used to measure the innovation competence. The validation of only a few has been published, while no validation has been published in Spanish. We also describe in detail the validation process that we will follow, the employed measuring instrument (by giving a detailed explanation of how the FINCODA questionnaire was built, and by specifying the measuring model and SSS17, F62 and F34 questionnaire items in their English and Spanish versions), the characteristics of the sample of 329 voluntary students, and the analysis procedure following SPSS and smartPLS.
The results show how the measurement model of the long FINCODA questionnaire version presents content validity (relevance and comprehensiveness) and internal consistency (with analysis considering constructs to be either common factors or composites). Nonetheless, the discriminant validity of the constructs could not be demonstrated with the employed sample. Our analyses did not confirm the medium-length version put forward by other authors’ previous research. So, we will consider that versions F62 and F34 are pending to be analyzed with new independent samples, as is the proposal of the new F34 version obtained by more robust methods. The multidimensionality assumption of the innovation construct also needs revising. Having a short innovation scale with 10-15 items at the most is also recommendable. All this is considered future research in the present work.
Downloads
References
Abramis, D. J. (1994). Relationship of job stressors to job performance: Linear or an inverted-u? PSYCHOLOGICAL REPORTS, 75(1), 547-558.
https://doi.org/10.2466/pr0.1994.75.1.547
Amabile, T. M. (1988). A model of creativity and innovation in organizations. Research in organizational behavior, 10(1), 123-167.
American Management Association. (2012). Critical skills survey. https://www.amanet.org/training/articles/ama-2012-critical-skills-survey.aspx: American Management Association.
Anderson, N., Potočnik, K., & Zhou, J. (2014). Innovation and creativity in organizations: A state-of-the-science review, prospective commentary, and guiding framework. Journal of Management, 40(5), 1297-1333. https://doi.org/10.1177/0149206314527128
Andreu-Andrés, M. Á., Marin-García, J. A., & García-Carbonell, A. (2017). El barómetro incode como herramienta de autoevaluación de las competencias de innovación. REDU Revista de Educación Universitaria, 15(2), 275-294. https://doi.org/10.4995/redu.2017.7746
Andreu Andres, M. A., Garcia-Carbonell, A., González-Ladrón-de-Guevara, F., & Watts, F. (2018). Contrasting innovation competence fincoda model in software engineering: Narrative review. Journal of Industrial Engineering and Management, 11(4), 715-734. https://doi.org/10.3926/jiem.2656
Anzengruber, J., & Goetz, M. A. (2018). The cognitive and the action-oriented elements of competence along the innovation process – evidence from r&d teams in the medical equipment sector. International Journal of Human Resource Management, 1-22. https://doi.org/10.1080/09585192.2018.1424013
Aryee, S., Walumbwa, F. O., Zhou, Q., & Hartnell, C. A. (2012). Transformational leadership, innovative behavior, and task performance: Test of mediation and moderation processes. Human Performance, 25(1), 1-25. https://doi.org/10.1080/08959285.2011.631648
Ato, M., & Vallejo, G. (2011). Los efectos de terceras variables en la investigación psicológica. Anales de Psicología, 27(2), 550-561.
Azañedo, C. M., Fernandez-Abascal, E. G., & Barraca, J. (2017). The short form of the via inventory of strengths. Psicothema, 29(2), 254-260. doi:10.7334/psicothema2016.225
Berdrow, I., & Evers, F. T. (2011). Bases of competence: A framework for facilitating reflective learner-centered educational environments. Journal of Management Education, 35(3), 406-427. https://doi.org/10.1177/1052562909358976
Burch, G. S. J., Pavelis, C., & Port, R. L. (2008). Selecting for creativity and innovation: The relationship between the innovation potential indicator and the team selection inventory. International Journal of Selection and Assessment, 16(2), 177-181. https://doi.org/10.1111/j.1468-2389.2008.00422.x
Butter, R., & van Beest, W. (2017). Psychometric validation of a tool for innovation competencies development and assessment using a mixed-method design. Paper presented at the Internal research report of HU.
Cerinsek, G., & Dolinsek, S. (2009). Identifying employees' innovation competency in organisations. Internation Journal of Innovation and Learning, 6(2), 164-177. https://doi.org/10.1504/IJIL.2009.022811
Chatenier, E. D., Verstegen, J. A. A. M., Biemans, H. J. A., Mulder, M., & Omta, O. S. W. F. (2010). Identification of competencies for professionals in open innovation teams. R and D Management, 40(3), 271-280. https://doi.org/10.1111/j.1467-9310.2010.00590.x
Choi, J. N. (2004). Individual and contextual dynamics of innovation-use behavior in organizations. Human Performance, 17(4), 397-414. https://doi.org/10.1207/s15327043hup1704_3
Conference Board of Canada. (2013). General innovation skills aptitude test (gisat 2.0). Retrieved from http://www.conferenceboard.ca/cbi/innovationskills.aspx
De Jong, J., & Den Hartog, D. (2008). Innovative work behaviour: Meassurement and validaton (1467-8691).
De Jong, J., & Den Hartog, D. (2010). Measuring innovative work behaviour. Creativity and Innovation Management, 19(1), 23-36. https://doi.org/10.1111/j.1467-8691.2010.00547.x
Doval Dieguez, E., & Viladrich Segués, M. C. (2011). Desarrollo y adaptación de cuestionarios en el ámbito de la salud. Bellaterra: Laboratori d'Estadística Aplicada i de Modelització (UAB).
Dyer, J. H., Gregersen, H. B., & Christensen, C. M. (2009). The innovator's DNA. Harvard Business Review, 87(12), 60+-60+.
Goffin, K., & Mitchell, R. (2010). Innovation management. New York: Palgrave-MacMillan. https://doi.org/10.1007/978-1-137-04752-6
Gómez-Gasquet, P., Verdecho, M. J., Rodriguez-Rodriguez, R., & Alfaro-Saiz, J. J. (2018). Formative assessment framework proposal for transversal competencies: Application to analysis and problem-solving competence. Journal of Industrial Engineering and Management, 11(2), 334-340. https://doi.org/10.3926/jiem.2504
González Pernía, J. L., & Pe-a-Legazkue, I. (2007). Determinantes de la capacidad de innovación de los negocios emprendedores en espa-a. Economia Industrial(363), 129-147.
Hair, J. F., Hult, G. T., Ringle, C. M., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (pls-sem). 2nd edition. Thousand Oaks: Sage. https://doi.org/10.15358/9783800653614
Hammond, M. M., Neff, N. L., Farr, J. L., Schwall, A. R., & Zhao, X. (2011). Predictors of individual-level innovation at work: A meta-analysis. Psychology of Aesthetics, Creativity, and the Arts, 5(1), 90-115. https://doi.org/10.1037/a0018556
Henseler, J. (2017). User manual adanco 2.0.1 (1st ed.). Kleve: Composite Modeling GmbH & Co.
Henseler, J., Hubona, G., & Ray, P. A. (2016a). Using pls path modeling in new technology research : Updated guidelines. Industrial Management & Data Systems, 116(1), 2-20. https://doi.org/10.1108/IMDS-09-2015-0382
Henseler, J., Ringle, C. M., & Sarstedt, M. (2016b). Testing measurement invariance of composites using partial least squares. International Marketing Review, 33(3), 405-431. https://doi.org/10.1108/IMR-09-2014-0304
Hoai Nam, T., Phong Tuan, N., & Van Minh, N. (2017). Critical successful factors for innovation in vietnamese firms. Journal of Industrial Engineering and Management, 10(3), 522-544. https://doi.org/10.3926/jiem.2020
Hülsmann, M., Tilebein, M., Cordes, P., & Stolarski, V. (2017). Cognitive diversity of top management teams as a competence-based driver of innovation capability Strategy and communication for innovation: Integrative perspectives on innovation in the digital economy (pp. 77-88) https://doi.org/10.1007/978-3-319-49542-2_6
Isaksson, K. (2007). Psychological contracts across employment situations (psycones). Brussels. Retrieved from http://cordis.europa.eu/documents/documentlibrary/100123961EN6.pdf: European Commission.
Jabri, M. (1991). The development of conceptually independent subscales in the measurement of modes of problem solving. Educational & Psychological Measurement, 31, 783-813. https://doi.org/10.1177/001316449105100417
Janssen, O. (2000). Job demands, perceptions of effort-reward fairness and innovative work behaviour. Journal of Occupational and Organizational Psychology(73), 287-302. https://doi.org/10.1348/096317900167038
Jarvis, C.-B., MacKenzie, S.-B., & Podsakoff, P.-M. (2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30(2), 199-218. https://doi.org/10.1086/376806
Karwowski, M., Lebuda, I., Wisniewska, E., & Gralewski, J. (2013). Big five personality traits as the predictors of creative selfâ€efficacy and creative personal identity: Does gender matter? The Journal of Creative Behavior, 47(3), 215-232. https://doi.org/10.1002/jocb.32
Keinänen, M., & Oksanen, A. (2017). Students' perception of learning innovation competences in activity-based learning environment. Ammattikasvatuksen aikakauskirja, 19(4), 48-61.
Keinänen, M., Ursin, J., & Nissinen, K. (2018). How to measure students' innovation competences in higher education: Evaluation of an assessment tool in authentic learning environments. Studies in Educational Evaluation, 58, 30-36. https://doi.org/10.1016/j.stueduc.2018.05.007
Kirton, M. (1976). Adaptors and innovators: A description and measure. Journal of Applied Psychology, 61(5), 622-629. https://doi.org/10.1037/0021-9010.61.5.622
Kleysen, R. F., & Street, C. T. (2001). Toward a multi-dimensional measure of individual innovative behavior. Journal of intellectual Capital. https://doi.org/10.1108/EUM0000000005660
Klippel, A. F., Petter, C. O., & Antunes, J. (2008). Management innovation, a way for mining companies to survive in a globalized world. Paper presented at the Utilities Policy European Regulatory Perspectives. https://doi.org/10.1016/j.jup.2007.09.001
Lehto, A., Kairisto-Mertanene, L., & Penttilä, T. (2011). Towards innovation pedagogy. A new approach to teaching and learning for universities of applied sciences. Turku: Turku University of Apllied Sciences.
Losilla, J. M., Navarro, J. B., Palmer, A., Rodrigo, M. F., & Ato, M. (2005). Análisis de datos. Del contraste de hipótesis al modelado estadístico. Barcelona: Edicions a Petició.
Luke, R. (2013). Measuring innovation skills acquired by college and polytechnic students through applied research. Technology Innovation Management Review(October), 36-43. https://doi.org/10.22215/timreview/735
Marin-Garcia, J. A. (2019). Development and validation of spanish version of soft skills scale (sss17sp). WPOM-Working Papers on Operations Management, 10(in press).
Marin-Garcia, J. A., Alfalla-Luque, R., & Machuca, J. A. D. (2018). A triple-a supply chain measurement model: Validation and analysis. International Journal of Physical Distribution & Logistics Management, 48(10), 976-994. https://doi.org/10.1108/IJPDLM-06-2018-0233
Marin-Garcia, J. A., Andreu Andres, M. A., Atares-Huerta, L., Aznar-Mas, L. E., Garcia-Carbonell, A., González-Ladrón-de-Guevara, F., Watts, F. (2016a). Propossal of framework for innovation competencies development and assessment (fincoda). WPOM-Working Papers on Operations Management, 7(2), 119-126. https://doi.org/10.4995/wpom.v7i2.6472
Marin-Garcia, J. A., Atares-Huerta, L., & Aznar-Mas, L. E. (2017). ¿cuántas competencias transversales podemos diferenciar en un auto-diagnóstico? Paper presented at the IN-RED Congreso Nacional de Innovación Educativa y de Docencia en Red, UPV. Valencia, 13 y 14 de junio 2017. https://doi.org/10.4995/INRED2017.2017.6781
Marin-Garcia, J. A., Aznar-Mas, L. E., & González-Ladrón-de-Guevara, F. (2011). Innovation types and talent managment for innovation. WPOM-Working Papers on Operations Management, 2(2), 25-31. https://doi.org/10.4995/wpom.v2i2.926
Marin-Garcia, J. A., Garcia-Sabater, J. P., Perello-Marin, M. R., & Canos-Daros, L. (2009). Proposal of skills for the bachelor degree of industrial engineering in the context of the new curriculum. Intangible Capital, 5(4), 387-406. https://doi.org/10.3926/ic.2009.v5n4.p387-406
Marin-Garcia, J. A., González, E., Carrasco, M., & Ros, D. (2016b). Action planning intervention to identify how to improve selection processes for internships. WPOM-Working Papers on Operations Management, 7(2), 13. https://doi.org/10.4995/wpom.v7i2.6549
Marin-Garcia, J. A., Perez-Pe-alver, M. J., & Watts, F. (2013). How to assess innovation competence in services: The case of university students. Direccion y Organizacion(50), 48-62.
Marin-Garcia, J. A., Ramirez Bayarri, L., & Atares-Huerta, L. (2015). Protocol: Comparing advantages and disadvantages of rating scales, behavior observation scales and paired comparison scales for behavior assessment of competencies in workers. A systematic literature review. WPOM-Working Papers on Operations Management, 2(6), 49-63. https://doi.org/10.4995/wpom.v6i2.4032
Mathieson, K., Peacock, E., & Chin, W. W. (2001). Extending the technology acceptance model : The influence of perceived user resources. The DATA BASE for Advances in Information Systems, 32(3), 86-112. https://doi.org/10.1145/506724.506730
Matthews, R. A., Diaz, W. M., & Cole, S. G. (2003). The organizational empowerment scale. Personnel Review, 32(3), 297-318. https://doi.org/10.1108/00483480310467624
Mokkink, L. B., Prinsen, C. A., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C., & Terwee, C. B. (2018). Cosmin methodology for systematic reviews of patientâ€reported outcome measures (proms). User manual. Amsterdam: Amsterdam Public Health research institute. https://doi.org/10.1007/s11136-018-1798-3
Mokkink, L. B., Terwee, C. B., Knol, D. L., Stratford, P. W., Alonso, J., Patrick, D. L., . . . De Vet, H. C. (2010). The cosmin checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content. BMC medical research methodology, 10(1), 22.
https://doi.org/10.1186/1471-2288-10-22
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., . . . De Vet, H. C. (2012). The cosmin checklist manual.
Morente, F., & Ferràs, X. (2017). Innovation management from the inside: An approach from attention and everyday praxis. Intangible Capital, 13(3), 640-667. doi:http://dx.doi.org/10.3926/ic.1004.
https://doi.org/10.3926/ic.1004
Munro, D., & Watt, D. (2014). Skills for business innovation success: It's people who innovate: Conference Board of Canada,
Ozkaya, A. (2010). R&d teams competencies, innovation, and growth with knowledge information flow. IEEE Transactions on Engineering Management, 57(3), 416-429. doi:10.1109/TEM.2009.2037737
https://doi.org/10.1109/TEM.2009.2037737
Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self efficacy: Four meta-analyses. Educational Research Review, 22, 74-98. https://doi.org/10.1016/j.edurev.2017.08.004
Patterson, F. (1999). The innovation potential indicator. Manual and user's guide. Oxford: OPP Ltd.
Patterson, F., Kerrin, M., & Gatto-Roissard, G. (2009). Characteristics & behaviours of innovative people in organisations. City University, London: NESTA Policy and Research Unit (NPRU).
Pérez Pe-alver, M. J., Aznar Mas, L. E., & Montero Fleta, B. (2018). Identification and classification of behavioural indicators to assess innovation competence. Journal of Industrial Engineering and Management, 11(1), 29. https://doi.org/10.3926/jiem.2552
Prieto, M. I., & Pérez-Santana, M. P. (2014). Managing innovative work behavior: The role of human resource practices. Personnel Review, 43(2), 184-208. https://doi.org/10.1108/PR-11-2012-0199
Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2018). Cosmin guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1147-1157. https://doi.org/10.1007/s11136-018-1798-3
Prinsen, C. A. C., Vohra, S., Rose, M. R., Boers, M., Tugwell, P., Clarke, M., . . . Terwee, C. B. (2016). How to select outcome measurement instruments for outcomes included in a "core outcome set" – a practical guideline. Trials, 17(1), 449. https://doi.org/10.1186/s13063-016-1555-2
Ramirez Bayarri, L., Marin-Garcia, J. A., & Atares-Huerta, L. (2016). How has been assessed the innovation competency in companies and universities? WPOM-Working Papers on Operations Management, 7(2), 140-167. https://doi.org/10.4995/wpom.v7i2.6886
Richter, N. F., Cepeda, G., Roldán, J. L., & Ringle, C. M. (2016). European management research using partial least squares structural equation modeling (pls-sem). European Management Journal, 34(6), 589-597. https://doi.org/10.1016/j.emj.2016.08.001
Ringle, C. M., Sarstedt, M., & Straub, D. (2012). A critical look at the use of pls-sem in mis quarterly. Mis Quarterly, 36(1), ii-xiv. https://doi.org/10.2307/41410402
Ringle, C. M., Wende, S., & Becker, J. M. (2015). Smartpls 3. Boenningstedt: SmartPLS GmbH. Available at http://www.smartpls.com
Saiz, L., Pérez-Miguel, D., & Manzanedo-del Campo, M. Á. (2018). The knowledge absorptive capacity to improve the cooperation and innovation in the firm. Journal of Industrial Engineering and Management, 11(2), 290-307. https://doi.org/10.3926/jiem.2505
Sanchez, L., Blanco, B., & Marín-García, J. A. (2017). Protocol: Validation of the incode barometer to measure the innovation competence through the rasch measurement theory. WPOM-Working Papers on Operations Management, 8(Special Issue), 120-124. https://doi.org/10.4995/wpom.v8i0.7190
Santos, G. J. (2006). Card sort technique as a qualitative substitute for quantitative exploratory factor analysis. Corporate Communications: An International Journal, 11(3), 288-302. https://doi.org/10.1108/13563280610680867
Sarstedt, M., Hair, J. F., Ringle, C. M., Thiele, K. O., & Gudergan, S. P. (2016). Estimation issues with pls and cbsem: Where the bias lies! Journal of Business Research, 69(10), 3998-4010. https://doi.org/10.1016/j.jbusres.2016.06.007
Saunders, M., Lewis, P., & Thornhill, A. (2016). Research methods for business students, 7/e. Essex: Pearson Education.
Schepers, P., & van den Berg, P. T. (2007). Social factors of work-environment creativity. Journal of Business and Psychology, 21(3), 407-428. https://doi.org/10.1007/s10869-006-9035-4
Scott, S. G., & Bruce, R. A. (1994). Determinants of innovative behavior: A path model of individual innovation in the workplace. Academy of management Journal, 37(3), 580--607. https://doi.org/10.2307/256701
Spiegelaere, S. D., & Gyes, G. V. (2012). Innovative work behavior: Concept & measurement. ISPIM Conference Proceedings, 1-1.
Sternberg, R. J., & Matthew, C. T. (2006). Leading innovation through collaboration. In M. M. Beyerlein, S. T. Beyerlein, & F. A. Kennedy (Eds.), Innovation through collaboration (advances in interdisciplinary studies of work teams, volume 12) (pp. 27-52): Emerald Group Publishing Limited
Sung, S. Y., & Choi, J. N. (2009). Do big five personality factors affect individual creativity? The moderating role of extrinsic motivation. Social Behavior and Personality: an international journal, 37(7), 941-956. https://doi.org/10.2224/sbp.2009.37.7.941
ter Haar, P. (2018). Measuring innovation: A state of the science review of existing approaches. Intangible Capital, 14(3), 409-428. https://doi.org/10.3926/ic.1254
Terwee, C., Jansma, E., Riphagen, I., & de Vet, H. W. (2009). Development of a methodological pubmed search filter for finding studies on measurement properties of measurement instruments. Quality of Life Research, 18(8), 1115-1123. https://doi.org/10.1007/s11136-009-9528-5
Upasna, A. A., Sumita, D., Stacy, B. B., & Shivganesh, B. (2012). Linking lmx, innovative work behaviour and turnover intentions: The mediating role of work engagement. Career Development International, 17(3), 208-230. https://doi.org/10.1108/13620431211241063
Urbach, N., & Ahleman, F. (2010). Structural equation modeling in information systems research using partial least squares. Journal of Information Technology Theory and Application, 11(2), 1-39.
Viladrich Segués, M. C., & Doval Dieguez, E. (2011). Medición: Fiabilidad y validez. Bellaterra: Laboratori d'Estadística Aplicada i de Modelització (UAB).
Voorhees, C., Brady, M., Calantone, R., & Ramirez, E. (2016). Discriminant validity testing in marketing: An analysis, causes for concern, and proposed remedies. Journal of the Academy of Marketing Science, 44(1), 119-134. https://doi.org/10.1007/s11747-015-0455-4
Watts, F., Garcia-Carbonell, A., & Andreu Andrés, M. A. (2013). Innovation competencies development: Incode barometer and use guide. Turku: Turku University od Applied Sciences.
Watts, F., Marin-Garcia, J. A., Garcia-Carbonell, A., & Aznar-Mas, L. E. (2012). Validation of a rubric to assess innovation competence. WPOM-Working Papers on Operations Management, 3(1), 61-70. https://doi.org/10.4995/wpom.v3i1.1159
Waychal, P., Mohanty, R. P., & Verma, A. (2011). Determinants of innovation as a competence: An empirical study. International Journal of Business Innovation and Research, 5(2), 192-211. https://doi.org/10.1504/IJBIR.2011.038781
West, M. A., & Farr, J. L. (1990). Innovation and creativity at work: Psychological and organizational strategies. Oxford: John Wiley & Sons.
Williams, B., & Figueiredo, J. (2014). Lessons from an innovation-leader and tools to learn them. Journal of Industrial Engineering and Management, 7(4), 932-960.
https://doi.org/10.3926/jiem.1135
World Economic Forum. (2016). Global challenge insight report: The future of jobs. Employment, skills and workforce strategy for the fourth industrial revolution. January 2016. Geneva: REF 010116.
Yeh, C. C., & Ku, E. C. S. (2019). Process innovation capability and subsequent collaborative team performance in travel planning: A knowledge exchange platform perspective. Current Issues in Tourism, 22(1), 107-126. https://doi.org/10.1080/13683500.2017.1328667
Yu Kyoung, P., Ji Hoon, S., Seung Won, Y., & Jungwoo, K. (2013). Learning organization and innovative behavior: The mediating effect of work engagement. European Journal of Training and Development, 38(1/2), 75-94. https://doi.org/10.1108/EJTD-04-2013-0040