Artigo Revisado por pares

From the Editors: Establishing Methodological Rigor in Quantitative Management Learning and Education Research: The Role of Design, Statistical Methods, and Reporting Standards

2017; Academy of Management; Volume: 16; Issue: 2 Linguagem: Inglês

10.5465/amle.2017.0079

ISSN

1944-9585

Autores

Tine Köhler, Ronald S. Landis, José M. Cortina,

Tópico(s)

Accounting Education and Careers

Resumo

Academy of Management Learning & EducationVol. 16, No. 2 From the EditorsFrom the Editors: Establishing Methodological Rigor in Quantitative Management Learning and Education Research: The Role of Design, Statistical Methods, and Reporting StandardsTine Köhler, Ronald S. Landis and José M. CortinaTine KöhlerThe University of Melbourne, Melbourne, Australia, Ronald S. LandisIllinois Institute of Technology, Chicago, Illinois and José M. CortinaGeorge Mason University, Fairfax, VirginiaPublished Online:12 Apr 2017https://doi.org/10.5465/amle.2017.0079AboutSectionsView articleView Full TextPDF/EPUB ToolsDownload CitationsAdd to favoritesTrack Citations ShareShare onFacebookTwitterLinkedInRedditEmail View articleREFERENCESAguinis H., Gottfredson R. K., Joo H. 2013. Best-practice recommendations for defining, identifying, and handling outliers. Organizational Research Methods, 16(2): 270–301. Google ScholarAiken L. S., West S. G., Reno R. R. 1991. Multiple regression: Testing and interpreting interactions. Thousand Oaks, CA: Sage Publications, Inc. Google ScholarAmerican Educational Research Association. 2006. Standards for reporting on empirical social science research in AERA publications. Educational Researcher, 35(6): 33–40. Google ScholarAnderson L. W., et al.. 2001. A taxonomy for learning, teaching, and assessing: A revision of Bloom's Taxonomy of Educational Objectives (Complete edition). New York, NY: Longman. Google ScholarAPA Publications and Communications Board Working Group on Journal Article Reporting Standards. 2008. Reporting Standards for Research in Psychology: Why Do We Need Them? What Might They Be? The American Psychologist, 63(9): 839–851. Google ScholarArbaugh J. B. 2008. From the Editor: Starting the long march to legitimacy. Academy of Management Learning & Education, 7(1): 5–8.Link , Google ScholarArbaugh J. B., Fornaciari C. J., Hwang A. 2016. Identifying research topic development in business and management education research using legitimation code theory. Journal of Management Education, 40(6): 654–691. Google ScholarArbaugh J. B., Hwang A. 2012. Uses of multivariate analytical techniques in online and blended business education: An assessment of current practice and recommendations for future research. Journal of Management Education, 37(2): 229–260. Google ScholarBacon D. R. 2016a. Progress in the legitimacy of business and management education research: Rejoinder to "identifying research topic development in business and management education research using legitimation code theory." Journal of Management Education, 40(6): 700–704. Google ScholarBacon D. R. 2016b. Reporting actual and perceived student learning in education research. Journal of Marketing Education, 38(1): 3–6. Google ScholarBacon D. R., Bean B. 2006. GPA in research studies: An invaluable but neglected opportunity. Journal of Marketing Education, 28(1): 35–42. Google ScholarBacon D. R., Stewart K. A. 2017. Why assessment will never work at many business schools: A call for better utilization of pedagogical research. Journal of Management Education, 41(2): 181–200. Google ScholarBaron R. M., Kenny D. A. 1986. The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51(6): 1173–1182. Google ScholarBeatty J. E., Leigh J. S. A. 2010. Taking stock of management education: A comparison of three management education journals. Journal of Management Education, 34(3): 367–392. Google ScholarBedeian A. G. 2007. Even if the tower is "ivory," it isn't "white:" Understanding the consequences of faculty cynicism. Academy of Management Learning & Education, 6(1): 9–32.Link , Google ScholarBedeian A., Taylor S., Miller A. 2010. Management science on the credibility bubble: Cardinal sins and various misdemeanors. Academy of Management Learning & Education, 9(4): 715–725.Link , Google ScholarBednall T. C., Sanders K., Runhaar P. 2014. Stimulating informal learning activities through perceptions of performance appraisal quality and HRM system strength: A two-wave study. Academy of Management Learning & Education, 13(1): 45–61.Link , Google ScholarBeenen G. 2014. The effects of goal orientations and supervisor concerns on MBA intern learning and performance. Academy of Management Learning & Education, 13(1): 82–101.Link , Google ScholarBell E., Kothiyal N., Willmott H. In press. Methodology-as-technique and the meaning of rigour in globalized management research. British Journal of Management, 1–17. Google ScholarBliese P. D., Hanges P. J. 2004. Being both too liberal and too conservative: The perils of treating grouped data as though they were independent. Organizational Research Methods, 7: 400–417. Google ScholarBohlmeyer E. M., Burke J. P., Helmstadter G. C. 1985. Differences between education and business students in cooperative and competitive attitudes, emotional empathy, and self-esteem. Psychological Reports, 56: 247–253. Google ScholarBono J. E., McNamara G. 2011. From the editors publishing in AMJ — Part 2: Research design. Academy of Management Journal, 54(4): 657–660.Link , Google ScholarBridgman T., Bell E. 2016. Seeing and being seen as a management learning and education scholar: Rejoinder to "Identifying research topic development in business and management education research using legitimation code theory." Journal of Management Education, 40(6): 692–699. Google ScholarBrowne M. W., Cudeck R. 1993. Alternative ways of assessing model fit. Sage Focus Editions, 154: 136–162. Google ScholarButts M. M., Casper W. J., Yang T. S. 2013. How important are work–family support policies? A meta-analytic investigation of their effects on employee outcomes. Journal of Applied Psychology, 98(1): 1–25. Google ScholarCajiao J., Burke M. J. 2016. How instructional methods influence skill development in management education. Academy of Management Learning & Education, 15(3): 508–524.Link , Google ScholarCaprar D. V., Do B., Rynes S. L., Bartunek J. M. 2016. It's personal: An exploration of students' (non)acceptance of management research. Academy of Management Learning & Education, 15(2): 207–231.Link , Google ScholarChan D. 2009. So why ask me? Are self-report data really that bad? In Lance C. E.Vandenberg R. J. (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences: 309–336. New York, NY: Routledge. Google ScholarCianci A. M., Klein H. J., Seijts G. H. 2010. The effect of negative feedback on tension and subsequent performance: The main and interactive effects of goal content and conscientiousness. The Journal of Applied Psychology, 95(4): 618–630. Google ScholarClayson D. E. 2009. Student evaluations of teaching: Are they related to what students learn? A meta-analysis and review of the literature. Journal of Marketing Education, 31(1): 16–30. Google ScholarCornelissen J., Floyd S. W. 2009. The future ahead: Imagination, rigour and the advancement of management studies. Journal of Management Studies, 46(1): 10–15. Google ScholarCortina J. M., Green J. P., Keeler K. R., Vandenberg R. J. In press. Degrees of freedom in SEM: Are we testing the models that we claim to test? Organizational Research Methods. Google ScholarCortina J. M., Landis R. S. 2009. When small effect sizes tell a big story, and when large effect sizes don't. In Lance C. E.Vandenberg R. J. (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences: 287–308. New York, NY: Routledge. Google ScholarDavies P. 1999. What is evidence-based education? British Journal of Educational Studies, 47(2): 108–121. Google ScholarDehler G. E., Beatty J. E., Leigh J. S. A. 2010. From "good teaching" to "scholarly teaching:" Legitimizing management education and learning scholarship. In Wankel C.DeFillippi R. (Eds.), Being and becoming a management education scholar: 95–118. Charlotte, NC: Information Age. Google ScholarDelbridge R., Fiss P. C. 2013. Style of theorizing and the social organization of knowledge. Academy of Management Journal, 38(3): 325–331.Abstract , Google ScholarDiestel S., Schmidt K. H. 2011. Costs of simultaneous coping with emotional dissonance and self-control demands at work: Results from two German samples. The Journal of Applied Psychology, 96(3): 643–653. Google ScholarEarp B. D., Trafimow D. 2015. Replication, falsification, and the crisis of confidence in social psychology. Frontiers in Psychology, 6: 621–631. Google ScholarEdwards J. R. 2008. To prosper, organizational psychology should ... overcome methodological barriers to progress. Journal of Organizational Behavior, 29: 469–491. Google ScholarEdwards J. R., Berry J. W. 2010. The presence of something or the absence of nothing: Increasing theoretical precision in management research. Organizational Research Methods, 13(4): 668–689. Google ScholarEdwards J. R., Lambert L. S. 2007. Methods for integrating moderation and mediation: A general analytical framework using moderated path analysis. Psychological Methods, 12(1): 1–22. Google ScholarEgri C. P. 2013. From the editors: Context matters in management education scholarship. Academy of Management Learning & Education, 12(2): 155–157.Link , Google ScholarGielnik M. M., Frese M., Kahara-Kawuki A., Dlugosch T. J. 2015. Action and action-regulation in entrepreneurship: Evaluating a student training for promoting entrepreneurship. Academy of Management Learning & Education, 14(1): 69–94.Link , Google ScholarGlaub M. E., Frese M., Fischer S., Hoppe M. 2014. Increasing personal initiative in small business managers or owners leads to entrepreneurial success: A theory-based controlled randomized field intervention for evidence-based management. Academy of Management Learning & Education, 13(3): 354–379.Link , Google ScholarGleser L. J. 1996. Comment on bootstrap confidence intervals by T. J. DiCiccio and B. Efron. Statistical Science, 11: 219–221. Google ScholarGrote G. 2017. There is hope for better science. European Journal of Work and Organizational Psychology, 26(1): 1–3. Google ScholarHarley B. 2015. The one best way? "Scientific" research on HRM and the threat to critical scholarship. Human Resource Management Journal, 25(4): 399–407. Google ScholarHayes A. F. 2013. Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. New York, NY: Guilford Press. Google ScholarHolland S. J., Shore D. B., Cortina J. M. In press. Review and recommendations for integrating mediation and moderation. Organizational Research Methods. Google ScholarHu L. T., Bentler P. M. 1999. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1): 1–55. Google ScholarHunt S. D., Morgan R. M. 1994. Organizational commitment: One of many commitments or key mediating construct? Academy of Management Journal, 37(6): 1568–1587.Link , Google ScholarHwang A. 2012. From the editors: Student learning and outcomes. Academy of Management Leaning & Education, 11(4): 529–533.Abstract , Google ScholarJack G., Westwood R. 2006. Postcolonialism and the politics of qualitative research in international business. Management International Review, 46(4): 481–501. Google ScholarJudge T. A., Kammeyer-Mueller J. D. 2012. On the value of aiming high: The causes and consequences of ambition. The Journal of Applied Psychology, 97(4): 758–775. Google ScholarKarabag S. F., Berggren C. 2016. Misconduct, marginality and editorial practices in management, business and economics journals. PLoS One, 11(7): 1–25. Google ScholarKelly C. D. 2006. Replicating empirical research in behavioral ecology: How and why it should be done but rarely ever is. The Quarterly Review of Biology, 81(3): 221–236. Google ScholarKline R. B. 2016. Principles and practice of structural equation modeling. New York, NY: Guilford Press. Google ScholarKöhler T. 2016. From the editors: On writing up qualitative research in management learning and education. Academy of Management Learning & Education, 15(3): 400–418.Link , Google ScholarKöhler T., Cortina J. M. In preparation. A framework for replication and reproducibility. Google ScholarKraiger K., Ford J. K., Salas E. 1993. Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. The Journal of Applied Psychology, 78: 311–328. Google ScholarLance C. E., Siminovsky A. B. 2014. Use of "independent" measures does not solve the shared method bias problem. In Lance C. E.Vandenberg R. J. (Eds.), More statistical and methodological myths and urban legends: 276–291. New York, NY: Routledge. Google ScholarLandis R. S., Beal D. J., Tesluk P. E. 2000. A comparison of approaches to forming composite measures in structural equation models. Organizational Research Methods, 3(2): 186–207. Google ScholarLandis R. S., Edwards B. D., Cortina J. M. 2009. On the practice of allowing correlated residuals among indicators in structural equation models. In Lance C. E.Vandenberg R. J. (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences: 193–216. New York, NY: Routledge. Google ScholarLeavitt K., Mitchell R. R., Peterson J. 2010. Theory pruning: Strategies to reduce our dense theoretical landscape. Organizational Research Methods, 13: 644–667. Google ScholarLe Breton J. M., Wu J., Bing M. N. 2009. The truth(s) on testing for mediation in the social and organizational sciences. In Lance C. E.Vandenberg R. J. (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences: 107–141. New York, NY: Routledge. Google ScholarMacKinnon D. P., Lockwood C. M., Hoffman J. M., West S. G., Sheets V. 2002. A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7: 83–104. Google ScholarMarsh H. W. 2007. Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility. In Perry R. P.Smart J. C. (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective: 319–383. Dordrecht, The Netherlands: Springer. Google ScholarMaynes T. D., Podsakoff P. M. 2014. Speaking more broadly: An examination of the nature, antecedents, and consequences of an expanded set of employee voice behaviors. The Journal of Applied Psychology, 99(1): 87–112. Google ScholarMcAllister D. J. 1995. Affect-and cognition-based trust as foundations for interpersonal cooperation in organizations. Academy of Management Journal, 38(1): 24–59.Link , Google ScholarMcNatt D. B. 2010. Negative reputation and biased student evaluations of teaching: Longitudinal results from a naturally occurring experiment. Academy of Management Learning & Education, 9(2): 225–242.Link , Google ScholarMessick S. 1995. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. The American Psychologist, 50: 741–749. Google ScholarMorris S. B. 2008. Estimating effects sizes from pretest-posttest-control group designs. Organizational Research Methods, 11(2): 364–386. Google ScholarNiehoff B. P., Moorman R. H. 1993. Justice as a mediator of the relationship between methods of monitoring and organizational citizenship behavior. Academy of Management Journal, 36(3): 527–556.Link , Google ScholarPodsakoff P. M., MacKenzie S. B., Podsakoff N. 2003. Common method biases in behavioral research: A critical review of the literature and recommended remedies. The Journal of Applied Psychology, 25: 879–903. Google ScholarPrussia G. E., Kinicki A. J., Bracker J. S. 1993. Psychological and behavioral consequences of job loss: A covariance structure analysis using Weiner's (1985) attribution model. The Journal of Applied Psychology, 78(3): 382–394. Google ScholarRamsey J. R., Lorenz M. P. 2016. Exploring the impact of cross-cultural management education on cultural intelligence, student satisfaction, and commitment. Academy of Management Learning & Education, 15(1): 79–99.Link , Google ScholarReisenwitz T. H. 2016. Student evaluation of teaching: An investigation of nonresponse bias in an online context. Journal of Marketing Education, 38(1): 7–17. Google ScholarRyazanova O., McNamara P. 2016. Socialization and proactive behavior: Multilevel exploration of research productivity drivers in U.S. business schools. Academy of Management Learning & Education, 15(3): 525–548.Link , Google ScholarRynes S. L., Brown K. G. 2011. Where are we in the "long march to legitimacy?" Assessing scholarship in management learning and education. Academy of Management Learning & Education, 10(4): 561–582.Link , Google ScholarSchmidt-Wilk J., Fukami C. 2010. Relevance with rigor: Stories from the Journal of Management Education. In Wankel C.DeFillippi R. (Eds.), Being and becoming a management education scholar: 135–155. Charlotte, NC: Information Age. Google ScholarSchmitt N. 1989. Editorial. The Journal of Applied Psychology, 74: 843–845. Google ScholarSchulz A. C., Nicolai A. T. 2015. The intellectual link between management research and popularization media: A bibliometric analysis of the Harvard Business Review. Academy of Management Learning & Education, 14(1): 31–49.Link , Google ScholarShaw J. B., Fisher C. D., Southey G. N. 1999. Evaluating organizational behavior teaching innovations: More rigorous designs, more relevant criteria, and an example. Journal of Management Education, 23(5): 509–536. Google ScholarSheng Z., Cortina J. M., Zhu Z., Meaden J. C. 2017. On the use of overall fit indices. Presentation in a symposium titled, How can (and should) we make sense of our data In J. Cortina, (Chair), 32nd Annual Conference of the Society for Industrial and Organizational Psychology, Orlando. Google ScholarShevlin M., Banyard P., Davies M., Griffiths M. 2000. The validity of student evaluation of teaching in higher education: Love me, love my lectures? Assessment & Evaluation in Higher Education, 25(4): 397–405. Google ScholarShrout P. E., Bolger N. 2002. Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods, 7: 422–445. Google ScholarSobel M. E. 1982. Asymptotic confidence intervals for indirect effects in structural equation models. Sociological Methodology, 13: 290–312. Google ScholarSobral F., Islam G. 2015. He who laughs best, leaves last: The influence of humor on the attitudes and behavior of interns. Academy of Management Learning & Education, 14(4): 500–518.Link , Google ScholarSitzmann T., Ely K., Brown K. G., Bauer K. N. 2010. Self-assessment of knowledge: A cognitive learning or affective measure? Academy of Management Learning & Education, 9(2): 169–191.Link , Google ScholarTanaka J. S. 1993. Multifaceted conceptions of fit in structural equation models. In Bollen K. A.Long J. S. (Eds.), Testing structural equation models: 10–39. Newbury Park, CA: Sage. Google ScholarUrbig D., Terjesen S., Procher V., Muehlfeld K., van Witteloostuijn A. 2016. Come on and take a free ride: Contributing to public goods in native and foreign language settings. Academy of Management Learning & Education, 15(2): 268–286.Link , Google ScholarVarela O. E. In press. Learning outcomes of study-abroad programs: A meta-analysis. Academy of Management Learning & Education. Google ScholarVarela O. E., Gatlin-Watts R. 2014. The development of the global manager: An empirical study on the role of academic international sojourns. Academy of Management Learning & Education, 13(2): 187–207.Link , Google ScholarWeimer M. 1997. Assumptions that devalue university teaching. The International Journal for Academic Development, 2: 52–59. Google ScholarWilliams L. J., Hazer J. T. 1986. Antecedents and consequences of satisfaction and commitment in turnover models: A reanalysis using latent variable structural equation methods. The Journal of Applied Psychology, 71(2): 219–231. Google ScholarFiguresReferencesRelatedDetailsCited byDistanced from Others, Connected to Self: Online Mindfulness Training Fosters Psychological Well-Being by Cultivating AuthenticityAdam A. Kay and Tarli Young27 June 2022 | Academy of Management Learning & Education, Vol. 21, No. 2Ladders for Learning: Is Scaffolding the Key to Teaching Problem-Solving in Technology-Mediated Learning Contexts?Andreas Janson, Matthias Sӧllner and Jan Marco Leimeister23 December 2020 | Academy of Management Learning & Education, Vol. 19, No. 4 Vol. 16, No. 2 Permissions Metrics in the past 12 months History Published online 12 April 2017 Published in print 1 June 2017 Information© Academy of Management Learning & EducationDownload PDF

Referência(s)