1932
0
  1. Home
  2. A-Z Publications
  3. Annual Review of Organizational Psychology and Organizational Behavior
  4. Volume 5, 2018
  5. Article

Annual Review of Organizational Psychology and Organizational Behavior

Volume 5, 2018

More Than Words? Computer-Aided Text Analysis in Organizational Behavior and Psychology Research

Abstract

Computer-aided text analysis (CATA) offers great promise for scholars who aspire to capture the beliefs, cognitions, and emotions of individuals as reflected in their narratives and written texts. We review advancements in the use of CATA in organizational studies and highlight the increased momentum towards incorporating rigor when using CATA. We review key CATA software and note the variance in possibilities of approaches when extracting meaning from languages. We then outline the potential for this technique to build knowledge surrounding organizational psychology and organizational behavior. Specifically, we highlight specific research streams that might benefit from the use of CATA and highlight cross-cultural perspectives that might further advance the use of this technique.

Keyword(s): computer-aided text analysis, content analysis, language, organizational behavior
Loading

Article metrics loading...

/content/journals/10.1146/annurev-orgpsych-032117-104622
2018-01-21
2024-04-20
Loading full text...

Full text loading...

/deliver/fulltext/orgpsych/5/1/annurev-orgpsych-032117-104622.html?itemId=/content/journals/10.1146/annurev-orgpsych-032117-104622&mimeType=html&fmt=ahah

Literature Cited

  1. Abrahamson E, Eisenman M. 2008. Employee-management techniques: transient fads or trending fashions?. Adm. Sci. Q. 53:719–44 [Google Scholar]
  2. Aguinis H, Vandenberg RJ. 2014. An ounce of prevention is worth a pound of cure: improving research quality before data collection. Annu. Rev. Organ. Psychol. Organ. Behav. 1:569–95 [Google Scholar]
  3. Ahrens B. 2016. Gratitude, psychological capital, and work stress PhD Thesis Bellevue Univ. Bellevue, NE:
  4. Alliger GM, Tannenbaum SI, Bennett W, Traver H, Shotland A. 1997. A meta-analysis of the relations among training criteria. Pers. Psychol. 50:341–58 [Google Scholar]
  5. Barber JD. 1992. The Presidential Character: Predicting Performance in the White House Englewood Cliffs, NJ: Prentice Hall
  6. Barclay LJ, Skarlicki DP. 2009. Healing the wounds of organizational injustice: examining the benefits of expressive writing. J. Appl. Psychol. 94:511–23 [Google Scholar]
  7. Bardi A, Calogero RM, Mullen B. 2008. A new archival approach to the study of values and value-behavior relations: validation of the value lexicon. J. Appl. Psychol. 93:483–97 [Google Scholar]
  8. Barley SR, Meyerson DE, Grodal S. 2011. E-mail as a source and symbol of stress. Organ. Sci. 22:887–906 [Google Scholar]
  9. Barlow MA, Verhaal JC, Hoskins JD. 2016. Guilty by association: product-level category stigma and audience expectations in the US craft beer industry. J. Manag. In press. https://doi.org/10.1177/0149206316657593 [Crossref]
  10. Basu S, Savani K. 2017. Choosing one at a time? Presenting options simultaneously helps people make more optimal decisions than presenting options sequentially. Organ. Behav. Hum. Decis. Process. 139:76–91 [Google Scholar]
  11. Baur JE, Ellen BP, Buckley MR, Ferris GR, Allison TH. et al. 2016. More than one way to articulate a vision: a configurations approach to leader charismatic rhetoric and influence. Leadersh. Q. 27:156–71 [Google Scholar]
  12. Bednar MK. 2012. Watchdog or lapdog? A behavioral view of the media as a corporate governance mechanism. Acad. Manag. J. 55:131–50 [Google Scholar]
  13. Bennett RJ, Robinson SL. 2000. Development of a measure of workplace deviance. J. Appl. Psychol. 85:349–60 [Google Scholar]
  14. Berelson B. 1952. Content Analysis in Communication Research Glencoe, IL: Free Press
  15. Bezrukova K, Thatcher S, Jehn KA, Spell CS. 2012. The effects of alignments: examining group faultlines, organizational cultures, and performance. J. Appl. Psychol. 97:77–92 [Google Scholar]
  16. Blei DM, Ng AY, Jordan MI. 2003. Latent Dirichlet allocation. J. Mach. Learn. Res. 3:993–1022 [Google Scholar]
  17. Bligh MC, Kohles JC, Meindl JR. 2004. Charting the language of leadership: a methodological investigation of President Bush and the crisis of 9/11. J. Appl. Psychol. 89:562–74 [Google Scholar]
  18. Bono JE, Ilies R. 2006. Charisma, positive emotions and mood contagion. Leadersh. Q. 17:317–34 [Google Scholar]
  19. Brett JM, Olekalns M, Friedman R, Goates N, Anderson C, Lisco CC. 2007. Sticks and stones: language, face, and online dispute resolution. Acad. Manag. J. 50:85–99 [Google Scholar]
  20. Campion MC, Campion MA, Campion ED, Reider MH. 2016. Initial investigation into computer scoring of candidate essays for personnel selection. J. Appl. Psychol. 101:7958–75 [Google Scholar]
  21. Caprar DV. 2011. Foreign locals: a cautionary tale on the culture of MNC local employees. J. Int. Bus. Stud. 42:608–28 [Google Scholar]
  22. Cerdin J-L, Diné MA, Brewster C. 2014. Qualified immigrants' success: exploring the motivation to migrate and to integrate. J. Int. Bus. Stud. 45:151–68 [Google Scholar]
  23. Charmaz K. 2014. Constructing Grounded Theory Thousand Oaks, CA: Sage
  24. Chen X, Latham GP. 2014. The effect of priming learning versus performance goals on a complex task. Organ. Behav. Hum. Decis. Process. 125:88–97 [Google Scholar]
  25. Cohn MA, Mehl MR, Pennebaker JW. 2004. Linguistic markers of psychological change surrounding September 11, 2001.. Psychol. Sci. 15:687–93 [Google Scholar]
  26. Cole MS, Rubin RS, Feild HS, Giles WF. 2007. Recruiters' perceptions and use of applicant résumé information: screening the recent graduate. Appl. Psychol. 56:319–43 [Google Scholar]
  27. De Gama N, McKenna S, Peticca-Harris A. 2012. Ethics and HRM: theoretical and conceptual analysis. J. Bus. Ethics 111:97–108 [Google Scholar]
  28. Deerwester S, Dumais S, Furnas G, Landauer T, Harshman R. 1990. Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci. 41:391–407 [Google Scholar]
  29. Detert JR, Treviño LK. 2010. Speaking up to higher-ups: how supervisors and skip-level leaders influence employee voice. Organ. Sci. 21:249–70 [Google Scholar]
  30. Dewey J. 1931. Philosophy and Civilization New York: Minton, Blach & Co.
  31. Duriau VJ, Reger RK, Pfarrer MD. 2007. A content analysis of the content analysis literature in organization studies: research themes, data sources, and methodological refinements. Organ. Res. Methods 10:5–34 [Google Scholar]
  32. Dutton JE, Glynn MA. 2008. Positive organizational scholarship. The SAGE Handbook of Organizational Behavior J Barling, CL Cooper 693–712 London: Sage [Google Scholar]
  33. Etzioni A. 1993. The Spirit of Community: Rights, Responsibilities, and the Communitarian Agenda New York: Crown
  34. Fanelli A, Misangyi VF, Tosi HL. 2009. In charisma we trust: the effects of CEO charismatic visions on securities analysts. Organ. Sci. 20:1011–33 [Google Scholar]
  35. Fehr R, Fulmer A, Awtrey E, Miller J. 2017. The grateful workplace: a multilevel model of gratitude in organizations. Acad. Manag. Rev. 42:2361–81 [Google Scholar]
  36. Feldman MS, Khademian AM. 2003. Empowerment and cascading vitality. Positive Organizational Scholarship: Foundations of a New Discipline K Cameron, J Dutton, R Quinn 343–58 San Francisco: Berrett-Koehler Publ. [Google Scholar]
  37. Felps W, Mitchell TR, Hekman DR, Lee TW, Holtom BC, Harman WS. 2009. Turnover contagion: how coworkers' job embeddedness and job search behaviors influence quitting. Acad. Manag. J. 52:545–61 [Google Scholar]
  38. Ferris DL, Brown DJ, Berry JW, Lian H. 2008. The development and validation of the workplace ostracism scale. J. Appl. Psychol. 93:1348–66 [Google Scholar]
  39. Fisher K, Hutchings K. 2013. Making sense of cultural distance for military expatriates operating in an extreme context. J. Organ. Behav. 34:791–812 [Google Scholar]
  40. Flanagan JC. 1954. The critical incident technique. Psychol. Bull. 51:327–58 [Google Scholar]
  41. Friedman R, Anderson C, Brett J, Olekalns M, Goates N, Lisco CC. 2004. The positive and negative effects of anger on dispute resolution: evidence from electronically mediated disputes. J. Appl. Psychol. 89:369–76 [Google Scholar]
  42. Friese S. 2014. Qualitative Data Analysis with ATLAS.ti Thousand Oaks, CA: Sage
  43. Gamache DL, McNamara G, Mannor MJ, Johnson RE. 2015. Motivated to acquire? The impact of CEO regulatory focus on firm acquisitions. Acad. Manag. J. 58:1261–82 [Google Scholar]
  44. Gatewood RD, Feild HS. 2001. Human Resource Selection New York: Harcourt Coll. Publ.
  45. Gelfand MJ, Severance L, Lee T, Bruss CB, Lun J. et al. 2015. Culture and getting to yes: the linguistic signature of creative agreements in the United States and Egypt. J. Organ. Behav. 36:967–89 [Google Scholar]
  46. Gibson CB, Zellmer-Bruhn ME. 2001. Metaphors and meaning: an intercultural analysis of the concept of teamwork. Adm. Sci. Q. 46:274–303 [Google Scholar]
  47. Grant AM, Wrzesniewski A. 2010. I won't let you down… or will I? Core self-evaluations, other-orientation, anticipated guilt and gratitude, and job performance. J. Appl. Psychol. 95:108–21 [Google Scholar]
  48. Hart RP. 1984. Systematic analysis of political discourse: the development of DICTION. Political Communication Yearbook K Sanders, L Kaid, D Nimmo 97–134 Carbondale: Southern Ill. Univ. Press [Google Scholar]
  49. Hart RP. 2001. Redeveloping DICTION: theoretical considerations. Prog. Commun. Sci. 16:43–60 [Google Scholar]
  50. Heyden ML, Sidhu JS, Volberda HW. 2015. The conjoint influence of top and middle management characteristics on management innovation. J. Manag. In press. https://doi.org/10.1177/0149206315614373 [Crossref]
  51. Hofmann T. 2001. Unsupervised learning by probabilistic latent semantic analysis. Mach. Learn. 42:177–96 [Google Scholar]
  52. Holsti OR. 1969. Content Analysis for the Social Sciences and Humanities Reading, MA: Addison-Weasley
  53. Jauch LR, Osborn RN, Martin TN. 1980. Structured content analysis of cases: a complementary method for organizational research. Acad. Manag. Rev. 5:517–25 [Google Scholar]
  54. Jehn KA, Bezrukova K. 2004. A field study of group diversity, workgroup context, and performance. J. Organ. Behav. 25:703–29 [Google Scholar]
  55. Kabanoff B. 1996. Computers can read as well as count: how computer-aided text analysis can benefit organisational research. J. Organ. Behav. 18:507–11 [Google Scholar]
  56. Kellogg KC, Orlikowski WJ, Yates J. 2006. Life in the trading zone: structuring coordination across boundaries in postbureaucratic organizations. Organ. Sci. 17:22–44 [Google Scholar]
  57. King EB, Shapiro JR, Hebl MR, Singletary SL, Turner S. 2006. The stigma of obesity in customer service: a mechanism for remediation and bottom-line consequences of interpersonal discrimination. J. Appl. Psychol. 91:579–93 [Google Scholar]
  58. Kobayashi VB, Mol ST, Berkers HA, Kismihók G, Den Hartog DN. 2017a. Text classification for organizational researchers. Organ. Res. Methods. https://doi.org/10.1177/1094428117719322 [Crossref]
  59. Kobayashi VB, Mol ST, Berkers HA, Kismihók G, Den Hartog DN. 2017b. Text mining in organizational research. Organ. Res. Methods. https://doi.org/10.1177/1094428117722619 [Crossref]
  60. Kreiner GE, Hollensbe EC, Sheep ML. 2006. Where is the “me” among the “we”? Identity work and the search for optimal balance. Acad. Manag. J. 49:1031–57 [Google Scholar]
  61. Kreiner GE, Hollensbe EC, Sheep ML. 2009. Balancing borders and bridges: negotiating the work-home interface via boundary work tactics. Acad. Manag. J. 52:704–30 [Google Scholar]
  62. Krippendorff K. 2013. Content Analysis: An Introduction to Its Methodology Thousand Oaks, CA: Sage
  63. Lacy S, Riffe D. 1996. Sampling error and selecting intercoder reliability samples for nominal content categories. J. Mass Commun. Q. 73:4963–73 [Google Scholar]
  64. Lasswell HD. 1948. The structure and function of communication in society. Commun. Ideas 37:215–28 [Google Scholar]
  65. Liang LH, Lian H, Brown DJ, Ferris DL, Hanig S, Keeping LM. 2016. Why are abusive supervisors abusive? A dual-system self-control model. Acad. Manag. J. 59:1385–406 [Google Scholar]
  66. Lumpkin GT, Dess GG. 1996. Clarifying the entrepreneurial orientation construct and linking it to performance. Acad. Manag. Rev. 21:135–72 [Google Scholar]
  67. Luthans F, Youssef-Morgan CM. 2017. Psychological capital: an evidence-based positive approach. Annu. Rev. Organ. Psychol. Organ. Behav. 4:339–66 [Google Scholar]
  68. Madera JM, Hebl MR, Martin RC. 2009. Gender and letters of recommendation for academia: agentic and communal differences. J. Appl. Psychol. 94:1591–99 [Google Scholar]
  69. Maietta RC. 2009. The life of an ATLAS.ti quotation. ATLAS.ti Library. http://downloads.atlasti.com/library/Maietta_2009-05_6.pdf
  70. Manning CD, Schütze H. 1999. Foundations of Statistical Natural Language Processing Cambridge, MA: MIT Press
  71. Marcus B, Taylor OA, Hastings SE, Sturm A, Weigelt O. 2016. The structure of counterproductive work behavior: a review, a structural meta-analysis, and a primary study. J. Manag. 42:203–33 [Google Scholar]
  72. Mathews BC. 1910. A study of a New York daily. Independent 68:82–86 [Google Scholar]
  73. McClelland PL, Liang X, Barker VL III. 2010. CEO commitment to the status quo: replication and extension using content analysis. J. Manag. 36:1251–77 [Google Scholar]
  74. McKenny AF, Aguinis H, Short JC, Anglin AH. 2016. What doesn't get measured does exist: measuring measurement error in computer-aided text analysis. J. Manag. In press. https://doi.org/10.1177/0149206316657594 [Crossref]
  75. McKenny AF, Short JC, Payne GT. 2013. Using computer-aided text analysis to elevate constructs: an illustration using psychological capital. Organ. Res. Methods 16:152–84 [Google Scholar]
  76. Morris R. 1994. Computerized content analysis in management research: a demonstration of advantages & limitations. J. Manag. 20:903–31 [Google Scholar]
  77. Neuendorf KA. 2017. The Content Analysis Guidebook Thousand Oaks, CA: Sage
  78. Newman ML, Pennebaker JW, Berry DS, Richards JM. 2003. Lying words: predicting deception from linguistic style. Personal. Soc. Psychol. Bull. 29:665–75 [Google Scholar]
  79. Osgood CE, Suci GJ, Tannenbaum P. 1957. The Measurement of Meaning Urbana-Champaign: Univ. Ill. Press
  80. Palmer I, Kabanoff B, Dunford R. 1997. Managerial accounts of downsizing. J. Organ. Behav. 18:623–39 [Google Scholar]
  81. Pang B, Lee L. 2008. Opinion mining and sentiment analysis. Found. Trends Inf. Ret. 2:1–21–135 [Google Scholar]
  82. Pennebaker JW, Boyd RL, Jordan K, Blackburn K. 2015. The Development and Psychometric Properties of LIWC2015 Austin: Univ. Tex. Austin https://repositories.lib.utexas.edu/bitstream/handle/2152/31333/LIWC2015_LanguageManual.pdf
  83. Pennebaker JW, Mehl MR, Niederhoffer KG. 2003. Psychological aspects of natural language use: our words, our selves. Annu. Rev. Psychol. 54:547–77 [Google Scholar]
  84. Pfeffer J. 1981. Four laws of organizational research. Perspectives on Organizational Design and Behavior AH Van de Ven, WF Joyce 409–18 New York: Wiley [Google Scholar]
  85. Pool IDS. 1959. Trends in Content Analysis Urbana-Champaign: Univ. Ill. Press
  86. Rhee EY, Fiss PC. 2014. Framing controversial actions: regulatory focus, source credibility, and stock market reaction to poison pill adoption. Acad. Manag. J. 57:1734–58 [Google Scholar]
  87. Ridge JW, Ingram A. 2014. Modesty in the top management team: investor reaction and performance implications. J. Manag. 43:1283–306 [Google Scholar]
  88. Robinson SL, O'Reilly J, Wang W. 2013. Invisible at work: an integrated model of workplace ostracism. J. Manag. 39:203–31 [Google Scholar]
  89. Rossel RD. 1970. Instrumental and expressive leadership in complex organizations. Adm. Sci. Q. 15:306–16 [Google Scholar]
  90. Savani K, King D. 2015. Perceiving outcomes as determined by external forces: the role of event construal in attenuating the outcome bias. Organ. Behav. Hum. Decis. Process. 130:136–46 [Google Scholar]
  91. Shantz A, Latham GP. 2009. An exploratory field experiment of the effect of subconscious and conscious goals on employee performance. Organ. Behav. Hum. Decis. Process. 109:9–17 [Google Scholar]
  92. Shen R, Tang Y, Chen G. 2014. When the role fits: how firm status differentials affect corporate takeovers. Strateg. Manag. J. 35:2012–30 [Google Scholar]
  93. Short JC, Broberg JC, Cogliser CC, Brigham K. 2010. Construct validation using computer-aided text analysis (CATA): an illustration using entrepreneurial orientation. Organ. Res. Methods 13:320–47 [Google Scholar]
  94. Short JC, Palmer TB. 2008. The application of DICTION to content analysis research in strategic management. Organ. Res. Methods 11:727–52 [Google Scholar]
  95. Socher R, Perelygin A, Wu JY, Chuang J, Manning CD. et al. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. Proc. Conf. Empir. Methods Nat. Lang. Process. (EMNLP)1631–42 Stroudsburg, PA: Assoc. Comp. Linguist. [Google Scholar]
  96. Sonenshein S. 2014. How organizations foster the creative use of resources. Acad. Manag. J. 57:814–48 [Google Scholar]
  97. Spreitzer G. 1995. Psychological empowerment in the workplace: dimensions, measurement, and validation. Acad. Manag. J. 38:1442–65 [Google Scholar]
  98. Surroca J, Prior D, Tribó Giné JA. 2016. Using panel data DEA to measure CEOs' focus of attention: an application to the study of cognitive group membership and performance. Strateg. Manag. J. 37:370–88 [Google Scholar]
  99. Tausczik YR, Pennebaker JW. 2010. The psychological meaning of words: LIWC and computerized text analysis methods. J. Lang. Soc. Psychol. 29:24–54 [Google Scholar]
  100. Tenzer H, Pudelko M. 2016. Media choice in multilingual virtual teams. J. Int. Bus. Stud. 47:427–52 [Google Scholar]
  101. Tenzer H, Pudelko M, Harzing AW. 2014. The impact of language barriers on trust formation in multinational teams. J. Int. Bus. Stud. 45:508–35 [Google Scholar]
  102. Thoms P, McMasters R, Roberts MR, Dombkowski DA. 1999. Resume characteristics as predictors of an invitation to interview. J. Bus. Psychol. 13:339–56 [Google Scholar]
  103. Uotila J, Maula M, Keil T, Zahra S. 2009. Exploration, exploitation, and financial performance: analysis of S&P 500 corporations. Strateg. Manag. J. 30:221–31 [Google Scholar]
  104. Walker DD, van Jaarsveld DD, Skarlicki DP. 2017. Sticks and stones can break my bones but words can also hurt me. J. Appl. Psychol. 102:163–79 [Google Scholar]
  105. Wilhelmy A, Kleinmann M, König CJ, Melchers KG, Truxillo DM. 2016. How and why do interviewers try to make impressions on applicants? A qualitative study. J. Appl. Psychol. 101:313–32 [Google Scholar]
  106. Wilson KS, DeRue DS, Matta FK, Howe M, Conlon DE. 2016. Personality similarity in negotiations: testing the dyadic effects of similarity in interpersonal traits and the use of emotional displays on negotiation outcomes. J. Appl. Psychol. 101:1405–21 [Google Scholar]
  107. Zachary MA, McKenny AF, Short JC, Payne GT. 2010. Family business and market orientation: construct validation and comparative analysis. Fam. Bus. Rev. 24:233–51 [Google Scholar]
  108. Zavyalova A, Pfarrer MD, Reger RK, Shapiro DL. 2012. Managing the message: the effects of firm actions and industry spillovers on media coverage following wrongdoing. Acad. Manag. J. 55:1079–101 [Google Scholar]
  109. Zellmer-Bruhn M, Gibson C. 2006. Multinational organization context: implications for team learning and performance. Acad. Manag. J. 49:501–18 [Google Scholar]
/content/journals/10.1146/annurev-orgpsych-032117-104622
Loading
More Than Words? Computer-Aided Text Analysis in Organizational Behavior and Psychology Research
Annual Review of Organizational Psychology and Organizational Behavior 5, 415 (2018); https://doi.org/10.1146/annurev-orgpsych-032117-104622
/content/journals/10.1146/annurev-orgpsych-032117-104622
/content/journals/10.1146/annurev-orgpsych-032117-104622
Loading

Data & Media loading...

  • Article Type: Review Article

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error