Research

Research on online reviews, digital trust, and AI

My research examines online reviews in healthcare: how patient reviews shape the search for and choice of a physician, how platforms can elicit richer reviews while respecting privacy, and why fake reviews persuade.

My current projects study how AI tools change the content people create and the decisions they make.

Digital word-of-mouth and platforms

How online reviews, ratings, and other user-generated content shape consumer trust, decision-making, and market dynamics, with a focus on sensitive contexts like online healthcare platforms.

AI and digital trust

How AI, including large language models, affects the authenticity of online information, the detection of manipulation such as fake reviews, and trust and integrity on digital platforms.

Healthcare information technology

The design, adoption, and effectiveness of IT in healthcare settings, including how interface design influences patient engagement and what patients choose to disclose.

Methods. Field experiments run on live platforms, large-scale econometric analysis of platform data, and text analysis with machine learning and large language models. Combining observational data, experimental evidence, and computational text analysis lets me study the same phenomenon from several angles.

Peer-reviewed journal articles. Management Science and the Journal of Management Information Systems are on the Financial Times list of 50 research journals.

  1. 2026

    The Illusion of Trust and the Paradox of Disclosure: How Fake Physician Reviews Exploit Privacy Concerns

    A. D. Shukla, J. M. Goh, L. Agarwal

    Internet Research, 36(4), 1519–1540.

    Fake physician reviews are perceived as more helpful and more trustworthy than genuine ones. Drawing on a dataset of 34,997 reviews that includes 8,313 verified fakes, we find that fake reviews contain more personal and specific health information, the kind of detail that real patients tend to withhold out of concern for their privacy.

    Abstract

    Purpose. Online reviews shape consumer decisions, even in healthcare, a credence service where expertise is difficult to evaluate. Like unethical retailers, some healthcare providers post fake reviews. However, the impact of fake reviews on potential patients remains unclear. Using a dataset of fake reviews, this study examines how patients perceive the helpfulness and trustworthiness of fraudulent vs genuine physician reviews.

    Design/methodology/approach. We used an archival dataset containing a representative sample of 5,000 online physician reviews, both fake and genuine, and performed empirical analysis. In addition to the helpful votes obtained from the data, we used large language models to derive the perceived trustworthiness score.

    Findings. Fake physician reviews are paradoxically perceived as more helpful and trustworthy than genuine reviews. To unravel the underlying mechanism, we investigated the extent of personalized and specific health information. We found that fake reviews often contain more personalized and specific health information, making them appear more credible.

    Research limitations/implications. Results may not generalize beyond online physician reviews. Future research could extend this investigation to other contexts.

    Practical implications. Online platforms may need to reconsider their approach to managing online reviews, address ethical concerns, and strengthen regulatory oversight in sensitive areas, particularly in healthcare.

    Originality/value. This study highlights an ethical paradox: while patients seek detailed health information, privacy concerns limit real patients from sharing such details, creating an information gap that fake reviews exploit. This is the first study to make use of unique data that contains real fake online physician reviews.

  2. 2025

    Effects of Nudging and Privacy Control on Online Physician Reviews: Evidence from a Field Experiment

    A. D. Shukla, J. M. Goh, T. Sun, G. Gao, R. Agarwal

    Journal of Management Information Systems, 42(2), 529–563.

    A two-stage randomized field experiment on a major healthcare platform, complemented by lab experiments. An open appeal raised the likelihood of a patient contributing a review by 31% relative to an appeal to benefit others. Nudges highlighting benefits to self led more patients to reveal sensitive medical information and their identity, and preemptive privacy control increased identity revelation without reducing the sharing of sensitive information.

    Abstract

    Patients using healthcare services have substantial privacy concerns when writing online reviews of their physicians that may deter them from sharing information potentially helpful for others. This gives rise to a dilemma in which patients have to trade off between privacy and social welfare, leading to fewer and less informative reviews. To examine this trade off, we study how nudging strategies together with privacy control affect reviewers’ decisions related to the provision of reviews, disclosure of sensitive information, and identity revelation. We conducted a large-scale two-stage field experiment, complemented by lab experiments, to establish causality. Results reveal that nudging with an open appeal, compared to nudging with targeted benefits, increases the likelihood of patients submitting reviews. However, nudges that highlight benefits to self increase the proportion of patients revealing sensitive medical information in their reviews and the likelihood of them revealing their identity. Additionally, preemptive privacy control increases the likelihood of identity revelation without adversely impacting the sharing of sensitive information in reviews. Our findings highlight how nudging and privacy control influence patients’ review provision behavior. This study offers strategic implications for online platforms navigating the complex interplay of consumer motivations and privacy concerns in healthcare.

  3. 2024

    Fighting Fake Reviews: Authenticated Anonymous Reviews Using Identity Verification

    A. D. Shukla, J. M. Goh

    Business Horizons, 67(1), 71–81.

    Written for a practitioner audience. As generative AI enables human-like fake reviews at scale, we propose digital identity verification as a platform mechanism: the reviewer’s identity is verified while the published review remains anonymous.

    Abstract

    Fake reviews have become a pervasive problem in the realm of online commerce, affecting businesses and consumers alike. These fraudulent reviews can cause significant damage to the credibility of companies and negatively impact consumer welfare. While various platforms, such as Yelp and Amazon, have implemented measures to combat fake reviews, these efforts have been largely ineffective and, at times, even exacerbated the problem. As a result, on November 8, 2022, the Federal Trade Commission announced that it is soliciting input for possible regulations around ways to fight fake reviews. The growing sophistication of Artificial Intelligence—particularly generative AI technologies like ChatGPT—worsens the problem by enabling the production of human-like fake reviews at an unprecedented scale. This lends new urgency to the fake review problem, so it is imperative to examine the pros and cons of extant approaches and propose alternative approaches that are better equipped to tackle the issue. In this article, we introduce a novel approach using digital identity verification, which involves verifying a user’s identity via various forms of digital information that represent the individual and have not been applied to online reviews. We highlight the limitations of extant techniques and outline ways in which digital identity verification may be a promising solution to the problem of fake reviews. Potential benefits and challenges, as well as the effectiveness of our proposed approach in addressing the issue of fake reviews, are discussed.

  4. 2021

    How Digital Word-of-Mouth Affects Consumer Decision Making: Evidence from Doctor Appointment Booking

    A. D. Shukla, G. Gao, R. Agarwal

    Management Science, 67(3), 1546–1568.

    Using clickstream data and a feature launch on a doctor appointment booking platform, we show that the effect of ratings on patient search depends on how many doctors in a market are rated. Where ratings are abundant, patients consider fewer doctors, browse for less time, and stay closer to home; where they are scarce, the opposite holds. Highly rated doctors gain demand at the expense of unrated ones.

    Abstract

    We use detailed clickstream data on online word-of-mouth (WOM) to uncover mechanisms underlying its influence on consumer decision making. A feature launch on a major doctor appointment booking platform allows us to examine the effects of online WOM on three dimensions of a consumer’s choice process: the consideration set size, the time taken to consider alternatives (web session duration), and the geographic dispersion of the choices considered. Results indicate that the effects of WOM on decision-making processes are not monotonic but rather are contingent on the abundance of WOM (number of rated doctors) in a market. When the abundance of WOM is high, the introduction of WOM makes patients consider fewer doctors, browse for a shorter duration, and focus on doctors that are geographically more proximate. In contrast, when the abundance of WOM is low, the introduction of WOM makes patients consider more doctors, browse for longer duration, and consider doctors that are geographically more dispersed. We also find that WOM can lead to a cannibalization effect: when ratings are published, the highly rated doctors reap the benefits (in the form of increased demand) at the expense of unrated doctors. Our study contributes to the extant literature on online WOM by providing new insights into how WOM influences consumer decision making and by examining this question at a more granular level than prior work.

  • S. Ghose, S. Jaikumar, S. Chakraborty, A. D. Shukla. “Who is your Doctor and Why? The Role of Information Signaling in Physician Selection.” Under review
  • R. Shams, N. Saraf, A. D. Shukla. “Value Appropriation in Open Digital Platform Ecosystems: The Effect of Forking on Platform Participation.” Under review
  • P. Tavassoli, A. D. Shukla, J. M. Goh. “Effect of AI Chatbot on Organic Word-of-Mouth: Evidence from a Natural Experiment on Amazon.com.” Under review
  • A. D. Shukla, L. Agarwal, J. M. Goh, G. Gao, R. Agarwal. “Catch Me If You Can: Identifying Fraudulent Physician Reviews with Large Language Models Using Generative Pre-Trained Transformers.” arXiv:2304.09948 Preprint

Invited seminars

“How Digital Word-of-Mouth Affects Consumer Decision Making: Evidence from Doctor Appointment Booking,” presented at the University of British Columbia (2019), the University of Toronto (2018), and the University of Manitoba (2018).

Conference presentations

  • A. D. Shukla, J. M. Goh, T. Sun, G. Gao, R. Agarwal (2023). “Effect of Warm Glow Nudge and Privacy Control on Online Physician Reviews: Evidence from a Field Experiment.” Conference on Health Information Technology and Analytics, Washington, DC, USA.
  • A. D. Shukla, J. M. Goh, N. Saraf (2022). “Effect of Questions and Answers on Online Reviews: Evidence from Amazon.com.” Statistical Challenges in Electronic Commerce Research, Madrid, Spain.
  • A. D. Shukla, T. Sun, G. Gao, R. Agarwal (2019). “Speech is Silver, Silence is Golden—Motivational Framing Backfires: Evidence from a Field Experiment.” INFORMS Annual Meeting, Seattle, USA.
  • A. D. Shukla, W. Wang, G. Gao, R. Agarwal (2018). “Catch Me If You Can: Fraudulent Online Reviews in Healthcare.” Workshop on Information Systems and Economics (WISE), San Francisco, USA.
  • M. Dugas, A. D. Shukla, G. Gao, R. Agarwal (2017). “Gender Inequalities in Online Doctor Ratings.” INFORMS Annual Meeting, Philadelphia, USA.
Earlier presentations (2014–2016)
  • A. D. Shukla, W. Wang, G. Gao, R. Agarwal (2016). “Using Machine Learning to Detect Fraudulent Reviews.” Workshop on Health IT and Economics (WHITE), Washington, DC, USA.
  • A. D. Shukla, G. Gao, R. Agarwal (2015). “The Effects of Online Word of Mouth on Physician Demand: Evidence from a Natural Experiment.” INFORMS Annual Meeting, Philadelphia, USA.
  • A. D. Shukla, G. Gao, R. Agarwal (2015). “Digital Word-of-Mouth and Consumer Demand for Credence Services: Evidence from a Natural Experiment.” INFORMS Healthcare, Nashville, USA.
  • A. D. Shukla, G. Gao, R. Agarwal (2014). “Digital Word-of-Mouth and Consumer Demand for Credence Services: Evidence from a Natural Experiment.” Workshop on Information Systems and Economics (WISE), Auckland, New Zealand.
  • A. D. Shukla, G. Gao, R. Agarwal (2014). “Would You See a Doctor Just Because Anonymous Patients Vouch for Him? A Longitudinal Study on Effect of Online Patient Recommendations on Doctor’s Appointments.” Workshop on Health IT and Economics (WHITE), Washington, DC, USA.
  • 2026 – Present SFU SSHRC Insight Internal Grant $10,000 CAD
  • 2022–2024 SSHRC Insight Development Grant Social Sciences and Humanities Research Council of Canada $69,000 CAD
  • 2019–2024 SFU Beedie School of Business Dean’s Grant $20,000 CAD
  • 2018–2021 SFU Startup Research Grant $40,000 CAD
  • 2021–2022 SFU SSHRC Insight Internal Grant $6,918 CAD
  • 2019–2022 SFU Teaching and Learning Development Grant $6,000 CAD
  • 2014–2017 University of Maryland Dean’s Fellowship $32,000 USD
  • 2016 University of Maryland Center for International Business Research Grant $4,000 USD

I supervise students on research projects, where we work on research design, data analysis, and critical evaluation in Information Systems. Since 2018 I have worked with one doctoral student, 14 undergraduate research assistants, and 17 work-study students.

PhD student

  • Aug 2022 – Present Parto Tavassoli Research focus includes topics related to artificial intelligence in digital platforms.
Undergraduate research assistants (14)
  • Danishbir Singh Sep–Dec 2023
  • Matthio Lim Mar–Aug 2023
  • Ina Wong Feb–Aug 2023
  • Laksh Agarwal Sep 2021 – Sep 2025
  • Jared Chiu Aug 2021 – Feb 2022
  • Himani Boury Apr–Sep 2021
  • Cassidy Lee Emby Apr–Aug 2021
  • Zaid Rauf Apr–May 2019
  • Daniel Breedveld Apr–May 2019
  • Raveen Saroya Apr–May 2019
  • Annie Zhou Jan–Aug 2019
  • Eric Wong Oct 2018 – Apr 2019
  • Laura Cao Oct–Nov 2018
  • Raymond Zheng Oct–Nov 2018
Work-study students (17)
  • Matthew Myckland Fall 2023
  • Michael Alegbeleye Fall 2023
  • Guanhua Lao Fall 2023, Spring 2024
  • Ha Thu Nguyen Fall 2023
  • Enwongobasi Ekanem Spring 2022
  • Tarunjeev Juneja Spring 2022
  • Azwad Fardeen Spring 2022
  • Giulia Crovini Spring 2022
  • Anshal Chopra Spring 2022
  • Abhishek Banka Spring 2022
  • Salehin Haque Fall 2021, Spring 2022
  • Mannat Kang Fall 2021
  • Kapil Shrestha Fall 2021
  • Huyen Pham Summer 2021
  • Lakshay Sethi Summer 2021
  • Rubab Singh Summer 2021
  • Uddhav Solanki Summer 2021