Summary: A new study finds that mathematical, data-driven models can influence human decisions more effectively than traditional psychological techniques.
Researchers introduce the concept of “choice engineering”—a systematic, model-based alternative to the intuition-driven “choice architecture.” In a multi-team international challenge, computational models built to reflect real human behavior, notably the CATIE model, outperformed both intuitive psychological strategies and common machine-learning approaches such as Q-learning. The results suggest behavior can be steered precisely using optimized quantitative methods.
Key Facts:
- Choice engineering defined: Uses computational, data-driven models and optimization to design interventions that steer decisions with measurable precision, contrasted with intuition-based nudging.
- CATIE model success: The CATIE (Contingent Average, Trend, Inertia, and Exploration) model produced the most effective reward schedules, outperforming both Q-learning and strategies based on psychological heuristics.
- Ethical caution: The authors emphasize the need for clear ethical frameworks to guide any real-world application of these techniques.
Source: Hebrew University of Jerusalem
Overview: Published in Nature Communications, this study, led by Prof. Yonatan Loewenstein of the Safra Center for Brain Sciences (ELSC) at Hebrew University with collaborators from Yale University and the Technion, offers a fresh way to influence choices by applying calibrated mathematical models to human decision-making.
The paper contrasts two approaches. Choice architecture—popularized in policy and behavioral economics and associated with concepts like nudging—uses psychological insights such as anchoring, primacy effects, and intuitive heuristics to steer decisions subtly. Choice engineering, by contrast, relies on formal models of learning and decision processes plus optimization algorithms to design reward structures that systematically shape behavior.
To evaluate these methods, the research team organized an academic competition in which international teams submitted reward schedules designed to bias choices in a repeated two-option task. Over 3,000 participants took part, each exposed to one reward schedule. Competing strategies ranged from intuition-driven psychological designs to those derived from computational learning models.
The winning approach was based on CATIE, developed by Dr. Ori Plonsky together with Prof. Ido Erev. CATIE integrates several behavioral tendencies—such as trend sensitivity, inertia, contingent averaging, and exploration—into a unified predictive framework. In this experiment, CATIE-based reward schedules consistently generated stronger and more reliable shifts in participant choices than both Q-learning-based schedules and those rooted in qualitative intuition.
Prof. Loewenstein notes that the results demonstrate the potential to engineer behavior much like engineers design physical systems: by using well-calibrated mathematical models to predict and shape outcomes reliably. Beyond demonstrating effectiveness, the study proposes a new criterion for evaluating cognitive models—assessing their ability to shape real-world decisions in addition to standard statistical fit measures like likelihood or explained variance.
The implications are broad. In education, public health, digital interface design, and policymaking, choice engineering could enable scalable, empirically optimized interventions that are tailored to actual patterns of human learning and choice. At the same time, the authors stress that deploying these tools responsibly will require strong ethical guidelines, transparency, and accountability to prevent manipulation or misuse.
As a proof of concept, the study highlights the emerging role of quantitative modeling in the behavioral sciences—not only for explaining how people decide but for actively and predictably guiding decisions. The approach adds a practical dimension to cognitive modeling: models can be judged by how effectively they achieve intended behavioral outcomes when used to design interventions.
About this math and human behavior research news
Author: Danae Marx
Source: Hebrew University of Jerusalem
Contact: Danae Marx – Hebrew University of Jerusalem
Image: The image is credited to Neuroscience News
Original Research: Open access. “Behavior engineering using quantitative reinforcement learning models” by Yonatan Loewenstein et al., Nature Communications.
Abstract
Behavior engineering using quantitative reinforcement learning models
Successfully shaping human and animal behavior is both a theoretical challenge and a practical goal across many fields. This study asks whether quantitative models of choice—grounded in reinforcement learning and behavioral tendencies—can be used to guide behavior more effectively than qualitative psychological principles.
Termed “choice engineering,” the approach borrows the rigor of engineering from the natural sciences and applies it to behavioral interventions. In a competition-based experiment, academic teams used either quantitative models or qualitative principles to design reward schedules intended to bias choices in a repeated two-alternative task.
The findings show that choice engineering can be the most effective method for shaping behavior in this context, providing a proof of concept that well-calibrated quantitative models are ready to be used for engineered behavioral interventions. Additionally, the study demonstrates that choice engineering offers a practical way to compare cognitive models based on their ability to produce desired behavioral change, complementing traditional model comparison methods.