Construal Level International Multi-lab Replication (CLIMR) Project

This project entails multi-lab collaborative replications of studies on
Construal Level Theory (CLT):

Liberman, N., & Trope, Y. (1998). The role of feasibility and desirability
considerations in near and distant future decisions: A test of temporal
construal theory. Journal of Personality and Social Psychology, 75(1), 5-18.
Study 1.

Fujita, K., Henderson, M., Eng, J., Trope, Y., & Liberman, N. (2006). Spatial
distance and mental construal of social events. Psychological Science, 14,
278-282. Study 1.

In addition to close replications of these two studies, this project also
includes two paradigmatic replications relevant to social and likelihood
distance.

The CLIMR project is a collaboration of 78 labs, across 27 countries, featuring
15 languages.

Report of Results

A preprint for the project's main article, reporting the primary results, is
available on PsyArXiv: https://osf.io/preprints/psyarxiv/wqbhd_v2

Compendium Structure

The CLIMR project compendium comprises two main parts, one hosted on the Open
Science Framework (OSF; https://osf.io/ra3dp/) and one hosted on GitHub
(https://github.com/RabbitSnore/CLIMR). The OSF repository for CLIMR contains
the materials, methods, and data (when data are collected). The OSF repository
also contains the registration documentation and Stage 1 manuscript for the
registered report for the primary results of the project. The GitHub repository
contains the code necessary to execute and reproduce the statistical analyses
for the project.

This repository is structured as follows:

The source file for compiling the project is located in the root directory.
The source files to render analysis reports (i.e., .Rmd files) in the root
directory.
The source files for data wrangling, visualization, simulation,
effect calculation, and analysis are located in the /R/ directory.
Rendered figures are located in the /figures/ directory.
Some data are located in the /data/ directory, and data required for
analyses will be downloaded automatically from the Open Science Framework as
required.
Rendered reports are located in the /reports/ directory.

(Re-)Building the Project

If you want to reproduce the analyses and output for the CLIMR project, the most
straightforward way to do this is to clone this repository into an RStudio
project. This
webpage has
information about how to clone repositories in RStudio. Once you have cloned
the repository, open the project in RStudio, and run the following code:

source("CLIMR_build-project.R")

Running this script will install all necessary packages and build the project,
including all effect size calculations, meta-analytic models, data
visualizations, and reports.

Additionally, CLIMR_build-project.R includes parameters that control its
operations (e.g., whether to run a simulation or load data files). These
parameters must be changed manually, and they should only be changed if you know
what you are doing.

Additional supplemental materials are available on the Open Science Framework:
https://osf.io/ra3dp/

By default, running this script will download a pre-cleaned version of the data.
This version of the data is considerably more convenient to work with than the
raw data. If you want to access the raw data, it can be found on OSF or
automatically downloaded using the parameters in CLIMR_build-project.R.

Technical Information for Reproducibility

The CLIMR project analysis code was built using R 4.3.2. The packages required
for the project are tracked with the renv package. Guidance on how to use the
renv package can be found
here

If you are reproducing the analyses for the first time, before running the
script to build the project, you will need to install all necessary packages (in
their correct version). The parameters of the build script are set to perform
these installations by default. Note that this process can be time consuming and
may require user input to confirm the installations. Alternatively, to do this
manually, make sure that renv is installed, and run renv::restore().

Readable Reports

Reports of the the main analyses, supplemental analyses, and preliminary studies
are available in the /reports/ directory. These reports are rendered in a
format that is readable on GitHub.

Primary Results

The primary results of the replications are available in the reports linked
below.

Validation Studies

In part to assist with the selection of studies that would be theoretically
informative to replicate, we have conducted a series of studies assessing
measures of mental abstraction/concreteness. These validations studies are
reported in a preprint available here: https://osf.io/preprints/psyarxiv/v6xt4

Pretests and Examination of Outcome Measures

To address reviewer concerns and to validate the procedures used in the
replication studies, we have conducted a series of pretests and assessments of
potential sources of error. These analyses are reported in the documents linked
below.

Exploratory and Post Hoc Analyses

In addition to the planned analyses, we conducted several exploratory and post
hoc analyses of the data.

RabbitSnore/CLIMR