Conducting experimental research online - ABO700623

• Title: Conducting experimental research online
• Guaranteed by: Institute of Czech Language and Theory of Communication (21-UCJTK)
• Faculty: Faculty of Arts
• Actual: from 2023
• Semester: summer
• Points: 5
• E-Credits: 5
• Examination process: summer s.:
• Hours per week, examination: summer s.:0/2, Ex [HT]
• Capacity: unknown / 15 (unknown)
• Min. number of students: unlimited
• 4EU+: no
• Virtual mobility / capacity: no
• State of the course: taught
• Language: English
• Teaching methods: full-time
• Teaching methods: full-time
• Note: course can be enrolled in outside the study plan; enabled for web enrollment
• Guarantor: James Brand, Ph.D.
• Teacher(s): James Brand, Ph.D.
• Class: A - Mezioborová nabídka VP: Lingvistika; Exchange - 09.3 Linguistics

Annotation

Last update: Mgr. Ivan Kafka (28.11.2023)

This course will provide students with a practical and technical introduction to running online behavioural experiments for
research in linguistics and psychology. In recent years, the use of online data collection has been critical for making
scientific studies of language more efficient, reliable and transparent, but to use these methods effectively, a knowledge of
how they work and when they are appropriate is crucial. Throughout the course, the content will focus on developing a
solid understanding of how to code experiments using the JsPsych framework, but no prior experience with
coding/programming is required - the content will be aimed at a beginner level, with the expectation of learning to advance
steadily each week. During each lecture, worksheets will be provided and students will be required to use their own
laptops to learn practically, as well as having support and guidance from the lecturer. A range of different experimental
paradigms will be covered, so that students acquire the expertise to be able to create their very own experiments, collect
data and then produce a written report, thus following the workflow of empirical researchers.

Aim of the course

Last update: Mgr. Ivan Kafka (28.11.2023)

The materials will be focused on learning from the bottom up, so the development of skills and knowledge through practical experience will be key – everybody is welcome and will be supported. You simply need a laptop and enthusiasm.

This workshop will aim to provide you with the following learning outcomes:

• A conceptual understanding of online research workflows

• A practical knowledge of how JsPsych works

• A technical capacity to run your own research online

• A knowledge of how to report methods transparently

Course completion requirements

Last update: Mgr. Ivan Kafka (28.11.2023)

1. Active participation in completing course worksheets

2. Construction of a fully working experiment for data collection

3. Writing up a lab report based on your experiment

Literature

Last update: Mgr. Ivan Kafka (28.11.2023)

De Leeuw, J. R. (2015). jsPsych: A JavaScript library for creating behavioral experiments in a Web browser. Behavior research methods, 47, 1-12.

Keuleers, E., & Balota, D. A. (2015). Megastudies, crowdsourcing, and large datasets in psycholinguistics: An overview of recent developments. Quarterly Journal of Experimental Psychology, 68(8), 1457-1468.

Laurinavichyute, A., Yadav, H., & Vasishth, S. (2022). Share the code, not just the data: A case study of the reproducibility of articles published in the Journal of Memory and Language under the open data policy. Journal of Memory and Language, 125, 104332.

Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716.

Syllabus

Last update: Mgr. Ivan Kafka (28.11.2023)

The structure of the course will be:

1. Introduction to online data collection

2. Methods for running experiments

3. Basics of JsPsych - how to code

4. Integrating JsPsych and Cogntion.run

5. Building your first experiment

6. Extending experiments

7. Working with stimuli

8. Working with data

9. Different experimental paradigms 1

10. Different experimental paradigms 2

11. Crowdsourcing

12. Project proposals

13. Reporting methods