How to design surveys and experiments for top tier publishing

A methods seminar for behaviorally-oriented management disciplines


Kühne Logistics University
Grosser Grasbrook 17, 20457 Hamburg

English
Spoken language

Profile image

Prof. Dr. Niels Van Quaquebeke

Professor of Leadership and Organizational Behavior & Head of Department of Leadership and Management

Kühne Logistics University - KLU

View profile

Profile image

Prof. Christian Tröster, PhD

Associate Professor of Leadership and Organizational Behavior

Kühne Logistics University - KLU

View profile

Guest lecturer

Profile image

Prof. Laszlo Tihanyi

Professor of Strategic Management & Editor in chief of the Academy of Management Journal

Rice University

View profile

Please note: 

  • Your registration is binding.
  • The registration is only considered complete when the amount of 200 EUR has been received.
  • The course will be limited to max. 50 participants on a first come, first serve basis.
  • The purpose of the bank transfer should be "PhD Methods 2020". If the name of the participant differs from the registration, please include the name of the participant.
  • You will receive the bank details by e-mail after completing the registration.
  • In case of cancellation the fee will be refunded in full up to four weeks before the event begins. After that, we will only refund 50% of the amount. From one week before the event starts, you will not receive a refund.
  • If the situation continues to allow, the seminar will take place on the campus of the KLU in Hamburg, strictly following our COVID19 hygiene plan. Else we will prepare an online version.

Course Objectives

Being able to design experiments and surveys is a key qualification for anyone who wants to do any type of behavioral research. However, despite a lot of effort and resources invested, often experiments and surveys are designed suboptimally or are outright flawed. This also means that the chances to publish such studies in top-tier journals will be seriously limited. In this four-day PhD (and junior faculty) seminar, we will teach how to design and conduct experiments and surveys that rigorously test theory.

Additional emphasis will be laid on typical challenges when designing, recruiting for, analyzing, and writing up experiments and surveys. This will also include coverage of online studies.

The seminar consists of a mix of extensive prereading of key articles, to-the-point in-class discussion, and actual designing of own research projects within the seminar using Questback or Qualtrics and the Amazon’s MTurk platform.

At the end, participants will be able to confidently design their own behaviorally-oriented studies, and potentially already have a running start with one of them.

Course Content (Selection)

  • Introduction to the behavioural foundations of research in management and organization disciplines and how they are linked to the survey/experimental paradigm.
  • Coverage of  various experimental design types (e.g. lab experiment, scenario experiments, online experiments, between/within-subjects designs, etc.) and survey designs (panel designs, time-lag designs, cross-sectional designs, multi-source, etc.) 
  • Typical challenges when designing experiments/surveys (e.g., demand characteristics, sampling bias, measurement, common method/source variance, measurement quality and separation, implicit vs. explicit measures,  single item measures, manipulation checks, outliers, drop-out, translation, etc.) and how to address them optimally.
  • Introduction on how to approach the design from the perspective of your theory (e.g., how to design experiments for testing mediation effects), provision of input on typical mistakes in the analysis of experimental and survey data (e.g., not accounting for nested data structures, difference scores, etc.),  and discussions of types mistakes in the write-up (e.g., inferring causality, implying behavior instead of perceptions, etc.).
  • Discussion of how you should design multiple study papers to provide a compelling test of your hypothesis (e.g., triangulation, conceptual replication, etc.). 
  • Strategies to rule out alternative theoretical explanations of your findings by design or with covariates.
  • Outlook on how topics like Big Data, new European privacy laws, and the replication crisis might affect the methods presented in this course.
  • First hand insights how to dance the tango with reviewers from two instructors who have published in and reviewed for some of the field’s best journals (Including Niels being Senior AE at The Leadership Quarterly and Chris being on the ERB of the Academy of Management Journal).  Additional live input (incl. Q&A session) will be provided by Laszlo Tihanyi current editor in chief of the Academy of Management Journal.

Requirements

This course is designed for PHD students and other early stage researchers from all disciplines in management (e.g., organizational behaviour, strategy, operations management, etc.) and related fields (e.g. psychology, sociology, etc.).

This is not a statistics course. We therefore do require that you have working knowledge in statistics, particularly, variants of regression-based methods. You will also need a statistics software to analyze your survey/ experimental data. Of course, it is you choice what you will use. But we recommend STATA simply because it is a powerful software, we know this software quite well, and can give feedback on how to use it.

The course will be limited to max. 50 participants

Grades, Costs and Readings

GradesA certificate over 5 ECTS will be handed out to each participant who attended all four days.
If participants additionally require a grade, they will need to hand in a write-up of their in-class experiment/ survey (deadline: tba.).
Costs200 Euro. The costs cover lunch and costs for respondents for your own experiment/ survey.
Readings

Please download the list of literature here.  

Note: We require that you read the literature that is written in bold

Please note: 

  • Your registration is binding.
  • The registration is only considered complete when the amount of 200 EUR has been received.
  • The course will be limited to max. 50 participants on a first come, first serve basis.
  • The purpose of the bank transfer should be "PhD Methods 2020". If the name of the participant differs from the registration, please include the name of the participant.
  • You will receive the bank details by e-mail after completing the registration.
  • In case of cancellation the fee will be refunded in full up to four weeks before the event begins. After that, we will only refund 50% of the amount. From one week before the event starts, you will not receive a refund.
  • If the situation continues to allow, the seminar will take place on the campus of the KLU in Hamburg, strictly following our COVID19 hygiene plan. Else we will prepare an online version.

Organizer

Profile image

Melanie Winkelmann

Assistant Resident Faculty