IT-Universitetet i København
 
  Tilbage Kursusoversigt
Kursusbeskrivelse
Kursusnavn (dansk):Experimental Design and Analysis 
Kursusnavn (engelsk):Experimental Design and Analysis 
Semester:Efterår 2010 
Udbydes under:cand.it., digital design og kommunikation (ddk) 
Omfang i ECTS:7,50 
Kursussprog:Engelsk 
Kursushjemmeside:https://blog.itu.dk/DEDA-E2010/ 
Min. antal deltagere:12 
Forventet antal deltagere:15 
Maks. antal deltagere:30 
Formelle forudsætninger:  
Læringsmål:After the the course, the student is expected to be able to:
[1] Characterize the fundamentals of statistical analysis and statistical design of experiments and apply this knowledge in a practical context within the field of Human Computer Interaction.
[2] Identify relevant variables for analysis and evaluate sampled data using basic statistical measures and methods.
[3] Extract knowledge from research literature on selecting procedures and variables for quantitative experimental evaluation.
[4] Research and analyze a specific problem area, identify research questions and formulate key hypotheses; develop and evaluate a strategy for testing the hypotheses experimentally, analyze results statistically, and present them visually.
[5] Write a scientific report on a quantitative study or experiment.  
Fagligt indhold:This course provides a basic introduction to statistical methods, with an emphasis on the connection between planning of quantitative experiments and statistical analysis and how this can be applied in the area of Human Computer Interaction. The basic principles of statistical design of experiments are introduced, and the statistical methods used to analyze the resulting data are presented. The standard way of presenting the results in coherent scientific reports is also covered.
The course contains three major sections:
• How to write scientific reports.
• How to design and run experiments.
• How to analyze experimental data.

The course provides some of the basic methodological elements for the course Usability and Accessibility, thus preparing the ground to go into more depth with the key components of the usability testing in that course. Through its emphasis on quantitative methods the Experimental Design and Analysis course also serves as a complement to other courses with a more qualitative approach.

Condensed list of topics

1. How to write a scientific report

o The standard format of reports
o Basic components of reports:
- Writing summaries, abstracts and introductions
- Writing method sections (background, method, equipment, approach)
- Writing results sections (analysis, results)
- Writing discussions (discussion, conclusion, further work)
- Referencing and formatting

2. Introduction to design of experiments

o Scientific method – quantitative vs. qualitative methods
o How are questions researched? (hypothesis testing vs. explorative methods)
o The aims of research and experimentation
o Data sources (such as user studies, log files, questionnaires) and introduction to variables and data types
o Planning of experiments:
- Data sources, requirements and quality
- Systematic and random sources of variation
- Within vs. between subject approaches
- Confounding factors

3. Introduction to statistical analysis
o Introduction to Excel and the SPSS statistical software
o Descriptive statistics
o Statistical modeling and inferential statistics
o Hypothesis testing and statistical significance
o Parametric statistics (such as confidence intervals, t-tests, ANOVA, and linear regression)
o Non-parametric statistical tests (such as Mann-Whitney, Wilcoxon signed rank, Kruskal-Wallis, and Friedman)
o Checking the validity of statistical models and assumptions in practice and considering the representativeness and generalizability of results

4. Introduction to survey-based methods & analysis
o Finding the target audience
o Constructing surveys and questionnaires
o Data analysis  
Læringsaktiviteter:

Lectures and exercises will be integrated to provide direct hands-on experience with the methods presented during the lecture. There will be a reading list with material students should read for each lecture. The purpose of the exercises is to work with the statistical methods presented during the lectures, and they will present problems relevant for the field of HCI. The SPSS software will be used for the statistical analyses. The students are encouraged to work in groups, as discussion and exchange of ideas is an important part of the digestion of the material.

There will be 4 mandatory assignments during the course:

1.A short written review (2 pages) of a scientific article followed by a peer review and a discussion seminar.

2.A report (5 pages) based on a small practical experiment performed on the first day of the course.

3.A report (5 pages) based on an HCI-related experiment presented as part of the course material. This experiment has to be planned and carried out mainly outside of scheduled course hours.

4.A report (8 pages) based on an HCI-related experiment proposed by the students. This experiment has to be planned and carried out mainly outside of scheduled course hours. There will be a peer review and a discussion seminar as part of the writing process. This final group report will also form the basis of the exam.

The students are expected to work and write in groups, as discussion and exchange of ideas is an important part of the digestion of the material. Note that the peer reviews and discussion seminars are part of the assignment, and that participation therefore is mandatory. All assignments have to be approved before the student is accepted for the final exam. The final report (assignment 4) has to be handed in to the Examination office before the deadline specified by the office.

Workload: Expected 10 hours per week.
------------------
Information about study structure
This course is part of the DDK specialization User-centered Design. Find it described here:
DDK specializations

Se hvordan undervisningen er tilrettelagt her:
link til skemaoplysninger
Skemaoplysningerne vil være tilgængelige fra kort før semesterstart.

See the schedule here:
link to the time table
The schedule will be available shortly before the beginning of the term.  

Eksamensform og -beskrivelse:X. experimental examination form (7-scale; external exam), 7-trins-skala, Ekstern censur

(Assignment 4, 8-page report), without time for preparation at the examination. 7-point marking scale and external examiner.

There will be 4 mandatory assignments during the course. All assignments have to be approved before the student is accepted for the final exam. The final report (assignment 4) has to be handed in to the Examination office before the deadline specified by the office.  

Litteratur udover forskningsartikler:Hugh Coolican (2009). Research Methods and Statistics in Psychology (5th ed.). London: Hodder Education. 
 
Afholdelse (tid og sted)
Kurset afholdes på følgende tid og sted:
UgedagTidspunktForelæsning/ØvelserStedLokale
Onsdag 08.30-10.30 Forelæsning ITU 2A52
Onsdag 10.45-12.45 Øvelser ITU 2A52

Eksamen afholdes på følgende tid og sted:
EksamensdatoTidspunktEksamenstypeStedLokale
2010-12-15 Før kl. 15.00 Skriftlige arbejder ITU Eksamenskontoret (2E)
2011-01-25 Please contact the course manager Mundtlig eksamen ITU 4A22
2011-02-15 Re-eksamen Mundtlig eksamen ITU Lokale oplyses senere