IT-Universitetet i København
 
  Tilbage Kursusoversigt
Kursusbeskrivelse
Kursusnavn (dansk):Experimental Design and Analysis 
Kursusnavn (engelsk):Experimental Design and Analysis 
Semester:Forår 2011 
Udbydes under:cand.it., digital design og kommunikation (ddk) 
Omfang i ECTS:7,50 
Kursussprog:Engelsk 
Kursushjemmeside:https://blog.itu.dk/DEDA-F2011/ 
Min. antal deltagere:12 
Forventet antal deltagere:15 
Maks. antal deltagere:30 
Formelle forudsætninger: Information about the course of study
This course is first part of a specialization on the Master of Science in IT, study programme Digital Design and Communication. See a description of specializations on DDK here (in Danish): Master of Science Digital Design and Communication
 
Læringsmål:After the the course, the student is expected to be able to:
[1] Characterize the fundamentals of statistical analysis and statistical design of experiments and apply this knowledge in a practical context within the field of Human Computer Interaction.
[2] Identify relevant variables for analysis and evaluate sampled data using basic statistical measures and methods.
[3] Extract knowledge from research literature on selecting procedures and variables for quantitative experimental evaluation.
[4] Research and analyze a specific problem area, identify research questions and formulate key hypotheses; develop and evaluate a strategy for testing the hypotheses experimentally, analyze results statistically, and present them visually.
[5] Write a scientific report on a quantitative study or experiment.  
Fagligt indhold:This course provides a basic introduction to statistical methods, with an emphasis on the connection between planning of quantitative experiments and statistical analysis and how this can be applied in the area of Human Computer Interaction. The basic principles of statistical design of experiments are introduced, and the statistical methods used to analyze the resulting data are presented. The standard way of presenting the results in coherent scientific reports is also covered.
The course contains three major sections:
• How to write scientific reports.
• How to design and run experiments.
• How to analyze experimental data.

The course provides some of the basic methodological elements for the course Usability and Accessibility, thus preparing the ground to go into more depth with the key components of the usability testing in that course. Through its emphasis on quantitative methods the Experimental Design and Analysis course also serves as a complement to other courses with a more qualitative approach.

Condensed list of topics

1. How to write a scientific report

o The standard format of reports
o Basic components of reports:
- Writing summaries, abstracts and introductions
- Writing method sections (background, method, equipment, approach)
- Writing results sections (analysis, results)
- Writing discussions (discussion, conclusion, further work)
- Referencing and formatting

2. Introduction to design of experiments

o Scientific method – quantitative vs. qualitative methods
o How are questions researched? (hypothesis testing vs. explorative methods)
o The aims of research and experimentation
o Data sources (such as user studies, log files, questionnaires) and introduction to variables and data types
o Planning of experiments:
- Data sources, requirements and quality
- Systematic and random sources of variation
- Within vs. between subject approaches
- Confounding factors

3. Introduction to statistical analysis
o Introduction to Excel and the SPSS statistical software
o Descriptive statistics
o Statistical modeling and inferential statistics
o Hypothesis testing and statistical significance
o Parametric statistics (such as confidence intervals, t-tests, ANOVA, and linear regression)
o Non-parametric statistical tests (such as Mann-Whitney, Wilcoxon signed rank, Kruskal-Wallis, and Friedman)
o Checking the validity of statistical models and assumptions in practice and considering the representativeness and generalizability of results

4. Introduction to survey-based methods & analysis
o Finding the target audience
o Constructing surveys and questionnaires
o Data analysis  
Læringsaktiviteter:

Lectures and exercises will be integrated to provide direct hands-on experience with the methods presented during the lecture. There will be a reading list with material students should read for each lecture. The purpose of the exercises is to work with the statistical methods presented during the lectures, and they will present problems relevant for the field of HCI. The SPSS software will be used for the statistical analyses. The students are encouraged to work in groups, as discussion and exchange of ideas is an important part of the digestion of the material.

There will be 4 mandatory assignments during the course:

1.A short written review (2 pages) of a scientific article followed by a peer review and a discussion seminar.

2.A report (5 pages) based on a small practical experiment performed on the first day of the course.

3.A report (5 pages) based on an HCI-related experiment presented as part of the course material. This experiment has to be planned and carried out mainly outside of scheduled course hours.

4.A report (8 pages) based on an HCI-related experiment proposed by the students. This experiment has to be planned and carried out mainly outside of scheduled course hours. There will be a peer review and a discussion seminar as part of the writing process. This final group report will also form the basis of the exam.

The students are expected to work and write in groups, as discussion and exchange of ideas is an important part of the digestion of the material. Note that the peer reviews and discussion seminars are part of the assignment, and that participation therefore is mandatory. All assignments have to be approved before the student is accepted for the final exam. After it has been approved, the final report (assignment 4) is to be submitted to the Examination office before the deadline specified by the office.

Workload: Expected 10 hours per week.
------------------
See the schedule here:
link to the time table
The schedule will be available shortly before the beginning of the term.
 

Eksamensform og -beskrivelse:X. experimental examination form (7-scale; external exam), 7-trins-skala, Ekstern censur

This course has mandatory assignments (e.g. attendance, papers, exercises, presentations, productions), that need to be completed/approved before being eligible to register for the examination:
- 1 review and 3 reports (see above)  

Litteratur udover forskningsartikler:Hugh Coolican (2009). Research Methods and Statistics in Psychology (5th ed.). London: Hodder Education. 
 
Afholdelse (tid og sted)
Kurset afholdes på følgende tid og sted:
UgedagTidspunktForelæsning/ØvelserStedLokale
Mandag 12.00-14.00 Forelæsning ITU 2A18
Mandag 14.00-16.00 Øvelser ITU 4A54

Eksamen afholdes på følgende tid og sted:
EksamensdatoTidspunktEksamenstypeStedLokale
2011-05-18 09:00-15:00 Skriftlige arbejder ITU Eksamenskontoret (2E)
2011-06-06 Kontakt kursusansvarlig for individuelt tidspunkt Mundtlig eksamen ITU 2A12
2011-06-07 Kontakt kursusansvarlig for individuelt tidspunkt Mundtlig eksamen ITU 2A12
2011-06-08 Kontakt kursusansvarlig for individuelt tidspunkt Mundtlig eksamen ITU 2A12