Till KTH:s startsida Till KTH:s startsida

Visa version

Version skapad av Patric Jensfelt 2015-08-25 10:45

Visa < föregående | nästa >
Jämför < föregående | nästa >

Examination and grading

Intended learning outcomes

After completing this course the student should be able to 

  1. recall and apply basic concepts in artificial intelligence 

  2. solve problems from the AI domain with limited resources in the form of time and computations

  3. formulate and address an AI related scientific problem 

  4. demonstrate an insight into the risks of AI and its role in society 

  5. present work in writing and orally 

so that the student can 

  • make use of methods from artificial intelligence in the analysis, design and implementation of computer programs in academic as well as industrial applications

  • in an appropriate way present results and solutions.

Criteria based grading

We make use of a criteria based grading system. You will not collect points as in most other courses. Instead, to reach a certain grade you should show that you have fulfilled the criteria for that grade. In the tables below the means of examination has been indicated. 

The matrix below shows which assessment tasks, assesses which ILO.

ILO 

Quizzes 

HW1 

HW2 

HW3 

Project 

recall and apply basic concepts in artificial intelligence 

solve problems from the AI domain with limited resources in the form of time and computations 

X X

formulate and address an AI related scientific problem 

demonstrate an insight into the risks of AI and its role in society 

present work in writing and orally 

The matrix below shows to which level a certain ILO is assessed. The requirements for ILOs that are only assessed at an E level need to be met to pass the course but they do not influence the final grade in any other way.

ILO / Grade

recall and apply basic concepts in artificial intelligence 

solve problems from the AI domain with limited resources 
in the form of time and computations 

formulate and address an AI related scientific problem 

demonstrate an insight into the risks of AI and its role in society 

present work in writing and orally 

ILO 1: recall and apply basic concepts in artificial intelligence

Grade

Criteria 

E

Can answer questions regarding all parts of the course material. 

This translates into passing all quizzes.

ILO 2: solve problems from the AI domain with limited resources in the form of time and computations 

Grade Criteria
E
  1. Can solve problems from the AI domain at the most basic level
  2. Can implement the algorithms and can explain the code
  3. All tasks are completed
C
  1. Can solve problems from the AI domain outperforming simple solutions.
  2. Can implement the algorithms and explain the design of the code.
  3. At least one of the HW1 and HW2 is completed before the deadline and all but two quizzes passed before the deadline.  
A
  1. Can solve problems from the AI domain applying some more advanced techniques, combining several methods when needed, making good use of information and outperforming basic solutions.
  2. Can analyse the performance of different implementations and evaluate and recommend different solutions to the problems, can justify all choices in the designs and reason about how to address modified versions of the problems.
  3. All tasks (incl project) except one quiz are passed before the deadline.

A student that falls short of some but not all requirements for A but meets all requirements for C can be given a B for ILO2 and similar when being between E and C and D.

The requirements regarding timely completion of tasks captures the fact that solving a problem under time constraints is harder. To get a B you need to meet the time criteria at the A level. To get a D you need to meet the time criteria at the C level. 

It is the state of HW1 and HW2 before the deadline that counts in the grading when considering the time constraint (ILO2.3). For example, HW1 and HW2 handed in before the deadline and assessed to be at an E level will forever be at E level regarding ILO2.3. Handing in HW1 before the deadline and assessed to be at level C can still give an overall C even if HW2 is handed in later as long as it is assessed to be at least at level C. Level A and B can only be reached if the homework assignments and the project are handed in before the deadline and are at that level.

HW1 and HW2 will be assess with respect to ILO2.1 and ILO2.2 separately. That is, you could think of it as having the following five criteria: ILO2.HW1.1, ILO2.HW1.2, ILO2.HW2.1, ILO2.HW1.2 and ILO2.3.

The resulting grade for ILO2 is calculates as
min( ILO2.1+2, ILO2.3)
where
ILO2.1+2 = round_down(min(ILO2.HW1.1, ILO2.HW1.2), min(ILO2.HW2.1, ILO2.HW2.2))

Examples

  • HW1 and HW2 handed in after the deadline gives E no matter what the results are.
  • Not passing the project before the deadline limits the grade to C
  • HW1/2 are solved but you can cannot explain your code means you do not pass
  • HW1 and HW2 are solved with awesome performance (A+ level ILO2.HW1/2.1) but you can only explain what your code does but not why it is written like that (E level ILO2.HW1/2.2) would result in a E for ILO2.1+2 and thus E for ILO2 no matter the result of ILO2.3.

ILO 3: formulate and address an AI related scientific problem 

This ILO contains some general requirement and some project specific ones. The project specific grading criteria are specified for each project here.

Note that ILO3 does not result in exact grades but rather intervals of grades. The text describes the minimum requirement for a certain interval. Meeting the criteria for grade interval C-A means that the result can be thought of as A in all practical senses when calculating the final grade whereas E-D would count as D.

Grade Criteria
E-D
  1. Can identify and formulate a problem based on scientific literature.
  2. Can refer to the work on which the work is based in the report and explain the connection between the work in the project and the referred work.
  3. Results from the system are presented in the report and the oral presentation.
C-A
  1. Can identify and formulate a problem based on scientific literature and motivate why the problem is worth addressing.
  2. Can describe related work more broadly and identify strengths and weaknesses of the related work and relate own work to it. 
  3. Results are presented and analysed to, for example, show why/when the method fails or succeeds. Experiments are motivated and designed for evaluating the developed system. 

ILO 4: demonstrate an insight into the risks of AI and its role in society 

Grade Criteria
E

Can independently identify risks of AI and discuss these and the role of AI in the society. 

Assessed in the ethics essay handing (HW3). 

ILO 5: present work in writing and orally 

Grade Criteria
E
  1. Can explain own solutions orally
  2. Can write short reports discussing the results of own work
  3. Can present work of a group in writing and orally.
  4. Can write an essay in a language that is grammatically correct and understandable. 

This is tested when presenting HW1 and HW2, the project and the ethics essay. 

The final grade 

To pass the course the student needs to meet the requirements at an E level for all goals. The final grade on the course is given by ILO2, but no higher than the upper limit of the grade interval given by ILO3. 

For example

  • A on ILO2 and C-A on ILO3 gives an overall A
  • B on ILO2 and C-A on ILO3 gives an overall B
  • A on ILO2 and E-D on ILO3 gives an overall D