Grading criteria

Intended learning outcomes After completing this course the student should be able to

* recall and apply basic concepts in artificial intelligence ¶
* solve problems from the AI domain with limited resources in the form of time and computations¶
* formulate and address an AI related scientific problem ¶
*
* demonstrate an insight into the risks of AI and its role in society ¶
* present work in writing and orally ¶
so that the student can

* make use of methods from artificial intelligence in the analysis, design and implementation of computer programs in academic as well as industrial applications

* in an appropriate way present results and solutions.

Criteria based grading We make use of a criteria based grading system. You will not collect points as in most other courses. Instead, to reach a certain grade you should show that you have fulfilled the criteria for that grade. In the tables below the means of examination has been indicated.

The matrix below shows which assessment tasks, assesses which ILO.

ILO

Quizzes

HW1

HW2

HW3 Essay

Project

1

recall and apply basic concepts in artificial intelligence

X

2

solve problems from the AI domain with limited resources in the form of time and computations

X

X

X

X X 3 ¶ formulate and address an AI related scientific problem ¶ X ¶ 4

demonstrate an insight into the risks of AI and its role in society

X

5 4

present work in writing and orally

X

X

X

X

The matrix below shows to which level a certain ILOassessment task is assessed. The requirements for ILOtasks that are only assessed at an E level need to be met to pass the course but they do not influence the final grade in any other way.

ILOTask / Grade

E ¶ D ¶ C ¶ B Graded¶

Quizzes ¶

Pass/Fail¶

HW1 (HMM)

A -E

1 ¶ recall and apply basic concepts in artificial intelligence ¶ X ¶ 2 ¶ solve problems from the AI domain with limited resources in the form of time and computations ¶ X ¶ X ¶ X ¶ X ¶ X ¶ 3 ¶ formulate and address an AI related scientific problem ¶ X ¶ X ¶ X ¶ X ¶ X ¶ 4 ¶ demonstrate an insight into the risks of AI andHW2 (Games)¶

A-E¶

Essay (Ethics)¶

Pass/Fail¶

Project on planning (Optional)¶

Completed at A or incomplete¶

Note that the project is assessed only at an A level and that it is optional. It its role in society ¶ X ¶ 5 ¶ present work in writing and orally ¶ X ¶ equired for grades A and B and it is meant primarily for the students that are aiming for these grades.¶

In the tables for the different ILOs below you need to meet all criteria up to a certain grade. That is, at an C level you need to meet all criteria from E up to C and at A level you need to meet all criteria.

There are two course components for the course; TEN1 and LAB1. The mapping between assignment and course component is as follow.TEN1: Quizzes and essayLAB1: Homework assignments HW1 and HW2 and the optional Project.¶

¶

ILO 1: recall and apply basic concepts in artificial intelligence Grade Criteria

Pass Can answer questions regarding all parts of the course material.

This translates into passing all quizzes.

ILO 2: solve problems from the AI domain with limited resources in the form of time and computations Grade Criteria E
* Can solve problems from the AI domain at the most basic level
* Can implement the algorithms and can explain the code
* All tasks are completed
C
* Can solve problems from the AI domain outperforming simple solutions.
* Can explain in detail how the algorithms work in a particular application and justify all design decisions.
* All but three quizzes passed before their respective deadlines.
A
* Can solve problems from the AI domain applying some more advanced techniques, combining several methods when needed, making good use of information and outperforming basic solutions.
* Can analyse the performance of different implementations and suggest how to address modified versions of the problem.
* Look at specific requirements for HW1, HW2 and the Project.
A student that falls short of some but not all requirements for A but meets all requirements for C can be given a B for ILO2. The same holds for being between E and C which can give a D.¶ HW1 and HW2 will be assessed separately and the grade corresponding to ILO2 will be based on the average of the two, rounded down.¶ Examples¶
* If HW1 or HW2 is solved but you can cannot explain your code you do not pass
* If HW1 and HW2 are solved with awesome performance (A+ level ILO2.1) but you can only explain what your code does but not why it is written like that (E level ILO2.2) would result in a overall E no matter the result of ILO2.3.
¶ ILO 3: formulate and address an AI related scientific problem This ILO contains some general requirement and some project specific ones. The project specific grading criteria are specified for each project here.¶ Note that ILO3 does not result in exact grades but rather intervals of grades. The text describes the minimum requirement for a certain interval. Meeting the criteria for grade interval C-A means that the result can be thought of as A in all practical senses when calculating the final grade whereas E-D would count as D.¶ Grade Criteria E-D
* Can identify and formulate a problem based on scientific literature.
* Can refer to the work on which the work is based in the report and explain the connection between the work in the project and the referred work.
* Results from the system are presented in the report and the oral presentation.
C-A
* Can identify and formulate a problem based on scientific literature and motivate why the problem is worth addressing.
* Can describe related work more broadly and identify strengths and weaknesses of the related work and relate own work to it.
* Results are presented and analysed to, for example, show why/when the method fails or succeeds. Experiments are motivated and designed for evaluating the developed system.
¶ ILO 4: demonstrate an insight into the risks of AI and its role in society Grade Criteria Pass Can independently identify risks of AI and discuss these and the role of AI in the society. ¶ Assessed in the ethics essay handing (HW3). ¶ ¶ ILO 5: present work in writing and orally Grade Criteria Pass
* Can explain own solutions orally
* Can present work of a group in writing and orally.
* Can write an essay in a language that is grammatically correct and understandable.
This is tested when presenting HW1 and HW2, the project and the ethics essay. ¶ The final grade To pass the course the student needs to meet the requirements at an E level for all goals. The final grade on the course is given by ILO2, but no higher than the upper limit of the grade interval given by ILO3. ¶ For example¶
* A on ILO2 and C-A on ILO3 gives an overall A
* B on ILO2 and C-A on ILO3 gives an overall B
* A on ILO2 and E-D on ILO3 gives an overall D
After the course is complete:
* A course feedback will be sent out. It is completely anonymous and makes the course better. Please participate actively and elaborately. We value your inputs. We release results only after everyone participates in this survey. Find the survey here. (link later)
* If you still have not completed QUIZZES: do the late quizzes which will be online for a couple of weeks after the completion of the course. Your grade can be finalised only after you have completed all QUIZZES.
* If you still have not completed any of the following: HW1 HW2. Complete them as soon as possible and make a presentation appointment here. There will be a penalty for late completion as deemed fit by the teacher. If these dates are unsuitable for you send us an email, we will try to fit you in some other way. No promises.
* If you have not completed HW3 complete it and send it asap. We will accept submissions for a couple of weeks after the course completion. You cannot pass the course without HW3.
* if you have not presented your project or have not passed - please send us an email and we have to deal with you individually. Best case scenario: you will have to present again, worst case scenario: you will have to redo it the next year.Can identify and address a scientifically interesting problem based on literature self study.
* Solves the problems with limited resources in the form of time.
HW1 and HW2 will be assessed against ILO2 separately and individually with grades E-A. Grades B and D on HW1 and HW2 are awarded when some but not all criteria for A and C levels respectively are achieved.¶

For each of HW1 and HW2 the level understanding has to, at least, match that of the implementation for a certain grade, otherwise the grade will be defined by the level of understanding. Examples: ¶


* If HWX is solved but you can cannot explain your code you do not pass
* If HWX is solved to level A but you can only answer questions at an C level, the grade is C
¶

The project is optional but is required to meet the 3rd criteria for A level. To qualify to start the project you need to¶


* have achieved a minimum of B on HW1 and HW2 or
* pass the qualifier for the project.
The project qualifier consists of completing the quizzes connected to Logic and Planning before a certain deadline and with a high enough score.¶

The project assignment is at A level of ILO2. To be more specific, in the project we expect students to identify an interesting problem in the area of planning, find material in the scientific literature, read up on it and propose a creative solution for it involving an implementation/demonstration. ¶

The 4th criteria at A level translates into competing the assignments on time. ¶

ILO 3: demonstrate an insight into the risks of AI and its role in society Grade Criteria Pass Can independently identify risks of AI and discuss these and the role of AI in the society. ¶

Assessed in the ethics essay handing. ¶

¶

ILO 4: present work Grade Criteria Pass
* Can explain own solutions orally
* Can write an essay in a language that is grammatically correct and understandable.
This is tested when presenting HW1 and HW2, and the ethics essay. ¶

¶

¶

The final grade To pass the course the student needs to get a passing grade for ILO1, 3, and 4 and get at least grade E on ILO2.¶

The final grade on the course is given by ILO2.¶

The final grade for ILO2 is the average of HW1 and HW2 , rounded down. Also, not completing the project results in a maximum of C. This can be summarised in the following table.¶

Project completed Grade No worst_of(round_down(average(HW1,HW2)), "C") Yes round_down(average(HW1,HW2,"A")) Examples:¶


* A on HW1, A on HW2 and completed project --> grade A
* A on HW1, B on HW2 and completed project --> grade A
* A on HW1, A on HW2 but no project --> grade C
*
Clarifications regarding deadlines
* After the deadline for HW1 and HW2 you can give at most C on that assignment
* You cannot submit a project at all after the deadline, you need to wait until next year. In cases where a project has been submitted by the deadline and is very close to pass the requirements, a chance to reach the requirements may be granted.
* If you have not passed the quizzes by the deadline you need to pass all quizzes again.