AI-marked short-answer questions

Atomi can offer AI-driven feedback on some questions, allowing students to receive instant feedback when they need it most.

When you submit a response, Atomi AI can provide feedback on its quality. You may also see a sample answer or what a correct answer should include.

How does Atomi AI assess the quality of a response?

Atomi's AI auto-marking evaluates your answer based on its relevance, completeness and clarity.

Relevance measures the extent to which your answer supplies factually correct information that addresses the question. In other words, did you provide the information the question was looking for?
Completeness is a measure of the extent to which you fulfilled all of the instructions or requirements of the question. For example, if the question asked you to "give an example" and you did not include an example, your answer might be relevant but incomplete.
Clarity measures the quality of your writing and how easily the model can understand your response. Your choice of words, the specificity of your language and your spelling, syntax and grammar all impact clarity. We've designed our AI model to be quite forgiving in this regard, but a minimum threshold of clarity is required for an answer to get full marks.

Marks are awarded as follows:

Label	Definition	Marks
`correct`	When an answer has all of the following qualities: It's highly relevant It's complete It's clear	2
`partly`	When an answer either: Is incomplete - i.e. it addresses some, but not all of the requirements of the question. For example, if you provided one correct example when the question asks you to give two examples, your answer will only be partly correct. Includes some, but not all the expected information. For example: If your answer provides three examples and one of them is incorrect or invalid. You omit a key fact such as a date, name or equation that is required. Is written in such a way that one or more parts are unclear or ambiguous.	1
`incorrect`	When an answer either: Does not address the criteria established by the instructions in the question (including non-serious attempts) Provides substantially false or inaccurate statements. Is substantially unclear, ambiguous or unintelligible. Generally speaking, incorrect answers do not adequately satisfy any part of the question.	0

How do I access AI-marked short answer questions?

AI-powered auto-marking is being progressively rolled out across Atomi. At this point, Atomi's AI marks most short answer questions across English, Maths, Science and Physical Education in interactive lessons across Years 7-10. AI auto-marking also available in Atomi Revision Sessions.

As Atomi's AI model is still learning, there are times when it might not be able to confidently decide which mark to give your answer. When the AI model doesn't have a high confidence level to auto-mark, we'll fall back to asking you to self-mark your response.

We're constantly improving the Atomi AI model, so these questions and other subjects will be unlocked in the future.

How accurate is Atomi’s AI at marking?

Atomi’s AI is tested extensively under the tight supervision of our in-house machine learning experts, academic content creators and high school teachers.

Internal testing has shown that Atomi’s AI model grades student responses within one mark of accuracy 99.6% of the time. This accuracy is comparable to state-of-the-art models in the field of Automatic Short Answer Grading.

In comparison, most students are far more likely to mark themselves incorrectly when self-marking.

If you believe your answer was marked incorrectly, you can log a dispute. The Atomi team uses this information to further improve the accuracy of Atomi's AI model.

As a teacher, can I see what mark Atomi’s AI gave?

Student marks for short-answer questions appear in the Marks tab in the lesson progress report, just like any other question type. AI-marked answers are shown in the same report, distinguished with a single sparkle icon (see example below).

How does Atomi protect the privacy of student data?

Atomi is committed to protecting student privacy.

You can learn more about the types of data we collect, how we use and store data and your rights in our privacy policy or the Security, privacy and trust section of this Help Centre.