Hello, if you have any need, please feel free to consult us, this is my wechat: wx91due

Assignment 2 – Usability evaluation

Part 1 – Ethics (3 marks)

For this assignment, we have obtained low risk ethical approval to enable you to do the study with participants under the Massey Code of Ethical Conduct for Research, Teaching and Evaluations involving Human Participants.

• participants must be 16 years or older.
• participants must sign a consent form before the study begins (provided in the assignment documents).
• all data collected must be non-identifying/anonymous
• use a participant numbering system to label data collected instead of names.
• you can record screens/voices but not faces.
• Data must be kept private and secure and cannot be shared with anyone other than the teaching team for this course. You cannot under any circumstances upload data collected from participants to generative AI tools e.g. ChatGPT as this would be a breach of ethics.

To complete this part do the following:

Write a plan for your usability evaluation. Use the following headings as a guide for your plan. If you are focusing on certain parts of a system, specify the parts of the system you are choosing to focus on in your goal, questions, and tasks.

• Goal
• Questions – these are research questions relating to your goal.
• Equipment/Materials/Environment – make a detailed list of equipment/materials (electronic and non-electronic) you will need to conduct this evaluation. Also describe where the evaluation will be conducted - remember you need to meet with participants in person!158757 2025
• Participants - who would your ideal participants be and why? ? It is ok if you don’t find the ideal people when you do the evaluation in Part 3.
• Tasks – describe the tasks you would ask participants to perform in the evaluation. Include the task sheet of instructions you will be providing to participants. Do not include any parts of the site that require payment and ensure that no personal information from the participant is entered into the system.
• Test procedure – document what you will do in your evaluation session step by step from beginning to end for each participant.
• Data to be collected – describe all the kinds of data you plan to collect. If you plan to use questionnaires/interview, you must include a copy of the questions planned. As a Massey student you can use Qualtrics for administering online questionnaires if you wish: massey.qualtrics.com. You must include some kind of recording in your data e.g. audio/video and screen.
• Data analysis plan – explain how you plan to analyse each type of data you plan to collect to answer your questions and ultimately, your goal.

There is no word limit for this part, but please keep your plan succinct and to the point.

a) Pilot study: Run a pilot study by carrying out your usability evaluation plan. You must pilot your usability study with at least 1 participant in person. If you must make significant changes after 1 pilot participant, do the pilot study with more participants until the changes are no longer significant. Note that in practice it is very unusual to not make any changes to an evaluation plan after a pilot study.

Before any participant begins your pilot/usability study you must:

Once you have completed running the usability evaluation, analyse your data using your data analysis plan from Part 2. Pilot study data should NOT be included in this analysis. Summarise your results in your assignment document appropriately providing evidence (e.g. using relevant statistics, graphs, photos, screenshots, quotes etc.) with explanation. Finally, answer your questions and discuss your goal (from Part 2) using the results you have obtained.

Prepare slides for a 5-minute presentation of your evaluation including the following:

• Introduce your chosen software and the parts you will be evaluating.
• Briefly summarise your evaluation plan.
• Discuss how the pilot study progressed; how many participants were part of the pilot study and why.
• Summarise the findings of the pilot study and discuss the changes made to the evaluation plan based on these findings.
• Discuss how the main usability study progressed; how many participants were part of this part of the study. Summarise the results of the evaluation and link these back to your goals/questions.
• Discuss your personal experience and reflect on anything you might do/not do if you had to plan and run an evaluation again.

We are interested in experiential learning in this class. I would encourage you all to be a participant in a fellow class member’s evaluation as this will give you a good appreciation for what it is like to sit on the ‘other’ side and may help you think differently when you plan and conduct your own studies in the future. This is entirely optional and there are no marks associated with participating.

Massey uses the AI Assessment Scale. This assessment is Level 2 which Massey specifically defines as:

You may use AI for planning, idea development and research. Your final submission should show how you have developed and refined these ideas.

Find out more about AI at Massey: https://stream.massey.ac.nz/course/view.php?id=10

• You may use AI to explain concepts or clarify topics. For example: “Explain what brain computer interfaces are.”
• You may use AI to provide examples to deepen your understanding. For example: “Can you give me an example of how a brain-computer interface might be used”
• When using AI, make sure to carefully evaluate its responses for accuracy and relevance.

• You must not directly input assessment instructions into an AI bot or software.
• You must not directly copy any content from online sources or generated by AI into your assessments, even if you modify it slightly afterward.
• You must not paraphrase AI-generated content to make it appear as your own work. This means you should not reword or rearrange AI-generated content and present it as your own creation, even if you change some of the wording or structure.
• You must not assume AI outputs are always accurate—always verify information independently.

Still unsure? Ask your lecturer.

You must submit a generative AI use statement for all assessments that includes details on whether or not you have used AI, what AI tools have been used, and all AI prompts and responses. The template for this is provided in the assignment documents on Stream. More general information on AI usage can be found in Massey’s AI Essentials course on Stream:

https://stream.massey.ac.nz/course/view.php?id=10158757 2025

• Submit one document to Stream using the Assignment 1 Submission link. It must include:
• Low risk checklist (Part 1)
• Signed ethical compliance statement (Part 1)
• Evaluation plan (Part 2)
• Optional Link to a .zip file with recordings from the pilot study & main usability evaluation ONLY if they are too big to submit with the rest of the raw data on Stream
• Summary of the results (Part 4)
• Your completed Generative AI statement (using the template provided). All students, whether you used Generative AI or not must submit this statement.
• One .zip file with raw data collected during the pilot study & main usability evaluation including signed consent forms (Part 3)
• Auckland students: submit slides for your presentation (Part 5)
• Distance students: submit a video presentation file (Part 5) 

• Proof read your assignment carefully; marks will be deducted for poor presentation.
• Late penalty: Assignments submitted after the due date (without prior permission) will incur a penalty.
• Originality: Assignments will be checked on turnitin, so please ensure your work is your own. If you use content from another source (either directly or if you use the ideas), you must reference it appropriately. If you are unsure see the Massey guidelines here: https://www.massey.ac.nz/massey/about/massey/university-management/avc-academic/academic-integrity/academic-integrity-students.cfm
• Please see above for guidance on use of generative AI tools. Under no circumstances are you allowed to share any data collected from participants with AI tools as it would breach our ethics in terms of keeping participants data private and secure.

Marking Schedule