Prototype Usability Test Plan

​

What you've prototyped - Lulua

 

We have prototyped a user-friendly software platform for healthcare, featuring customizable user bio pages, medication schedule templates, and simplified medical reports. In addition to addressing medical jargon and organization challenges, our prototype focuses on simplifying complex medical terminology through features like the example report slide with simplified terms. Moreover, it emphasizes organizing information in a clear and intuitive manner to facilitate better understanding and navigation within the software, aiming to enhance both usability and accessibility for healthcare professionals and patients alike.

 

The feature(s) you will test - Lulua

 

We plan to test all the key features of the prototype, including:

• The comprehensive user bio page with customizable options for both healthcare professionals and patients. They can include their blood type, age, diagnosis, etc.

• The medication schedule template, allowing users to input and customize their medication schedules. They can add which medications they need to take when, with the dosage amounts so it is easier to refer to throughout the week. This also includes a side effects section in order to see possible consequences of their medications.

• The example report slides with simplified terms, demonstrating how the software can bridge the communication gap by making medical reports more understandable.

 

 What you want to learn about those features - Lulua

 

Through testing, we aim to gather insights on:

 

• Determine if patients prefer diagnosis and check-up reports presented in easily understandable language or professional medical jargon.

• Assess whether the presentation format affects patients' comprehension, engagement, and confidence in managing their health.

• Evaluate the practicality and efficiency of a medical calendar in aiding patient and healthcare professional organization.

• Assess the ease of use and effectiveness of the calendar in scheduling appointments, tracking medication regimens, and managing healthcare-related tasks.

 

Overall, we want to assess whether these features effectively address the identified challenges and whether users find them intuitive and beneficial in their healthcare interactions.

​

Who you'll test with (which personas, # of participants you're aiming to engage) - Khushali

 

Given our previous engagement with a diverse range of healthcare professionals and patients, we aim to re-engage these personas in testing the prototype to evaluate its effectiveness. The personas include:

 

Healthcare Professionals:

• Clinical Dietitian (Age range: 11-20 years)

• Primary Care Doctor (Age range: 21-30 years)

• Registered Nurses (Age ranges: 31-40 years)

• Pharmacist (Age range: 51-60 years)

• ER Doctor (Age range: 61-70 years)

Patients:

• Brain cancer patient (Age: 55 years)

• Neck and knee surgery patient (Age: 68 years)

• Heart patient (bypass) (Age: 80 years)

• Cancer patient (Age: 13 years)

• Stomach hemorrhoid patient (Age: 25 years)

 

We aim to assess their feedback on the prototype to determine its effectiveness in addressing the identified challenges and meeting their needs. If not all, we hope to test our prototype on at least 2 people from each persona.

​

The tasks you'll have them carry out - Amina

 

The users will be assigned the following tasks that revolve around the three main components of our prototype: the user bio page, the medication schedule template, and the example report slides. 

 

• Refer to the user bio page and customize it according to their role (healthcare professional or patient).

• Use the medication schedule template and input/customize their medication schedules. (They will be able to add specific medications along with dosage amount and instructions, and side effects to see possible consequences of their medications)

• Interact with and use the example report slides that contain complex medical jargon and simplified terms to show how to make the complicated medical report more understandable.

 

Any open ended questions you will ask - Amina

 

• How would you rate the ease of use of each feature (with ease, with difficulty, not done)?

• What aspects of the different features did you find to be most helpful?

• Are there any improvements or additional features you would suggest for enhancing usability?

• Can you describe some of the specific challenges that you encountered when interacting with any of the features?

• In what ways do you think these features could positively impact your healthcare management needs?

 

Describe how you will score how your prototype does in supporting the tasks (both qualitative and quantitative data) - Sukh

 

Qualitative Data: 

• We will collect feedback from our users on their experiences utilizing all the features of our prototype, including what they found helpful, challenging, and any suggestions they might have for improvement.

• User Ratings: Users will rate the ease of use of each feature of our prototype based on their rating of: with ease, with difficulty and not done. We will then view and collect these numerical ratings and assess the ease of use.

 

Quantitative Data:

• Time taken to perform each task (seconds): We will time how long the users take to perform a specific task.

 

Usability Test Script and Scenarios

Orientation Script

​

Introduction - Eyosyas

​

Good [morning/afternoon/evening]. I'm [NAME] from the UX Whisperers team, and today, we're conducting a usability test for our project, "MediEase", a software solution aimed at improving healthcare interactions. 

​

Thank you for agreeing to participate in our usability test.

​

Disclosures and Informed Consent - Sukh

​

Before we begin, I want to assure you that we're here to test the design of our software, not you. Your honest feedback is invaluable, and there are no right or wrong answers. Your responses will be kept confidential, and any recordings will only be used for this study. Additionally, we may take pictures or videos for our presentations, but if you're not comfortable with that, please let us know. We will ensure that your name remains anonymous throughout the process.

​

This test may take up to 6 minutes. If you like, you may interact with our prototype as long as needed and ask questions. 

​

Guidelines - Eyosyas

To ensure the effectiveness of our session, kindly adhere to the following guidelines:

• Articulate your interactions with the prototype clearly.

• Feel free to express any comments or concerns you may have during the test.

• Provide honest feedback based on your experience.

• When manipulating buttons, handle them with care and return them to their original positions if no longer needed.

• Customize the prototype according to your preferences.

• Remember, this is a test environment, so the information inputted into the prototype need not be accurate. For instance, using placeholder data instead of personal information like your real name or blood type is acceptable.

Warm up - Kirubel

 [Add warm up questions, e.g. about the participant, use of the site or similar products, or other high level questions to start the discussion]

• Is it  your first time using a healthcare app, or one with similar features?

• How is the experience of using this healthcare app?

• In your opinion, could a healthcare app like this one contribute to improving personal wellness management and health care outcomes?

 

Transition to Test - Kirubel

​

You'll be asked to perform a series of tasks. For each task, I will read a brief scenario and then ask you to use the [site or product] to find the answer or complete the task. We want to know how well the [product] works, and the best way to do that is to let you work through each task on your own without my help. However, I'm happy to clarify instructions and the purpose of the task, if needed. There may be times when I’ll ask you to explain why you said or did something.

·  To help me understand the way you would use the [product], I want you to  think aloud as you complete the tasks. Talking aloud helps us understand your thought processes.

 

Scenarios and Tasks - Amina

1. Customize User Bio Page

Scenario (Healthcare Professional): You are a primary care physician that wants to use the MediEase software to customize your bio page with your personal/relevant information and ensure that it reflects your role.

 

Task: To begin, please input your role (healthcare professional or patient). Then input personal information relevant to your role: Name, profession, age, email, years of experience, language, any additional notes.

 

Scenario (Patient): You are a brain cancer patient that wants to use the MediEase software to customize your bio page with your personal/relevant information and ensure that it reflects your role.

 

Task: To begin, please input your role (healthcare professional or patient). Then input personal information relevant to your role: Name, diagnosis, age, email, blood type, language, any additional notes.

 

As you input your personal information, please tell me:

• What do you think of this specific feature?

• How easy or difficult was it for you to customize your profile page?

 

2. Input Medication Schedule

​

Scenario(Healthcare Professional): You are a primary care physician that needs to upload the medication schedule for a patient of yours.

 

Task: Select patient name and input medication information such as the specific medications the patient needs to take and when, dosage amount, and any side effects.

​

Scenario(Patient): You are a brain cancer patient that needs to view your medication information. You want to select the timeframe for when you want to begin your medication.

 

Task: Choose which days of the week you will be able to take your medication(s).

 

As you input your medication schedule, please tell me:

• What do you think of this specific feature?

• How easy or difficult was it for you to input information regarding the medication schedule?

​

 3. Interact with Example Report Slides

​

Scenario (Healthcare Professional): You are a primary care physician that is reviewing lab results with a patient. The lab report contains complex medical jargon that may be difficult for the patient to understand.

 

Task: Highlight the complex medical terms and replace these words with easier-to- understand terms for the patient.

 

Scenario (Patient): You are a brain cancer patient that wants to view your lab results but you encounter medical jargon that makes it very difficult for you to understand your results.

 

Task: Highlight the medical jargon that is too complicated and replace these terms with words that are simpler.

 

As you interact with the example report slides, please tell me:

• What do you think of this specific feature?

• How easy or difficult was it for you to change the medical terms into simpler words in the example report slides?

• Do you feel this feature helps to bridge the communication gap and help to make medical reports more understandable?

​

 Qualitative Questions - Kirubel 

• During your experience were you confused or lost when finding a specific path.

• How easy was it for you to access the settings or preferences screen, and what made it straightforward or challenging.

• As a user, what additional information would you recommend or see implemented to enhance your experience.

 

Closing Discussion- Kirubel 

​

• What part of the app did you find beneficial or not important?

• Do you think there is a group of users that it could benefit from or have a hard time with?

• How would you describe the overall usability of the prototype? Was it easy to use, somewhat challenging, or extremely difficult? How long did it take you to complete the task?

• In your opinion, how could the prototype be improved to better meet your healthcare management needs or enhance usability?

• Were there any aspects of the prototype that interfered with your ability to navigate through the prototype? 

• Did you encounter any technical issues while navigating through this prototype? 

• Are there any specific functionalities you would like to recommend for this prototype?

​

Final Thoughts: Do you have any final thoughts or recommendations about the website or on any of the tasks or questions in this discussion?

·  Thank you again for your time and participation!

​

​

​

​

​