Client

Client

NewPath Learning

NewPath Learning

My Role

My Role

Moderator

Note-taker

Observer

Researcher

Evaluator

Moderator

Note-taker

Observer

Researcher

Evaluator

Team

Team

3 UX Researchers
2 UX Designers

3 UX Researchers
2 UX Designers

Timeline

Timeline

12 weeks

12 weeks

OVERVIEW

OVERVIEW

In this usability evaluation, we assessed NewPath Learning, an Learning Management System platform. We focused on the 'Build-a-Lesson' section, employing Nielsen's usability heuristics. We found usability issues including lack of draft saving, absent warning prompts, and inability to preview lessons. Inconsistencies in double-click actions, confusing sorting, and missing media element titles were also noted.

In this usability evaluation, we assessed NewPath Learning, an Learning Management System platform. We focused on the 'Build-a-Lesson' section, employing Nielsen's usability heuristics. We found usability issues including lack of draft saving, absent warning prompts, and inability to preview lessons. Inconsistencies in double-click actions, confusing sorting, and missing media element titles were also noted.

In this usability evaluation, we assessed NewPath Learning, an Learning Management System platform. We focused on the 'Build-a-Lesson' section, employing Nielsen's usability heuristics. We found usability issues including lack of draft saving, absent warning prompts, and inability to preview lessons. Inconsistencies in double-click actions, confusing sorting, and missing media element titles were also noted.

THE CHALLENGE

THE CHALLENGE

How might we enhance the UX of the website?

How might we enhance the UX of the website?

How might we enhance the UX of the website?

The challenge was to identify usability issues and propose solutions that would make the platform more intuitive and user-friendly.

The challenge was to identify usability issues and propose solutions that would make the platform more intuitive and user-friendly.

The challenge was to identify usability issues and propose solutions that would make the platform more intuitive and user-friendly.

DISCOVERY

DISCOVERY

Why Heuristic Evaluation?

Why Heuristic Evaluation?

Why Heuristic Evaluation?

We started with a heuristic evaluation using Nielsen's ten usability heuristics as a guide, we first independently evaluated the 'Build a Lesson' section and then discussed them as a team. We decided to do a heuristic evaluation to identify and prioritize critical usability issues that could potentially impact the user experience.

We started with a heuristic evaluation using Nielsen's ten usability heuristics as a guide, we first independently evaluated the 'Build a Lesson' section and then discussed them as a team. We decided to do a heuristic evaluation to identify and prioritize critical usability issues that could potentially impact the user experience.

We started with a heuristic evaluation using Nielsen's ten usability heuristics as a guide, we first independently evaluated the 'Build a Lesson' section and then discussed them as a team. We decided to do a heuristic evaluation to identify and prioritize critical usability issues that could potentially impact the user experience.

Who's Target Audience?

Who's Target Audience?

Who's Target Audience?

Students

Students

Students

Educators

Educators

Educators

Through the Heuristic Evaluation we identified these issues…

Through the Heuristic Evaluation we identified these issues…

Through the Heuristic Evaluation we identified these issues…

Consistency & Standards

Consistency & Standards

The absence of clear calls to action left customers without an obvious path to make purchases. While products were categorized on the homepage, there were no options to add items to the cart or proceed with purchases.

The absence of clear calls to action left customers without an obvious path to make purchases. While products were categorized on the homepage, there were no options to add items to the cart or proceed with purchases.

The absence of clear calls to action left customers without an obvious path to make purchases. While products were categorized on the homepage, there were no options to add items to the cart or proceed with purchases.

User Control & Freedom

User Control & Freedom

Users faced restrictions in their control and freedom, such as lessons starting from the beginning even when selected from the middle, inability to preview a lesson interactable before adding it, and no option to delete uploaded media. Enhancing user control and freedom can lead to a more satisfying user experience.

Users faced restrictions in their control and freedom, such as lessons starting from the beginning even when selected from the middle, inability to preview a lesson interactable before adding it, and no option to delete uploaded media. Enhancing user control and freedom can lead to a more satisfying user experience.

Users faced restrictions in their control and freedom, such as lessons starting from the beginning even when selected from the middle, inability to preview a lesson interactable before adding it, and no option to delete uploaded media. Enhancing user control and freedom can lead to a more satisfying user experience.

Help & Documentation

Help & Documentation

While the help and documentation icon was well-placed, there were issues such as no format instructions on the upload pop-up. Improving help and documentation can assist users when they encounter difficulties.

While the help and documentation icon was well-placed, there were issues such as no format instructions on the upload pop-up. Improving help and documentation can assist users when they encounter difficulties.

While the help and documentation icon was well-placed, there were issues such as no format instructions on the upload pop-up. Improving help and documentation can assist users when they encounter difficulties.

Error Prevention

The platform lacked sufficient error prevention measures, such as no prompt to confirm deleting an interactable and no warning or draft saved when navigating away from building a custom lesson. Implementing error prevention measures can help avoid user frustration and loss of work.

The platform lacked sufficient error prevention measures, such as no prompt to confirm deleting an interactable and no warning or draft saved when navigating away from building a custom lesson. Implementing error prevention measures can help avoid user frustration and loss of work.

The platform lacked sufficient error prevention measures, such as no prompt to confirm deleting an interactable and no warning or draft saved when navigating away from building a custom lesson. Implementing error prevention measures can help avoid user frustration and loss of work.

Visibility of System Status

There were issues with the visibility of system status, such as the sort function not working and text changes only when an option is selected.

There were issues with the visibility of system status, such as the sort function not working and text changes only when an option is selected.

There were issues with the visibility of system status, such as the sort function not working and text changes only when an option is selected.

WHAT DID WE DO ABOUT IT?

WHAT DID WE DO ABOUT IT?

We designed and conducted Usability Tests

We designed and conducted Usability Tests

We designed and conducted Usability Tests

Following the heuristic evaluation, we conducted usability tests with 6 participants who matched our desired participant characteristics. The tests were designed to evaluate and improve critical aspects of the system, and to enhance the user experience, ensure user-friendliness, and optimize system usability.

Following the heuristic evaluation, we conducted usability tests with 6 participants who matched our desired participant characteristics. The tests were designed to evaluate and improve critical aspects of the system, and to enhance the user experience, ensure user-friendliness, and optimize system usability.

Following the heuristic evaluation, we conducted usability tests with 6 participants who matched our desired participant characteristics. The tests were designed to evaluate and improve critical aspects of the system, and to enhance the user experience, ensure user-friendliness, and optimize system usability.

USABILITY TESTING

USABILITY TESTING

We designed 5 tasks based on our heuristic evaluation

We designed 5 tasks based on our heuristic evaluation

We designed 5 tasks based on our heuristic evaluation

1. Create a custom lesson on Chemical reactions for 8th Grade students. Objective: To check if the users can find the ‘Build-a-Lesson’ section of the website and if they are able to successfully add a presentation to a new folder with a custom name.

5. Add media from "Types of chemical reactions" to the custom lesson. Objective: To check if the user could successfully add a video to the designated folder of the lesson.

4. Add a presentation on chemical reactions for New York State curriculum for 8th grade. Objective: To check if the user can navigate to the ‘Select by standard’ section to make courses relevant to students of different grade levels.

2. Upload files from the computer to the custom lesson. Objective: The website had a section for uploading image files and a different section for uploading PDF files. The purpose of this task was to check if the users can upload PDF and image files from the local computer to the lesson resources without any error.

3. View the most recently added interactable in a lesson. Objective: To check if the user can easily find and interact with the most recently added interactive element in a lesson.

1. Create a custom lesson on Chemical reactions for 8th Grade students. Objective: To check if the users can find the ‘Build-a-Lesson’ section of the website and if they are able to successfully add a presentation to a new folder with a custom name.

2. Upload files from the computer to the custom lesson. Objective: The website had a section for uploading image files and a different section for uploading PDF files. The purpose of this task was to check if the users can upload PDF and image files from the local computer to the lesson resources without any error.

3. View the most recently added interactable in a lesson. Objective: To check if the user can easily find and interact with the most recently added interactive element in a lesson.

4. Add a presentation on chemical reactions for New York State curriculum for 8th grade. Objective: To check if the user can navigate to the ‘Select by standard’ section to make courses relevant to students of different grade levels.

5. Add media from "Types of chemical reactions" to the custom lesson. Objective: To check if the user could successfully add a video to the designated folder of the lesson.

FINDINGS

Lack of Feedback and Guidance

Lack of Feedback and Guidance

Users frequently mentioned difficulties due to the lack of feedback and guidance provided by the platform. They felt unsure about their actions and the outcomes, leading to uncertainty and inefficiency. They desired more immediate and clear feedback to guide their actions.​"I feel like I'm guessing most of the time. Some instructions or feedback would be helpful,"  shared a user.

Users frequently mentioned difficulties due to the lack of feedback and guidance provided by the platform. They felt unsure about their actions and the outcomes, leading to uncertainty and inefficiency. They desired more immediate and clear feedback to guide their actions.​"I feel like I'm guessing most of the time. Some instructions or feedback would be helpful,"  shared a user.

Users frequently mentioned difficulties due to the lack of feedback and guidance provided by the platform. They felt unsure about their actions and the outcomes, leading to uncertainty and inefficiency. They desired more immediate and clear feedback to guide their actions.​"I feel like I'm guessing most of the time. Some instructions or feedback would be helpful,"  shared a user.

Poor Error Prevention and Recovery

Poor Error Prevention and Recovery

Users were frustrated by the lack of an auto-save feature, leading to potential loss of work. They also found the error messages unclear, making it difficult to understand and recover from errors. This lack of clarity increased their frustration and hindered their progress.​ "I lost all my work when I accidentally closed the tab. I assumed it would save automatically," one user commented. Another user stated, "These error messages are cryptic. I don't know what I'm supposed to do to fix this." 

Users were frustrated by the lack of an auto-save feature, leading to potential loss of work. They also found the error messages unclear, making it difficult to understand and recover from errors. This lack of clarity increased their frustration and hindered their progress.​ "I lost all my work when I accidentally closed the tab. I assumed it would save automatically," one user commented. Another user stated, "These error messages are cryptic. I don't know what I'm supposed to do to fix this." 

Users were frustrated by the lack of an auto-save feature, leading to potential loss of work. They also found the error messages unclear, making it difficult to understand and recover from errors. This lack of clarity increased their frustration and hindered their progress.​ "I lost all my work when I accidentally closed the tab. I assumed it would save automatically," one user commented. Another user stated, "These error messages are cryptic. I don't know what I'm supposed to do to fix this." 

Discoverability Issues

Discoverability Issues

Users reported difficulties in discovering essential features and content on the platform. This hindered their efficiency and ability to successfully complete tasks. They felt that the system was not intuitive and that they had to spend unnecessary time searching for features. ​"I spent too much time trying to find what I needed. It should be more straightforward," a participant noted. 

Users reported difficulties in discovering essential features and content on the platform. This hindered their efficiency and ability to successfully complete tasks. They felt that the system was not intuitive and that they had to spend unnecessary time searching for features. ​"I spent too much time trying to find what I needed. It should be more straightforward," a participant noted. 

Users reported difficulties in discovering essential features and content on the platform. This hindered their efficiency and ability to successfully complete tasks. They felt that the system was not intuitive and that they had to spend unnecessary time searching for features. ​"I spent too much time trying to find what I needed. It should be more straightforward," a participant noted. 

​​Lack of User Control and Freedom

​​Lack of User Control and Freedom

Users reported feeling restricted in their actions. They desired more control, especially when it came to undoing actions or navigating back to a previous state. This lack of control led to frustration and a sense of being trapped. A participant shared, ​"I feel like I'm stuck in a loop. I can't go back to where I was before."

Users reported feeling restricted in their actions. They desired more control, especially when it came to undoing actions or navigating back to a previous state. This lack of control led to frustration and a sense of being trapped. A participant shared, ​"I feel like I'm stuck in a loop. I can't go back to where I was before."

Users reported feeling restricted in their actions. They desired more control, especially when it came to undoing actions or navigating back to a previous state. This lack of control led to frustration and a sense of being trapped. A participant shared, ​"I feel like I'm stuck in a loop. I can't go back to where I was before."

Inconsistency in Design

Inconsistency in Design

Users expressed confusion due to inconsistencies in the platform's design elements. They found it challenging to predict the system's behavior, which disrupted their workflow and led to inefficiency. One user remarked, "I'm not sure what to expect when I click on different buttons. They don't behave the same way."

Users expressed confusion due to inconsistencies in the platform's design elements. They found it challenging to predict the system's behavior, which disrupted their workflow and led to inefficiency. One user remarked, "I'm not sure what to expect when I click on different buttons. They don't behave the same way."

Users expressed confusion due to inconsistencies in the platform's design elements. They found it challenging to predict the system's behavior, which disrupted their workflow and led to inefficiency. One user remarked, "I'm not sure what to expect when I click on different buttons. They don't behave the same way."

OUR RECOMMENDATIONS

Improve discoverability and navigation

Improve discoverability and navigation

Implement clear navigation menus with user-friendly labels, complemented by visual cues and tooltips, to facilitate easy discovery of features and content, and seamlessly guide users through creating and customizing lessons or assignments.

Implement clear navigation menus with user-friendly labels, complemented by visual cues and tooltips, to facilitate easy discovery of features and content, and seamlessly guide users through creating and customizing lessons or assignments.

Implement clear navigation menus with user-friendly labels, complemented by visual cues and tooltips, to facilitate easy discovery of features and content, and seamlessly guide users through creating and customizing lessons or assignments.

Enhance feedback and guidance

Enhance feedback and guidance

Improve user experience by implementing enhanced system feedback, including confirmation messages and progress indicators for user actions. Additionally, offer contextual help and inline documentation to facilitate user understanding of specific features. Introduce an interactive wizard to create a more guided and informative onboarding experience for new teachers, featuring step-by-step walkthroughs and explanations of key platform features.

Improve user experience by implementing enhanced system feedback, including confirmation messages and progress indicators for user actions. Additionally, offer contextual help and inline documentation to facilitate user understanding of specific features. Introduce an interactive wizard to create a more guided and informative onboarding experience for new teachers, featuring step-by-step walkthroughs and explanations of key platform features.

Improve user experience by implementing enhanced system feedback, including confirmation messages and progress indicators for user actions. Additionally, offer contextual help and inline documentation to facilitate user understanding of specific features. Introduce an interactive wizard to create a more guided and informative onboarding experience for new teachers, featuring step-by-step walkthroughs and explanations of key platform features.

Improve consistency

Improve consistency

Ensure platform-wide consistency in design, interactions, and language. Align with user expectations, incorporating actions like double-clicking and drag-and-drop for media uploads. Simplify media management with centralized, multi-file uploads, including batch processing, and improve content organization for user efficiency.

Ensure platform-wide consistency in design, interactions, and language. Align with user expectations, incorporating actions like double-clicking and drag-and-drop for media uploads. Simplify media management with centralized, multi-file uploads, including batch processing, and improve content organization for user efficiency.

Ensure platform-wide consistency in design, interactions, and language. Align with user expectations, incorporating actions like double-clicking and drag-and-drop for media uploads. Simplify media management with centralized, multi-file uploads, including batch processing, and improve content organization for user efficiency.

Optimize error prevention and recovery

Optimize error prevention and recovery

Implement auto-save to minimize data loss and ensure consistent saving of users' work; refine error messages for specificity, clarity, and actionable guidance.

Implement auto-save to minimize data loss and ensure consistent saving of users' work; refine error messages for specificity, clarity, and actionable guidance.

Implement auto-save to minimize data loss and ensure consistent saving of users' work; refine error messages for specificity, clarity, and actionable guidance.

Address issues with the interface and interactions

Address issues with the interface and interactions

Enhance platform readability through refined visual hierarchy and layout, ensuring clear affordances and interactive feedback for all elements.

Enhance platform readability through refined visual hierarchy and layout, ensuring clear affordances and interactive feedback for all elements.

Enhance platform readability through refined visual hierarchy and layout, ensuring clear affordances and interactive feedback for all elements.

NewPath Learning began implementing our recommendations

NewPath Learning began implementing our recommendations

NewPath Learning began implementing our recommendations

Our usability study had a direct impact on the development of the NewPath Learning platform. Based on our findings and recommendations, the team at NewPath Learning began implementing changes to improve the user experience.

Our usability study had a direct impact on the development of the NewPath Learning platform. Based on our findings and recommendations, the team at NewPath Learning began implementing changes to improve the user experience.

Our usability study had a direct impact on the development of the NewPath Learning platform. Based on our findings and recommendations, the team at NewPath Learning began implementing changes to improve the user experience.

My reflections

My reflections

My reflections

  • During this project, I applied Norman's heuristic principles to enhance user experience in real-world scenarios.

  • Collaborating within a team provided valuable insights from diverse perspectives. Notably, I gained proficiency in navigating and addressing constraints within a corporate setting.

  • It is a rewarding experience to see our work influencing real-world changes and contributing to a better user experience. We look forward to seeing the full implementation of our recommendations and the positive impact it will have on the users of the NewPath Learning platform.

  • During this project, I applied Norman's heuristic principles to enhance user experience in real-world scenarios.

  • Collaborating within a team provided valuable insights from diverse perspectives. Notably, I gained proficiency in navigating and addressing constraints within a corporate setting.

  • It is a rewarding experience to see our work influencing real-world changes and contributing to a better user experience. We look forward to seeing the full implementation of our recommendations and the positive impact it will have on the users of the NewPath Learning platform.

  • During this project, I applied Norman's heuristic principles to enhance user experience in real-world scenarios.

  • Collaborating within a team provided valuable insights from diverse perspectives. Notably, I gained proficiency in navigating and addressing constraints within a corporate setting.

  • It is a rewarding experience to see our work influencing real-world changes and contributing to a better user experience. We look forward to seeing the full implementation of our recommendations and the positive impact it will have on the users of the NewPath Learning platform.

Thanks for stopping by!

Get in touch with me on LinkedIn or email me at vn9336@g.rit.edu

Thanks for stopping by!

Get in touch with me on LinkedIn or email me at vn9336@g.rit.edu

Thanks for stopping by!

Get in touch with me on LinkedIn or email me at vn9336@g.rit.edu