VDK Logs Usability Testing
- Purpose
- Background
- Participants
- Environment
- Data Job for Testing
- Task for Participants
- Usability Testing Process
- Post-Testing
The purpose of this usability testing is to evaluate the effectiveness and clarity of our logging system. By engaging users in a hands-on experience with a pre-configured environment, we aim to observe how they interact with the logs to identify and resolve errors.
The primary goal is to assess how users interact with VDK, especially in terms of navigating logs and identifying as well as troubleshooting errors.
- TO BE ADDED
We will use this pre-configured environment for the usability testing:
The environment comes with a ready failing job for the participants to work with.
Data processing job within VDK that is intentionally designed to fail due to a common and identifiable error. The job is simple yet reflective of real-world tasks users might encounter.
- Run the Job: Instruct participants to execute the data job.
- Identify the Error: Participants should use the logs to identify what caused the job to fail.
- Attempt to Fix: After identifying the error, participants should try to fix it based on their understanding and available resources.
- Introduction: Briefly introduce participants to the testing environment and the task at hand.
- Execution: Allow participants to run the job, examine the logs, and attempt to rectify the error.
- Observation: Observe and record their approach, focusing on how they interact with the logs and the troubleshooting steps they take.
- Feedback: Conduct a short post-task conversation to gather feedback on their experience, challenges faced, and suggestions for improvement.
- Report on Data Collected: Analyze common patterns, difficulties, and areas of improvement identified during the testing.
- Action Items for Improvements: Develop a list of actionable steps to enhance the usability and effectiveness of the logging system.