What I did
- Writing and executing of tests
- Reporting problems in Jira
- Creating an automated spreadsheet to keep track of problems over time
What I used
About the project
Arboreal is a game made at my game development bachelor at IGAD in the third year. I joined as the sole dedicated tester in the last quarter of the year. I spent the first 3 quarters of the first year working on other projects including Project Sulphur.
Automated spreadsheet
I made an Excel workbook that scanned a spreadsheet exported from Jira and automatically generated metrics from it.
The spreadsheet has 3 builtin worksheets, and to use the spreadsheet exported from Jira it has to be imported as a worksheet first.
The overview worksheet looks as follows..
"Data Sheet" is the name of the worksheet which is expected to be one that was exported by Jira (i.e. the format of this is assumed).
The open rate and close rate are the number of bugs opened/closed per week and the fix rate the number of bugs fixed per day (in hindsight it would have made more sense to measure both per week or both per day).
The rating is a number between 0 and 10. The way I implemented this at the time (it was my first time doing Quality Assurance) was as the average of the weekly rating, which is calculated as 10 - 10 * Open Bugs / Total Bugs. Because of this implementation the rating automatically became higher as bugs were fixed. I think that it would have made more sense to calculate the weekly rating as 10 * Closed Bugs / Open Bugs At Start Of Week so 10 would mean there were (at least) as many bugs closed this week as there were at the start of the week.
"Totals" here means the performance of the entire team, not any individual team member. In hindsight I think replacing "Total Bugs" here with "Open Bugs" and replacing "Open Bugs" with "Bugs Opened This Week" would make sense. This way ideally the "Open Bugs" would be decreasing even if the "Bugs Opened This Week" is increasing.
The individual section shows metrics per team member to see who are fixing bugs and how fast. In hindsight I think priority might have been a good addition, which was exported by Jira, but I think what I managed to implement was a good start.
In the last week of the the project I finished an idea I had, namely the leaderboard. I shared an image in Slack, and it was well received by the team. Some people said that if was posted every week it would motivate them. However, due to this being completed in the last week it was too late to actually use it.
The other worksheets contain data used by the overview worksheet.
The individual effort worksheet looks as follows..
This worksheet contains the number of bugs closed and opened per week on the right and a summary on the left as well as the number of total bugs assigned, which isn't measured per week.
The overall effort worksheet looks as follows..
The fix rate here is the per week fix rate summarized on the overview worksheet.