Rubric

Keep in mind that 96 students have already been assessed using this rubric. Changing it will affect their evaluations.
Interim Status - Sys Dev Progress and Planning - FA23
Interim Status - Sys Dev Progress and Planning - FA23
Criteria Ratings Pts
Cover Sheet - Title and Team
Your cover sheet should list: (1) title of deliverable “[Client Name] Interim Status Report”, (2) team name, (3) names of team members, and (4) details on how access will be provided to professor for their review and evaluation of your software progress (both as a user and as a developer).
threshold: pts
2 pts Included title of deliverable as “[Client Name] Interim Status Report”, team name, names of team members
1 pts Missing at least one of the following: title of deliverable as “[Client Name] Interim Status Report”, team name, names of team members
pts
2 pts
--
Cover Sheet - User access
threshold: pts
2 pts Provided clear explanation of how user access to the system will be provided
1 pts Provided explanation of how user access to the system will be provided but prof needed more info to access
pts
2 pts
--
Coversheet - Admin/Dev access
threshold: pts
2 pts Provided clear explanation of how developer/admin access to the system will be provided
1 pts Provided clear explanation of how developer/admin access to the system will be provided but prof needed more info to access
pts
2 pts
--
Table of Contents
Include a Table of Contents as the 2nd page of the report that lists the sections/subsections of your report with page numbers
threshold: pts
1.5 pts Table of contents is complete, includes subsections, format aligns with other report formatting, is clickable, and professionally formatted.
1 pts Table of contents is missing one or more of the following: complete, includes subsections, format aligns with other report formatting, is clickable, and professionally formatted.
0.5 pts Table of contents is manually created.
pts
1.5 pts
--
Executive Summary - Project status
A concise 1-page letter to your client(s) that summarizes the status of your project (i.e., % planned vs % actual), plans for completion through the end of the project, risk update, explain report components, and likelihood of meeting all project objectives (cc your professor). NOTE: This is not persuasive. Be transparent about good and bad. Include this summary as the body of the email to your client and cc your Professor.
threshold: pts
1.5 pts Clear and concise summary of the status of the project, including % of planned work and actual work
1 pts Clear and concise summary, but missing either % of planned work or % of actual work completed
0.5 pts Vague summary of work completed, unclear what has actually been completed versus what has been planned to be completed
pts
1.5 pts
--
Executive Summary - Plans for completion
threshold: pts
1.5 pts Clear and concise explanation of plans for the completion of the project through the last day of the project
1 pts Clear explanation of plans, but don’t align with other report documents
0.5 pts Vague explanation of plans to complete the project
pts
1.5 pts
--
Executive Summary - Risk update
threshold: pts
1.5 pts Clear and concise update on risks identified in Solution Analysis and effectiveness of reduction plans
1 pts Clear update of risks; reduction plans not specific
0.5 pts Vague recap of risks and/or missing reduction plans
pts
1.5 pts
--
Executive Summary - Project objectives
threshold: pts
1.5 pts Clear explanation of meeting all project objectives identified in Solution Analysis
1 pts Clear explanation but did not address all objectives
0.5 pts Vague description of the likelihood of meeting overall objectives
pts
1.5 pts
--
Executive Summary - Report components
threshold: pts
1.5 pts Clear and concise explanation of report components that is written for the client to understand
1 pts Clear explanation of components that prof understands but client likely doesn’t understand
0.5 pts Vague explanation of report components
pts
1.5 pts
--
Executive Summary - cc'd prof
threshold: pts
1 pts CC’d prof and included link to Interim Status Report.
0.5 pts Cc’d prof but did not include link to Interim Status Report
pts
1 pts
--
Updated Feasibility Matrix - Original matrix
Include a screenshot of the original Feasibility Matrix from when Inception ended. During each retrospective, create a new Feasibility Matrix Mural to reflect completed work, and changes in value and or difficulty. For D2, include a screenshot of your current/updated Feasibility Matrix that captures any changes in the relative value of user stories as well as the relative feasibility of user stories.
Write a short paragraph to describe any changes to relative value and relative feasibility of user stories and why the changes occurred.
threshold: pts
1.5 pts Included screenshot of the original Feasibility Matrix from the end of Inception
0 pts Did not include screenshot of the original Feasibility Matrix from the end of Inception
pts
1.5 pts
--
Updated Feasibility Matrix - Current matrix
threshold: pts
1.5 pts Included a screenshot of current/updated Feasibility Matrix when D2 is submitted and includes changes to the relative value and/or feasibility of each user story as well as completed user stories (e.g. change the color of the sticky note to indicate completion)
1 pts Included a screenshot of current/updated Feasibility Matrix when D2 is submitted and includes changes to the relative value and/or feasibility of each user story as well as completed user stories (e.g. change the color of the sticky note to indicate completion) but team changed US numbers and they don't align with the original US numbers
0.5 pts Included a screenshot of current/updated Feasibility Matrix when D2 is submitted but changes to the relative value and/or feasibility of each user story as well as completed user stories are not clear
pts
1.5 pts
--
Updated Feasibility Matrix - Description of changes
threshold: pts
1.5 pts Clearly and concisely described changes to value/feasibility and why the changes occurred
1 pts Clearly and concisely described changes to value/feasibility but missing why the changes occurred
0.5 pts Vaguely described changes to value/feasibility and why the changes occurred, or are missing an explanation of why the changes occurred
pts
1.5 pts
--
Updated Project Timeline - Original Timeline
Include a screenshot of your original project timeline when Inception ended. During each retrospective, create a new Project Timeline Mural to reflect completed work, and changes to stories planned in current/future sprints based on updates to the Feasibility Matrix. For D2, include a screenshot of your current/updated project timeline to capture project progress. The current timeline should reflect your team’s current status of all sprints, including actual dates of sprint completion and updated planned start/end dates for current/future sprints.
Write a short paragraph to describe the updates that were made to the timeline and reasons for the changes (e.g. new user stories added, user stories cut from scope, updates to expected start and end dates of user stories, changes to order of user stories).
Include a bulleted list to capture the status of each user story (Not Started, In Progress, In Review, Completed). Please use abbreviated user story names (e.g. US1: Add Donor).
For stories marked “In progress” or “In review,” show percent complete.
threshold: pts
1.5 pts Included screenshot of the original Project Timeline from the end of Inception
0 pts Did not include screenshot of the original Project Timeline from the end of Inception
pts
1.5 pts
--
Updated Project Timeline - Current Timeline
threshold: pts
1.5 pts Included a screenshot of current/updated Project Timeline when D2 is submitted and reflects team’s current status of all sprints, including actual dates of sprint completion and updated planned start/end dates for current/future sprints
0.5 pts Included a screenshot of current/updated Project Timeline when D2 is submitted but does not align with status reflected in Trello board
pts
1.5 pts
--
Updated Project Timeline - Described updates
threshold: pts
1.5 pts Clearly and concisely described updates made to the timeline and reasons for the changes
1 pts Clearly and concisely described updates made to the timeline but missing reasons for the changes
0.5 pts Vague description of timeline updates and/or missing reasons for the changes
pts
1.5 pts
--
Updated Project Timeline - Stories and status
threshold: pts
1.5 pts Included bulleted list of all user stories captures status of all stories (Not Started, In Progress, In Review, Completed) and completely aligns with current Project Timeline
1 pts Included bulleted list of all user stories captures status of all stories (Not Started, In Progress, In Review, Completed) but does not align with current Project Timeline
0.5 pts Included bulleted list of some user stories and/or captures status of some stories (Not Started, In Progress, In Review, Completed) and/or does not align with current Project Timeline
pts
1.5 pts
--
Updated Project Timeline - Percentage complete
threshold: pts
1.5 pts For user stories that are “In Progress” or “In Test/Review”, percentage complete provided and completely aligns with current Project Timeline
1 pts For user stories that are “In Progress” or “In Test/Review”, percentage complete is provided but does not align with current Project Timeline
pts
1.5 pts
--
Trello Board - Clear process
Include a link to your User Stories Trello Board. Be sure that Trello is continuously updated to show progress, any potential scope updates, and current status
threshold: pts
1.5 pts Process for how your team uses Trello to track work is clear when viewing board (WBS, marking work complete, internal testing, tracking bugs, client UAC/user story sign off)
1 pts All but one aspect of how your team uses Trello to track work is clear when viewing board (WBS, marking work complete, internal testing, tracking bugs, client UAC/user story sign off)
0.5 pts Only some aspects of how your team uses Trello to track work is clear when viewing board (WBS, marking work complete, internal testing, tracking bugs, client UAC/user story sign xoff)
pts
1.5 pts
--
Trello Board - Clear owners
threshold: pts
1.5 pts Clear owners of all work to be completed since Sprint 1 (all previous and current sprints) and clear distribution of work among all team members
1 pts Clear owners of ¾ or more of work to be completed since Sprint 1 (all previous and current sprints)AND/OR 1-2 members not clearly owning work
0.5 pts Clear owners of less than ¾ of work to be completed since Sprint 1 (all previous and current sprints) AND/OR Only 1-2 people assigned to own work
pts
1.5 pts
--
Trello Board - Team involvement
threshold: pts
1.5 pts Entire team involved in managing work completed in Trello
1 pts 1-2 team members missing in managing work completed in Trello
0.5 pts Only 1-2 team members managing work completed in Trello
pts
1.5 pts
--
Trello Board - Deadlines added
threshold: pts
1.5 pts Deadlines added to every card in past sprints and current sprint
1 pts Deadlines added to ¾ of cards in past sprints and current sprint
0.5 pts Deadlines added to less than ¾ of cards in past sprints and current sprint
pts
1.5 pts
--
Trello Board - Deadline alignment
threshold: pts
1.5 pts All deadlines for cards in current and future sprints align with deadlines in current Project Timeline
1 pts Deadlines for ¾ or more cards in current and future sprints align with deadlines in current Project Timeline
0.5 pts Deadlines for less than ¾ of cards in current and future sprints align with deadlines in current Project Timeline
pts
1.5 pts
--
Trello Board - Completed work
threshold: pts
1.5 pts Indicates that all planned work has been completed by the date when prof grades (or noted in Timeline why it’s delayed)
1 pts Indicates that ¾ or more of planned work has been completed by the date when prof grades (or noted in Timeline why it’s delayed)
0.5 pts Indicates that less than ¾ of planned has been completed by the date when prof grades (or noted in Timeline why it’s delayed)
pts
1.5 pts
--
Trello Board - UAC
threshold: pts
1.5 pts All user story level cards in current and past sprints include clear, easy-to-find user acceptance criteria for client sign-off
1 pts ¾ or more of user story level cards in current and past sprints include clear, easy-to-find user acceptance criteria for client sign-off
0.5 pts Less than ¾ of user story level cards in current and past sprints include clear, easy-to-find user acceptance criteria for client sign-off
pts
1.5 pts
--
Trello Board - Client involvement
threshold: pts
1.5 pts Client actively approving UACs in Trello during each completed sprint (user acceptance testing)
1 pts Client actively approving work just before Interim Status due (primarily during later sprints)
0.5 pts Client approving minimal work in Trello
pts
1.5 pts
--
Trello Board - Explanation for late work
threshold: pts
1.5 pts Team provided explanation in status and/or Project Timeline for all user stories/tasks that have exceeded their original deadlines (i.e. that are late)
1 pts Team provided explanation in status and/or Project Timeline for ¾ or more user stories/tasks that have exceeded their original deadlines (i.e. that are late)
0.5 pts Team provided explanation in status and/or Project Timeline for less than ¾ of user stories/tasks that have exceeded their original deadlines (i.e. that are late)
pts
1.5 pts
--
Trello Board - Tasks updated regularly
threshold: pts
1.5 pts Tasks updated regularly (as they are completed) throughout sprints
1 pts Tasks updated just before meetings
0.5 pts Tasks updated in only at end of sprint/start of new sprint (or less frequently)
pts
1.5 pts
--
Weekly Rituals - Agendas
threshold: pts
1.5 pts Client Meeting Agendas – each agenda includes Trello screenshot; all agendas stored on Box throughout Sprints
1 pts Agendas include Trello screenshots; agendas mostly uploaded to Box just before Interim Status deadline
0.5 pts Agendas missing Trello screenshots and relevant meeting details; mostly uploaded to Box just before Interim Status deadline
pts
1.5 pts
--
Weekly Rituals - Retrospectives
threshold: pts
2 pts Completed at least 2 out of 3 weekly retrospectives in Mural Weekly Retrospectives
1 pts Completed 1 out of 3 weekly retrospectives in Mural Weekly Retrospectives
pts
2 pts
--
Weekly Rituals - Status calculations
threshold: pts
2 pts Completed all 3 % Actual vs. % Planned calculations correctly, provided thoughtful comments and stored in Mural
1 pts Completed all 3 % Actual vs. % Planned calculations but misused the template (e.g. bad calculations, didn’t provide comments)
0.5 pts Completed 1 to 2 % Actual vs. % Planned calculations correctly with comments AND/OR misused the template (e.g. bad calculations, didn’t provide comments)
pts
2 pts
--
Weekly Rituals - Trello screenshots
threshold: pts
2 pts Added all 3 Weekly Trello screenshots to Mural at the end of each sprint
1 pts Added 2 Weekly Trello screenshots to Mural at the end of 2 sprints
0.5 pts Added 1 Weekly Trello screenshots to Mural at the end of 1 sprint
pts
2 pts
--
Weekly Rituals - Feasibility Matrix
threshold: pts
1.5 pts Clearly revisited Feasibility matrix at the end of each sprint and made updates to value and feasibility of remaining user stories when relevant (notes provided in Timeline or Weekly Retrospective)
0.5 pts Revisited Feasibility matrix just before the Interim status to update value and feasibility of remaining user stories when relevant (notes provided in Timeline or Weekly Retrospective)
pts
1.5 pts
--
Weekly Rituals - Project Timeline
threshold: pts
1.5 pts Clearly revisited Project Timeline at the end of each sprint (during retrospective) to reflect completed work, and changes to stories planned in current/future sprints based on updates to the Feasibility Matrix were included when relevant (notes provided in Timeline or Weekly Retrospective)
0.5 pts Revisited Project Timeline just before Interim status to reflect completed work, and changes to stories planned in current/future sprints based on updates to the Feasibility Matrix were included when relevant (notes provided in Timeline or Weekly Retrospective)
pts
1.5 pts
--
Test Plan/Update - How testing happens
Write a summary of your approach to how your team tests the system internally. For completed sprints and the current sprint, include a summary of the components tested and those still to be tested. Include statistics and details on testing progress up to this point, such as percentages and specifics on issues found and resolutions. Write about % of testing complete and incomplete as well as bugs found. Facts and transparency!
threshold: pts
1.5 pts Clear and concise summary describing how your team tests the system internally (includes who, when, and how)
1 pts Clear and concise summary describing how your team tests the system internally but missing one of the following: who, when, and how
0.5 pts Vague summary describing how your team tests the system internally and missing several details (e.g. who, when, how)
pts
1.5 pts
--
Test Plan/Update - What's been tested
threshold: pts
1.5 pts Clear and meaningful summary of components tested and those still to be tested for completed sprints and the current sprint
1 pts Only included a clear and meaningful summary of one of the following: components tested OR those still to be tested for completed sprints and the current sprint
0.5 pts Vague summary of components tested and those still to be tested for completed sprints and the current sprint
pts
1.5 pts
--
Test Plan/Update - Testing details
threshold: pts
1.5 pts Included relevant statistics and details on testing progress up to this point, such as percentage of testing complete and incomplete
1 pts Included relevant statistics and details on testing progress up to this point for either percentage of testing complete OR percentage of testing incomplete
0.5 pts Statistics and details on testing progress up to this point provided are not relevant, are confusing, or are unclear
pts
1.5 pts
--
Test Plan/Update - Bugs
threshold: pts
1.5 pts Clearly included the percentage of bugs found and provided details for issues found and their resolutions
1 pts Clearly included percentage of bugs found and provided details for issues found but missing how they were resolved
0.5 pts Included only one of the following: percentage of bugs found OR provided details for issues found
pts
1.5 pts
--
Test Specifications - Features have cases
Include a link to the Excel Test Tracker stored in UT Box as well as a link to the folder that includes the documentation regarding test execution.
threshold: pts
1.5 pts All features of all current and past user stories have test cases
1 pts ¾ or more of the features of all current and past user stories have test cases
0.5 pts Less than ¾ of the features of all current and past user stories have test cases
pts
1.5 pts
--
Test Specifications - Positive cases
threshold: pts
1.5 pts All features have necessary positive test cases
1 pts ¾ or more of the features have necessary positive test cases
0.5 pts Less than ¾ of the features have necessary positive test cases
pts
1.5 pts
--
Test Specifications - Negative cases
threshold: pts
1.5 pts When applicable, all features have necessary negative test cases
1 pts When applicable, ¾ or more of the features have necessary negative test cases
0.5 pts When applicable, less than ¾ of the features have necessary negative test cases
pts
1.5 pts
--
Test Specifications - Test steps
threshold: pts
1.5 pts All test cases have test steps
1 pts ¾ or more of test cases have test steps
0.5 pts Less than ¾ of test cases have test steps
pts
1.5 pts
--
Test Specifications - Clearly written steps
threshold: pts
1.5 pts All test steps are clearly written such that anyone not involved in the project could execute them
1 pts ¾ or more of test cases are clearly written such that anyone not involved in the project could execute them
0.5 pts Less than ¾ of test cases have test steps that need more detail for a non-project member to execute them (e.g. missing URLs; missing login information)
pts
1.5 pts
--
Test Specifications - Test data
threshold: pts
1.5 pts Test data clearly provided for each test step where applicable
1 pts Test data clearly provided for ¾ or more of test steps where applicable
0.5 pts Test data clearly provided for less than ¾ or more of test steps where applicable
pts
1.5 pts
--
Test Specifications - Author/Executor
threshold: pts
1.5 pts Author (all) and executor (executed tests only) listed for all test cases
1 pts Author (all) and executor (executed tests only) listed for ¾ or more of test cases
0.5 pts Author (all) and executor (executed tests only) listed for less than ¾ of test cases
pts
1.5 pts
--
Test Specifications - Planned date
threshold: pts
1.5 pts Planned test date included for all test cases
1 pts Planned test date included for ¾ or more of test cases
0.5 pts Planned test date included for less than ¾ of test cases
pts
1.5 pts
--
Test Specifications - Actual notes
threshold: pts
1.5 pts (executed tests only) Actual notes recorded for all failed test steps
1 pts (executed tests only) Actual notes recorded for ¾ or more of failed test steps
0.5 pts (executed tests only) Actual notes recorded for less than ¾ of failed test steps
pts
1.5 pts
--
Test Specifications - Actual date
threshold: pts
1.5 pts (executed tests only) Actual test date included for all test cases
1 pts (executed tests only) Actual test date included for ¾ or more of test cases
0.5 pts (executed tests only) Actual test date included for less than ¾ of test cases
pts
1.5 pts
--
Test Specifications - Execution proof
threshold: pts
1.5 pts (executed tests only) Test execution proof uploaded to Box for all test steps
1 pts (executed tests only) Test execution proof uploaded to Box for ¾ or more of test steps
0.5 pts (executed tests only) Test execution proof uploaded to Box for less than ¾ of test steps
pts
1.5 pts
--
Test Specifications - Updated tracker on Box
threshold: pts
1.5 pts Test tracker is updated on Box
1 pts Test tracker is updated on Box but team changed the file name
pts
1.5 pts
--
Test Specifications - Updated regularly
threshold: pts
1.5 pts Test tracker updated during testing in each sprint
1 pts Test tracker updated just before D2 deadline
pts
1.5 pts
--
Test Specifications - Tracker aligns with Trello
threshold: pts
1.5 pts Test tracker completely aligns with Trello status
1 pts Test tracker partially aligns with Trello status
0.5 pts Test tracker does not align with Trello status (e.g. stories marked as completed/tested, UAC signed off, but tests not executed or documented in Tracker)
pts
1.5 pts
--
Test Specifications - Link to tracker provided
threshold: pts
1.5 pts Included a link to Excel Test Tracker and Test Documentation folders on UT Box
1 pts Only included a link to one of these: Excel Test Tracker or Test Documentation folders on UT Box
pts
1.5 pts
--
User Acceptance Testing - Progress
Summarize your approach and progress for UAT. Summarize feedback received from your client after each sprint and changes your team made based on their feedback.
UAT will be on-going at this point. For your completed sprints, provide all details around UAT and the results. Include any instructions or sample data/materials provided to the users for testing of overall user stories and integrated functionality. Provide information around which user will perform the task, what they need to do (e.g. add a recurring donation), when they need to execute the test, and how they should provide feedback to your team.
Clearly indicate which user acceptance tests resulted in functionality accepted by your client and notes around areas that were not and how that was addressed.
threshold: pts
1.5 pts Clearly summarized your team’s progress for UAT
0.5 pts Vaguely summarized your team’s progress to UAT
pts
1.5 pts
--
User Acceptance Testing - Stories covered
threshold: pts
1.5 pts User acceptance tests are included for all completed user stories
1 pts User acceptance tests are included for ¾ or more of completed user stories
0.5 pts User acceptance tests are included for less than ¾ of completed user stories
pts
1.5 pts
--
User Acceptance Testing - Breadth of UAT
threshold: pts
1.5 pts All aspects of user stories are tested from the client perspective
1 pts Most aspects of user stories are tested from the client perspective
0.5 pts Some aspects of user stories are tested from the client perspective
pts
1.5 pts
--
User Acceptance Testing - How to perform UAT
threshold: pts
1.5 pts For completed user stories, provide information that user needs to perform the task (what they need to do, when they need to execute it, and how they should provide feedback)
1 pts For completed user stories, missing one of the following: what they need to do, when they need to execute it, and how they should provide feedback
0.5 pts For completed user stories, did not provide sufficient detail about information that user needs to perform the task
pts
1.5 pts
--
User Acceptance Testing - Instructions and sample data
threshold: pts
1.5 pts For completed user stories, include instructions or sample data/materials provided to the users for testing of overall user stories and functionality
1 pts For ¾ or more of the completed user stories, include instructions or sample data/materials provided to the users for testing
0.5 pts For less than ¾ of the completed user stories, include instructions or sample data/materials provided to the users for testing
pts
1.5 pts
--
User Acceptance Testing - UAT acceptance
threshold: pts
1.5 pts For completed user stories, clearly indicated which user acceptance tests resulted in functionality accepted by your client
1 pts For ¾ or more of the completed user stories, clearly indicated which user acceptance tests resulted in functionality accepted by your client
0.5 pts For less than ¾ of the completed user stories, clearly indicated which user acceptance tests resulted in functionality accepted by your client
pts
1.5 pts
--
User Acceptance Testing - UAT not accepted
threshold: pts
1.5 pts For completed user stories, clearly indicated which UATs were not accepted by the client and how that was addressed
1 pts For ¾ or more of the completed user stories, clearly indicated which UATs were not accepted by the client and how that was addressed
0.5 pts For less than ¾ of the completed user stories, clearly indicated which UATs were not accepted by the client and how that was addressed
pts
1.5 pts
--
User Acceptance Testing - Client feedback
threshold: pts
1.5 pts For completed user stories, included feedback received from client after they performed UAT and how the feedback was incorporated into the system
1 pts For completed user stories, included feedback received from client after they performed UAT but did not include how the feedback was incorporated into the system
0.5 pts For completed user stories, only included feedback for some sprints and did not include how the feedback was incorporated into the system
pts
1.5 pts
--
User Acceptance Testing - Client users
threshold: pts
1.5 pts All appropriate client users are involved in UAT by role
1 pts Most appropriate client users are involved in UAT by role
0.5 pts UAT only completed by main client contact when multiple client users of different roles should have been involved
pts
1.5 pts
--
Working (well-tested) Software - Functionality
threshold: pts
3 pts All “completed” user stories have fully functioning system features with no issues/bugs found by professor.
2 pts All “completed” user stories have fully functioning system features with 1-2 issues/bugs found by professor
1 pts Some “completed” user stories have fully functioning system features with no issues/bugs found by professor OR all “completed” user stories have fully functioning system features with more than 2 issues/bugs found by professor
pts
3 pts
--
Working (well-tested) Software - Testing accurate
threshold: pts
1.5 pts All unit test cases and steps indicated as passed can be replicated by the professor
1 pts ¾ or more of unit test cases and steps indicated as passed can be replicated by the professor
0.5 pts Less than ¾ of unit test cases and steps indicated as passed can be replicated by the professor
pts
1.5 pts
--