🧪 Manual Testing

Checklist

When manually testing the app, If it's for a ticket or just regression there are a few points to remember.

If you are testing a ticket which has AC's make sure to do those first so that any bugs relating to the ticket can be logged

When it comes to doing regression manual testing on the app the points are:

• Run through the visual aspects of the app making sure the new changes have not changed anything they were not supposed to
• Run through the application using screen readers to make sure that the correct information is read out
• Using keyboard navigation through the pages
• Reset the application and make sure that levels can still be passed with the correct information being sent within the email
• In the sandbox, Run through the defence config toggles and check that the correct pop up appears within the chat window
• Activate defence configs and send a message that would trigger that configuration and check that the response the bot gives to this trigger is expected of the activated configuration
• Modals should be appearing when they are supposed to
• Dialogs are appearing on correct button presses

Test Cases

For each test case the pre-requisite steps are that the app is running and the frontend is open

Description	Steps
Keyboard Navigation	Run through the application only using keyboard navigation. Check that navigation cycles through all readable or selectable objects.
Handbook locked out	Reset levels Select handbook and check that all information is correctly locked until associated level is completed for all pages Manually set the levels completed so that all levels are now unlocked Select handbook and check all information that was locked out before is now unlocked for all pages
Header and Footer	Check that the header and footer are present Ensure details in the header and footer are correct Ensure that header and footer are fully visible and functional without overflowing at 200% zoom on laptop screen
Modal Dialogs	Click on any of the following buttons: Reset Progress, Getting Started, Mission Info and Reset Level Ensure details on the modal are correct Ensure any navigation on the modal works as expected Ensure the modal closes Repeat for remaining buttons
Screen Readers	Open screen reader of choice (NVDA or Narrator) Navigate over elements with mouse control Correct info is read out Repeat with keyboard navigation
Level win conditions happy path	If not a new user then reset progress Play Levels and ensure the correct information for each level is required and that the win condition is met
Level win conditions unhappy path	If not a new user then reset progress Play level 1 and ensure that incorrect information is not accepted and that the level does not complete Win the level to move to the next Repeat for levels 2 and 3
Sandbox config	In the sandbox ensure all the defence configuration options are present Run through the defence configs and check that each can be opened Turn on each defence config and ensure that correct pop up appears in chat Send message to bot that would trigger the turn on configuration and make sure that the bot reacts appropriately to the configuration
Level 3 config	If level 3 is not available manual set variables so that it is On Level 3 make sure there is a limited amount of defence configurations available Run through these configurations and make sure pop up appears in chat Send bot message that would trigger defence config and ensure response is appropriate for the configuration set
Email placement	If not a new user then reset progress Play levels and ensure that emails are in the right side column when they are sent by the bot
Reset Level	Complete level of choosing Click reset level and confirm Ensure chat and emails are cleared, and reset message appears in chat window
Server off/down	Start up app locally Open frontend Turn off server in backend Refresh frontend page in browser Check that error message appears in chat that the server is not running
Reset Progress	When Reset Progress is clicked and confirmed Ensure user is sent back to level 1 only if they were on level 2 or 3 If user is already on Level 1 or Sandbox Ensure the Welcome dialog opens