Smoke test

Revision as of 02:00, 22 February 2009 by Mchua (talk | contribs)

Introduction

Smoke testing is the first quick round of simple tests run on a new software build to verify that it starts and does not catastrophically crash. It is a preliminary to further testing, and is also a fast way to verify the basic integrity of a new development environment, as well as a good tour of basic functionality. The instructions below are for smoke-testing core Sugar using Activities included in Glucose (though it does not test the Activities themselves). To learn how to create smoke tests for other software (such as Activities), see creating a smoke test.

How to smoke test

  • Install Sugar. All smoke test cases assume you begin with a clean install of Sugar in Home view with no Activities running.
  • Execute the smoke test cases below. Test cases are listed in priority order, so if you have limited time, go through them sequentially.
  • If a smoke test fails, file a bug in Trac noting the failure with as much detail and reproduction steps as possible.
  • (Needed: a way to report smoke test results for builds.)

Test cases

Reflecting and exploring with Activities

  1. Begin in Home view with no Activities running.
  2. Verify: Home view appears. (Tests: #Home view appears)
  3. From Home view, start the Chat Activity.
  4. Verify: Activity icon pulses while Chat is starting, followed by the Chat interface. (Tests: #Activities start)
  5. Switch to Neighborhood view.
  6. Verify: Neighborhood view appears. (Tests: #Neighborhood view appears)
  7. Verify: Neighborhood view does not display any shared Chat sessions with your colors. (Tests: #Neighborhood view only displays shared sessions)
  8. Switch to Friends view.
  9. Verify: Friends view appears. (Tests: #Friends view appears)
  10. Switch to the Chat Activity.
  11. Share Chat session with Neighborhood.
  12. Switch to Neighborhood view.
  13. Verify: Neighborhood view now displays a shared Chat sessions with your colors. (Tests: #Neighborhood view only displays shared sessions)
  14. Switch to Home view.
  15. From Home view, start the Write Activity.
  16. Once the Write Activity has started, type something into the main text input area of the Write Activity.
  17. Rename the Write Activity session to something that is not "Write Activity."
  18. Verify: You are able to rename the Activity session. (Tests: #Activity sessions can be renamed)
  19. Display the Frame.
  20. Verify: The Frame displays. Battery and volume indicators are visible in the Frame. Neighborhood, Friends, Home, and Activity view icons are visible in the Frame. The Journal icon is visible in the Frame. Both Chat and Write are displayed as active in the Frame. (Tests: #Frame appears/disappears)
  21. Switch to Journal view from the Frame.
  22. Verify: The Journal starts and contains an entry for your current Write session at the top with the correct name, as well as an entry for your current Chat session below it. (Tests: #Frame can launch items, #Journal records Activity sessions, #Activity sessions can be renamed)
  23. Switch to the Chat Activity.
  24. Verify: You are able to access the currently running session of Chat. (Tests: #Multiple Activities can run simultaneously)
  25. Close the Chat Activity.
  26. Verify: The Chat Activity closes. (Tests: #Activities stop
  27. Hide the Frame.
  28. Verify: The Frame hides. (Tests: #Frame appears/disappears)
  29. Switch to the Write Activity.
  30. Close the Write Activity.
  31. Verify: The Write Activity closes. (Tests: #Activities stop
  32. Switch to Journal view.
  33. Resume the Write session you just closed.
  34. Verify: The Write session resumes, and the text you typed in earlier is still present. (Tests: #Journal records Activity sessions, #Activity sessions can be resumed)
  35. Close the Write Activity.

Servers and collaboration

This test case is not complete.

This test will require 2 instances of Sugar, likely on 2 computers/virtual machines, with the ability to connect with each other via an AP, XS, or Jabber server.

This test will verify:

  • registering with a XS / connecting to an AP / connecting to a Jabber server
  • making and removing friends
  • seeing other Sugar users in Neighborhood view
  • seeing shared Activity sessions in Neighborhood view
  • sharing an Activity session
  • inviting another Sugar user to a private Activity session
  • accepting invitations to an Activity session

Installing, modifying, and uninstalling Activities

  • This test case is not complete.

This test will require internet connectivity.

This test will verify:

  • selecting a means of connectivity
  • installing a new Activity
  • upgrading an existing Activity
  • uninstalling an existing Activity
  • editing an existing Activity

Features tested

This list is not complete.

Activities start

Activities stop

Home view appears

Neighborhood view appears

Friends view appears

Frame appears/disappears

Frame can launch items

Neighborhood view only displays shared sessions

Journal records Activity sessions

Activity sessions can be renamed

Multiple Activities can run simultaneously

Activity sessions can be resumed