Difference between revisions of "0.88/Testing"

From Sugar Labs
Jump to navigation Jump to search
m
 
(31 intermediate revisions by 6 users not shown)
Line 1: Line 1:
{{TOCright}}
+
<noinclude>[[Category:Testing]]
 +
</noinclude>
  
=Meetings=
+
==Install testing environment==
  
== Testing Day February the 16th ==
+
===SoaS===
This will be an asynchronous effort, hence "Testing day" :). However we will do two kickstart meetings. One at 14:00 UTC and one at 19:00 UTC. In these meetings we will give a short introduction to what to test and answer questions about how to get the image on a usb-key and of course how to gather the results.
+
 
 +
See [[Sugar on a Stick/Beta]].
 +
 
 +
Also see: [[Sugar on a Stick/Installation/Variations]]
 +
 
 +
===Fedora 13===
 +
 
 +
See [[Fedora]].
 +
 
 +
===Ubuntu 9.10 (Karmic)===
 +
 
 +
Follow [[Ubuntu#Sugar-0.88_on_Ubuntu_9.10_.28karmic.29|instruction]] to install latest sugar packages and keep them up-to-date.
 +
 
 +
==Testing plans==
 +
===0.88 Features===
 +
For instructions how to test the Features listed below please have a look at the section "How to test" of each Feature page. Please add yourself with your test result to the table of each Feature.
  
=== When ===
 
* Kickoff-Meeting 1: 14:00 UTC
 
* Kickoff-Meeting 2: 19:00 UTC
 
  
===Where===
+
* '''Enhanced Gettext'''
This meeting will be an online meeting using IRC, [http://en.wikipedia.org/wiki/IRC Internet Relay Chat]. You can read here more how to use [http://wiki.sugarlabs.org/go/Sugar_Labs/Contacts#IRC.2C_Internet_Relay_Chat IRC] to join the meeting. The meeting will be taking place on the channel #sugar on the irc.freenode.net server.
+
[http://wiki.sugarlabs.org/go/Features/Enhanced_Gettext#How_To_Test Enhanced Gettext Testing plan] - Enhanced Gettext adds an extra search path for translation files for Sugar activities. This allows deployments to add and update activity translations independently of the release process.
* IRC Channel: #sugar Server: irc.freenode.net
 
  
=== Attendees ===
+
{| border=1 cellpadding=3 style="border: 1px solid white; border-collapse: collapse; background: #e3e4e5;"
 +
|-style="background:#787878; color: white;"
 +
! Name !! Works !! Comment
 +
|-
 +
| ''Juan Pérez''
 +
| ''no'' || ''None''
 +
|-
 +
|}
  
Are you planning to attend?  Add your name and your expertise below!
 
  
 +
* '''Allow the Sugar user to connect to 3G networks'''
 +
[http://wiki.sugarlabs.org/go/Features/3G_Support#How_To_Test 3G Support Testing plan] - This Feature allows the Sugar user to connect to 3G networks using a device in the frame.
  
 
{| border=1 cellpadding=3 style="border: 1px solid white; border-collapse: collapse; background: #e3e4e5;"
 
{| border=1 cellpadding=3 style="border: 1px solid white; border-collapse: collapse; background: #e3e4e5;"
 
  |-style="background:#787878; color: white;"
 
  |-style="background:#787878; color: white;"
! Name !! Tester !! Feature owner !! Coordinator !! Special skills
+
! Name !! Works !! Comment
 
|-
 
|-
! [[User:Erikos | Simon Schampijer]]
+
| ''Jane Doe''
| yes || yes || yes
+
| ''yes'' || ''None''
 
|-
 
|-
! [[User:Sdz | Sebastian Dziallas]]
+
|}
| yes || no || [[Sugar_on_a_Stick|soas]]
+
 
 +
 
 +
* '''Font configuration'''
 +
[http://wiki.sugarlabs.org/go/Features/Font_configuration#How_To_Test Font configuration] - Distributors/deployers can use a GConf preference to customize the Sugar font size.
 +
 
 +
{| border=1 cellpadding=3 style="border: 1px solid white; border-collapse: collapse; background: #e3e4e5;"
 +
|-style="background:#787878; color: white;"
 +
! Name !! Works !! Comment
 
|-
 
|-
! [[User:Rkabir | Ryan Kabir]]
+
| ''Marko Marković''
| yes || no || no
+
| ''yes/no'' || ''None''
 
|-
 
|-
! [[User:Mchua|Mel chua]]
 
| yes || no || [http://blog.melchua.com/category/soas/ soas pilot] || community QA, SMW-based test case systems
 
 
|}
 
|}
  
===Testing image===
 
[http://shell.sugarlabs.org/~erikos/soas-testing-day-13-02-10.iso Soas Testing day build]
 
  
(This is the [http://alt.fedoraproject.org/pub/alt/nightly-composes/soas/ latest soas nightly build]. At the moment starting activities is broken in that build. As this is a daily snapshot it will not be fixed in time for the meeting, hence use the build from the link above.)
+
===Language Tests===
 +
* Test your own native language (can be set using the Control Panel).  
 +
** is the 3G Feature listed in the section above fully translated?
 +
 
 +
{| border=1 cellpadding=3 style="border: 1px solid white; border-collapse: collapse; background: #e3e4e5;"
 +
|-style="background:#787878; color: white;"
 +
! Name !! Language !! Works !! Comment
 +
|-
 +
| ''Max Mustermann''
 +
| ''German'' || ''yes/no'' || ''None''
 +
|-
 +
|}
  
=Testing plans=
 
==0.88 Features==
 
We use the section "How to test" of the Feature page.
 
  
* [http://wiki.sugarlabs.org/go/Features/Enhanced_Gettext#How_To_Test Enhanced Gettext Testing plan] - Enhanced Gettext adds an extra search path for translation files for Sugar activities. This would allow deployments to add and update activity translations independently of the release process.
+
===Backwards compatibility tests===
 +
* '''Migrate the Journal'''
 +
Please verify that the Journal is migrated fine after an update. For example from 0.82 to 0.88.
  
* [http://wiki.sugarlabs.org/go/Features/3G_Support#How_To_Test 3G Support Testing plan] - Allow the Sugar user to connect to 3G networks.
+
{| border=1 cellpadding=3 style="border: 1px solid white; border-collapse: collapse; background: #e3e4e5;"
 +
|-style="background:#787878; color: white;"
 +
! Name !! Versions !! Works !! Comment
 +
|-
 +
| ''Pierre-Paul-Jacques''
 +
| ''0.82-0.88'' || ''yes/no'' || ''None''
 +
|-
 +
|}
  
* [http://wiki.sugarlabs.org/go/Features/Font_configuration#How_To_Test Font configuration] - Distributors/deployers need a way to be able to customize the Sugar font size.
 
  
==Language Tests==
+
===Connectivity: Different internet connections===
* There was an issue with unpackaged languages.
+
You should test here if you can connect with a WEP and WPA/WPA2 network, if a wired connection is possible and the 3G connection test can be logged here, too.
** [1] Danish (da): Control Panel, about me section: (msgid "You must enter a name." msgstr "Du skal skrive et navn.")
 
** [1] Malagasy (mg): Control Panel, about me section: (msgid "You must enter a name." msgstr "Tsy maintsy mampiditra anarana ianao")
 
** Albania (sq): Control Panel, about me section: (msgid "You must enter a name." msgstr "Vetem emri duhet shkruar")
 
** Swedish (sv): Control Panel, about me section: (msgid "You must enter a name." msgstr "Du måste ange ett namn.")
 
** Swahili (sw): Control Panel, about me section: (msgid "You must enter a name." msgstr "Lazima uingize jina lako")
 
** Tamil (ta): Control Panel, about me section: (msgid "You must enter a name." msgstr "நீங்கள் பெயரை பதிவு செய்யுங்கள்.")
 
* Test your own native language (can be set using the Control Panel)
 
  
==Bug Fix testing==
+
{| border=1 cellpadding=3 style="border: 1px solid white; border-collapse: collapse; background: #e3e4e5;"
* [-1, -1] Synchronize changes made to a Journal entry {{Bug|1358}}
+
|-style="background:#787878; color: white;"
** Start a new Activity from the home fav view (e.g Browse)
+
! Name !! Connectivity Type !! Works !! Comment
** Switch to Journal
+
|-
** Favourite star it, edit the title, in detail view add description and/or tags
+
| ''Pierre-Paul-Jacques''
** Switch back to Journal list view (i.e don't leave in Journal details view)
+
| ''WEP'' || ''yes/no'' || ''None''
** Switch to Activity instance
+
|-
** Switch back to Journal view
+
|}
** All Journal metadata details should be still there
 
* [0] Several Access Points with the same essid {{Bug|330}}
 
* [1] Name input screen should be deactivable {{Bug|1497}}
 
* [0] Create temporary files for DS in ~/.sugar {{Bug|1452}}
 
* [0] can't connect to WEP shared key networks {{Bug|1602}}
 
* [0] intro screen doesn't unfreeze dcon {{Bug|1601}}
 
* [0] copy-to-journal dbus error {{Bug|573}}
 
* [0] file descriptor leak in filestore.retrieve() {{Bug|1550}}
 
* [0] range queries use lexical comparison, not numerical {{Bug|1342}}
 
* [0] add and use type information for Xapian value-stored properties {{Bug|1437}}
 
  
Legend: 0 means untested, 1 means does work, -1 does not work for me (there can be several 1 and -1)
 
  
=Instructions to flash Soas=
+
===Bug Fix testing===
You can use the [http://wiki.sugarlabs.org/go/Sugar_on_a_Stick/Blueberry Blueberry instructions] to flash Sugar on a Stick on your usb device.
+
For particular bugs you can indicate your test results in this section. This can be done by more than one person, just separate name and result by a column.
  
livecd-iso-to-disk_to_write_live_USB  possibly '''unsupported''' [http://wiki.sugarlabs.org/go/Category:Liveusb#livecd-iso-to-disk_to_write_live_USB] if using Fedora
+
{| border=1 cellpadding=3 style="border: 1px solid white; border-collapse: collapse; background: #e3e4e5;"
 +
|-style="background:#787878; color: white;"
 +
! Bug !! Description !! Works? !! Tester !! Comment
 +
|-
 +
| {{Bug|1}} || ''Example'' || ''yes, no, yes'' || ''Walter Bender, Tomeu Vizoso, Gary C. Martin'' || ''None''
 +
|-
 +
| {{Bug|1358}} || Synchronize changes made to a Journal entry || ''yes/no'' || ''Name'' || ''None''
 +
|-
 +
| {{Bug|330}} || Several Access Points with the same essid || ''yes/no'' || ''Name'' || ''None''
 +
|-
 +
| {{Bug|1497}} || Name input screen is deactivable || ''yes/no'' || ''Name'' || ''None''
 +
|-
 +
| {{Bug|1602}} || Can't connect to WEP shared key networks || ''yes/no'' || ''Name'' || ''None''
 +
|-
 +
| {{Bug|1601}} || Intro screen doesn't unfreeze dcon || ''yes/no'' || ''Name'' || ''None''
 +
|-
 +
|}
  
=How to write a good bug report=
+
==How to write a good bug report==
 
You should note the following in the bug report:
 
You should note the following in the bug report:
 
* the version you are using
 
* the version you are using
Line 93: Line 130:
  
 
In most cases it is of interest to the developers to look at the Sugar logs. Instructions how to get the logs can be seen [http://wiki.sugarlabs.org/go/BugSquad/Get_Logs here].
 
In most cases it is of interest to the developers to look at the Sugar logs. Instructions how to get the logs can be seen [http://wiki.sugarlabs.org/go/BugSquad/Get_Logs here].
 +
 +
==Meetings==
 +
====Where====
 +
Meetings are held online using IRC, [http://en.wikipedia.org/wiki/IRC Internet Relay Chat]. You can read here more how to use [[Sugar_Labs/Communication channels#IRC.2C_Internet_Relay_Chat | IRC]] to join the meeting. The meeting will be taking place on the channel #sugar on the irc.freenode.net server, irc://irc.freenode.net#sugar, or [http://webchat.freenode.net/?randomnick=1&channels=sugar&prompt=1 webchat client].
 +
=== 01 March 2010 ===
 +
'''When:''' 14:00 UTC (9 EST)
 +
=== Testing Day February the 16th ===
 +
This will be an asynchronous effort, hence "Testing day" :). However we will do two kickstart meetings. One at 14:00 UTC and one at 19:00 UTC. In these meetings we will give a short introduction to what to test and answer questions about how to get the image on a usb-key and of course how to gather the results.
 +
==== When ====
 +
* Kickoff-Meeting 1: 14:00 UTC
 +
* Kickoff-Meeting 2: 19:00 UTC
 +
==== Attendees ====
 +
Are you planning to attend?  Add your name and your expertise below!
 +
{| border=1 cellpadding=3 style="border: 1px solid white; border-collapse: collapse; background: #e3e4e5;"
 +
|-style="background:#787878; color: white;"
 +
! Name !! Tester !! Feature owner !! Coordinator !! Special skills
 +
|-
 +
! [[User:Erikos | Simon Schampijer]]
 +
| yes || yes || yes
 +
|-
 +
! [[User:Sdz | Sebastian Dziallas]]
 +
| yes || no || [[Sugar_on_a_Stick|soas]]
 +
|-
 +
! [[User:Rkabir | Ryan Kabir]]
 +
| yes || no || no
 +
|-
 +
! [[User:Mchua|Mel chua]]
 +
| yes || no || [http://blog.melchua.com/category/soas/ soas pilot] || community QA, SMW-based test case systems
 +
|-
 +
|[[User:Satyag|Satyaakam Goswami]] || yes ||no ||[http://translate.sugarlabs.org/hi/  Hindi Translation]  || testing
 +
|-
 +
! [[User:garycmartin|Gary Martin]]
 +
| yes || no || no
 +
|}
 +
 +
====Testing image====
 +
[http://shell.sugarlabs.org/~erikos/soas-testing-day-13-02-10.iso Soas Testing day build]
 +
 +
(This is the [http://alt.fedoraproject.org/pub/alt/nightly-composes/soas/ latest soas nightly build]. At the moment starting activities is broken in that build. As this is a daily snapshot it will not be fixed in time for the meeting, hence use the build from the link above.)

Latest revision as of 13:33, 3 July 2012


Install testing environment

SoaS

See Sugar on a Stick/Beta.

Also see: Sugar on a Stick/Installation/Variations

Fedora 13

See Fedora.

Ubuntu 9.10 (Karmic)

Follow instruction to install latest sugar packages and keep them up-to-date.

Testing plans

0.88 Features

For instructions how to test the Features listed below please have a look at the section "How to test" of each Feature page. Please add yourself with your test result to the table of each Feature.


  • Enhanced Gettext

Enhanced Gettext Testing plan - Enhanced Gettext adds an extra search path for translation files for Sugar activities. This allows deployments to add and update activity translations independently of the release process.

Name Works Comment
Juan Pérez no None


  • Allow the Sugar user to connect to 3G networks

3G Support Testing plan - This Feature allows the Sugar user to connect to 3G networks using a device in the frame.

Name Works Comment
Jane Doe yes None


  • Font configuration

Font configuration - Distributors/deployers can use a GConf preference to customize the Sugar font size.

Name Works Comment
Marko Marković yes/no None


Language Tests

  • Test your own native language (can be set using the Control Panel).
    • is the 3G Feature listed in the section above fully translated?
Name Language Works Comment
Max Mustermann German yes/no None


Backwards compatibility tests

  • Migrate the Journal

Please verify that the Journal is migrated fine after an update. For example from 0.82 to 0.88.

Name Versions Works Comment
Pierre-Paul-Jacques 0.82-0.88 yes/no None


Connectivity: Different internet connections

You should test here if you can connect with a WEP and WPA/WPA2 network, if a wired connection is possible and the 3G connection test can be logged here, too.

Name Connectivity Type Works Comment
Pierre-Paul-Jacques WEP yes/no None


Bug Fix testing

For particular bugs you can indicate your test results in this section. This can be done by more than one person, just separate name and result by a column.

Bug Description Works? Tester Comment
#1 Example yes, no, yes Walter Bender, Tomeu Vizoso, Gary C. Martin None
#1358 Synchronize changes made to a Journal entry yes/no Name None
#330 Several Access Points with the same essid yes/no Name None
#1497 Name input screen is deactivable yes/no Name None
#1602 Can't connect to WEP shared key networks yes/no Name None
#1601 Intro screen doesn't unfreeze dcon yes/no Name None

How to write a good bug report

You should note the following in the bug report:

  • the version you are using
  • steps to reproduce

In most cases it is of interest to the developers to look at the Sugar logs. Instructions how to get the logs can be seen here.

Meetings

Where

Meetings are held online using IRC, Internet Relay Chat. You can read here more how to use IRC to join the meeting. The meeting will be taking place on the channel #sugar on the irc.freenode.net server, irc://irc.freenode.net#sugar, or webchat client.

01 March 2010

When: 14:00 UTC (9 EST)

Testing Day February the 16th

This will be an asynchronous effort, hence "Testing day" :). However we will do two kickstart meetings. One at 14:00 UTC and one at 19:00 UTC. In these meetings we will give a short introduction to what to test and answer questions about how to get the image on a usb-key and of course how to gather the results.

When

  • Kickoff-Meeting 1: 14:00 UTC
  • Kickoff-Meeting 2: 19:00 UTC

Attendees

Are you planning to attend? Add your name and your expertise below!

Name Tester Feature owner Coordinator Special skills
Simon Schampijer yes yes yes
Sebastian Dziallas yes no soas
Ryan Kabir yes no no
Mel chua yes no soas pilot community QA, SMW-based test case systems
Satyaakam Goswami yes no Hindi Translation testing
Gary Martin yes no no

Testing image

Soas Testing day build

(This is the latest soas nightly build. At the moment starting activities is broken in that build. As this is a daily snapshot it will not be fixed in time for the meeting, hence use the build from the link above.)