|
Dimensione: 1017
Commento:
|
← Versione 28 del 14/03/2011 12.55.03 ⇥
Dimensione: 4872
Commento: converted to 1.6 markup
|
| Le cancellazioni sono segnalate in questo modo. | Le aggiunte sono segnalate in questo modo. |
| Linea 1: | Linea 1: |
| == Information == | #format wiki #LANGUAGE it <<Indice(depth=2)>> |
| Linea 3: | Linea 5: |
| * '''Home Page''' [http://wiki.ubuntu.com/Testing/Laptop] * in Italian [http://wiki.ubuntu-it.org/GruppoTest/TestPortatili] |
|
| Linea 6: | Linea 6: |
| * '''Test Cases''' [http://testcases.qa.ubuntu.com/Plans/LaptopTesting] | = Information = |
| Linea 8: | Linea 8: |
| * '''Template''' [https://wiki.ubuntu.com/Testing/Laptop/Reports/Template] | == Background == * Previous session at [[https://wiki.ubuntu.com/Specs/ImprovingCommunityLaptopTesting|UDS-M]] |
| Linea 10: | Linea 11: |
| * '''Reports''' [http://wiki.ubuntu.com/Testing/Laptop/Reports] | == Summary == |
| Linea 12: | Linea 13: |
| == Feedbacks == | "[[https://wiki.ubuntu.com/Testing|Laptop Testing]]" is a community-driven project started with Lucid Lynx Alpha 3. Our goal is get Ubuntu working great on as many different makes and models of laptops as possible, mainly testing point releases of the development cycle. This could be done both in all the Community and !LoCos, sharing hardware info about Laptops to avoid duplicates and trying to attract as many new contributors as possible. |
| Linea 14: | Linea 15: |
| * Laptop tested. * Lucid 37 * Maverick 24 (two didn't report it on the report wiki page.) |
Project has been started by the [[https://launchpad.net/~ubuntu-it-testing|Italian LoCo Testing]] team on launchpad. It's organized at moment with [[http://wiki.ubuntu-it.org/GruppoTest|Wiki pages]], a [[http://liste.ubuntu-it.org/cgi-bin/mailman/listinfo/gruppo-test|Mailing List]] and an IRC channel #ubuntu-it-test. In the [[https://wiki.ubuntu.com/Testing|Testing Team Wiki page]] this project is reported under [[https://wiki.ubuntu.com/Testing/Activities|Activities]] along with an [[https://wiki.ubuntu.com/Testing/Laptop|English page]]. |
| Linea 18: | Linea 17: |
| * How many people filed a report: * Lucid * 40 people, * 10 from Italian community * 7 active members of the Italian Testing Team. |
In this session we would like to discuss how to improve this project. |
| Linea 24: | Linea 19: |
| * Maverick * 21 people * 8 from Italian community * 7 active members of the Italian Testing Team. |
= Activity = == Lucid Cycle Data == |
| Linea 29: | Linea 22: |
| == How results have been reported == * Lucid (54% ok) * 17 of them useless. * 20 ok. |
Laptop tested. * 49 |
| Linea 34: | Linea 25: |
| * Maverick (71,4% ok) * 7 useless (for various reasons: bugs not reported to Launchpad, tests never done or results never reported etc.) * 15 ok. |
How many people filed a report: * 40 people (7 of them are also active members of the Italian Testing Team). How results have been reported: * 17 of them useless (for various reasons: bugs not reported to Launchpad, tests never done or results never reported etc.) * 20 ok. → 54% ok ||<tablestyle="font-size: 0,9em; text-align: center; border: none; width: 50%; font-weight: bold; background-color: #f1f1ed; table-layout: fixed;"> Milestone || People || Test cases performed * || ||< : #FFFFFF> 10.04 A3 ||< : #FFFFFF> 15 ||< : #FFFFFF> 167 || ||< : #FFFFFF> 10.04 Beta 1 ||< : #FFFFFF> 16 ||< : #FFFFFF> 211 || ||< : #FFFFFF> 10.04 Beta 2 ||< : #FFFFFF> 12 ||< : #FFFFFF> 171 || ||< : #FFFFFF> 10.04 RC ||< : #FFFFFF> 9 ||< : #FFFFFF> 145 || ||< : #FFFFFF> 10.04 Final ||< : #FFFFFF> 7 ||< : #FFFFFF> 117 || == Maverick Cycle Data == Laptop tested. * 24 How many people filed a report: * 21 people (7 of them are also active members of the Italian Testing Team.) How results have been reported: * 7 useless (for various reasons: bugs not reported to Launchpad, tests never done or results never reported etc.) * 15 ok. → 71,4% ok ||<tablestyle="font-size: 0,9em; text-align: center; border: none; width: 50%; font-weight: bold; background-color: #f1f1ed; table-layout: fixed;"> Milestone || People || Test cases performed * || ||< : #FFFFFF> 10.10 A1 ||< : #FFFFFF> 4 ||< : #FFFFFF> 49 || ||< : #FFFFFF> 10.10 A2 ||< : #FFFFFF> 4 ||< : #FFFFFF> 88 || ||< : #FFFFFF> 10.10 A3 ||< : #FFFFFF> 2 ||< : #FFFFFF> 48 (Holidays) || ||< : #FFFFFF> 10.10 Beta ||< : #FFFFFF> 7 ||< : #FFFFFF> 167 || ||< : #FFFFFF> 10.10 RC ||< : #FFFFFF> 5 ||< : #FFFFFF> 81 || ||< : #FFFFFF> 10.10 Final ||< : #FFFFFF> 5 ||< : #FFFFFF> 54 || * Counted as done even tests performed in "useless" reports (those marked as such because test failed but a bug have not been reported). Tests done several days after the final release have not been considered. = Thoughts = * Less people have partecipate in Maverick so less testcases have been performed. * A large part of this decrease is due to a significant drop of wrong/useless reports. * Number of testers from the Italian testing team (moderated) has been stable . * List of common error found in reporting: 1. Testcase marked as "Failed" without opening a bug or linking the bug on the page 1. Laptop report not added in the [[https://wiki.ubuntu.com/Testing/Laptop/Reports|Reports page]] 1. Laptop report linked wrong in the Reports page (typos) 1. Name/nick of tester not added with the ''@SIG''@ macro (users can't be identified if the nick is different or has typos) 1. Due to the open structure of wiki pages, some people add lots of unnecessary/unstructured or not properly formatted info 1. A script to import Laptop testcases in checkbox is available but is useless without a plan to use/integrate checkbox database = How to improve = * Dedicated ISO Tracker. This would resolve a lot of issues and advantages are listed below: 1. Users needs to be registered and providing the launchpad nickname are recognizable 1. Reports are structured and data validated and can be aggregated or filtered 1. Really easy to report a test result 1. No more failed test with bugs not linked 1. Tag system already implemented * ISO Tracker / Checkbox integration ---- CategoryHomepage |
Information
Background
Previous session at UDS-M
Summary
"Laptop Testing" is a community-driven project started with Lucid Lynx Alpha 3. Our goal is get Ubuntu working great on as many different makes and models of laptops as possible, mainly testing point releases of the development cycle. This could be done both in all the Community and LoCos, sharing hardware info about Laptops to avoid duplicates and trying to attract as many new contributors as possible.
Project has been started by the Italian LoCo Testing team on launchpad. It's organized at moment with Wiki pages, a Mailing List and an IRC channel #ubuntu-it-test. In the Testing Team Wiki page this project is reported under Activities along with an English page.
In this session we would like to discuss how to improve this project.
Activity
Lucid Cycle Data
- Laptop tested.
- 49
- 40 people (7 of them are also active members of the Italian Testing Team).
- 17 of them useless (for various reasons: bugs not reported to Launchpad, tests never done or results never reported etc.)
- 20 ok.
- → 54% ok
Milestone |
People |
Test cases performed * |
10.04 A3 |
15 |
167 |
10.04 Beta 1 |
16 |
211 |
10.04 Beta 2 |
12 |
171 |
10.04 RC |
9 |
145 |
10.04 Final |
7 |
117 |
Maverick Cycle Data
- Laptop tested.
- 24
- 21 people (7 of them are also active members of the Italian Testing Team.)
- 7 useless (for various reasons: bugs not reported to Launchpad, tests never done or results never reported etc.)
- 15 ok.
- → 71,4% ok
Milestone |
People |
Test cases performed * |
10.10 A1 |
4 |
49 |
10.10 A2 |
4 |
88 |
10.10 A3 |
2 |
48 (Holidays) |
10.10 Beta |
7 |
167 |
10.10 RC |
5 |
81 |
10.10 Final |
5 |
54 |
* Counted as done even tests performed in "useless" reports (those marked as such because test failed but a bug have not been reported). Tests done several days after the final release have not been considered.
Thoughts
- Less people have partecipate in Maverick so less testcases have been performed.
- A large part of this decrease is due to a significant drop of wrong/useless reports.
- Number of testers from the Italian testing team (moderated) has been stable .
- List of common error found in reporting:
- Testcase marked as "Failed" without opening a bug or linking the bug on the page
Laptop report not added in the Reports page
- Laptop report linked wrong in the Reports page (typos)
Name/nick of tester not added with the @SIG@ macro (users can't be identified if the nick is different or has typos)
- Due to the open structure of wiki pages, some people add lots of unnecessary/unstructured or not properly formatted info
- A script to import Laptop testcases in checkbox is available but is useless without a plan to use/integrate checkbox database
How to improve
- Dedicated ISO Tracker. This would resolve a lot of issues and advantages are listed below:
- Users needs to be registered and providing the launchpad nickname are recognizable
- Reports are structured and data validated and can be aggregated or filtered
- Really easy to report a test result
- No more failed test with bugs not linked
- Tag system already implemented
- ISO Tracker / Checkbox integration
