6376
Commento:
|
← Versione 36 del 03/11/2011 18.10.55 ⇥
6452
|
Le cancellazioni sono segnalate in questo modo. | Le aggiunte sono segnalate in questo modo. |
Linea 39: | Linea 39: |
||< : #FFFFFF> 11.04 A1 ||< : #FFFFFF> 6 ||< : #FFFFFF> 54 || ||< : #FFFFFF> 11.04 A2 ||< : #FFFFFF> 4 ||< : #FFFFFF> 56 || ||< : #FFFFFF> 11.04 A3 ||< : #FFFFFF> 2 ||< : #FFFFFF> 28 || ||< : #FFFFFF> 11.04 Beta 1 ||< : #FFFFFF> 15 ||< : #FFFFFF> 174 || ||< : #FFFFFF> 11.04 Beta 2 ||< : #FFFFFF> 11 ||< : #FFFFFF> 102 || ||< : #FFFFFF> 11.04 Final ||< : #FFFFFF> 7 ||< : #FFFFFF> 58 || |
||< : #FFFFFF> 11.10 A1 ||< : #FFFFFF> 6 ||< : #FFFFFF> 54 || ||< : #FFFFFF> 11.10 A2 ||< : #FFFFFF> 4 ||< : #FFFFFF> 56 || ||< : #FFFFFF> 11.10 A3 ||< : #FFFFFF> 2 ||< : #FFFFFF> 28 || ||< : #FFFFFF> 11.10 Beta 1 ||< : #FFFFFF> 15 ||< : #FFFFFF> 174 || ||< : #FFFFFF> 11.10 Beta 2 ||< : #FFFFFF> 11 ||< : #FFFFFF> 102 || ||< : #FFFFFF> 11.10 Final ||< : #FFFFFF> 10 ||< : #FFFFFF> 97 || |
Linea 53: | Linea 53: |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> Suspend/Resume||<style="color:red"> 25/13 ||<style="color:red"> 10 || ||Memory Usage|| 27/1 || 1 || ||Internal Data Card Reader ||<style="color:gold"> 25/3 ||<style="color:gold"> 6 || ||Builtin Webcam || 23/1 || 4 || |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> Suspend/Resume||<style="color:red"> 28/15 ||<style="color:red"> 11 || ||Memory Usage|| 30/1 || 1 || ||Internal Data Card Reader ||<style="color:gold"> 28/4 ||<style="color:gold"> 6 || ||Builtin Webcam || 25/1 || 4 || |
Linea 59: | Linea 59: |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> Builtin Keyboard|| 30/2 || 3 || | ||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> Builtin Keyboard|| 32/2 || 3 || |
Linea 61: | Linea 61: |
||Touchpad|| 30/1 || 1 || ||USB Mouse|| 21 || 1 || |
||Touchpad|| 32/1 || 1 || ||USB Mouse|| 24 || 1 || |
Linea 65: | Linea 65: |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Internal Speakers || 36/1 || 2 || ||Headphones || 31/1 || 5 || ||Internal Microphone || 33/1 || 1 || ||External Microphone|| 28/1 || 1 || |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Internal Speakers || 38/1 || 2 || ||Headphones || 33/1 || 5 || ||Internal Microphone || 35/1 || 1 || ||External Microphone|| 30/1 || 1 || |
Linea 71: | Linea 71: |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Builtin Screen||<style="color:gold"> 32/4 ||<style="color:gold"> 4 || ||External Screen||<style="color:gold"> 10/3 ||<style="color:gold"> 6 || |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Builtin Screen||<style="color:gold"> 35/4 ||<style="color:gold"> 4 || ||External Screen||<style="color:gold"> 11/3 ||<style="color:gold"> 6 || |
Linea 75: | Linea 75: |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Cabled|| 25 || 1 || ||Wireless|| 30/1 || 2 || |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Cabled|| 28 || 1 || ||Wireless|| 34/1 || 2 || |
Linea 79: | Linea 79: |
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> USB Ports ||<style="color:gold"> 27/3 ||<style="color:gold"> 5 || | ||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> USB Ports ||<style="color:gold"> 29/3 ||<style="color:gold"> 5 || |
Linea 87: | Linea 87: |
||<tablestyle="font-size: 0,9em; border: none; text-align: left;font-weight: bold; table-layout: fixed;"> * Critical :|| 2 (Fix Released)|| | ||<tablestyle="font-size: 0,9em; border: none; text-align: left;font-weight: bold; table-layout: fixed;"> * Critical :|| 3 (2 Fix Released, 1 Confirmed)|| |
Linea 89: | Linea 89: |
|| * Medium :|| 1 (Incomplete)|| || * Low :|| 6 (1 Fix released, 2 in progress, 1 Triaged, 2 Confirmed) || || * Undecided :|| 46 (5 Fix Released, 3 Triaged, 13 Confirmed, 5 Incomplete, 11 New, 5 Invalid, 3 Expired, 1 Won't Fix)|| |
|| * Medium :|| 2 (1 Medium, 1 Incomplete)|| || * Low :|| 5 (1 Fix Released, 2 In Progress, 1 Triaged, 1 Confirmed) || || * Undecided :|| 48 (6 Fix Released, 1 Fix Committed, 4 Triaged, 16 Confirmed, 5 Incomplete, 7 New, 5 Invalid, 3 Expired, 1 Won't Fix)|| |
Linea 101: | Linea 101: |
{{attachment:laptop-graph.png}} | {{attachment:laptop-test-graph.png}} |
Linea 124: | Linea 124: |
* Integrate in some way LTT/UF projects? | * Integrate in some way !LaptopTestingTeam/UbuntuFriendly projects? |
Information
Background
Summary
"Laptop Testing" is a community-driven project started with Lucid Lynx Alpha 3. Our goal is get Ubuntu working great on as many different makes and models of laptops as possible, mainly (but not only) testing point releases of the development cycle to help devs in triaging bugs. This could be done both in all the Community and LoCos, sharing hardware info about Laptops and trying to attract as many new contributors as possible.
Project has a Testing Team on launchpad. It uses the QA Mailing List and IRC channel #ubuntu-testing. In the Testing Team Wiki page this project is reported under Activities along with an English page.
In this session we would like to present goals reached and some suggestions to improve the project.
Activity
Natty Cycle Data
Tests here
Milestone |
People/Laptop |
Test cases performed * |
11.04 Beta 1 |
19 |
174 |
11.04 Beta 2 |
17 |
191 |
11.04 Final |
11 |
236 |
Oneiric Cycle Data
29 laptop have tested at least one milestone
Tests here
Milestone |
People/Laptop |
Test cases performed * |
11.10 A1 |
6 |
54 |
11.10 A2 |
4 |
56 |
11.10 A3 |
2 |
28 |
11.10 Beta 1 |
15 |
174 |
11.10 Beta 2 |
11 |
102 |
11.10 Final |
10 |
97 |
Failures summary
Testcase |
Total/Failed |
Bugs |
System
Suspend/Resume |
28/15 |
11 |
Memory Usage |
30/1 |
1 |
Internal Data Card Reader |
28/4 |
6 |
Builtin Webcam |
25/1 |
4 |
Input/Output
Builtin Keyboard |
32/2 |
3 |
Hotkeys |
20/10 |
9 |
Touchpad |
32/1 |
1 |
USB Mouse |
24 |
1 |
Audio
Internal Speakers |
38/1 |
2 |
Headphones |
33/1 |
5 |
Internal Microphone |
35/1 |
1 |
External Microphone |
30/1 |
1 |
Video
Builtin Screen |
35/4 |
4 |
External Screen |
11/3 |
6 |
Networking
Cabled |
28 |
1 |
Wireless |
34/1 |
2 |
External Expansion Port
USB Ports |
29/3 |
5 |
Firewire Ports |
|
|
Bug Tasks Importance
* Critical : |
3 (2 Fix Released, 1 Confirmed) |
* High : |
1 (Fix Released) |
* Medium : |
2 (1 Medium, 1 Incomplete) |
* Low : |
5 (1 Fix Released, 2 In Progress, 1 Triaged, 1 Confirmed) |
* Undecided : |
48 (6 Fix Released, 1 Fix Committed, 4 Triaged, 16 Confirmed, 5 Incomplete, 7 New, 5 Invalid, 3 Expired, 1 Won't Fix) |
P.S.: About half of bugs have been reported against "linux" package
Graph (last cycles comparation)
Laptop Tracker
Thoughts
- About the same number of tests performed in Beta 1, slight drop in Beta 2.
- People need time to test their laptop (see the increment in Natty Final)
- Critical areas for laptops (most bugs/test failures) are Suspend/Resume and Hotkeys.
- Internal Data Card Reader, Video (internal and external) need attention too.
What's next
- Try to automate the testing process as much as possible with checkbox. It can be patched to detect a dev release, so it can be used to test/report a bug about a laptop for the tracker without sending reports for the UF project (that it's used to validate hardware for stable releases)
Integrate in some way LaptopTestingTeam/UbuntuFriendly projects?