|
Dimensione: 9998
Commento:
|
Dimensione: 7743
Commento:
|
| Le cancellazioni sono segnalate in questo modo. | Le aggiunte sono segnalate in questo modo. |
| Linea 22: | Linea 22: |
| == Lucid Cycle Data == * Tests [[https://wiki.ubuntu.com/Testing/Laptop/Lucid/Reports|here]] ||<tablestyle="font-size: 0,9em; text-align: center; border: none; width: 50%; font-weight: bold; background-color: #f1f1ed; table-layout: fixed;"> Milestone || People || Test cases performed || ||< : #FFFFFF> 10.04 A3 ||< : #FFFFFF> 15 ||< : #FFFFFF> 167 || ||< : #FFFFFF> 10.04 Beta 1 ||< : #FFFFFF> 16 ||< : #FFFFFF> 211 || ||< : #FFFFFF> 10.04 Beta 2 ||< : #FFFFFF> 12 ||< : #FFFFFF> 171 || ||< : #FFFFFF> 10.04 RC ||< : #FFFFFF> 9 ||< : #FFFFFF> 145 || ||< : #FFFFFF> 10.04 Final ||< : #FFFFFF> 7 ||< : #FFFFFF> 117 || |
|
| Linea 31: | Linea 23: |
== Maverick Cycle Data == * Tests [[https://wiki.ubuntu.com/Testing/Laptop/Maverick/Reports|here]] ||<tablestyle="font-size: 0,9em; text-align: center; border: none; width: 50%; font-weight: bold; background-color: #f1f1ed; table-layout: fixed;"> Milestone || People || Test cases performed || ||< : #FFFFFF> 10.10 A1 ||< : #FFFFFF> 4 ||< : #FFFFFF> 49 || ||< : #FFFFFF> 10.10 A2 ||< : #FFFFFF> 4 ||< : #FFFFFF> 88 || ||< : #FFFFFF> 10.10 A3 ||< : #FFFFFF> 2 ||< : #FFFFFF> 48 (Holidays) || ||< : #FFFFFF> 10.10 Beta ||< : #FFFFFF> 7 ||< : #FFFFFF> 167 || ||< : #FFFFFF> 10.10 RC ||< : #FFFFFF> 5 ||< : #FFFFFF> 81 || ||< : #FFFFFF> 10.10 Final ||< : #FFFFFF> 5 ||< : #FFFFFF> 54 || |
|
| Linea 47: | Linea 29: |
| ||< : #FFFFFF> 11.04 A1 ||< : #FFFFFF> 4 ||< : #FFFFFF> 120 || ||< : #FFFFFF> 11.04 A2 ||< : #FFFFFF> 7 ||< : #FFFFFF> 164 || ||< : #FFFFFF> 11.04 A3 ||< : #FFFFFF> 5 ||< : #FFFFFF> 86 || |
|
| Linea 54: | Linea 33: |
| * N.B. testcases here stand for "case-id" to compare them with wiki data (e.g. tracker has 18 testcases but most of them contain more than one case-id) | |
| Linea 109: | Linea 87: |
| ||<tablestyle="font-size: 0,9em; text-align: center; border: none; width: 50%; font-weight: bold; background-color: #f1f1ed; table-layout: fixed;"> Bug Importance/Status || linux || dbus || udev || xserver-xorg || ||< : #FFFFFF> 11.04 A1 ||< : #FFFFFF> 6 ||< : #FFFFFF> 54 || ||< : #FFFFFF> 11.04 A2 ||< : #FFFFFF> 4 ||< : #FFFFFF> 56 || ||< : #FFFFFF> 11.04 A3 ||< : #FFFFFF> 2 ||< : #FFFFFF> 28 || ||< : #FFFFFF> 11.04 Beta 1 ||< : #FFFFFF> 15 ||< : #FFFFFF> 174 || ||< : #FFFFFF> 11.04 Beta 2 ||< : #FFFFFF> 11 ||< : #FFFFFF> 102 || ||< : #FFFFFF> 11.04 Final ||< : #FFFFFF> 4 ||< : #FFFFFF> 54 || |
* Critical : 2 (Fix Released) * High : 1 (Fix Released) * Medium : 1 (Incomplete) * Low : 6 (1 Fix released, 2 in progress, 1 Triaged, 2 Confirmed) * Wishlist : 0 * Undecided : 42 (5 Fix Released, 3 Triaged, 10 Confirmed, 5 Incomplete, 10 New, 5 Invalid, 3 Expired, 1 Won't Fix) |
| Linea 117: | Linea 94: |
* Critical : 2 (2 Fix Released) * High : 1 (2 Fix Released) * Medium : 1 (1 Incomplete) * Low : 6 (1 Fix released, 2 in progress, 1 Triaged, 2 Confirmed, * Wishlist : 0 * Undecided : 42 (5 Fix Released, 3 Triaged, 10 Confirmed, 5 Incomplete, 10 New, 5 Invalid, 2 Expired, 1 Won't Fix) |
P.S.: About half of bugs have been reported against "linux" package |
Information
Background
Summary
"Laptop Testing" is a community-driven project started with Lucid Lynx Alpha 3. Our goal is get Ubuntu working great on as many different makes and models of laptops as possible, mainly (but not only) testing point releases of the development cycle to help devs in triaging bugs. This could be done both in all the Community and LoCos, sharing hardware info about Laptops and trying to attract as many new contributors as possible.
Project has a Testing Team on launchpad. It uses the QA Mailing List and IRC channel #ubuntu-testing. In the Testing Team Wiki page this project is reported under Activities along with an English page.
In this session we would like to present goals reached and some suggestions to improve the project.
Activity
Natty Cycle Data
Milestone |
People/Laptop |
Test cases performed * |
11.04 Beta 1 |
19 |
174 (338) |
11.04 Beta 2 |
17 |
191 (366) |
11.04 Final |
11 |
236 (201 → 455) |
Oneiric Cycle Data
Tests here (Laptop Tracker)
Milestone |
People/Laptop |
Test cases performed * |
11.04 A1 |
6 |
54 |
11.04 A2 |
4 |
56 |
11.04 A3 |
2 |
28 |
11.04 Beta 1 |
15 |
174 |
11.04 Beta 2 |
11 |
102 |
11.04 Final |
4 |
54 |
Failures summary
18 bugs have been reported with 9 test cases failed:
Testcase |
Total/Failed |
Bugs |
System
Suspend/Resume |
21/11 |
9 |
Memory Usage |
24/1 |
1 |
Internal Data Card Reader |
22/3 |
6 |
Builtin Webcam |
20/1 |
4 |
Input/Output
Builtin Keyboard |
25/1 |
2 |
Hotkeys |
17/9 |
8 |
Touchpad |
27/1 |
1 |
USB Mouse |
19 |
1 |
Audio
Internal Speakers |
31/1 |
2 |
Headphones |
27/1 |
5 |
Internal Microphone |
27/1 |
1 |
External Microphone |
24/1 |
1 |
Video
Builtin Screen |
30/3 |
4 |
External Screen |
9/3 |
6 |
Networking
Cabled |
22 |
1 |
Wireless |
27 |
2 |
External Expansion Port
USB Ports |
23/1 |
4 |
Firewire Ports |
|
Bug Tasks Importance
- Critical : 2 (Fix Released)
- High : 1 (Fix Released)
- Medium : 1 (Incomplete)
- Low : 6 (1 Fix released, 2 in progress, 1 Triaged, 2 Confirmed)
- Wishlist : 0
- Undecided : 42 (5 Fix Released, 3 Triaged, 10 Confirmed, 5 Incomplete, 10 New, 5 Invalid, 3 Expired, 1 Won't Fix)
P.S.: About half of bugs have been reported against "linux" package
Mixed reports, filed using wiki until Alpha 3, with Laptop Tracker from Beta 1.
- Laptop tested (Natty only, the tracker has also 7 for Maverick and 4 for Lucid).
- 8+33 = 41 Wiki method + Laptop tracker
- 49 people out of 73 members of ubuntu-laptop-testing team in Launchpad.
- 4 reports with test results marked as failed but bugs not reported to Launchpad (all using wiki method)
- 45 ok
Graph (dev cycles)
Laptop Tracker
How it works
- Profile setup
![[ALLEGA]](/SergioZanchetta/LaptopTesting-P?action=AttachFile&do=upload_form&ticket=0067fb470e.dfc855cc9fd24062c635234388ff65caeeb1ee14&target=laptop-info550.png "[ALLEGA]"){kind=small}
- Main page
![[ALLEGA]](/SergioZanchetta/LaptopTesting-P?action=AttachFile&do=upload_form&ticket=0067fb470e.dfc855cc9fd24062c635234388ff65caeeb1ee14&target=releases450.png "[ALLEGA]"){kind=small}
![[ALLEGA]](/SergioZanchetta/LaptopTesting-P?action=AttachFile&do=upload_form&ticket=0067fb470e.dfc855cc9fd24062c635234388ff65caeeb1ee14&target=testcase450.png "[ALLEGA]"){kind=small}
![[ALLEGA]](/SergioZanchetta/LaptopTesting-P?action=AttachFile&do=upload_form&ticket=0067fb470e.dfc855cc9fd24062c635234388ff65caeeb1ee14&target=laptop-report.png "[ALLEGA]"){kind=small}
![[ALLEGA]](/SergioZanchetta/LaptopTesting-P?action=AttachFile&do=upload_form&ticket=0067fb470e.dfc855cc9fd24062c635234388ff65caeeb1ee14&target=laptop-summary550.png "[ALLEGA]"){kind=small}
Thoughts
- Sensible increase in partecipants/tests performed.
- A consistent drop of errors in filing a report, using wiki the most common were:
- Various kind of typos, in some cases lack of important info,in others lots of unnecessary/unstructured or not properly formatted one etc...
- Tests marked as "Failed" without opening a bug or linking the bug on the page.
- Laptop report done not added in the Reports summary page.
Achievements
- Much more easy and quick for a user to report a results.
- Reports are structured and data validated and can be aggregated or filtered.
- Testcases are grouped by category (Audio, Video, I/O etc.)
- Users can be easily contacted via tracker/launchpad and milestone and can be notificated by email when a new milestone is available.
What's next
- Extend the actual iso-testing tag system implementing a tag scheme specific for laptop (Audio-Video-I/O etc)
- Add more testcases.
Try to automate the testing process using tools like kernel-qa script (using USB live disks for example).
Patches are welcome!
