Wiki Ubuntu-it

Indice
Partecipa
FAQ
Wiki Blog
------------------
Ubuntu-it.org
Forum
Chiedi
Chat
Cerca
Planet
  • Pagina non alterabile
  • Informazioni
  • Allegati
  • Differenze per "SergioZanchetta/LaptopTesting-P"
Differenze tra le versioni 15 e 17 (in 2 versioni)
⇤ ← Versione 15 del 21/10/2011 08.33.38 →
Dimensione: 7839
Autore: SergioZanchetta
Commento:
← Versione 17 del 24/10/2011 16.04.23 → ⇥
Dimensione: 6793
Autore: SergioZanchetta
Commento:
Le cancellazioni sono segnalate in questo modo. Le aggiunte sono segnalate in questo modo.
Linea 9: Linea 9:
 * Previous session at [[ |UDS-O]]
Linea 36: Linea 37:
29 laptop tested at least one milestone
Linea 43: Linea 45:
||< : #FFFFFF> 11.04 Final ||< : #FFFFFF> 4 ||< : #FFFFFF> 54 || ||< : #FFFFFF> 11.04 Final ||< : #FFFFFF> 7 ||< : #FFFFFF> 58 ||
Linea 53: Linea 55:
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> Suspend/Resume||<style="color:red"> 21/11 ||<style="color:red"> 9 ||
||Memory Usage|| 24/1 || 1 ||
||Internal Data Card Reader ||<style="color:gold"> 22/3 ||<style="color:gold"> 6 ||
||Builtin Webcam || 20/1 || 4 ||		 ||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> Suspend/Resume||<style="color:red"> 25/13 ||<style="color:red"> 10 ||
||Memory Usage|| 27/1 || 1 ||
||Internal Data Card Reader ||<style="color:gold"> 25/3 ||<style="color:gold"> 6 ||
||Builtin Webcam || 23/1 || 4 ||
Linea 59: Linea 61:
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> Builtin Keyboard|| 25/1 || 2 ||
||Hotkeys||<style="color:red"> 17/9 ||<style="color:red"> 8 ||
||Touchpad|| 27/1 || 1 ||
||USB Mouse|| 19 || 1 ||		 ||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> Builtin Keyboard|| 30/2 || 3 ||
||Hotkeys||<style="color:red"> 20/10 ||<style="color:red"> 9 ||
||Touchpad|| 30/1 || 1 ||
||USB Mouse|| 21 || 1 ||
Linea 65: Linea 67:
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Internal Speakers || 31/1 || 2 ||
||Headphones || 27/1 || 5 ||
||Internal Microphone || 27/1 || 1 ||
||External Microphone|| 24/1 || 1 ||		 ||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Internal Speakers || 36/1 || 2 ||
||Headphones || 31/1 || 5 ||
||Internal Microphone || 33/1 || 1 ||
||External Microphone|| 28/1 || 1 ||
Linea 71: Linea 73:
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Builtin Screen||<style="color:gold"> 30/3 ||<style="color:gold"> 4 ||
||External Screen||<style="color:gold"> 9/3 ||<style="color:gold"> 6 ||		 ||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Builtin Screen||<style="color:gold"> 32/4 ||<style="color:gold"> 4 ||
||External Screen||<style="color:gold"> 10/3 ||<style="color:gold"> 6 ||
Linea 75: Linea 77:
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Cabled|| 22 || 1 ||
||Wireless|| 27 || 2 ||		 ||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%; font-weight: bold;table-layout: fixed;"> Cabled|| 25 || 1 ||
||Wireless|| 30/1w || 2 ||
Linea 79: Linea 81:
||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> USB Ports || 23/1 || 4 || ||<tablestyle="font-size: 0,9em; border: none; text-align: center; width: 50%;font-weight: bold; table-layout: fixed;"> USB Ports || 27/3 || 5 ||
Linea 91: Linea 93:
|| * Undecided :|| 42 (5 Fix Released, 3 Triaged, 10 Confirmed, 5 Incomplete, 10 New, 5 Invalid, 3 Expired, 1 Won't Fix)|| || * Undecided :|| 46 (5 Fix Released, 3 Triaged, 13 Confirmed, 5 Incomplete, 11 New, 5 Invalid, 3 Expired, 1 Won't Fix)||
Linea 106: Linea 108:
Mixed reports, filed using wiki until Alpha 3, with Laptop Tracker from Beta 1.

 Laptop tested (Natty only, the tracker has also 7 for Maverick and 4 for Lucid).
  * 8+33 = 41 Wiki method + Laptop tracker


 How many people filed a report (dev and stable releases):
  * 49 people out of 73 members of ubuntu-laptop-testing team in Launchpad.

 How results have been reported (natty):
 
         * 4 reports with test results marked as failed but bugs not reported to Launchpad (all using wiki method)
  * 45 ok
Linea 125: Linea 113:
##<<Immagine(/PaoloSammicheli/LaptopTesting-O/tests-graph.png,850,center)>> ##<<Immagine(/SergioZanchetta/LaptopTesting-O/tests-graph.png,850,center)>>
Linea 129: Linea 117:
 * [[https://blueprints.launchpad.net/ubuntu/+spec/ubuntutheproject-qa-n-laptop-testing-tracker| Blueprint on Launchpad]]  * [[ | Blueprint on Launchpad]]
Linea 132: Linea 120:

== How it works ==

 * Profile setup

  {{attachment:laptop-info550.png}}

<<BR>>

 * Main page

  {{attachment:releases450.png}}

<<BR>>

 * [[http://laptop.qa.ubuntu.com/qatracker/test/5759|Testcases]]

  {{attachment:testcase450.png}}

<<BR>>

 * [[http://laptop.qa.ubuntu.com/qatracker/laptop/Natty/28712|Report example]]

  {{attachment:laptop-report.png}}

<<BR>>

 * [[http://laptop.qa.ubuntu.com/qatracker/laptop|Laptops summary]]

  {{attachment:laptop-summary550.png}}

Information

Background

  • Previous session at UDS-O

  • Previous session at UDS-M

  • Previous session at UDS-N

  • Laptop Testing page

Summary

"Laptop Testing" is a community-driven project started with Lucid Lynx Alpha 3. Our goal is get Ubuntu working great on as many different makes and models of laptops as possible, mainly (but not only) testing point releases of the development cycle to help devs in triaging bugs. This could be done both in all the Community and LoCos, sharing hardware info about Laptops and trying to attract as many new contributors as possible.

Project has a Testing Team on launchpad. It uses the QA Mailing List and IRC channel #ubuntu-testing. In the Testing Team Wiki page this project is reported under Activities along with an English page.

In this session we would like to present goals reached and some suggestions to improve the project.

Activity

Natty Cycle Data

  • Tests here (Wiki)

  • Tests here (Laptop Tracker)

Milestone

People/Laptop

Test cases performed *

11.04 Beta 1

19

174

11.04 Beta 2

17

191

11.04 Final

11

236

Oneiric Cycle Data

29 laptop tested at least one milestone

  • Tests here (Laptop Tracker)

Milestone

People/Laptop

Test cases performed *

11.04 A1

6

54

11.04 A2

4

56

11.04 A3

2

28

11.04 Beta 1

15

174

11.04 Beta 2

11

102

11.04 Final

7

58

Failures summary

18 bugs have been reported with 9 test cases failed:

Testcase

Total/Failed

Bugs


System

Suspend/Resume

25/13

10

Memory Usage

27/1

1

Internal Data Card Reader

25/3

6

Builtin Webcam

23/1

4


Input/Output

Builtin Keyboard

30/2

3

Hotkeys

20/10

9

Touchpad

30/1

1

USB Mouse

21

1


Audio

Internal Speakers

36/1

2

Headphones

31/1

5

Internal Microphone

33/1

1

External Microphone

28/1

1


Video

Builtin Screen

32/4

4

External Screen

10/3

6


Networking

Cabled

25

1

Wireless

30/1w

2


External Expansion Port

USB Ports

27/3

5

Firewire Ports


Bug Tasks Importance

* Critical :

2 (Fix Released)

* High :

1 (Fix Released)

* Medium :

1 (Incomplete)

* Low :

6 (1 Fix released, 2 in progress, 1 Triaged, 2 Confirmed)

* Undecided :

46 (5 Fix Released, 3 Triaged, 13 Confirmed, 5 Incomplete, 11 New, 5 Invalid, 3 Expired, 1 Won't Fix)

P.S.: About half of bugs have been reported against "linux" package

Graph (dev cycles)

laptop-tests-graph.png

Laptop Tracker

Thoughts

  • Sensible increase in partecipants/tests performed.
  • A consistent drop of errors in filing a report, using wiki the most common were:
    1. Various kind of typos, in some cases lack of important info,in others lots of unnecessary/unstructured or not properly formatted one etc...
    2. Tests marked as "Failed" without opening a bug or linking the bug on the page.
    3. Laptop report done not added in the Reports summary page.

Achievements

  1. Much more easy and quick for a user to report a results.
  2. Reports are structured and data validated and can be aggregated or filtered.
  3. Testcases are grouped by category (Audio, Video, I/O etc.)
  4. Users can be easily contacted via tracker/launchpad and milestone and can be notificated by email when a new milestone is available.

What's next

  1. Extend the actual iso-testing tag system implementing a tag scheme specific for laptop (Audio-Video-I/O etc)
  2. Add more testcases.

  3. Try to automate the testing process using tools like kernel-qa script (using USB live disks for example).

  4. Patches are welcome! :-)

CategoryHomepage