[prev in list] [next in list] [prev in thread] [next in thread] 

List:       meego-releases
Subject:    [meego-releases] MeeGo v1.0 Netbook Software Update Fullpass Test
From:       daniel.tao () intel ! com (Tao, Daniel)
Date:       2010-06-23 13:24:17
Message-ID: 625BA99ED14B2D499DC4E29D8138F1503084425A30 () shsmsx502 ! ccr ! corp ! intel ! com
[Download RAW message or body]

Test Objective
---------------------------
MeeGo v1.0 netbook software update fullpass test is to evaluate the whole quality of \
the 1.0 software update release, validate the updated packages and sub-systems \
impacted by the updated packages to guarantee no regression happens on the updated \
system. Image
---------------------------
meego-netbook-ia32-chrome-1.0.0.3.20100620.1.img
meego-netbook-ia32-chromium-1.0.0.3.20100620.1.img
Test Environment
---------------------------
Hardware
  Pinetrail Netbooks          HP mini 210           Asus EeePC 1005PE
Test Coverage
---------------------------
System Use Case on whole system;
Sanity test on whole system
Regression Test for component as below:
Chromium web browser
Installation
Pasteboard panel
People panel
Top panel
Device panel
Input method and virtual keyboard
Packagekit
Quality Summary
---------------------------
We finished part of whole test execution plan:  for sanity test, we covered both \
chrome and chromium image, and executed 56 test cases, 54 passed, only one issue is \
the boot time regression (Bug 2903); for system use case,  executed 140 test cases, \
96 passed; covered regression test for 8 components with 52 BAT test cases, 49 \
passed. We will continue the fullpass testing in following days.
Highlights

?  No new/regression bug found in today's testing;

Lowlights

?  The kernel update(Kernel-0013(noarch)) have caused 3s regression of boot time.( \
Bug 2903<http://bugs.meego.com/show_bug.cgi?id=2903>)

?  Evolution account assistant get stuck if click "back-Identity" with a non-IMAP \
Server Type during creating new email accounts (Bug \
3286<http://bugs.meego.com/show_bug.cgi?id=3286>)

?  Toolbar panel fail to drop back after application launched (Bug \
3278<http://bugs.meego.com/show_bug.cgi?id=3278>) Test Result
---------------------------
Result Overview
Total TCs

Passed

Failed

Not Testable

Run Rate

Pass Rate of Total

Pass Rate of Executed

248

196

49

3

98.8%

79%

80%

Detail Result
Types of Tests

Results

Sanity Test

Pass rate: 96%
Top bugs:
Bug 2903<http://bugs.meego.com/show_bug.cgi?id=2903> - [REG]Boot time regression 3s \
after system update which include kernel update

System Use Case

Pass rate: 68%
Top bugs:
Bug 748<http://bugs.meego.com/show_bug.cgi?id=748> - [Chrome] Chrome browser can not \
show Chinese strings with bold font correctly Bug \
375<http://bugs.meego.com/show_bug.cgi?id=375> - "Refresh package lists" doesn't work \
even if the repos change Bug 1723<http://bugs.meego.com/show_bug.cgi?id=1723> - \
[Performance] It takes about 9 seconds to launch banshee in the first time

Functional test

Chromium web browser

Pass rate: 96.5%
Top bugs: None
Notes: BAT test cases are covered

Installation

Pass rate: 100%
Top bugs: None
Notes: BAT test cases are covered;

Pasteboard panel

Pass rate: 100%
Top bugs: None
Notes: BAT test cases are covered;

People panel

Pass rate: 100%
Top bugs: None
Notes: BAT test cases are covered;

Top panel

Pass rate: 100%
Top bugs: None
Notes: BAT test cases are covered;

Device panel

Pass rate: 100%
Top bugs: None
Notes: BAT test cases are covered;

Input method and virtual keyboard

Pass rate: 83.3%
Top bugs:
Bug 2427<http://bugs.meego.com/show_bug.cgi?id=2427> - [REG] cannot invoke input \
                method in mx based text entry
Notes: BAT test cases are covered;

Packagekit

Pass rate: 80%
Top bugs:
Bug 375<http://bugs.meego.com/show_bug.cgi?id=375> - "Refresh package lists" doesn't \
                work even if the repos change
Notes: BAT test cases are covered;

Issue Summary
---------------------------
Top Bugs (3)
Bug 2903<http://bugs.meego.com/show_bug.cgi?id=2903> - [REG]Boot time regression 3s \
after system update which include kernel update Bug \
3286<http://bugs.meego.com/show_bug.cgi?id=3286> - Evolution account assistant get \
stuck if click "back-Identity" with a non-IMAP Server Type during creating new email \
accounts Bug 3278<http://bugs.meego.com/show_bug.cgi?id=3278> - [REG]Toolbar panel \
fail to drop back after application launched

New Bugs
N/A
[cid:image001.png at 01CB1318.B83672B0]

Thanks

Daniel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/private/meego-releases/attachments/20100623/67194bb0/attachment-0001.html>
                
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 34474 bytes
Desc: image001.png
URL: <http://lists.meego.com/private/meego-releases/attachments/20100623/67194bb0/attachment-0001.png>



[prev in list] [next in list] [prev in thread] [next in thread]