[prev in list] [next in list] [prev in thread] [next in thread]
List: meego-releases
Subject: [meego-releases] FW: MeeGo v1.1 Handset ww25.5 Test Report for Day
From: may.xie () intel ! com (Xie, May)
Date: 2010-06-23 7:44:32
Message-ID: F2E9EB7348B8264F86B6AB8151CE2D7916AFE9A76A () shsmsx502 ! ccr ! corp ! intel ! com
[Download RAW message or body]
FYI - Weekly Test report for Handset Day one release from Intel MeeGo QA.
________________________________
From: Li, Cathy
Sent: Saturday, June 19, 2010 12:51 AM
To: meego-dist at linux.intel.com; moblin at linux.intel.com
Cc: Chris Ferron; Blouin, Pierre J; Chen, Terence; Nagarajan, Guru; Nashif, Anas; \
Rullman, Brad; Lynch, Rusty; Parenteau, Paul A; Guo, Young; Jiang, Xiaodan; Yu, \
Zhiqiang; Skarpness, Mark; Xie, May; Zhao, Fan; Yu, Jerry; Li, Cathy
Subject: MeeGo v1.1 Handset ww25.5 Test Report for Day One RC (for \
1.0.80.6.20100616.1 images)
Test Objective
--------------------------------------
This is QA basic functional pass testing cycle targets for providing a stable MeeGo \
Handset OS and compelling visual and system interaction, consistent and intuitive \
system interaction, as well as ensuring reference applications in good shape towards \
MeeGo Handset DayOne public release on June 30th. Our test focuses on OS base \
(kernel, device driver), OS middleware (gfx, Ofono, connection manager, Bluetooth, \
package manager, tracker, context kit, sensor framework) and UX/key applications \
(MeeGo Touch Framework, system UI, Dialer, SMS, fennec browser, and photo viewer) on \
top of Aava and MRST CDK platforms.
Build Location
---------------------------------------
Aava image with kernel-2.6.33
http://repo.meego.com/.mEeGo/builds/internal/1.0.80.6.20100616.1/handset/images/meego-handset-ia32-aava-mtf/
Test Environment
---------------------------------------
Hardware: Aava Koski DV1 and EV2
Test Coverage
---------------------------------------
Sanity test
Functional test
Bug verification
Test Result
---------------------------------------
Result Overview
Total TCs
Passed
Failed
Not testable (Blocked)
Run Rate
Pass rate of total
Pass rate of executed
Core: 119
72
38
9
92.4%
60.5%
65.5%
UX/Applications: 287
194
57
36
87.5%
67.6%
77.3%
Quality Summary
--------------------------------------
Highlights:
? Connman, Ofono and bluez could basically works and no major issues introduced.
Lowlights:
? Blocking issues detected for duihome: no icons appear in app \
launcher(3182<http://bugs.meego.com/show_bug.cgi?id=3182>), Duihome abort when Meego \
started with high possibility (3250<http://bugs.meego.com/show_bug.cgi?id=3250>).
? System UI functionalities are not ready yet with one major REGRESSION issues \
explored (3252<http://bugs.meego.com/show_bug.cgi?id=3252>).
? VKB doesn't work anymore with DUI/GTK applications \
(3193<http://bugs.meego.com/show_bug.cgi?id=3193>), however it works fine in previous \
0611 image.
? Segment fault when press exit button on sms application \
(3190<http://bugs.meego.com/show_bug.cgi?id=3190>).
? Several new major issues are introduced for photo viewer \
(3195<http://bugs.meego.com/show_bug.cgi?id=3195>, \
3229<http://bugs.meego.com/show_bug.cgi?id=3229>, \
3238<http://bugs.meego.com/show_bug.cgi?id=3238> )
? QT based fennec browser are not integrated till now \
(3179<http://bugs.meego.com/show_bug.cgi?id=3179>).
Legend:
Low risk, most functions work well, minor bugs or limited normal bugs
Medium risk, main function work, normal bugs and limited major bugs
High risk, main functions loss, a few critical/major bugs
Components
Grading
Comments (Top Issues)
OS base
Kernel and device driver
236 - sound record not work
239 - [Aava]Camera driver fail to find the sensor devices
247 - [REG][CDK]Infineon GPS daemon crash the kernel
2287 - [Aava] [REG]USB OTG port doesn't work
2801 - [Aava] Battery driver reporting incorrect/incomplete information
2905 - [Aava] Modem can not work in Aava koski device
OS middleware
Gfx
2761 - Serious graphics glitching/flickering exhibited during flash videos playback \
on YouTube website 1760 - Screen is messed after rotating it
1334 - Significant visible tearing in GL applications
Ofono
Basic functions work in good state
Connman
966 - [Aava][CDK] Wifi network with WEP security setting doesn't work (driver issue \
blocked some ) 2924 - [REG][Avva]Can NOT connect to Guest network
Bluetooth
3253 - [Handset] Need pygobject2 package integrated
Tracker
1503 - [REG]Can't view bmp&gif photos using meegophotos
Package manager(yum, rpm)
Basic functions works
Sensor framework
3255 - screen cannot be rotated
UX/Applications
DUIhome/MeeGo Touch Framework/Theme
3182 - [REG] No icons appear in app launcher
3250 - [REG] Duihome abort when Meego started with high possibility
2598 - [REG] No default home background and shows white page instead
1758 - Duihome cannot adjust to the rotated screen
3171 - People: Context menu dims entire screen
2185 - Screen flickering and slow UI response in the first few seconds after \
launching libmeegotouch applications: 2070 - [Aava] System model dialog caused weird \
UI showing 1757 - Mess screen when start mcompositor
Other issue: we don't any idear about lock screen feature, is it supported currently? \
How to validate?
Fennec (QT based)
3179 - QT Fennec is NOT integrated in images as default web-browser
2761 - Serious graphics glitching/flickering exhibited during flash videos playback \
on YouTube website
System UI
2935 - The profile settings (Ringing, silent, beep, loud) doesn't work
3252 - [REG] No icons (notifications & battery charge, clock, network/3G connection) \
appear in system UI
Dialer
2923 - [REG] It shows dialer screen information in call history panel after declining \
a call 2043 - call history information is not saved for the first time that dialer is \
launched 548 - can't see call information like date, name etc. in UI
949 - Add to people function doesn't work
2245 - no time information in call history
SMS
3190 - [REG] Segment fault when pressing exit button from sms application
2313 - No sms notification information when a new message arriving
2635 - multiline sms messages do not expand correctly
2453 - [REG]Missing the send button in sms
2636 - Can not receive more than 160 byte message
3228 - can not receive message in idle or other application
Virtual Keyboard
3193 - Unable to launch VKB in DUI/GTK applications
2645 - corruption of text of VKB in input field
2643 - If launch VKB after system boot up, the VKB shows very slow.
Photo viewer
2469 - Photo viewer state is out of order when entry photo viewer again from app \
thumbnail 2926 - [REG] [Photo]The upper title bar is not hidden in slide show mode
3195 - [Photo viewer] The "pause" icon can't show completely.
3229 - [Photo viewer]No picture shows in a album thumbnail
3238 - [Photo viewer]The number of photos in a album is no change when delete some \
photos
Contacts
667 - Email button doesn't work
3167 - dialer: Not using widgets provded by libseaside
3230 - [REG]Alphabetical scroll bar doesn't work
Known issue: we don't have a fixed backend storage in Qt (Tracker)
Control Panel
- Currently only WIFI applet works well in Control panel
- Look and Feel looks like only an example to show widgets
- For other items, they are all empty
Issue Summary
--------------------------------------
Key Issues: Open high bugs on Handset: \
http://bugs.meego.com/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=handheld_open_high&sharer_id=43
New issues: 23 new bugs (13 are high) are reported, 8 are REGRESSION issues: \
http://bugs.meego.com/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=handset_1.0.80.6.20100616.1&sharer_id=43
3182<http://bugs.meego.com/show_bug.cgi?id=3182> High [REG] No \
icons appear in app launcher 3193<http://bugs.meego.com/show_bug.cgi?id=3193> \
High [REG] Unable to launch VKB in DUI/GTK applications \
3223<http://bugs.meego.com/show_bug.cgi?id=3223> High \
[Aava][REG]Audio driver not work 3228<http://bugs.meego.com/show_bug.cgi?id=3228> \
High can not receive message in idle or other application \
3250<http://bugs.meego.com/show_bug.cgi?id=3250> High Duihome abort \
when Meego started with high possibility \
3252<http://bugs.meego.com/show_bug.cgi?id=3252> High [REG] No icons \
(notifications & battery charge, clock, network/3G connection) appear in system UI \
3179<http://bugs.meego.com/show_bug.cgi?id=3179> High QT Fennec is \
NOT integrated in images as default web-browser \
3190<http://bugs.meego.com/show_bug.cgi?id=3190> High [REG] Segment \
fault when pressing exit button from sms application \
3195<http://bugs.meego.com/show_bug.cgi?id=3195> High [Photo viewer] \
The "pause" icon can't show completely. \
3229<http://bugs.meego.com/show_bug.cgi?id=3229> High [Photo \
viewer]No picture shows in a album thumbnail \
3230<http://bugs.meego.com/show_bug.cgi?id=3230> High \
[REG]Alphabetical scroll bar doesn't work \
3238<http://bugs.meego.com/show_bug.cgi?id=3238> High [Photo \
viewer]The number of photos in a album is no change when delete some photos \
3255<http://bugs.meego.com/show_bug.cgi?id=3255> High screen cannot \
be rotated 3249<http://bugs.meego.com/show_bug.cgi?id=3249> Medium [REG] \
Theme doesn't update unless reboot system \
3224<http://bugs.meego.com/show_bug.cgi?id=3224> Medium [REG]go back icon \
display abnormal in sms forward application
Verified issues: 6 bugs (4 are high) are verified fixed:
2371<http://bugs.meego.com/show_bug.cgi?id=2371> High Virtual \
keyboard doesn't come up when clicking on text fields \
2454<http://bugs.meego.com/show_bug.cgi?id=2454> High System status \
On/Off buttons are shown with red blocks \
2456<http://bugs.meego.com/show_bug.cgi?id=2456> [SEC] High [REG] \
Mcontainer title could not show out correctly under meegite theme \
2613<http://bugs.meego.com/show_bug.cgi?id=2613> High [REG] Progress \
and spin indicator could not dynamically show out under meegite theme \
1428<http://bugs.meego.com/show_bug.cgi?id=1428> Medium Flicker behavior \
when scroll up/down the MList 1729<http://bugs.meego.com/show_bug.cgi?id=1729> \
Medium [REG] DUI home shows slowly after displaying black screen
Conclusions and Recommendations From QA
--------------------------------------
The image quality is bad and QA expect new handset images will be available next week \
with several critical bugs fixed. So that QA could proceed further testing and do bug \
verifications on new handset images.
Thanks
--Cathy
MeeGo Handset QA
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/private/meego-releases/attachments/20100623/2788b3a7/attachment-0001.html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic