[prev in list] [next in list] [prev in thread] [next in thread]
List: meego-releases
Subject: [meego-releases] MeeGo v1.1 Handset ww26.5 Test Report for Day One
From: cathy.li () intel ! com (Li, Cathy)
Date: 2010-06-25 13:47:15
Message-ID: B32E3D5F1713054290B4FF257B89C51A16E7FB017A () shsmsx502 ! ccr ! corp ! intel ! com
[Download RAW message or body]
Test Objective
--------------------------------------
This is regression testing cycle for handset DayOne release, which targets for \
providing a stable MeeGo Handset OS and compelling visual and system interaction, \
consistent and intuitive system interaction, as well as demonstrate a few reference \
applications on June 30th. Our regression test is based on change, we will do bug \
verification, and ensure no new regressions are brought about by changes. The test \
covers OS base (kernel, device driver), OS middleware (gfx, Ofono, connection \
manager, Bluetooth, package manager, tracker, context kit, sensor framework) and \
UX/key applications (MeeGo Touch Framework, system UI, Dialer, SMS, fennec browser, \
and photo viewer).
Build Location
---------------------------------------
Aava image with kernel-2.6.33
http://repo.meego.com/.mEeGo/builds/internal/1.0.80.8.20100624.1/handset/images/meego-handset-ia32-aava-mtf/
Test Environment
---------------------------------------
Hardware: Aava Koski DV1 and EV2
Test Coverage
---------------------------------------
Regression test
Bug verification
Test Result
---------------------------------------
Result Overview
Total TCs
Passed
Failed
Not testable (Blocked)
Run Rate
Pass rate of total
Pass rate of executed
UX/Applications: 296
208
50
38
87.2%
70.3%
80.6%
Quality Summary
Highlights:
? Good news is that the blocking REGRESSION bug that black screen of death after \
launching Dialer, SMS, mannequin (3444<http://bugs.meego.com/show_bug.cgi?id=3444>) \
is FIXED today.
? Another major progress we can see is that Photo viewer basically works with \
several high bugs (2926<http://bugs.meego.com/show_bug.cgi?id=2926> , \
3298<http://bugs.meego.com/show_bug.cgi?id=3298> , \
3371<http://bugs.meego.com/show_bug.cgi?id=3371>) got fixed and has improved visual \
effect.
? QT backend storage works fine as the major bug \
3396<http://bugs.meego.com/show_bug.cgi?id=3396> doesn't exist anymore. Lowlights:
? SMS basic functions almost does NOT work with some REGRESSION issues introduced, \
bugs (1492<http://bugs.meego.com/show_bug.cgi?id=1492>, \
3226<http://bugs.meego.com/show_bug.cgi?id=3226>, \
3392<http://bugs.meego.com/show_bug.cgi?id=3392>) are REOPENED..
? The blocking issue (3375<http://bugs.meego.com/show_bug.cgi?id=3375>) that unlock \
screen crashes X or causes systemui to crash still exists.
? The white screen issue (3289<http://bugs.meego.com/show_bug.cgi?id=3289>) still \
exists for system UI, and another major REGRESSION issue reoccurred that Wifi \
indicator not visible (3324<http://bugs.meego.com/show_bug.cgi?id=3324>).
Legend:
Low risk, most functions work well, minor bugs or limited normal bugs
Medium risk, main function work, normal bugs and limited major bugs
High risk, main functions loss, a few critical/major bugs
Components
Grading
Comments (Top Issues)
Notes
OS base
Kernel and device driver
236<http://bugzilla.meego.com/show_bug.cgi?id=236> - sound record not work
239<http://bugzilla.meego.com/show_bug.cgi?id=239> - [Aava]Camera driver fail to find \
the sensor devices 966<http://bugzilla.meego.com/show_bug.cgi?id=966> - [Aava][CDK] \
Wifi network with WEP security setting doesn't work (driver issue blocked some \
connectivity functional test) 2287<http://bugzilla.meego.com/show_bug.cgi?id=2287> - \
[Aava] [REG]USB OTG port doesn't work 2801 \
<http://bugzilla.meego.com/show_bug.cgi?id=2801> - [Aava] Battery driver reporting \
incorrect/incomplete information 2905<http://bugzilla.meego.com/show_bug.cgi?id=2905> \
- [Aava] Modem can not work in Aava koski device
All the issues are not DayOne blocker. Will be fixed in v1.1.
OS middleware
Gfx
2761<http://bugzilla.meego.com/show_bug.cgi?id=2761> - Serious graphics \
glitching/flickering exhibited during flash videos playback on YouTube website \
1334<http://bugzilla.meego.com/show_bug.cgi?id=1334> - Significant visible tearing in \
GL applications
DayOne won't fix them. Target for v1.1
Ofono
Basic functions work with phonesim
Connman
Some normal issues:
3378<http://bugs.meego.com/show_bug.cgi?id=3378> - Ethernet services state is wrong \
when network behind proxy 3395<http://bugs.meego.com/show_bug.cgi?id=3395> - ConnMan \
easily fail to connect to hidden WIFI services for the first time after reboot or \
disable/enable device
Normal issues, not critical enough for DayOne release blocker
Bluetooth
Basic commands (hciconfig, sdptool, hcitool and l2ping) and basic profiles work.
Tracker
1503<http://bugzilla.meego.com/show_bug.cgi?id=1503> - [REG]Can't view bmp&gif photos \
using meegophotos
Package manager(yum, rpm)
Basic functions work
Sensor framework
Basic functions work
UX/Applications
DUIhome/MeeGo Touch Framework/Theme
2185<http://bugs.meego.com/show_bug.cgi?id=2185> - Screen flickering and slow UI \
response in the first few seconds after launching libmeegotouch \
1757<http://bugs.meego.com/show_bug.cgi?id=1757> - Mess screen when start mcompositor \
3375<http://bugs.meego.com/show_bug.cgi?id=3375> - Unlock screen crashes X by tapping \
and drag lock icon or causes systemui to crash only by tapping lock icon
#1757ࢉ critical annoyance, not SS for ay1. Will be SS for 1.1.
Fennec (QT based)
2761<http://bugs.meego.com/show_bug.cgi?id=2761> - Serious graphics \
glitching/flickering exhibited during flash videos playback on YouTube website \
3452<http://bugs.meego.com/show_bug.cgi?id=3452> - QT Fennec doesn't recalculate \
scrolling size after orientation switching
#2761: not critical enough for DayOne release blocker
System UI
2801<http://bugs.meego.com/show_bug.cgi?id=2801> - [Aava] Battery driver reporting \
incorrect/incomplete information 3289<http://bugs.meego.com/show_bug.cgi?id=3289> - \
[REG] White screen shows instead drop down menu after tap the system UI \
3324<http://bugs.meego.com/show_bug.cgi?id=3324> - Wifi indicator not visible
#2801: not critical enough for DayOne release blocker
Dialer
3474<http://bugs.meego.com/show_bug.cgi?id=3474> - [REG]No dial button in call \
history,people,favorite panel 3475<http://bugs.meego.com/show_bug.cgi?id=3475> - \
Abnormal display of missed call notiifcation
New introduced
SMS
1492<http://bugs.meego.com/show_bug.cgi?id=1492> - Message history isn't saved
3226<http://bugs.meego.com/show_bug.cgi?id=3226> - [REG]Can not see message content
3392<http://bugs.meego.com/show_bug.cgi?id=3392> - [REG]Can not receive message
Virtual Keyboard
2645<http://bugs.meego.com/show_bug.cgi?id=2645> - corruption of text of VKB in input \
field
Photo viewer
3481<http://bugs.meego.com/show_bug.cgi?id=3481> - [Photo viewer]The contextual menu \
will be poped when click the "All" button in the title bar. \
3487<http://bugs.meego.com/show_bug.cgi?id=3487> - [Photo Viewer]There are two blank \
thumbnails at the end of the thumbnails list view
New introduced
Contacts
Several normal issues:
3170<http://bugs.meego.com/show_bug.cgi?id=3170> [SEC]- People: No way to return to \
People from SMS/Dialer/Email 3476<http://bugs.meego.com/show_bug.cgi?id=3476> - New \
added contact doesn't have icon
Normal issues, not critical enough for DayOne release blocker
Connectivity Applets
811<http://bugs.meego.com/show_bug.cgi?id=811> - Click Failure network in WIFI \
network list can crash Settings 3397<http://bugs.meego.com/show_bug.cgi?id=3397> - \
Wifi applet always shows the same networks many times
Connectivity Applets is not part of the expected POR for Day1. Only connecting to a \
netwrok is a requirement.
Control Panel
- Currently only WIFI applet works well in Control panel
- Look and Feel looks like only an example to show widgets
- For other items, they are all empty
Issue Summary
--------------------------------------
Key Issues:
Bugs accepted to be Handset_DayOne_Release_Blocker: \
http://bugs.meego.com/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=Handset_DayOne_BlockerApproved&sharer_id=43
Open high bugs on Handset: \
http://bugs.meego.com/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=handheld_open_high&sharer_id=43
New issues: 11 new bugs (3 high) are reported, 3 are REGRESSION issues:
3472<http://bugs.meego.com/show_bug.cgi?id=3472> High [REG] Dialer \
application will quit if user reject an incoming call in call history panel \
3474<http://bugs.meego.com/show_bug.cgi?id=3474> High [REG]No dial \
button in call history,people,favorite panel \
3481<http://bugs.meego.com/show_bug.cgi?id=3481> High [Photo \
viewer]The contextual menu will be poped when click the "All" button in the title bar \
3475<http://bugs.meego.com/show_bug.cgi?id=3475> Medium Abnormal display of \
missed call notiifcation 3482<http://bugs.meego.com/show_bug.cgi?id=3482> \
Medium [REG] X crashes and then restarts after updating meego reference theme to \
Plankton theme 3484<http://bugs.meego.com/show_bug.cgi?id=3484> Medium Icons \
on task bar don't appear simultaneously after system booting to home screen \
3476<http://bugs.meego.com/show_bug.cgi?id=3476> Medium New added contact \
doesn't have icon 3479<http://bugs.meego.com/show_bug.cgi?id=3479> Medium \
Contacts app doesn't verify the format of new added email \
3480<http://bugs.meego.com/show_bug.cgi?id=3480> Medium fennec-meego-theme] \
Go and Reload icon image is poorly visible on MeeGo dark background color \
3494<http://bugs.meego.com/show_bug.cgi?id=3494> Medium [fennec-meego-theme] \
Difficult to interact with Autocomplete panel with VKB in place \
3487<http://bugs.meego.com/show_bug.cgi?id=3487> Medium [Photo Viewer]There \
are two blank thumbnails at the end of the thumbnails list view
Verified fixed issues: 19 bugs (10 are high) are verified fixed: \
http://bugs.meego.com/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=verified_fixed_0624&sharer_id=43
2453<http://bugs.meego.com/show_bug.cgi?id=2453> High [REG]Missing \
the send button in sms 2777<http://bugs.meego.com/show_bug.cgi?id=2777> High \
QT Fennec failed to play page embedded flash videos on Intel and Sina web portal \
2926<http://bugs.meego.com/show_bug.cgi?id=2926> High [REG] \
[Photo]The upper title bar is not hidden in slide show mode \
3190<http://bugs.meego.com/show_bug.cgi?id=3190> High [REG] Segment \
fault when pressing exit button from sms application \
3298<http://bugs.meego.com/show_bug.cgi?id=3298> High No icon for \
the photo viewer shortcut in app launcher \
3371<http://bugs.meego.com/show_bug.cgi?id=3371> High \
meego-handset-photos launcher icon does nothing \
3382<http://bugs.meego.com/show_bug.cgi?id=3382> High [REG]call \
history information is not saved 3390<http://bugs.meego.com/show_bug.cgi?id=3390> \
High [REG]Can not see any contact information in sms \
3436<http://bugs.meego.com/show_bug.cgi?id=3436> High \
fennec-qt-branding-meego package is not pre-installed in image \
3443<http://bugs.meego.com/show_bug.cgi?id=3443> High Most GUI \
components can NOT be shown for contacts
Reopened issues:
1492<http://bugs.meego.com/show_bug.cgi?id=1492> High Message \
history isn't saved 3226<http://bugs.meego.com/show_bug.cgi?id=3226> High \
[REG]Can not see message content 3392<http://bugs.meego.com/show_bug.cgi?id=3392> \
High [REG]Can not receive message \
3324<http://bugs.meego.com/show_bug.cgi?id=3324> High Wifi indicator \
not visible
Conclusions and Recommendations From QA
--------------------------------------
> From QA perspective, the image quality improves a lot with several blocking issues \
> fixed. The biggest issue is SMS almost does not work, pls. fix the related release \
> blockers ASAP.
Thanks
--Cathy
MeeGo Handset QA
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/private/meego-releases/attachments/20100625/5a851cab/attachment-0001.html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic