'[meego-releases] FW: [meego-dist] [Moblin] MeeGo Handset Sanity'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       meego-releases
Subject:    [meego-releases] FW: [meego-dist] [Moblin] MeeGo Handset Sanity
From:       may.xie () intel ! com (Xie, May)
Date:       2010-06-23 7:42:30
Message-ID: F2E9EB7348B8264F86B6AB8151CE2D7916AFE9A767 () shsmsx502 ! ccr ! corp ! intel ! com
[Download RAW message or body]

FYI - Sanity Test report from Intel MeeGo QA.
________________________________
From: meego-dist-bounces@linux.intel.com [mailto:meego-dist-bounces at \
                linux.intel.com] On Behalf Of Fu, Yi
Sent: Tuesday, June 22, 2010 3:51 PM
To: moblin at linux.intel.com; meego-dist at linux.intel.com
Cc: Ferron, Chris E; Van De Ven, Arjan
Subject: [meego-dist] [Moblin] MeeGo Handset Sanity Test Report -20100622

Test Objective
-----------------------
Sanity test is a very brief run-through of the functionality of the entire MeeGo \
distribution, to assure that the basic health of the distribution and report major \
regressions at the earliest time. All the checkpoints in sanity test reflects the \
most important and basic functionalities of the distribution.

Know more about sanity test @ http://moblin.intel.com/wiki/Handset_Sanity_Test

Quality Summary
---------------------------

l  Sanity test image is created from daily repository.

l  The image can successfully boot to DUI home. But the Bluetooth and \
volumn/time/data/phone setting mode is removed from system setting and audio player \
application is not in the image. All the related test cases are not testable.

l  Performance data:

Boot time: 41 s

Videoplayer start time:6.4 s

Browser start time: 9.5 s

The audio player application doesn?t in the image. The other performance data like \
bootchart, memory footprint collection blocked due to bug \
2287<http://bugs.meego.com/show_bug.cgi?id=2287>.

l  Of all the 46 check points that we defined in sanity test:
         Executable rate: 76.09%(35 executable against 46 total)
         Pass rate: 40% (14 passed against 35 executable)

Major issues:
---------------------------
Top issues:
Bug 2287<http://bugs.meego.com/show_bug.cgi?id=2287> - [Aava] [REG]USB OTG port \
doesn't work Bug 2600<http://bugs.meego.com/show_bug.cgi?id=2600> - [REG] No response \
when clicking application home button the second time Bug \
2645<http://bugs.meego.com/show_bug.cgi?id=2645> - corruption of text of VKB in input \
field Bug 3289<http://bugs.meego.com/show_bug.cgi?id=3289> - [REG] White screen shows \
instead drop down menu after tap the system UI Bug \
3290<http://bugs.meego.com/show_bug.cgi?id=3290> - [REG] [Photo viewer]No application \
icons showed in the photo viewer screen Bug \
3293<http://bugs.meego.com/show_bug.cgi?id=3293> - [REG] People, dialer and sms \
application can Not star

Platform
---------------------------
Aava Koski DV1

Detail
---------------------------
Category

Details

Test Results

Comments

Create Image

*  Create image with MIC2

Pass

?

System startup

*  Image Boot from SD card

Pass

Home screen

*  Check if core applications* (Dialer, SMS, fennec browser, photo viewer, audio \
player, video player, contacts, email, Terminal) can be launched from app-launcher

Fail

?Bug 3293<http://bugs.meego.com/show_bug.cgi?id=3293> - [REG] People, dialer and sms \
application can Not star

*  switch between different applications

Fail

?Bug 2600<http://bugs.meego.com/show_bug.cgi?id=2600> - [REG] No response when \
clicking application home button the second time

*  Check home screen theme and layout

Blocked

?Bug 3297<http://bugs.meego.com/show_bug.cgi?id=3297> - [REG] Missing widgets gallery \
application

*  Display orientation detection

Pass

?

Fennec browser


*Open 2 tabs to surf 2 websites contains flash plugin
Referenced websites:
Flash plugin:
http://www.adobe.com/flashplatform/  \
http://www.intel.com/consumer/index.htm?iid=gg_play+home_consumer Chinese websites:
http://www.sina.com.cn
http://www.taobao.com
Web applications :
http://mail.google.com/
http://mail.yahoo.com/
http://maps.google.com/

Pass

?







*  Check browser GUI widgets and windows layout

Pass

?

*  Browsing website over wifi (open & secured), 3G, GPRS & EDGE
(3G, GPRS & EDGE cannot be covered until real modem is supported)

Pass

?

Dialer

*  Dial one outgoing call, accept by other party, terminate this call (phonesim, GSM \
& WCDMA) (GSM and WCDMA cannot be covered until real modem supported,Will use \
phonesim to test before real modem support)

Blocked

?Bug 3293<http://bugs.meego.com/show_bug.cgi?id=3293> - [REG] People, dialer and sms \
application can Not star ?
?
?
?
?
?
?

*  Receive a call, accept the call, terminate this call (phonesim, GSM & WCDMA) (GSM \
and WCDMA cannot be covered until real modem supported,Will use phonesim to test \
before real modem support)

Blocked

*  Receive one call, reject this call without accepting the call(phonesim, GSM & \
WCDMA)(GSM and WCDMA cannot be covered until real modem supported,Will use phonesim \
to test before real modem support)

Blocked

*  Display PhoneBook

Blocked

*  Check call history

Blocked

SMS

*  Send SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem \
supported,Will use phonesim to test before real modem support)

Blocked

 * Receive SMS ( phonesim, 2G & 3G ) (2G and 3G cannot be covered until real modem \
supported,Will use phonesim to test before real modem support)

Blocked

*  Check message history (received, sent, draft)

Blocked

Applets

*  Add/remove weather/stock/news applet on applet library

Blocked

?Bug 3297<http://bugs.meego.com/show_bug.cgi?id=3297> - [REG] Missing widgets gallery \
application

Connectivity

*  scan wifi, check wifi connection (open/wep/wpa) and disconnection

Fail

?Bug 966<http://bugs.meego.com/show_bug.cgi?id=966> - [Aava][CDK] Wifi network with \
WEP security setting doesn't work

*  Browse website and download some files through wifi

Pass

?

*  check if wifi On/Off works

Pass

?

*  check bluetooth connection (pairing and connect to bluetooth handset)

N/A

?

*  check if bluetooth On/Off works

N/A

?

*  Connect device to computer with usb cable, check the usb mass storage device is \
detected by computer

Blocked

?
?Bug 2287<http://bugs.meego.com/show_bug.cgi?id=2287> - [Aava] [REG]USB OTG port \
doesn't work

*  Check sshd connection: connect board using usb gadget

Blocked

Run time status/Settings/Control Panel

*  Check if runtime status are correct on tiny toolbar/runtime status panel

Fail

?Bug 3300<http://bugs.meego.com/show_bug.cgi?id=3300> - Not showing correct battery \
charge status if not charge battery Bug \
3289<http://bugs.meego.com/show_bug.cgi?id=3289> - [REG] White screen shows instead \
drop down menu after tap the system UI

*  Check if volume could be adjusted

N/A

?

*  Check if time/date could be updated

N/A

?

*  Check if phone setting mode (offline, etc) could be updated

N/A

?

Virtual keyboard

*  Check if virtual keyboard can be launched automatically with apps which  need \
input text field (fennec, SMS)

Pass

?

*  Support text input

Fail

?Bug 2645<http://bugs.meego.com/show_bug.cgi?id=2645> - corruption of text of VKB in \
input field

Photo viewer

*  Check if the UI is correct (top bar, menu, button, etc.)

Blocked

?Bug 3290<http://bugs.meego.com/show_bug.cgi?id=3290> - [REG] [Photo viewer]No \
application icons showed in the photo viewer screen ?
?

*  Check if photo thumbnail index works

Blocked

*  Check if photo could be played

Blocked

Audio

*  Check if the UI is correct (top bar, menu, button, play queue etc.)

N/A

?

*  Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker (play music \
by command line if audio player is not ready. aplay to play music file)

N/A

Video

*  Check if the UI is correct (top bar, menu, button, play queue etc.)

Pass

*  Check if video thumbnail index works

Pass

?

*  Check if video could be played (MP4, WMV &  3GP-H264)

Pass

?

Contacts

*  Check if it works with dialer, SMS

Blocked

?Bug 3293<http://bugs.meego.com/show_bug.cgi?id=3293> - [REG] People, dialer and sms \
application can Not star

Security & Power

*  Check PIN activation/deactivation (Need GUI support)

N/A

?

*  PIN requested at boot

N/A

?

*  Power Off / Power On

Pass

?

Touchscreen

*  Use touch screen to operate the system

Pass

?

VOIP

* Outgoing VOIP call

N/A

?

* Incoming VOIP call

N/A

?


Best Regards
Yi

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.meego.com/private/meego-releases/attachments/20100623/41710f2a/attachment-0001.html>
                
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: ATT00001..txt
URL: <http://lists.meego.com/private/meego-releases/attachments/20100623/41710f2a/attachment-0001.txt>



[prev in list] [next in list] [prev in thread] [next in thread]
Configure | About | News | Add a list | Sponsored by KoreLogic