[prev in list] [next in list] [prev in thread] [next in thread] 

List:       ltp-list
Subject:    [LTP]  Broken Test-Cases List
From:       Subrata Modak <subrata () linux ! vnet ! ibm ! com>
Date:       2007-09-10 9:22:13
Message-ID: 1189415413.4742.11.camel () subratamodak ! linux ! ibm ! com
[Download RAW message or body]

Hi,

We have been hearing some couple of fuming faces for LTPś Broken Test
cases, commonly known as false positives. Yes there are hundreds of such
Test cases which has not been updated for quite some time. So, the
functionality they test may have undergone changes during that period.
Hence, we need to revisit/rework the way they report PASS or FAIL.
Following is attached an initial set of Test cases, which according to
jmtt@us.ibm.com reports false positives. Our aim is to make this as
comprehensive as we can and then swiftly act upon these erring test
cases before they loose their value. I would request you to add your
entries to this list (as well as the reasons/observations/conditions for
which they report false positives). We would work out to include fixes
for them.

--Regards--
Subrata



["LTP_Broken_Testcases.txt" (LTP_Broken_Testcases.txt)]

****************************************************************************************************************************
                
* 			Test-Case Type			*					Broken-Issue(s)										*
****************************************************************************************************************************
 |	fcntl17							|		attempt to signal child failed											|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	fsync							|		took too long														|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	gettimeofday						|		is going backwards													|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	gf18							|																		|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	mlockall							|																		|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	msg								|call failed - erro=28 (note: after you get error 28 or 'device out of \
space, you'll get tons| |									|and tons of msg* error msgs that are safe to \
ignore. I think this tends to happen only     | |									| when swap is less than \
                2*ram, and perhaps only on RHEL)						|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	nanosleep						|remaining time doesn't match foo 											|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	pselect							|sleep time was incorrect													|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	syslog							|ailed to log msgs of all levels													|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	capset02 						|BROK Unexpected signal 15 received(matrix issue 1234 - if you see \
this, please mark as| |									| PASS, but attach the issue to help establish \
                trends)								|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	getsid02							|																		|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	ioperm							|																		|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	setpgid							|expect EACCES got 1 (21134 mention, ltp SF bug 1114033)						|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	shmctl01							|FAIL : # of attaches is incorrect												|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	shmget02						|FAIL: call succeeded unexpectedly 											|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	socket							|																		|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	syslogd							|no such command (21068 - diff failure than the historical)							|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------
 |	vmsplice01						|1 FAIL : vmsplice() Failed, errno=38											|
-------------------------------------------------------------------------------------- \
---------------------------------------------------------------------------------------




-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/

_______________________________________________
Ltp-list mailing list
Ltp-list@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ltp-list


[prev in list] [next in list] [prev in thread] [next in thread]