[prev in list] [next in list] [prev in thread] [next in thread] 

List:       woden-dev
Subject:    Violated Assertions added to TestMetadata.xml
From:       Arthur Ryman <ryman () ca ! ibm ! com>
Date:       2006-05-31 14:57:17
Message-ID: OFDFAFBECC.B23105C6-ON8525717F.00503FF6-8525717F.00522D80 () ca ! ibm ! com
[Download RAW message or body]

--=_alternative 005164208525717F_=
Content-Type: text/plain; charset="US-ASCII"

WSDL 2.0 Implementors,

I updated the WSDL 2.0 test suite to indicate indicate the violated 
assertion for bad documents. This info is in both the documentation 
element of the WSDL and the TestMetadata.xml file, e.g. 

<?xml version="1.0"?>
<TestMetadata xmlns="http://www.w3.org/2006/02/wsdl/TestMetadata">
        <Identifier>
 http://dev.w3.org/cvsweb/2002/ws/desc/test-suite/documents/bad/Import-1B
        </Identifier>
        <Title>Bad Document Import-1B</Title>
        <Purpose></Purpose>
        <Description></Description>
        <Status>accepted</Status>
        <SpecRef></SpecRef>
        <Preconditions>none</Preconditions>
        <Inputs>XSDImport.wsdl</Inputs>
        <ExpectedResults>
                <Successful>false</Successful>
                <ViolatesAssertion>Schema-0016</ViolatesAssertion>
        </ExpectedResults>
        <Version>1.0</Version>
        <Contributor>
                <Name>Lawrence Mandel</Name>
                <Affiliation>IBM</Affiliation>
                <EMail>lmandel@ca.ibm.com</EMail>
        </Contributor>
        <Rights>
http://www.w3.org/Consortium/Legal/2002/copyright-documents-20021231</
Rights>
        <Grouping>/documents/bad</Grouping>
        <SeeAlso><Reference>http://www.w3.org/TR/wsdl20#Schema-0016</
Reference></SeeAlso>
</TestMetadata>

I plan to update the Woden Ant task to write out a report of the failed 
assertions and then compare it to the expected assertions. 

Note that good test cases might also violate non-mandatory assertions. 
Those would correspond to warnings, not errors. We need some of these 
added to the test suite.

I also plan to generate a coverage report so we can see how many test 
cases exists for each assertion in the spec. We clearly need to write a 
lot more test cases.

Arthur Ryman,
IBM Software Group, Rational Division

blog: http://ryman.eclipsedevelopersjournal.com/
phone: +1-905-413-3077, TL 969-3077
assistant: +1-905-413-2411, TL 969-2411
fax: +1-905-413-4920, TL 969-4920
mobile: +1-416-939-5063, text: 4169395063@fido.ca
--=_alternative 005164208525717F_=
Content-Type: text/html; charset="US-ASCII"


<br><font size=2 face="sans-serif">WSDL 2.0 Implementors,</font>
<br>
<br><font size=2 face="sans-serif">I updated the WSDL 2.0 test suite to
indicate indicate the violated assertion for bad documents. This info is
in both the documentation element of the WSDL and the TestMetadata.xml
file, e.g. </font>
<br>
<br><font size=2 color=#008080 face="Courier New">&lt;?</font><font size=2 \
color=#3f8080 face="Courier New">xml </font><font size=2 color=#800080 face="Courier \
New">version</font><font size=2 face="Courier New">=</font><font size=2 color=#4200ff \
face="Courier New">&quot;1.0&quot;</font><font size=2 color=#008080 face="Courier \
New">?&gt;</font> <br><font size=2 color=#008080 face="Courier New">&lt;</font><font \
size=2 color=#3f8080 face="Courier New">TestMetadata </font><font size=2 \
color=#800080 face="Courier New">xmlns</font><font size=2 face="Courier \
New">=</font><font size=2 color=#4200ff face="Courier \
New">&quot;http://www.w3.org/2006/02/wsdl/TestMetadata&quot;</font><font size=2 \
color=#008080 face="Courier New">&gt;</font> <br><font size=2 face="Courier \
New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 color=#008080 face="Courier \
New">&lt;</font><font size=2 color=#3f8080 face="Courier New">Identifier</font><font \
size=2 color=#008080 face="Courier New">&gt;</font> <br><font size=2 face="Courier \
New">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; \
http://dev.w3.org/cvsweb/2002/ws/desc/test-suite/documents/bad/Import-1B</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Identifier</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;</font><font size=2 color=#3f8080 face="Courier \
New">Title</font><font size=2 color=#008080 face="Courier New">&gt;</font><font \
size=2 face="Courier New">Bad Document Import-1B</font><font size=2 color=#008080 \
face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Title</font><font size=2 color=#008080 face="Courier New">&gt;</font> <br><font \
size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;</font><font size=2 color=#3f8080 face="Courier \
New">Purpose</font><font size=2 color=#008080 face="Courier \
New">&gt;&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Purpose</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;</font><font size=2 color=#3f8080 face="Courier \
New">Description</font><font size=2 color=#008080 face="Courier \
New">&gt;&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Description</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;</font><font size=2 color=#3f8080 face="Courier \
New">Status</font><font size=2 color=#008080 face="Courier New">&gt;</font><font \
size=2 face="Courier New">accepted</font><font size=2 color=#008080 face="Courier \
New">&lt;/</font><font size=2 color=#3f8080 face="Courier New">Status</font><font \
size=2 color=#008080 face="Courier New">&gt;</font> <br><font size=2 face="Courier \
New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 color=#008080 face="Courier \
New">&lt;</font><font size=2 color=#3f8080 face="Courier New">SpecRef</font><font \
size=2 color=#008080 face="Courier New">&gt;&lt;/</font><font size=2 color=#3f8080 \
face="Courier New">SpecRef</font><font size=2 color=#008080 face="Courier \
New">&gt;</font> <br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; \
</font><font size=2 color=#008080 face="Courier New">&lt;</font><font size=2 \
color=#3f8080 face="Courier New">Preconditions</font><font size=2 color=#008080 \
face="Courier New">&gt;</font><font size=2 face="Courier New">none</font><font size=2 \
color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Preconditions</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;</font><font size=2 color=#3f8080 face="Courier \
New">Inputs</font><font size=2 color=#008080 face="Courier New">&gt;</font><font \
size=2 face="Courier New">XSDImport.wsdl</font><font size=2 color=#008080 \
face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Inputs</font><font size=2 color=#008080 face="Courier New">&gt;</font> <br><font \
size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;</font><font size=2 color=#3f8080 face="Courier \
New">ExpectedResults</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; \
&nbsp; </font><font size=2 color=#008080 face="Courier New">&lt;</font><font size=2 \
color=#3f8080 face="Courier New">Successful</font><font size=2 color=#008080 \
face="Courier New">&gt;</font><font size=2 face="Courier New">false</font><font \
size=2 color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 \
face="Courier New">Successful</font><font size=2 color=#008080 face="Courier \
New">&gt;</font> <br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; \
&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 color=#008080 face="Courier \
New">&lt;</font><font size=2 color=#3f8080 face="Courier \
New">ViolatesAssertion</font><font size=2 color=#008080 face="Courier \
New">&gt;</font><font size=2 face="Courier New">Schema-0016</font><font size=2 \
color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">ViolatesAssertion</font><font size=2 color=#008080 face="Courier \
New">&gt;</font> <br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; \
</font><font size=2 color=#008080 face="Courier New">&lt;/</font><font size=2 \
color=#3f8080 face="Courier New">ExpectedResults</font><font size=2 color=#008080 \
face="Courier New">&gt;</font> <br><font size=2 face="Courier New">&nbsp; &nbsp; \
&nbsp; &nbsp; </font><font size=2 color=#008080 face="Courier New">&lt;</font><font \
size=2 color=#3f8080 face="Courier New">Version</font><font size=2 color=#008080 \
face="Courier New">&gt;</font><font size=2 face="Courier New">1.0</font><font size=2 \
color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Version</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;</font><font size=2 color=#3f8080 face="Courier \
New">Contributor</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; \
&nbsp; </font><font size=2 color=#008080 face="Courier New">&lt;</font><font size=2 \
color=#3f8080 face="Courier New">Name</font><font size=2 color=#008080 face="Courier \
New">&gt;</font><font size=2 face="Courier New">Lawrence Mandel</font><font size=2 \
color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Name</font><font size=2 color=#008080 face="Courier New">&gt;</font> <br><font \
size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; \
</font><font size=2 color=#008080 face="Courier New">&lt;</font><font size=2 \
color=#3f8080 face="Courier New">Affiliation</font><font size=2 color=#008080 \
face="Courier New">&gt;</font><font size=2 face="Courier New">IBM</font><font size=2 \
color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Affiliation</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; \
&nbsp; </font><font size=2 color=#008080 face="Courier New">&lt;</font><font size=2 \
color=#3f8080 face="Courier New">EMail</font><font size=2 color=#008080 face="Courier \
New">&gt;</font><font size=2 face="Courier New">lmandel@ca.ibm.com</font><font size=2 \
color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">EMail</font><font size=2 color=#008080 face="Courier New">&gt;</font> <br><font \
size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Contributor</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 \
color=#008080 face="Courier New">&lt;</font><font size=2 color=#3f8080 face="Courier \
New">Rights</font><font size=2 color=#008080 face="Courier New">&gt;</font><font \
size=2 face="Courier \
New">http://www.w3.org/Consortium/Legal/2002/copyright-documents-20021231</font><font \
size=2 color=#008080 face="Courier New">&lt;/</font><font size=2 color=#3f8080 \
face="Courier New">Rights</font><font size=2 color=#008080 face="Courier \
New">&gt;</font> <br><font size=2 face="Courier New">&nbsp; &nbsp; &nbsp; &nbsp; \
</font><font size=2 color=#008080 face="Courier New">&lt;</font><font size=2 \
color=#3f8080 face="Courier New">Grouping</font><font size=2 color=#008080 \
face="Courier New">&gt;</font><font size=2 face="Courier \
New">/documents/bad</font><font size=2 color=#008080 face="Courier \
New">&lt;/</font><font size=2 color=#3f8080 face="Courier New">Grouping</font><font \
size=2 color=#008080 face="Courier New">&gt;</font> <br><font size=2 face="Courier \
New">&nbsp; &nbsp; &nbsp; &nbsp; </font><font size=2 color=#008080 face="Courier \
New">&lt;</font><font size=2 color=#3f8080 face="Courier New">SeeAlso</font><font \
size=2 color=#008080 face="Courier New">&gt;&lt;</font><font size=2 color=#3f8080 \
face="Courier New">Reference</font><font size=2 color=#008080 face="Courier \
New">&gt;</font><font size=2 face="Courier \
New">http://www.w3.org/TR/wsdl20#Schema-0016</font><font size=2 color=#008080 \
face="Courier New">&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">Reference</font><font size=2 color=#008080 face="Courier \
New">&gt;&lt;/</font><font size=2 color=#3f8080 face="Courier \
New">SeeAlso</font><font size=2 color=#008080 face="Courier New">&gt;</font> \
<br><font size=2 color=#008080 face="Courier New">&lt;/</font><font size=2 \
color=#3f8080 face="Courier New">TestMetadata</font><font size=2 color=#008080 \
face="Courier New">&gt;</font> <br><font size=2 face="sans-serif"><br>
I plan to update the Woden Ant task to write out a report of the failed
assertions and then compare it to the expected assertions. </font>
<br>
<br><font size=2 face="sans-serif">Note that good test cases might also
violate non-mandatory assertions. Those would correspond to warnings, not
errors. We need some of these added to the test suite.</font>
<br>
<br><font size=2 face="sans-serif">I also plan to generate a coverage report
so we can see how many test cases exists for each assertion in the spec.
We clearly need to write a lot more test cases.</font>
<br>
<br><font size=2 face="sans-serif">Arthur Ryman,<br>
IBM Software Group, Rational Division<br>
<br>
blog: http://ryman.eclipsedevelopersjournal.com/<br>
phone: +1-905-413-3077, TL 969-3077<br>
assistant: +1-905-413-2411, TL 969-2411<br>
fax: +1-905-413-4920, TL 969-4920<br>
mobile: +1-416-939-5063, text: 4169395063@fido.ca</font>
--=_alternative 005164208525717F_=--


[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic