[prev in list] [next in list] [prev in thread] [next in thread]
List: wsf-java-dev
Subject: Re: [Dev] Running G-Reg integrations tests with different DB config
From: Krishantha Samaraweera <krishantha () wso2 ! com>
Date: 2013-08-30 5:14:42
Message-ID: CACzzCr+0nwBuTJmq3mWNTKDC9-EMD0UfbN0wRwzzt-i9D5QFxQ () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
I think all G-Reg tests are stable now. It's better to do the $subject for
RC5 packs.
Also testing mounted G-Reg instance using integration tests is possible,
you have to follow the same steps mentioned.
In this way you can test mounted G-Reg instance with different DB
configurations as well.
Thanks,
Krishantha.
On Mon, Aug 26, 2013 at 3:16 PM, Nuwan Wimalasekara <nuwanw@wso2.com> wrote:
> All the test is passed in tests-new module now and it contains bellow
> packages
> org.wso2.carbon.registry.app.test
> org.wso2.carbon.registry.subscription.test
>
> Tests run: 213, Failures: 0, Errors: 0, Skipped: 0
>
> Disabled one test class since it leads to make other tests fail. Refer
> JIRA [1]
>
> [1] https://wso2.org/jira/browse/REGISTRY-1818
>
> Thanks,
> Nuwanw
>
>
> On Sun, Aug 25, 2013 at 8:28 AM, Nuwan Wimalasekara <nuwanw@wso2.com>wrote:
>
>> Fixed the test execution flow of all the registry tests modules by
>> downgrading the testng version and setting parallel test false in pomfiles.
>> in next reports we have to investigate the failures to ensure whether it
>> is test failure or greg issue.
>>
>> It is better to have alwaysRun = true in BeforeClass( @BeforeClass(
>> alwaysRun = true) ) and AfterClass methods to make sure It is running
>> always.
>> I added it to some classes.
>>
>>
>> On Thu, Aug 22, 2013 at 5:22 PM, Krishantha Samaraweera <
>> krishantha@wso2.com> wrote:
>>
>>> Hi Ajith,
>>>
>>> Can you list down the modules which have this problem
>>>
>>> Thanks,
>>> Krishantha.
>>>
>>>
>>> On Thu, Aug 22, 2013 at 11:20 AM, Ajith Vitharana <ajithn@wso2.com>wrote:
>>>
>>>> +1. But we are observing weird behavior in the test framework (may be
>>>> TestNG issue) even with the default pack. The main problem is test
>>>> framework load all the test cases in all the packages and execute randomly.
>>>> This makes the different results at each time we run all the tests
>>>> together.
>>>>
>>>> Thanks
>>>> Ajith.
>>>>
>>>>
>>>> On Thu, Aug 22, 2013 at 11:06 AM, Krishantha Samaraweera <
>>>> krishantha@wso2.com> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I think we can easily run G-Reg integration test with different DB
>>>>> configs. We have to get G-Reg pack and edit DB configs, then compress
>>>>> it and put it to the correct location and execute tests.
>>>>>
>>>>> We can generate a pack with all integration tests and point and run
>>>>> but, but all test cases depends on the run time configuration changes will
>>>>> be skipped, To get the full benefit of automated tests I highly recommend
>>>>> to run the tests on the branch.
>>>>>
>>>>> Thanks,
>>>>> Krishantha.
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Ajith Vitharana.
>>>> WSO2 Inc. - http://wso2.org
>>>> Email : ajithn@wso2.com
>>>> Mobile : +94772217350
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>> Nuwan Wimalasekara
>> Senior Software Engineer - Test Automation
>> WSO2, Inc.: http://wso2.com
>> lean. enterprise. middleware
>>
>> phone: +94 71 668 4620
>>
>>
>>
>>
>
>
> --
> Nuwan Wimalasekara
> Senior Software Engineer - Test Automation
> WSO2, Inc.: http://wso2.com
> lean. enterprise. middleware
>
> phone: +94 71 668 4620
>
>
>
>
[Attachment #5 (text/html)]
<div dir="ltr">I think all G-Reg tests are stable now. It's better to do the \
$subject for RC5 packs.<div><br></div><div style>Also testing mounted G-Reg instance \
using integration tests is possible, you have to follow the same steps \
mentioned.</div> <div style><br></div><div style> In this way you can test mounted \
G-Reg instance with different DB configurations as well.</div><div \
style><br></div><div style>Thanks,<br><span class="GINGER_SOFATWARE_noSuggestion \
GINGER_SOFATWARE_correct">Krishantha</span>.</div> </div><div \
class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Aug 26, 2013 at 3:16 PM, \
Nuwan Wimalasekara <span dir="ltr"><<a href="mailto:nuwanw@wso2.com" \
target="_blank">nuwanw@wso2.com</a>></span> wrote:<br> <blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">All the test is passed in tests-new module now \
and it contains bellow \
packages<div><span>org</span><span>.</span>wso2<span>.</span>carbon<span>.</span>registry<span>.</span>app<span>.</span>test</div>
<div><span>org</span><span>.</span>wso2<span>.</span>carbon<span>.</span>registry<span>.</span>subscription<span>.</span>test</div>
<div><br></div><div>Tests run: 213, Failures: 0, Errors: 0, Skipped: \
0<br></div><div><br></div><div><span>Disabled</span> one test class since it leads to \
make <span>other</span> tests fail. Refer JIRA [1]</div> <div><br></div><div>[1] <a \
href="https://wso2.org/jira/browse/REGISTRY-1818" \
target="_blank">https://wso2.org/jira/browse/REGISTRY-1818</a></div><div><br></div><div>Thanks,</div><div><span><span>Nuwanw</span></span></div>
</div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><br><div \
class="gmail_quote">On Sun, Aug 25, 2013 at 8:28 AM, Nuwan Wimalasekara <span \
dir="ltr"><<a href="mailto:nuwanw@wso2.com" \
target="_blank">nuwanw@wso2.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">Fixed the test execution flow of all the \
registry tests modules by downgrading the <span>testng</span> version and setting \
parallel test <span>false</span> in <span>pom</span> files. <span>in</span> next \
reports we have to investigate the failures to ensure whether it is test failure or \
<span>greg</span> issue. <div>
<br></div><div>It is better to have <span>alwaysRun</span> = true in \
BeforeClass<span>(</span> @BeforeClass<span>(</span><span>alwaysRun</span> = true) ) \
and AfterClass methods to make sure It is running always.</div> <div>I added it to \
some classes.</div></div><div class="gmail_extra"><br><br><div \
class="gmail_quote"><div><div>On Thu, Aug 22, 2013 at 5:22 PM, Krishantha Samaraweera \
<span dir="ltr"><<a href="mailto:krishantha@wso2.com" \
target="_blank">krishantha@wso2.com</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex"><div><div><div dir="ltr"><span></span>Hi \
Ajith,<span></span><div><br>Can you list down the modules which have this \
problem</div>
<div>
<br></div><div>Thanks,<br><span>Krishantha</span>.</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote"><div>On Thu, Aug 22, \
2013 at 11:20 AM, Ajith Vitharana <span dir="ltr"><<a \
href="mailto:ajithn@wso2.com" target="_blank">ajithn@wso2.com</a>></span> \
wrote:<br>
</div><div><div><blockquote class="gmail_quote" style="margin:0 0 0 \
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">+1. But we are \
observing weird behavior in the test framework (may be <span>TestNG</span> issue) \
even with the default pack. The main problem is test framework load all the test \
cases in all the packages and execute randomly.<div>
This makes the different results at each time we run all the tests \
together.<br><div><br></div><div>Thanks</div></div><div>Ajith.</div></div><div \
class="gmail_extra"><div><div><br><br><div class="gmail_quote"> On Thu, Aug 22, 2013 \
at 11:06 AM, Krishantha Samaraweera <span dir="ltr"><<a \
href="mailto:krishantha@wso2.com" target="_blank">krishantha@wso2.com</a>></span> \
wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex"><div dir="ltr"><span></span>Hi \
All,<span></span><div><br></div><div>I think we can easily run G-Reg integration test \
with different DB <span>configs</span>. We have to get G-Reg pack and edit DB \
<span>configs</span>, then compress it and put it to the correct location and execute \
tests.</div>
<div><br></div><div>We can generate a pack with all integration tests and point and \
run but, but all test cases depends on the run time configuration changes will be \
skipped, To get the full benefit of automated tests I highly recommend to run the \
tests on the branch.</div>
<div><br></div><div>Thanks,<br><span>Krishantha</span>.</div></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span><font \
color="#888888">-- <br><div dir="ltr">Ajith Vitharana.<div><span \
style="font-size:x-small">WSO2 Inc. - </span><a href="http://wso2.org" \
style="font-size:x-small" target="_blank">http://wso2.org</a><br>
</div><div><font size="1">Email : <a href="mailto:ajithn@wso2.com" \
target="_blank">ajithn@wso2.com</a><br>Mobile : <a href="tel:%2B94772217350" \
value="+94772217350" target="_blank">+94772217350</a></font><br><br></div>
</div>
</font></span></div>
</blockquote></div></div></div><br></div>
<br></div></div><div>_______________________________________________<br>
Dev mailing list<br>
<a href="mailto:Dev@wso2.org" target="_blank">Dev@wso2.org</a><br>
<a href="http://wso2.org/cgi-bin/mailman/listinfo/dev" \
target="_blank">http://wso2.org/cgi-bin/mailman/listinfo/dev</a><br> \
<br></div></blockquote></div><div><br><br clear="all"><div><br></div>-- <br><div \
dir="ltr"><font color="#999999">Nuwan Wimalasekara</font><div><font \
color="#999999">Senior Software Engineer - Test Automation</font></div>
<div><span style="color:rgb(153,153,153);font-size:13px;font-family:arial,helvetica,sans-serif">WSO2, \
Inc.: </span><span style="font-size:13px;font-family:arial,sans-serif"><a \
href="http://wso2.com/" target="_blank"><font \
color="#000099">http://wso2.com</font></a></span><span style="font-size:13px"><div \
style="font-family:arial">
<span style="border-collapse:collapse"><font face="arial, helvetica, sans-serif" \
color="#999999"><span style="font-family:arial,sans-serif;font-size:13px">lean. \
enterprise. middleware</span></font></span></div></span><span \
style="color:rgb(136,136,136)"><div>
<br></div></span></div><div><span \
style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">phone: <a \
href="tel:%2B94%2071%20668%204620" value="+94716684620" target="_blank">+94 71 668 \
4620</a></span><span style="font-size:13px"><div style="font-family:arial">
<span style="border-collapse:collapse;color:rgb(80,0,80)"><font face="arial, \
helvetica, sans-serif"><span \
style="font-family:arial,sans-serif;font-size:13px;color:rgb(0,0,0)"><br></span></font></span></div></span><font \
color="#888888" face="arial, sans-serif"><br>
</font><span style="font-size:13px"><div \
style="font-family:arial,sans-serif"><br></div></span></div></div> </div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><font \
color="#999999">Nuwan Wimalasekara</font><div><font color="#999999">Senior Software \
Engineer - Test Automation</font></div><div><span \
style="color:rgb(153,153,153);font-size:13px;font-family:arial,helvetica,sans-serif">WSO2, \
Inc.: </span><span style="font-size:13px;font-family:arial,sans-serif"><a \
href="http://wso2.com/" target="_blank"><font \
color="#000099">http://wso2.com</font></a></span><span style="font-size:13px"><div \
style="font-family:arial">
<span style="border-collapse:collapse"><font face="arial, helvetica, sans-serif" \
color="#999999"><span style="font-family:arial,sans-serif;font-size:13px">lean. \
enterprise. middleware</span></font></span></div></span><span \
style="color:rgb(136,136,136)"><div>
<br></div></span></div><div><span \
style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">phone: <a \
href="tel:%2B94%2071%20668%204620" value="+94716684620" target="_blank">+94 71 668 \
4620</a></span><span style="font-size:13px"><div style="font-family:arial">
<span style="border-collapse:collapse;color:rgb(80,0,80)"><font face="arial, \
helvetica, sans-serif"><span \
style="font-family:arial,sans-serif;font-size:13px;color:rgb(0,0,0)"><br></span></font></span></div></span><font \
color="#888888" face="arial, sans-serif"><br>
</font><span style="font-size:13px"><div \
style="font-family:arial,sans-serif"><br></div></span></div></div> </div>
</div></div></blockquote></div><br></div>
_______________________________________________
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic