[prev in list] [next in list] [prev in thread] [next in thread] 

List:       openjdk-2d-dev
Subject:    Re: [OpenJDK 2D-Dev] Regression test failures - could not find entries in JDK Bug System
From:       Vitaly Provodin <vitaly.provodin () jetbrains ! com>
Date:       2016-10-04 2:36:46
Message-ID: 647A634A-52BD-49AF-B693-D87CB08F2AB2 () jetbrains ! com
[Download RAW message or body]

Philip,

Anyway, thanks for the advise.

Thanks,
Vitaly

> On 03 Oct 2016, at 22:35, Philip Race <philip.race@oracle.com> wrote:
> 
> This seems to be a question that is not specific to the client tests
> even if the examples are. And I have no idea about these testresults files
> 
> So I think that you should instead raise this question on
> quality-discuss@openjdk.java.net <mailto:quality-discuss@openjdk.java.net> .. 
> 
> -phil.
> 
> On 10/3/16, 1:18 AM, Vitaly Provodin wrote:
> > 
> > Hello,
> > 
> > My question relates to failures of the Regression tests (jdk/test) on OpenJDK8 \
> > and how to identify whether a failure is expected or not. 
> > Running java/awt and javax/swing tests against OpenJDK8 on various platforms I \
> > got some failures. Trying to find any explanations for these failures I looked \
> > through the JDK Bug System and could not find any bugs explaining them, for \
> > example, for the following two tests 
> > -java/awt/Frame/UnfocusableMaximizedFrameResizablity/UnfocusableMaximizedFrameResizablity.java
> >  Failed.
> > Program `/Users/builduser/buildAgent/work/13ab0d4c51b0de0b/jbsdk/jdk/Contents/Home/bin/java' \
> > timed out (timeout set to 240000ms, elapsed time was 240786ms). 
> > - javax/swing/JPopupMenu/6800513/bug6800513.java
> > 
> > Failed.
> > Execution failed: `main' threw exception: java.lang.Exception: popup class is: \
> > javax.swing.PopupFactory$HeavyWeightPopup, expected: \
> > javax.swing.PopupFactory$LightWeightPopup 
> > I found out that these tests were excluded from runs against JDK 8 Update \
> > Releases Early Access Build (EAB) - see Test Results page at \
> > http://download.java.net/openjdk/testresults/8 \
> > <http://download.java.net/openjdk/testresults/8>. Please note, I do not know the \
> > status of these results, whether they are actual for OpenJDK8 final release or \
> > not. Also, I paid attention to that most of the failures I am talking about are  \
> > not included into jdk/test/ProblemList.txt as for now. 
> > Supposing once these tests were excluded from runs, there were some causes for \
> > that e.g. some known product or test issues which were not intended to be fixed \
> > for this particular release. My question is how can I get to know these causes in \
> > order to differentiate expected and unexpected failures - any of these tests, \
> > which were excluded from EAB runs because of one issue, may fail because of \
> > another. 
> > I tried to follow the link at Summary column placed on the page \
> > http://download.java.net/openjdk/testresults/9 \
> > <http://download.java.net/openjdk/testresults/9> and could not get information \
> > about statuses of the tests (similar to OpenJDK8). So another question, how can I \
> > get the list of regression tests (if any) which expectedly fail for some \
> > particular OpenJDK release? 
> > Thanks,
> > Vitaly 


[Attachment #3 (unknown)]

<html><head><meta http-equiv="Content-Type" content="text/html \
charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: \
space; -webkit-line-break: after-white-space;" class=""><div \
class="">Philip,</div><div class=""><br class=""></div><div class="">Anyway, thanks \
for the advise.</div><div class=""><br class=""></div><div class="">Thanks,</div><div \
class="">Vitaly</div><br class=""><div><blockquote type="cite" class=""><div \
class="">On 03 Oct 2016, at 22:35, Philip Race &lt;<a \
href="mailto:philip.race@oracle.com" class="">philip.race@oracle.com</a>&gt; \
wrote:</div><br class="Apple-interchange-newline"><div class="">  
    <meta content="text/html; charset=UTF-8" http-equiv="Content-Type" class="">
  
  <div bgcolor="#FFFFFF" text="#000000" class="">
    This seems to be a question that is not specific to the client tests<br class="">
    even if the examples are. And I have no idea about these testresults
    files<br class="">
    <br class="">
    So I think that you should instead raise this question on<br class="">
    <a class="moz-txt-link-abbreviated" \
href="mailto:quality-discuss@openjdk.java.net">quality-discuss@openjdk.java.net</a> \
.. <br class="">  <br class="">
    -phil.<br class="">
    <br class="">
    On 10/3/16, 1:18 AM, Vitaly Provodin wrote:
    <blockquote cite="mid:CAJP+qwu4xYU+u8aKB39p7ob5uAa7AbBymA2xb2fa81A4PoKzpA@mail.gmail.com" \
                type="cite" class="">
      <div dir="ltr" class=""><p class="gmail-p1"><span \
class="gmail-s1">Hello,</span></p><p class="gmail-p2">My question relates to failures \
of the  Regression tests (jdk/test) on OpenJDK8 and how to identify
          whether a failure is expected or not.</p><p class="gmail-p2">Running \
java/awt and javax/swing tests  against OpenJDK8 on various platforms I got some \
failures.  Trying to find any explanations for these failures I looked
          through the JDK Bug System and could not find any bugs
          explaining them, for example, for the following two tests</p><p \
class="gmail-p3"><i class="">-java/awt/Frame/UnfocusableMaximizedFrameResizablity/UnfocusableMaximizedFrameResizablity.java</i><br \
class="">  </p>
        <blockquote class="gmail_quote" style="margin:0px 0px 0px
          0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span \
class="gmail-s1">Failed.<br class="">  </span><span class="gmail-s1">Program
            `/Users/builduser/buildAgent/work/13ab0d4c51b0de0b/jbsdk/jdk/Contents/Home/bin/java'
  timed out (timeout set to 240000ms, elapsed time was
            240786ms).</span></blockquote><div class=""><span \
class="gmail-s1"></span><br class="webkit-block-placeholder"></div><p \
                class="gmail-p5"><i class="">-
            javax/swing/JPopupMenu/6800513/bug6800513.java</i><br class="">
        </p><div class=""><span class="gmail-s1"></span><br \
class="webkit-block-placeholder"></div>  <blockquote class="gmail_quote" \
                style="margin:0px 0px 0px
          0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Failed.<br \
class="">  <span class="gmail-s1">Execution failed: `main' threw
            exception: java.lang.Exception: popup class is:
            javax.swing.PopupFactory$HeavyWeightPopup, expected:
            javax.swing.PopupFactory$LightWeightPopup</span></blockquote><div \
                class=""><span class="gmail-s1"></span><br \
                class="webkit-block-placeholder"></div>
        <div class=""><p class="gmail-p5">I found out that these tests were excluded
            from runs against JDK 8 Update Releases Early Access Build
            (EAB) - see Test Results page at <a moz-do-not-send="true" \
href="http://download.java.net/openjdk/testresults/8" \
class="">http://download.java.net/openjdk/testresults/8</a>.  Please note, I do not \
know the status of these results,  whether they are actual for OpenJDK8 final release \
or not.  Also, I paid attention to that most of the failures I am
            talking about are &nbsp;not included into
            jdk/test/ProblemList.txt as for now.</p><p class="gmail-p5">Supposing \
once these tests were excluded  from runs, there were some causes for that e.g. some \
known  product or test issues which were not intended to be fixed
            for this particular release. My question is how can I get to
            know these causes in order to&nbsp;<span style="font-size: 13px; \
white-space: nowrap;" class="">differentiate  expected and&nbsp;</span>unexpected \
failures - any of these  tests, which were excluded from EAB runs because of one
            issue, may fail because of another.</p><p class="gmail-p5">I tried to \
follow the link at Summary  column placed on the page <a moz-do-not-send="true" \
href="http://download.java.net/openjdk/testresults/9" \
class="">http://download.java.net/openjdk/testresults/9</a>  and could not get \
information about statuses of the tests  (similar to OpenJDK8). So another question, \
how can I get  the list of regression tests (if any) which expectedly fail
            for some particular OpenJDK release?</p><p class="gmail-p5">Thanks,<br \
class="">  </p><p class="gmail-p5">Vitaly&nbsp;<br class="">
          </p>
        </div>
      </div>
    </blockquote>
  </div>

</div></blockquote></div><br class=""></body></html>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic