[prev in list] [next in list] [prev in thread] [next in thread]
List: webkit-dev
Subject: Re: [webkit-dev] Safari Tech Preview 96 available on wpt.fyi!
From: Jiewen Tan <jiewen_tan () apple ! com>
Date: 2019-12-03 2:04:51
Message-ID: C2CB036B-AE35-434D-A6BF-B699482A7407 () apple ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
Hi Maciej,
> On Dec 2, 2019, at 4:10 PM, Maciej Stachowiak <mjs@apple.com> wrote:
>
>
> There's a number of mysterious timeouts with 96. Not sure if flakiness or real?
>
> The new WebCrypto failures are surprising, but likely real and should be \
> investigated: https://wpt.fyi/results/WebCryptoAPI/wrapKey_unwrapKey?diff&filter=ADC&q=is%3Adifferent&run_id=347530011&run_id=381930013 \
> <https://wpt.fyi/results/WebCryptoAPI/wrapKey_unwrapKey?diff&filter=ADC&q=is:different&run_id=347530011&run_id=381930013>
>
I believe these tests are flaky. I have made a PR to improve it a while ago. I should \
probably get those improvement landed sometime. \
https://github.com/web-platform-tests/wpt/pull/6102 \
<https://github.com/web-platform-tests/wpt/pull/6102>
>
> Many large new chunks of not-run tests are caused by a harness error or timeout. \
> E.g. html/ and webauthn/
STP 96 has enabled user agent UI for WebAuthn, which could cause crashes. This could \
be the reason why webauthn is 0 all the time.
Best,
Jiewen
>
>
> > On Nov 27, 2019, at 7:07 AM, Stephen Mcgruer <smcgruer@chromium.org \
> > <mailto:smcgruer@chromium.org>> wrote:
> > Excited to announce that Safari Tech Preview 96 is now available on wpt.fyi \
> > <http://wpt.fyi/>!
> > Example run: https://wpt.fyi/results/?label=master&label=experimental&product=chrome&product=firefox&product=safari&aligned \
> > <https://wpt.fyi/results/?label=master&label=experimental&product=chrome&product=firefox&product=safari&aligned>
> >
> > Diff against Safari Tech Preview 95 (not at exactly the same WPT sha, but very \
> > close): https://wpt.fyi/results/?diff&filter=ADC&q=is%3Adifferent&run_id=347530011&run_id=381930013 \
> > <https://wpt.fyi/results/?diff&filter=ADC&q=is%3Adifferent&run_id=347530011&run_id=381930013>
> >
> > If you are surprised by the results in the diff view, I would love to hear about \
> > it. One thing that surprised me is that the release blog post[0] mentioned Web \
> > Animations being enabled by default, but we see no differences in the test diff \
> > for web-animations/. It's possible we enable some flag that turned on Web \
> > Animations already, but I can't see it obviously in our safari setup[1].
> > [0]: https://webkit.org/blog/9658/release-notes-for-safari-technology-preview-96/ \
> > <https://webkit.org/blog/9658/release-notes-for-safari-technology-preview-96/> \
> > [1]: https://github.com/web-platform-tests/wpt/blob/master/tools/ci/azure/install_safari.yml \
> > <https://github.com/web-platform-tests/wpt/blob/master/tools/ci/azure/install_safari.yml>_______________________________________________
> > webkit-dev mailing list
> > webkit-dev@lists.webkit.org <mailto:webkit-dev@lists.webkit.org>
> > https://lists.webkit.org/mailman/listinfo/webkit-dev
>
> _______________________________________________
> webkit-dev mailing list
> webkit-dev@lists.webkit.org
> https://lists.webkit.org/mailman/listinfo/webkit-dev
[Attachment #5 (unknown)]
<html><head><meta http-equiv="Content-Type" content="text/html; \
charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; \
line-break: after-white-space;" class="">Hi Maciej,<br class=""><div><br \
class=""><blockquote type="cite" class=""><div class="">On Dec 2, 2019, at 4:10 PM, \
Maciej Stachowiak <<a href="mailto:mjs@apple.com" class="">mjs@apple.com</a>> \
wrote:</div><br class="Apple-interchange-newline"><div class=""><meta \
http-equiv="Content-Type" content="text/html; charset=utf-8" class=""><div \
style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: \
after-white-space;" class=""><div class=""><br class=""></div>There's a number of \
mysterious timeouts with 96. Not sure if flakiness or real?<div class=""><br \
class=""></div><div class="">The new WebCrypto failures are surprising, but likely \
real and should be investigated: <a \
href="https://wpt.fyi/results/WebCryptoAPI/wrapKey_unwrapKey?diff&filter=ADC&q=is:different&run_id=347530011&run_id=381930013" \
class="">https://wpt.fyi/results/WebCryptoAPI/wrapKey_unwrapKey?diff&filter=ADC&am \
p;q=is%3Adifferent&run_id=347530011&run_id=381930013</a></div></div></div></blockquote><div><br \
class=""></div><div><span style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" \
class="">I believe these tests are flaky. I have made a PR to improve it a while ago. \
I should probably get those improvement landed sometime.</span><div class="" \
style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);"><a \
href="https://github.com/web-platform-tests/wpt/pull/6102" \
class="">https://github.com/web-platform-tests/wpt/pull/6102</a></div></div><br \
class=""><blockquote type="cite" class=""><div class=""><div style="word-wrap: \
break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div \
class=""><br class=""></div><div class="">Many large new chunks of not-run tests are \
caused by a harness error or timeout. E.g. html/ and \
webauthn/</div></div></div></blockquote><div><br class=""></div><div>STP 96 has \
enabled user agent UI for WebAuthn, which could cause crashes. This could be the \
reason why webauthn is 0 all the time.</div><div><br \
class=""></div><div>Best,</div><div>Jiewen</div><br class=""><blockquote type="cite" \
class=""><div class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; \
line-break: after-white-space;" class=""><div class=""><br class=""></div><div \
class=""><div class=""><br class=""><blockquote type="cite" class=""><div class="">On \
Nov 27, 2019, at 7:07 AM, Stephen Mcgruer <<a href="mailto:smcgruer@chromium.org" \
class="">smcgruer@chromium.org</a>> wrote:</div><br \
class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Excited to \
announce that Safari Tech Preview 96 is now available on <a href="http://wpt.fyi/" \
class="">wpt.fyi</a>!<div class=""><br class="">Example run: <a \
href="https://wpt.fyi/results/?label=master&label=experimental&product=chrome&product=firefox&product=safari&aligned" \
class="">https://wpt.fyi/results/?label=master&label=experimental&product=chrome&product=firefox&product=safari&aligned</a></div><div \
class=""><br class=""></div><div class="">Diff against Safari Tech Preview 95 (not at \
exactly the same WPT sha, but very close): <a \
href="https://wpt.fyi/results/?diff&filter=ADC&q=is%3Adifferent&run_id=347530011&run_id=381930013" \
class="">https://wpt.fyi/results/?diff&filter=ADC&q=is%3Adifferent&run_id=347530011&run_id=381930013</a></div><div \
class=""><br class=""></div><div class="">If you are surprised by the results in the \
diff view, I would love to hear about it. One thing that surprised me is that the \
release blog post[0] mentioned Web Animations being enabled by default, but we see no \
differences in the test diff for web-animations/. It's possible we enable some flag \
that turned on Web Animations already, but I can't see it obviously in our safari \
setup[1].</div><div class=""><br class=""></div><div class="">[0]: <a \
href="https://webkit.org/blog/9658/release-notes-for-safari-technology-preview-96/" \
class="">https://webkit.org/blog/9658/release-notes-for-safari-technology-preview-96/</a></div><div \
class="">[1]: <a \
href="https://github.com/web-platform-tests/wpt/blob/master/tools/ci/azure/install_safari.yml" \
class="">https://github.com/web-platform-tests/wpt/blob/master/tools/ci/azure/install_safari.yml</a></div></div>
_______________________________________________<br class="">webkit-dev mailing \
list<br class=""><a href="mailto:webkit-dev@lists.webkit.org" \
class="">webkit-dev@lists.webkit.org</a><br class=""><a \
href="https://lists.webkit.org/mailman/listinfo/webkit-dev" \
class="">https://lists.webkit.org/mailman/listinfo/webkit-dev</a><br \
class=""></div></blockquote></div><br \
class=""></div></div>_______________________________________________<br \
class="">webkit-dev mailing list<br class=""><a \
href="mailto:webkit-dev@lists.webkit.org" class="">webkit-dev@lists.webkit.org</a><br \
class="">https://lists.webkit.org/mailman/listinfo/webkit-dev<br \
class=""></div></blockquote></div><br class=""></body></html>
_______________________________________________
webkit-dev mailing list
webkit-dev@lists.webkit.org
https://lists.webkit.org/mailman/listinfo/webkit-dev
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic