[prev in list] [next in list] [prev in thread] [next in thread]
List: webkit-dev
Subject: Re: [webkit-dev] iOS EWS broken?
From: Jonathan Bedard <jbedard () apple ! com>
Date: 2018-10-01 15:49:04
Message-ID: 53C931FA-36A5-4827-94E8-E0C29F051E3F () apple ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
I inspected all of our bots this morning, none of them are chronically in a bad \
state: <https://webkit-queues.webkit.org/queue-status/ios-sim-ews \
<https://webkit-queues.webkit.org/queue-status/ios-sim-ews>>. Also, we are getting \
results for your patch <https://webkit-queues.webkit.org/patch/351200/ios-sim-ews \
<https://webkit-queues.webkit.org/patch/351200/ios-sim-ews>>, it's just occasionally \
failing to boot simulators.
There isn't much more we can do from an infrastructure perspective other than what \
Ryan did on the back end of last week. The Peace GM simulators are taking a very long \
time to boot, and the log here indicates that we timed out waiting for them to boot. \
Ryan bumped the timeout to 10 minutes last week. We can't fully inoculate our bots \
from this failure, ultimately it's either a simulator bug or an iOS bug which we can \
only reproduce on customer machines.
Jonathan
> On Sep 29, 2018, at 1:19 AM, Ryosuke Niwa <rniwa@webkit.org> wrote:
>
> Looks like this is still happening in the remaining bots:
>
> e.g.
> https://webkit-queues.webkit.org/results/9391751 \
> <https://webkit-queues.webkit.org/results/9391751>
> - R. Niwa
>
>
> On Thu, Sep 27, 2018 at 9:08 AM Ryan Haddad <ryanhaddad@apple.com \
> <mailto:ryanhaddad@apple.com>> wrote: It appears that a few bots are having issues. \
> I have taken them offline and will investigate.
> Ryan
>
> > On Sep 27, 2018, at 2:06 AM, Ryosuke Niwa <rniwa@webkit.org \
> > <mailto:rniwa@webkit.org>> wrote:
> > e.g. https://webkit-queues.webkit.org/results/9366267 \
> > <https://webkit-queues.webkit.org/results/9366267> RuntimeError raised: Timed out \
> > while waiting for data migration Traceback (most recent call last):
> > File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py", \
> > line 85, in main run_details = run(port, options, args, stderr)
> > File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py", \
> > line 448, in run run_details = manager.run(args)
> > File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py", \
> > line 246, in run if not self._set_up_run(tests_to_run):
> > File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py", \
> > line 181, in _set_up_run self._port.setup_test_run(self._options.device_class)
> > File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/port/ios.py", line 160, in \
> > setup_test_run self._create_devices(device_class)
> > File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/port/ios_simulator.py", \
> > line 103, in _create_devices SimulatedDeviceManager.initialize_devices([request] \
> > * self.child_processes(), self.host) File \
> > "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", line \
> > 368, in initialize_devices \
> > SimulatedDeviceManager.wait_until_data_migration_is_done(host, max(0, deadline - \
> > time.time())) File \
> > "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", line \
> > 428, in wait_until_data_migration_is_done raise RuntimeError('Timed out while \
> > waiting for data migration')
> > RuntimeError: Timed out while waiting for data migration
> > Error in atexit._run_exitfuncs:
> > Traceback (most recent call last):
> > File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/atexit.py", \
> > line 24, in _run_exitfuncs func(*targs, **kargs)
> > File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", \
> > line 446, in tear_down device.platform_device._tear_down(deadline - time.time())
> > File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", \
> > line 522, in _tear_down self._shut_down(deadline - time.time())
> > File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", \
> > line 508, in _shut_down raise RuntimeError('Timed out while waiting for {} to \
> > shut down'.format(self.udid))
> > RuntimeError: Timed out while waiting for 3FDF5418-1774-4710-B947-9952835E2563 to \
> > shut down
> > - R. Niwa
> > _______________________________________________
> > webkit-dev mailing list
> > webkit-dev@lists.webkit.org <mailto:webkit-dev@lists.webkit.org>
> > https://lists.webkit.org/mailman/listinfo/webkit-dev \
> > <https://lists.webkit.org/mailman/listinfo/webkit-dev>
>
[Attachment #5 (text/html)]
<html><head><meta http-equiv="Content-Type" content="text/html; \
charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; \
line-break: after-white-space;" class="">I inspected all of our bots this morning, \
none of them are chronically in a bad state: <<a \
href="https://webkit-queues.webkit.org/queue-status/ios-sim-ews" \
class="">https://webkit-queues.webkit.org/queue-status/ios-sim-ews</a>>. Also, we \
are getting results for your patch <<a \
href="https://webkit-queues.webkit.org/patch/351200/ios-sim-ews" \
class="">https://webkit-queues.webkit.org/patch/351200/ios-sim-ews</a>>, it's just \
occasionally failing to boot simulators.<div class=""><br class=""></div><div \
class="">There isn't much more we can do from an infrastructure perspective other \
than what Ryan did on the back end of last week. The Peace GM simulators are taking a \
very long time to boot, and the log here indicates that we timed out waiting for them \
to boot. Ryan bumped the timeout to 10 minutes last week. We can't fully inoculate \
our bots from this failure, ultimately it's either a simulator bug or an iOS bug \
which we can only reproduce on customer machines.</div><div class=""><br \
class=""></div><div class="">Jonathan<br class=""><div><br class=""><blockquote \
type="cite" class=""><div class="">On Sep 29, 2018, at 1:19 AM, Ryosuke Niwa <<a \
href="mailto:rniwa@webkit.org" class="">rniwa@webkit.org</a>> wrote:</div><br \
class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div \
dir="ltr" class="">Looks like this is still happening in the remaining bots:<div \
class=""><br class=""></div><div class="">e.g.</div><div class=""><a \
href="https://webkit-queues.webkit.org/results/9391751" \
class="">https://webkit-queues.webkit.org/results/9391751</a></div><div class=""><br \
clear="all" class=""><div class=""><div dir="ltr" class="gmail_signature">- R. \
Niwa</div></div><br class=""></div></div></div><br class=""><div \
class="gmail_quote"><div dir="ltr" class="">On Thu, Sep 27, 2018 at 9:08 AM Ryan \
Haddad <<a href="mailto:ryanhaddad@apple.com" \
class="">ryanhaddad@apple.com</a>> wrote:<br class=""></div><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div \
style="word-wrap:break-word;line-break:after-white-space" class="">It appears that a \
few bots are having issues. I have taken them offline and will investigate.<div \
class=""><br class=""></div><div class="">Ryan</div><div class=""><div class=""><br \
class=""><blockquote type="cite" class=""><div class="">On Sep 27, 2018, at 2:06 AM, \
Ryosuke Niwa <<a href="mailto:rniwa@webkit.org" target="_blank" \
class="">rniwa@webkit.org</a>> wrote:</div><br \
class="m_2225675392897621184Apple-interchange-newline"><div class=""><div dir="ltr" \
class=""><div dir="ltr" class=""><div dir="ltr" class="">e.g. <a \
href="https://webkit-queues.webkit.org/results/9366267" target="_blank" \
class="">https://webkit-queues.webkit.org/results/9366267</a></div><div dir="ltr" \
class=""><pre style="word-wrap:break-word;white-space:pre-wrap" class="">RuntimeError \
raised: Timed out while waiting for data migration Traceback (most recent call last):
File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py", \
line 85, in main run_details = run(port, options, args, stderr)
File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py", \
line 448, in run run_details = manager.run(args)
File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py", \
line 246, in run if not self._set_up_run(tests_to_run):
File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py", \
line 181, in _set_up_run self._port.setup_test_run(self._options.device_class)
File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/port/ios.py", line 160, in \
setup_test_run self._create_devices(device_class)
File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/port/ios_simulator.py", line \
103, in _create_devices SimulatedDeviceManager.initialize_devices([request] * \
self.child_processes(), self.host) File \
"/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", line \
368, in initialize_devices \
SimulatedDeviceManager.wait_until_data_migration_is_done(host, max(0, deadline - \
time.time())) File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", \
line 428, in wait_until_data_migration_is_done raise RuntimeError('Timed out while \
waiting for data migration')
RuntimeError: Timed out while waiting for data migration
Error in atexit._run_exitfuncs:
Traceback (most recent call last):
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/atexit.py", \
line 24, in _run_exitfuncs func(*targs, **kargs)
File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", \
line 446, in tear_down device.platform_device._tear_down(deadline - time.time())
File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", \
line 522, in _tear_down self._shut_down(deadline - time.time())
File "/Volumes/Data/EWS/WebKit/Tools/Scripts/webkitpy/xcode/simulated_device.py", \
line 508, in _shut_down raise RuntimeError('Timed out while waiting for {} to shut \
down'.format(self.udid))
RuntimeError: Timed out while waiting for 3FDF5418-1774-4710-B947-9952835E2563 to \
shut down</pre></div><div dir="ltr" class=""><br clear="all" class=""><div \
class=""><div dir="ltr" class="m_2225675392897621184gmail_signature" \
data-smartmail="gmail_signature">- R. Niwa</div></div></div></div></div> \
_______________________________________________<br class="">webkit-dev mailing \
list<br class=""><a href="mailto:webkit-dev@lists.webkit.org" target="_blank" \
class="">webkit-dev@lists.webkit.org</a><br class=""><a \
href="https://lists.webkit.org/mailman/listinfo/webkit-dev" target="_blank" \
class="">https://lists.webkit.org/mailman/listinfo/webkit-dev</a><br \
class=""></div></blockquote></div><br class=""></div></div> </blockquote></div>
</div></blockquote></div><br class=""></div></body></html>
_______________________________________________
webkit-dev mailing list
webkit-dev@lists.webkit.org
https://lists.webkit.org/mailman/listinfo/webkit-dev
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic