'Re: [Outages-discussion] [outages] Google DNS issue (maybe with CenturyLink)'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       outages-discussion
Subject:    Re: [Outages-discussion] [outages] Google DNS issue (maybe with CenturyLink)
From:       Ian Gallagher <cdine () cdine ! org>
Date:       2021-08-15 8:04:52
Message-ID: CAMZb=PqkPxvk6g=_OcoeGLCq6OG9NmvKoLn7WxrQqs2dF6McGA () mail ! gmail ! com
[Download RAW message or body]

[Attachment #2 (multipart/alternative)]

(Moved to -discussion)

CL/Google DNS Seems to have came back for me around 2021-08-15 04:19 UTC,
no issues since then until now.

During the outage, I didn't notice any other issues, including to other
Google properties - only their public resolvers.

Ian Gallagher

From: Mel Beckman <mel@beckman.org> <mel@beckman.org>
Date: August 14, 2021 at 21:28:31
To: Matt Krueger <matt@goblinit.com> <matt@goblinit.com>
CC: Zach Hanna <chezbut@gmail.com> <chezbut@gmail.com>, Zach Hanna via
Outages <outages@outages.org> <outages@outages.org>, Ian Gallagher
<cdine@cdine.org> <cdine@cdine.org>, outages <outages@outages.org>
<outages@outages.org>
Subject:  Re: [outages] Google DNS issue (maybe with CenturyLink)

I'm on CenturyLink/Lumen GigE circuits in Yuma, AZ and Santa Barbara, CA,
> and both sited have normal connectivity and resolution to 8.8.8.8 and
> 8.8.4.4.
>
>  -mel beckman
>
> On Aug 14, 2021, at 9:23 PM, Matt Krueger via Outages <outages@outages.org>
> wrote:
>
>  Same issue in Minnesota on Century link - just cut my homelab's
> forwarders over to cloudflare.
>
> On August 14, 2021 10:56:08 PM CDT, Zach Hanna via Outages <
> outages@outages.org> wrote:
>>
>> Able to replicate this same issue in Boise on Centurylink.
>> Traceroute does not leave the CL network.
>>
>> 2  boid-dsl-gw16.boid.qwest.net (184.99.64.16)  3.331 ms  3.319 ms
>> 3.044 ms
>>
>>  3  boid-agw1.inet.qwest.net (184.99.65.121)  4.438 ms  3.506 ms  3.763
>> ms
>>
>>  4  tuk-cntr-03.inet.qwest.net (208.168.128.13)  13.929 ms  64.983 ms
>>
>>     tuk-cntr-03.inet.qwest.net (205.171.190.113)  17.804 ms
>>
>>
>>
>>
>>
>> On Sat, Aug 14, 2021 at 9:44 PM Ian Gallagher via Outages <
>> outages@outages.org> wrote:
>>
>>> I see loss of resolution/ping to Google DNS as of just after 2021-08-15
>>> 02:55 UTC from Centurylink small business GPON in Seattle. Traceroute seems
>>> to not even get out of the CL network.
>>>
>>> No issues from seen from Comcast at the same location.
>>>
>>>
>>>
>>> Ian Gallagher
>>>
>>> From: Brandon Nguyen via Outages <outages@outages.org>
>>> <outages@outages.org>
>>> Reply: Brandon Nguyen <brandon@oastem.org> <brandon@oastem.org>
>>> Date: August 14, 2021 at 20:22:10
>>> To: Outages <outages@outages.org> <outages@outages.org>
>>> Subject:  [outages] Google DNS issue (maybe with CenturyLink)
>>>
>>> Hello,
>>>>
>>>> Anyone else experiencing ping issues with 8.8.8.8 or 8.8.4.4?
>>>>
>>>> Based on preliminary research might be a CenturyLink specific issue.
>>>>
>>>> 2 networks in Seattle and 1 network in SFO (ATT) have the issue. A few
>>>> others seem fine.
>>>>
>>>> Seeing a spike with Centurylink and Google on downdetector.com
>>>>
>>>> Thoughts?
>>>>
>>>> Thanks,
>>>>
>>>>
>>>> _______________________________________________
>>>> Outages mailing list
>>>> Outages@outages.org
>>>> https://puck.nether.net/mailman/listinfo/outages
>>>>
>>> _______________________________________________
>>> Outages mailing list
>>> Outages@outages.org
>>> https://puck.nether.net/mailman/listinfo/outages
>>>
>> --
> Sent from my Android device with K-9 Mail. Please excuse my brevity.
> _______________________________________________
> Outages mailing list
> Outages@outages.org
> https://puck.nether.net/mailman/listinfo/outages
>
>

[Attachment #5 (text/html)]

<html><head></head><body><div>(Moved to -discussion)</div><div><br></div>CL/Google \
DNS Seems to have came back for me around  2021-08-15 04:19 UTC, no issues since then \
until now.<div><br></div><div>During the outage, I didn't notice any other issues, \
including to other Google properties - only their public resolvers.   <br> <br><div \
class="gmail_signature"><span \
style="color:rgb(39,39,40);font-family:-apple-system,sans-serif;font-size:14px">Ian \
Gallagher</span></div> <div class="gmail_quote" style="color:black"><br>From:  <span \
style="color:black">Mel Beckman</span> <a \
href="mailto:mel@beckman.org">&lt;mel@beckman.org&gt;</a><br>Date:  <span \
style="color:black">August 14, 2021 at 21:28:31</span><br>To:  <span \
style="color:black">Matt Krueger</span> <a \
href="mailto:matt@goblinit.com">&lt;matt@goblinit.com&gt;</a><br>CC:  <span \
style="color:black">Zach Hanna</span> <a \
href="mailto:chezbut@gmail.com">&lt;chezbut@gmail.com&gt;</a>, <span \
style="color:black">Zach Hanna via Outages</span> <a \
href="mailto:outages@outages.org">&lt;outages@outages.org&gt;</a>, <span \
style="color:black">Ian Gallagher</span> <a \
href="mailto:cdine@cdine.org">&lt;cdine@cdine.org&gt;</a>, <span \
style="color:black">outages</span> <a \
href="mailto:outages@outages.org">&lt;outages@outages.org&gt;</a><br>Subject:  <span \
style="color:black"> Re: [outages] Google DNS issue (maybe with CenturyLink) \
<br></span></div><br> <blockquote type="cite" class="gmail_quote"><span><div \
dir="auto"><div></div><div>

I'm on CenturyLink/Lumen GigE circuits in Yuma, AZ and Santa
Barbara, CA, and both sited have normal connectivity and resolution
to 8.8.8.8 and 8.8.4.4.
<div><br>
<div dir="ltr">  -mel beckman</div>
<div dir="ltr"><br>
<blockquote type="cite">On Aug 14, 2021, at 9:23 PM, Matt Krueger
via Outages &lt;<a href="mailto:outages@outages.org">outages@outages.org</a>&gt; \
wrote:<br> <br></blockquote>
</div>
<blockquote type="cite">
<div dir="ltr"> Same issue in Minnesota on Century link - just cut
my homelab&#39;s forwarders over to cloudflare.<br>
<br>
<div class="gmail_quote">On August 14, 2021 10:56:08 PM CDT, Zach
Hanna via Outages &lt;<a \
href="mailto:outages@outages.org">outages@outages.org</a>&gt; wrote: <blockquote \
class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"> <div dir="ltr">Able to replicate this same issue \
in Boise on Centurylink.  
<div>Traceroute does not leave the CL network.  </div>
<div>
<p class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-as \
ian:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)">
 <span class="gmail-s1" style="font-variant-ligatures:no-common-ligatures">2<span \
class="gmail-Apple-converted-space">  </span> <a \
href="http://boid-dsl-gw16.boid.qwest.net">boid-dsl-gw16.boid.qwest.net</a> \
(184.99.64.16)<span class="gmail-Apple-converted-space">  </span> 3.331 ms<span \
class="gmail-Apple-converted-space">  </span> 3.319 ms<span \
class="gmail-Apple-converted-space">  </span> 3.044 ms</span></p> <p class="gmail-p1" \
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stre \
tch:normal;font-size:11px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"> \
<span class="gmail-s1" style="font-variant-ligatures:no-common-ligatures"><span \
class="gmail-Apple-converted-space">  </span>3<span \
class="gmail-Apple-converted-space">  </span> <a \
href="http://boid-agw1.inet.qwest.net">boid-agw1.inet.qwest.net</a> \
(184.99.65.121)<span class="gmail-Apple-converted-space">  </span> 4.438 ms<span \
class="gmail-Apple-converted-space">  </span> 3.506 ms<span \
class="gmail-Apple-converted-space">  </span> 3.763 ms</span></p> <p class="gmail-p1" \
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stre \
tch:normal;font-size:11px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"> \
<span class="gmail-s1" style="font-variant-ligatures:no-common-ligatures"><span \
class="gmail-Apple-converted-space">  </span>4<span \
class="gmail-Apple-converted-space">  </span> <a \
href="http://tuk-cntr-03.inet.qwest.net">tuk-cntr-03.inet.qwest.net</a> \
(208.168.128.13)<span class="gmail-Apple-converted-space">  </span> 13.929 ms<span \
class="gmail-Apple-converted-space">  </span> 64.983 ms</span></p> <p \
class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian \
:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)">
 <span class="gmail-s1" style="font-variant-ligatures:no-common-ligatures"><span \
class="gmail-Apple-converted-space">     </span> <a \
href="http://tuk-cntr-03.inet.qwest.net">tuk-cntr-03.inet.qwest.net</a> \
(205.171.190.113)<span class="gmail-Apple-converted-space">  </span> 17.804 \
ms</span></p> <p class="gmail-p1" \
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stre \
tch:normal;font-size:11px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"> \
<span class="gmail-s1" \
style="font-variant-ligatures:no-common-ligatures"><br></span></p> <p \
class="gmail-p1" style="margin:0px;font-variant-numeric:normal;font-variant-east-asian \
:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)">
 <span class="gmail-s1" \
style="font-variant-ligatures:no-common-ligatures"><br></span></p> <div><br></div>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Sat, Aug 14, 2021 at 9:44 PM
Ian Gallagher via Outages &lt;<a \
href="mailto:outages@outages.org">outages@outages.org</a>&gt; wrote:<br></div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"> <div>I see loss of resolution/ping to Google DNS \
as of just after  2021-08-15 02:55 UTC from Centurylink small business
GPON in Seattle. Traceroute seems to not even get out of the CL
network.  
<div><br></div>
<div>No issues from seen from Comcast at the same
location.  <br>
<div><br></div>
<div><br>
<br>
<div><span style="color:rgb(39,39,40);font-family:-apple-system,sans-serif;font-size:14px">
 Ian Gallagher</span></div>
<div class="gmail_quote" style="color:black"><br>
From:  <span style="color:black">Brandon Nguyen via
Outages</span> <a href="mailto:outages@outages.org" \
                target="_blank">&lt;outages@outages.org&gt;</a><br>
Reply:  <span style="color:black">Brandon Nguyen</span>
<a href="mailto:brandon@oastem.org" \
                target="_blank">&lt;brandon@oastem.org&gt;</a><br>
Date:  <span style="color:black">August 14, 2021 at
20:22:10</span><br>
To:  <span style="color:black">Outages</span> <a href="mailto:outages@outages.org" \
                target="_blank">&lt;outages@outages.org&gt;</a><br>
Subject:   <span style="color:black">[outages] Google DNS issue
(maybe with CenturyLink)<br></span></div>
<br>
<blockquote type="cite" class="gmail_quote">
<div>
<div>
<div dir="ltr">
<div><span>Hello,</span></div>
<div><span><br></span></div>
<div><span>Anyone else experiencing ping issues with 8.8.8.8 or
8.8.4.4?</span></div>
<div><span><br></span></div>
<div><span>Based on preliminary research might be a CenturyLink
specific issue.</span></div>
<div><span><br></span></div>
<div><span>2 networks in Seattle and 1 network in SFO (ATT) have
the issue. A few others seem fine.</span></div>
<div><span><br></span></div>
<div><span>Seeing a spike with Centurylink and Google on <a \
href="http://downdetector.com" target="_blank">downdetector.com</a><br></span></div> \
<div><span><br></span></div> <div><span>Thoughts?</span></div>
<div><span><br></span></div>
<div><span>Thanks,<br></span></div>
<div><span><br></span></div>
<div><span><br></span></div>
</div>
<span>_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" \
target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br></span></div> \
</div> </blockquote>
</div>
</div>
</div>
_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org" target="_blank">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages" rel="noreferrer" \
target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><br></blockquote> \
</div> </blockquote>
</div>
<div style="white-space:pre-wrap">
<div class="k9mail-signature">--<br>
Sent from my Android device with K-9 Mail. Please excuse my
brevity.</div>
</div>
<span>_______________________________________________</span><br>
<span>Outages mailing list</span><br>
<span><a href="mailto:Outages@outages.org">Outages@outages.org</a></span><br>
<span><a href="https://puck.nether.net/mailman/listinfo/outages">https://puck.nether.net/mailman/listinfo/outages</a></span><br></div>
 </blockquote>
</div>

</div></div></span></blockquote>

</div></body></html>

_______________________________________________
Outages-discussion mailing list
Outages-discussion@outages.org
https://puck.nether.net/mailman/listinfo/outages-discussion

[prev in list] [next in list] [prev in thread] [next in thread] 