[prev in list] [next in list] [prev in thread] [next in thread] 

List:       outages-discussion
Subject:    Re: [Outages-discussion] [outages] Level3 Connectivity Issues
From:       Wyn Bryant <wb () vistaits ! com>
Date:       2018-04-26 13:50:57
Message-ID: DM5PR1301MB198048B0539FA9AF7E62A311B78E0 () DM5PR1301MB1980 ! namprd13 ! prod ! outlook ! com
[Download RAW message or body]

Does anyone have access to Level 3's cascaded external notes regarding the issue?  \
Interested to confirm if yesterday's root cause was responsible for all significant \
packet loss issues over the course of the past week in the LA/Orange County market?

From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Jordan Morris via \
                Outages
Sent: Wednesday, April 25, 2018 5:32 PM
To: outages@outages.org
Subject: Re: [outages] Level3 Connectivity Issues

Looks like things are starting to stabilize

From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Andy Takacs via \
                Outages
Sent: Wednesday, April 25, 2018 1:52 PM
To: Outages <outages@outages.org<mailto:outages@outages.org>>
Subject: Re: [outages] Level3 Connectivity Issues


According to a CL ticket summary sent ~15 minutes ago they've found a misbehaving \
router in LA and are working on it.



________________________________
From: Outages <outages-bounces@outages.org<mailto:outages-bounces@outages.org>> on \
                behalf of Dovid Bender via Outages \
                <outages@outages.org<mailto:outages@outages.org>>
Sent: Wednesday, April 25, 2018 1:35 PM
To: Tim Choe
Cc: outages@outages.org<mailto:outages@outages.org>
Subject: Re: [outages] Level3 Connectivity Issues

I wonder how. We have equipment with ndchost out in CA. They peer with both L3 and \
Cox. As soon as they dropped L3 everything came back to normal. We also had the exact \
same issue with them last week.



On Wed, Apr 25, 2018 at 3:56 PM, Tim Choe via Outages \
<outages@outages.org<mailto:outages@outages.org>> wrote:

So according to Level3, is it a peering issue?

On 04/25/2018 12:41 PM, Joseph Jackson via Outages wrote:

The ticket we have with Level3 has been frustrating to say the least.  They keep \
blaming it on other peers.  First zayo now cox.







From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Wyn Bryant via \
                Outages
Sent: Wednesday, April 25, 2018 2:35 PM
To: outages@outages.org<mailto:outages@outages.org>
Subject: Re: [outages] Level3 Connectivity Issues



Yes, there is a significant Level 3 network event in Orange County, CA.  We're \
affected via a downstream provider (Cox), unfortunately we do not have access to any \
additional detail at this time.



From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Jordan Morris via \
                Outages
Sent: Wednesday, April 25, 2018 3:30 PM
To: outages@outages.org<mailto:outages@outages.org>
Subject: [outages] Level3 Connectivity Issues



We are seeing Level 3 connectivity issues in multiple city's can anyone else confirm























_______________________________________________

Outages mailing list

Outages@outages.org<mailto:Outages@outages.org>

https://puck.nether.net/mailman/listinfo/outages<https://na01.safelinks.protection.out \
look.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=02%7C0 \
1%7Candyt%40zumasys.com%7C37f498a854014cb8b14908d5aaec3017%7Cbfd62fcabd384e07a0785e994 \
3d1f9c0%7C0%7C0%7C636602853767043922&sdata=DiqLjAZyaoHjk2S%2FxV%2BVTl27d3pyAIQpnPwWJEa6YaE%3D&reserved=0>



_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages<https://na01.safelinks.protection.out \
look.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Foutages&data=02%7C0 \
1%7Candyt%40zumasys.com%7C37f498a854014cb8b14908d5aaec3017%7Cbfd62fcabd384e07a0785e994 \
3d1f9c0%7C0%7C0%7C636602853767043922&sdata=DiqLjAZyaoHjk2S%2FxV%2BVTl27d3pyAIQpnPwWJEa6YaE%3D&reserved=0>



[Attachment #3 (text/html)]

<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:Tahoma;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
	{font-family:Consolas;
	panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
pre
	{mso-style-priority:99;
	mso-style-link:"HTML Preformatted Char";
	margin:0in;
	margin-bottom:.0001pt;
	font-size:10.0pt;
	font-family:"Courier New";}
span.HTMLPreformattedChar
	{mso-style-name:"HTML Preformatted Char";
	mso-style-priority:99;
	mso-style-link:"HTML Preformatted";
	font-family:Consolas;}
p.msonormal0, li.msonormal0, div.msonormal0
	{mso-style-name:msonormal;
	margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;}
p.xmsonormal, li.xmsonormal, div.xmsonormal
	{mso-style-name:x_msonormal;
	margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;}
span.EmailStyle21
	{mso-style-type:personal;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
span.EmailStyle24
	{mso-style-type:personal;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
span.EmailStyle25
	{mso-style-type:personal-compose;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-size:10.0pt;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Does anyone have access to Level 3&#8217;s cascaded external \
notes regarding the issue? &nbsp;Interested to confirm if yesterday&#8217;s root \
cause was responsible for all significant packet loss issues over the course of the \
past week in the LA/Orange  County market?<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Outages [mailto:outages-bounces@outages.org] <b>
On Behalf Of </b>Jordan Morris via Outages<br>
<b>Sent:</b> Wednesday, April 25, 2018 5:32 PM<br>
<b>To:</b> outages@outages.org<br>
<b>Subject:</b> Re: [outages] Level3 Connectivity Issues<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Looks like things are starting to stabilize<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Outages [<a \
href="mailto:outages-bounces@outages.org">mailto:outages-bounces@outages.org</a>] \
<b>On Behalf Of </b>Andy Takacs via Outages<br> <b>Sent:</b> Wednesday, April 25, \
2018 1:52 PM<br> <b>To:</b> Outages &lt;<a \
href="mailto:outages@outages.org">outages@outages.org</a>&gt;<br> <b>Subject:</b> Re: \
[outages] Level3 Connectivity Issues<o:p></o:p></p> </div>
</div>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<div id="divtagdefaultwrapper">
<p><span style="font-size:12.0pt;color:black">According to a CL&nbsp;ticket summary \
sent ~15 minutes ago&nbsp;they've found a misbehaving router in LA and are working on \
it.&nbsp;<o:p></o:p></span></p> <p><span \
style="font-size:12.0pt;color:black"><o:p>&nbsp;</o:p></span></p> <p \
class="MsoNormal"><span \
style="font-size:12.0pt;color:black"><o:p>&nbsp;</o:p></span></p> <div>
<div class="MsoNormal" align="center" style="text-align:center"><span \
style="font-size:12.0pt;color:black"> <hr size="2" width="98%" align="center">
</span></div>
<div id="divRplyFwdMsg">
<p class="MsoNormal"><b><span style="color:black">From:</span></b><span \
style="color:black"> Outages &lt;<a \
href="mailto:outages-bounces@outages.org">outages-bounces@outages.org</a>&gt; on \
behalf of Dovid Bender via Outages &lt;<a \
href="mailto:outages@outages.org">outages@outages.org</a>&gt;<br> <b>Sent:</b> \
Wednesday, April 25, 2018 1:35 PM<br> <b>To:</b> Tim Choe<br>
<b>Cc:</b> <a href="mailto:outages@outages.org">outages@outages.org</a><br>
<b>Subject:</b> Re: [outages] Level3 Connectivity Issues</span><span \
style="font-size:12.0pt;color:black"> <o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span \
style="font-size:12.0pt;color:black">&nbsp;<o:p></o:p></span></p> </div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">I wonder how. We have \
equipment with ndchost out in CA. They peer with both L3 and Cox. As soon as they \
dropped L3 everything came back to normal. We also had the exact same issue with them \
last  week. <o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span \
style="font-size:12.0pt;color:black"><o:p>&nbsp;</o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:12.0pt;color:black"><o:p>&nbsp;</o:p></span></p> </div>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:12.0pt;color:black"><o:p>&nbsp;</o:p></span></p> <div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">On Wed, Apr 25, 2018 \
at 3:56 PM, Tim Choe via Outages &lt;<a href="mailto:outages@outages.org" \
target="_blank">outages@outages.org</a>&gt; wrote:<o:p></o:p></span></p> <blockquote \
style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in \
6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt"> <div>
<p><span style="font-size:12.0pt;color:black">So according to Level3, is it a peering \
issue? <o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span \
style="font-size:12.0pt;color:black"><o:p>&nbsp;</o:p></span></p> <div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">On 04/25/2018 12:41 \
PM, Joseph Jackson via Outages wrote:<o:p></o:p></span></p> </div>
</div>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="xmsonormal"><span style="font-size:12.0pt;color:#44546A">The ticket we have \
with Level3 has been frustrating to say the least.&nbsp; They keep blaming it on \
other peers.&nbsp; First zayo now cox.&nbsp; </span><span \
style="font-size:12.0pt;color:black"><o:p></o:p></span></p> <p \
class="xmsonormal"><span style="font-size:12.0pt;color:#44546A">&nbsp;</span><span \
style="font-size:12.0pt;color:black"><o:p></o:p></span></p> <p \
class="xmsonormal"><span style="font-size:12.0pt;color:#44546A">&nbsp;</span><span \
style="font-size:12.0pt;color:black"><o:p></o:p></span></p> <p \
class="xmsonormal"><span style="font-size:12.0pt;color:#44546A">&nbsp;</span><span \
style="font-size:12.0pt;color:black"><o:p></o:p></span></p> <div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="xmsonormal"><b><span \
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;color:black">From:</span></b><span \
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;color:black"> \
Outages [<a href="mailto:outages-bounces@outages.org" \
target="_blank">mailto:outages-bounces@outages.org</a>] <b>On Behalf Of </b>Wyn \
Bryant via Outages<br> <b>Sent:</b> Wednesday, April 25, 2018 2:35 PM<br>
<b>To:</b> <a href="mailto:outages@outages.org" \
target="_blank">outages@outages.org</a><br> <b>Subject:</b> Re: [outages] Level3 \
Connectivity Issues</span><span \
style="font-size:12.0pt;color:black"><o:p></o:p></span></p> </div>
</div>
<p class="xmsonormal"><span \
style="font-size:12.0pt;color:black">&nbsp;<o:p></o:p></span></p> <p \
class="xmsonormal"><a name="x_m_9009958030255267013__MailEndCompose"><span \
style="font-size:12.0pt;color:black">Yes, there is a significant Level 3 network \
event in Orange County, CA.&nbsp; We&#8217;re affected via a downstream provider \
(Cox), unfortunately we do not  have access to any additional detail at this \
time.&nbsp; </span></a><span \
style="font-size:12.0pt;color:black"><o:p></o:p></span></p> <p \
class="xmsonormal"><span \
style="font-size:12.0pt;color:black">&nbsp;<o:p></o:p></span></p> <div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="xmsonormal"><b><span \
style="font-size:12.0pt;color:black">From:</span></b><span \
style="font-size:12.0pt;color:black"> Outages [<a \
href="mailto:outages-bounces@outages.org" \
target="_blank">mailto:outages-bounces@outages.org</a>] <b>On Behalf Of </b>Jordan \
Morris via Outages<br> <b>Sent:</b> Wednesday, April 25, 2018 3:30 PM<br>
<b>To:</b> <a href="mailto:outages@outages.org" \
target="_blank">outages@outages.org</a><br> <b>Subject:</b> [outages] Level3 \
Connectivity Issues<o:p></o:p></span></p> </div>
</div>
<p class="xmsonormal"><span \
style="font-size:12.0pt;color:black">&nbsp;<o:p></o:p></span></p> <p \
class="xmsonormal"><span style="font-size:12.0pt;color:black">We are seeing Level 3 \
connectivity issues in multiple city&#8217;s can anyone else \
confirm<o:p></o:p></span></p> <p class="xmsonormal"><span \
style="font-size:12.0pt;color:black">&nbsp;<o:p></o:p></span></p> <table \
class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="400" \
style="width:300.0pt"> <tbody>
<tr>
<td colspan="2" style="padding:0in 0in 0in 0in">
<p class="xmsonormal">&nbsp;<o:p></o:p></p>
</td>
</tr>
<tr>
<td width="180" valign="top" style="width:135.0pt;padding:0in 0in 0in 11.25pt">
<p class="xmsonormal" style="line-height:13.5pt"><b><span \
style="font-size:10.5pt;font-family:&quot;Arial&quot;,sans-serif;color:#05529A">&nbsp;</span></b><o:p></o:p></p>
 </td>
<td width="220" style="width:165.0pt;border:none;border-left:solid #999999 \
1.0pt;padding:0in 0in 0in 20.25pt"> <p class="xmsonormal" \
style="line-height:13.5pt"><span \
style="font-size:9.0pt;font-family:&quot;Arial&quot;,sans-serif;color:#7D7D7D">&nbsp;</span><o:p></o:p></p>
 </td>
</tr>
<tr>
<td colspan="2" style="padding:0in 0in 0in 11.25pt">
<p class="xmsonormal" style="margin-top:6.0pt;line-height:13.5pt"><span \
style="font-size:9.0pt;font-family:&quot;Arial&quot;,sans-serif;color:#7D7D7D">&nbsp;</span><o:p></o:p></p>
 </td>
</tr>
<tr>
<td colspan="2" style="padding:0in 0in 0in 0in">
<p class="xmsonormal">&nbsp;<o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="xmsonormal"><span \
style="font-size:12.0pt;color:black">&nbsp;<o:p></o:p></span></p> <p \
class="xmsonormal"><span \
style="font-size:12.0pt;color:black">&nbsp;<o:p></o:p></span></p> </div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span \
style="font-size:12.0pt;color:black"><o:p>&nbsp;</o:p></span></p> </div>
</div>
<pre><span style="color:black">_______________________________________________<o:p></o:p></span></pre>
 <pre><span style="color:black">Outages mailing list<o:p></o:p></span></pre>
<pre><span style="color:black"><a href="mailto:Outages@outages.org" \
target="_blank">Outages@outages.org</a><o:p></o:p></span></pre> <pre><span \
style="color:black"><a \
href="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.net \
%2Fmailman%2Flistinfo%2Foutages&amp;data=02%7C01%7Candyt%40zumasys.com%7C37f498a854014 \
cb8b14908d5aaec3017%7Cbfd62fcabd384e07a0785e9943d1f9c0%7C0%7C0%7C636602853767043922&amp;sdata=DiqLjAZyaoHjk2S%2FxV%2BVTl27d3pyAIQpnPwWJEa6YaE%3D&amp;reserved=0" \
target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><o:p></o:p></span></pre>
 </blockquote>
<p class="MsoNormal"><span \
style="font-size:12.0pt;color:black"><o:p>&nbsp;</o:p></span></p> </div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span \
style="font-size:12.0pt;color:black"><br> \
_______________________________________________<br> Outages mailing list<br>
<a href="mailto:Outages@outages.org">Outages@outages.org</a><br>
<a href="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether. \
net%2Fmailman%2Flistinfo%2Foutages&amp;data=02%7C01%7Candyt%40zumasys.com%7C37f498a854 \
014cb8b14908d5aaec3017%7Cbfd62fcabd384e07a0785e9943d1f9c0%7C0%7C0%7C636602853767043922&amp;sdata=DiqLjAZyaoHjk2S%2FxV%2BVTl27d3pyAIQpnPwWJEa6YaE%3D&amp;reserved=0" \
target="_blank">https://puck.nether.net/mailman/listinfo/outages</a><o:p></o:p></span></p>
 </blockquote>
</div>
<p class="MsoNormal"><span \
style="font-size:12.0pt;color:black"><o:p>&nbsp;</o:p></span></p> </div>
</div>
</div>
</div>
</div>
</body>
</html>



_______________________________________________
Outages-discussion mailing list
Outages-discussion@outages.org
https://puck.nether.net/mailman/listinfo/outages-discussion

--===============4922860851057215104==--

[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic