[prev in list] [next in list] [prev in thread] [next in thread]
List: outages-discussion
Subject: Re: [Outages-discussion] [outages] Reports of AT&T outage(s)
From: "B.J. Ash" <bjash () kentrecords ! com>
Date: 2014-01-13 17:54:40
Message-ID: EC9B7552BD3A7C4AB4DAEDD1485079407A3D8AAA () krm-0704 ! krmimaging ! com
[Download RAW message or body]
We saw an outage from AT&T (fiber) only to Charter (cable) from 2:35 - 3:18=
with all other paths to other providers accessible throughout that time.
--
B.J.
From: Outages-discussion [mailto:outages-discussion-bounces@outages.org] On=
Behalf Of Chris Burwell
Sent: Monday, January 13, 2014 12:44
To: Outages Mailing List
Cc: outages-discussion@outages.org
Subject: Re: [Outages-discussion] [outages] Reports of AT&T outage(s)
This had wide impact, including MPLS customers and Internet service across =
the globe.
Our alerts started around 03:00 ET and the last issue cleared shortly befor=
e 09:00 AM ET today. AT&T stated a 3 hour outage window with no official rf=
o yet.
The numbers I saw stated over 400 routers were rebooted to recover.
- Chris
Sent from my mobile device
On Jan 13, 2014, at 11:21 AM, Evan Rhoades <evan@exigent.com<mailto:evan@ex=
igent.com>> wrote:
Earlier today we had a site down in the 12.250.x.x block, it came back up a=
round 8am PST.
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Eric Henson
Sent: Monday, January 13, 2014 7:53 AM
To: Damian Guppy; staticsafe
Cc: outages@outages.org<mailto:outages@outages.org>
Subject: Re: [outages] Reports of AT&T outage(s)
According to that reddit thread, ATT U-Verse can't connect to anything that=
uses AWS, such as Netflix.
One post says this:
"Work in a NOC; from what I understand ATT had a code bug that caused memor=
y problems on their edge routers. Had to reboot about 270 of them. Its supp=
osed to be resolved now"
--
ERIC HENSON
Solutions Architect for Systems Organization
PFSweb | www.pfsweb.com<http://www.pfsweb.com/>
p: 972.881.2900 x3104
m: 972.948.3424
From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Damian Gupp=
y
Sent: Monday, January 13, 2014 9:44 AM
To: staticsafe
Cc: outages@outages.org<mailto:outages@outages.org>
Subject: Re: [outages] Reports of AT&T outage(s)
I'm noticing a few sites down, possibly due to DDoS?
--Damian
On Mon, Jan 13, 2014 at 11:27 PM, staticsafe <me@staticsafe.ca<mailto:me@st=
aticsafe.ca>> wrote:
http://www.reddit.com/r/sysadmin/comments/1v3fs1/att_outage/
http://downdetector.com/status/att/map
--
staticsafe
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
------------------------
This email was scanned by BitDefender.
_______________________________________________
Outages mailing list
Outages@outages.org<mailto:Outages@outages.org>
https://puck.nether.net/mailman/listinfo/outages
[Attachment #3 (text/html)]
<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.hoenzb
{mso-style-name:hoenzb;}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">We \
saw an outage from AT&T (fiber) only to Charter (cable) from 2:35 – 3:18 \
with all other paths to other providers accessible throughout that \
time.<o:p></o:p></span></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">--</span><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">B.J.</span><span \
style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif"">From:</span></b><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif""> \
Outages-discussion [mailto:outages-discussion-bounces@outages.org] <b>On Behalf Of \
</b>Chris Burwell<br> <b>Sent:</b> Monday, January 13, 2014 12:44<br>
<b>To:</b> Outages Mailing List<br>
<b>Cc:</b> outages-discussion@outages.org<br>
<b>Subject:</b> Re: [Outages-discussion] [outages] Reports of AT&T \
outage(s)<o:p></o:p></span></p> </div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">This had wide impact, including MPLS customers and Internet \
service across the globe.<o:p></o:p></p> </div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Our alerts started around 03:00 ET and the last issue cleared \
shortly before 09:00 AM ET today. AT&T stated a 3 hour outage window with no \
official rfo yet.<o:p></o:p></p> </div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">The numbers I saw stated over 400 \
routers were rebooted to recover.<o:p></o:p></p> <div>
<p class="MsoNormal">- Chris<o:p></o:p></p>
</div>
<p class="MsoNormal">Sent from my mobile device<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
On Jan 13, 2014, at 11:21 AM, Evan Rhoades <<a \
href="mailto:evan@exigent.com">evan@exigent.com</a>> wrote:<o:p></o:p></p> </div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Earlier \
today we had a site down in the 12.250.x.x block, it came back up around 8am PST. \
</span><o:p></o:p></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span \
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> \
Outages [<a href="mailto:outages-bounces@outages.org">mailto:outages-bounces@outages.org</a>]
<b>On Behalf Of </b>Eric Henson<br>
<b>Sent:</b> Monday, January 13, 2014 7:53 AM<br>
<b>To:</b> Damian Guppy; staticsafe<br>
<b>Cc:</b> <a href="mailto:outages@outages.org">outages@outages.org</a><br>
<b>Subject:</b> Re: [outages] Reports of AT&T outage(s)</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">According \
to that reddit thread, ATT U-Verse can’t connect to anything that uses AWS, \
such as Netflix.</span><o:p></o:p></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">One \
post says this: </span><o:p></o:p></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">“Work \
in a NOC; from what I understand ATT had a code bug that caused memory problems on \
their edge routers. Had to reboot about 270 of them. Its supposed to be resolved \
now”</span><o:p></o:p></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="line-height:150%"><span \
style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#59595C">--
<b><br>
</b></span><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#6F8CC0">ERIC \
HENSON</span><span style="font-family:"Arial","sans-serif";color:#78A22F"><br>
</span><span style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#59595C">Solutions \
Architect for Systems Organization</span><o:p></o:p></p> <p class="MsoNormal" \
style="line-height:150%"><span \
style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#59595C">PFSweb \
| </span><span \
style="font-size:11.0pt;line-height:150%;font-family:"Calibri","sans-serif";color:#1F497D"><a \
href="http://www.pfsweb.com/"><span \
style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#59595C">www.pfsweb.com</span></a></span><span \
style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#59595C"><br>
</span><b><span style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#6F8CC0">p:</span></b><span \
style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#6F8CC0">
</span><span style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#59595C">972.881.2900 \
x3104<br> </span><b><span \
style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#6F8CC0">m:</span></b><span \
style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#6F8CC0">
</span><span style="font-size:8.0pt;line-height:150%;font-family:"Arial","sans-serif";color:#59595C">972.948.3424</span><o:p></o:p></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span \
style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> \
Outages [<a href="mailto:outages-bounces@outages.org">mailto:outages-bounces@outages.org</a>]
<b>On Behalf Of </b>Damian Guppy<br>
<b>Sent:</b> Monday, January 13, 2014 9:44 AM<br>
<b>To:</b> staticsafe<br>
<b>Cc:</b> <a href="mailto:outages@outages.org">outages@outages.org</a><br>
<b>Subject:</b> Re: [outages] Reports of AT&T outage(s)</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">I'm noticing a few sites down, possibly due to \
DDoS?<o:p></o:p></p> <div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">--Damian<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On Mon, Jan 13, 2014 at 11:27 PM, staticsafe <<a \
href="mailto:me@staticsafe.ca" target="_blank">me@staticsafe.ca</a>> \
wrote:<o:p></o:p></p> <p class="MsoNormal"><a \
href="http://www.reddit.com/r/sysadmin/comments/1v3fs1/att_outage/" \
target="_blank">http://www.reddit.com/r/sysadmin/comments/1v3fs1/att_outage/</a><br> \
<a href="http://downdetector.com/status/att/map" \
target="_blank">http://downdetector.com/status/att/map</a><br> <span \
class="hoenzb"><span style="color:#888888">--</span></span><span \
style="color:#888888"><br> <span class="hoenzb">staticsafe</span><br>
<br>
<span class="hoenzb">_______________________________________________</span><br>
<span class="hoenzb">Outages mailing list</span><br>
<span class="hoenzb"><a \
href="mailto:Outages@outages.org">Outages@outages.org</a></span><br> <span \
class="hoenzb"><a href="https://puck.nether.net/mailman/listinfo/outages" \
target="_blank">https://puck.nether.net/mailman/listinfo/outages</a></span></span><o:p></o:p></p>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
------------------------<br>
This email was scanned by BitDefender.<o:p></o:p></p>
</div>
</blockquote>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">_______________________________________________<br>
Outages mailing list<br>
<a href="mailto:Outages@outages.org">Outages@outages.org</a><br>
<a href="https://puck.nether.net/mailman/listinfo/outages">https://puck.nether.net/mailman/listinfo/outages</a><o:p></o:p></p>
</div>
</blockquote>
</div>
</body>
</html>
_______________________________________________
Outages-discussion mailing list
Outages-discussion@outages.org
https://puck.nether.net/mailman/listinfo/outages-discussion
--===============0388139476899459013==--
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic