[prev in list] [next in list] [prev in thread] [next in thread]
List: cisco-voip
Subject: Re: [cisco-voip] Fun message on CER after power outage...
From: Adam Pawlowski <ajp26 () buffalo ! edu>
Date: 2022-02-23 13:21:14
Message-ID: CY4PR15MB1254750969A82174FBF242C2AA3C9 () CY4PR15MB1254 ! namprd15 ! prod ! outlook ! com
[Download RAW message or body]
We rebuilt a bunch of them after a data center failure over summer. It did take up a \
bunch of time to schedule that maintenance and have someone run through it, but that \
was the worst of it.
In our lab things have been powered off / on forcefully before, and never any ill \
effect that I've run into that I can say is direct result, other than the experience \
I had with CER.
This document has been around for a number of years:
https://www.cisco.com/c/en/us/support/docs/unified-communications/unified-communications-manager-callmanager/116717-trouble-cucm-shutdown-00.html
so I would imagine that TAC, especially now with a shortage of engineers/experience, \
might want to check that instead of chasing weird issues. We'd run into things where \
phone tracking would just stop operating, even with the process running. Or it would \
say it ran and nothing happened or updated until we restarted it. Since CER is such \
jank in the background, with little exposed to really play with or look at, it was \
way faster to export, backup, re-install, restore, than to grind through that with \
TAC - and it seemed to solve our problem.
That being said restoring from backup is acceptable in these cases, and I have to \
wonder if it's possible for data in the database to be bad/corrupted as well in the \
backup if it's taken after that message is displayed. They didn't care. I think the \
call was some sort of consistency checking instead of just asking for it to be \
rebuilt, but I don't know if that would be delivered.
CER documentation specifically seemed to have a lot more wording in it about making \
sure it is running, it's working well, backed up, etc due to the nature of the \
service it is providing - likely to try and hedge against some sort of blame being \
placed on Cisco if an emergency call didn't complete.
Best,
Adam
From: Jonathan Charles <jonvoip@gmail.com>
Sent: Tuesday, February 22, 2022 5:35 PM
To: Lelio Fulgenzi <lelio@uoguelph.ca>
Cc: Nick Russo <russon81@yahoo.com>; cisco-voip@puck.nether.net; Adam Pawlowski \
<ajp26@buffalo.edu>
Subject: Re: [cisco-voip] Fun message on CER after power outage...
Yeah, that seems a bit extreme...
Everything seems fine with the box... every check I have made says it is working \
fine... (DB Replication, status, test calls, phone tracking...)
Jonathan
On Tue, Feb 22, 2022 at 3:11 PM Lelio Fulgenzi \
<lelio@uoguelph.ca<mailto:lelio@uoguelph.ca>> wrote: A UPS with comms available. In \
our datacenter we have a UPS but it's not comms enabled.
This is yet another "special requirement" for Cisco collab software that will drive \
people crazy. Including management.
"Sorry, you took power away, I know have to spend the weekend rebuilding 8 servers \
(or more)"
"But no one else is saying they have to rebuild servers"
"Yeah, it's another one of those special requirements"
From: Nick Russo <russon81@yahoo.com<mailto:russon81@yahoo.com>>
Sent: Tuesday, February 22, 2022 4:07 PM
To: Lelio Fulgenzi <lelio@uoguelph.ca<mailto:lelio@uoguelph.ca>>; Jonathan Charles \
<jonvoip@gmail.com<mailto:jonvoip@gmail.com>>; \
cisco-voip@puck.nether.net<mailto:cisco-voip@puck.nether.net>; Adam Pawlowski \
<ajp26@buffalo.edu<mailto:ajp26@buffalo.edu>>
Subject: Re: [cisco-voip] Fun message on CER after power outage...
CAUTION: This email originated from outside of the University of Guelph. Do not click \
links or open attachments unless you recognize the sender and know the content is \
safe. If in doubt, forward suspicious emails to \
IThelp@uoguelph.ca<mailto:IThelp@uoguelph.ca>
This is my favorite new Cisco "feature". All the 14.x platforms have this. I think \
they implemented in 12.5(su4 or 5), but if the system goes down dirty, the official \
Cisco policy is to do a restore from backup. So far, I haven't had any actual issues \
after this happens, but if your system is in this state, TAC won't help you until \
you've rebuilt. There are a few options for graceful shutdown in VMWare, but your \
server needs to be on a UPS for them to work.
On Tuesday, February 22, 2022, 01:01:39 PM PST, Adam Pawlowski \
<ajp26@buffalo.edu<mailto:ajp26@buffalo.edu>> wrote:
I need to find it, but of course can't right now, but I swear this is in the ER \
documentation somewhere, some version, that the system must be re-installed if it \
shuts down unexpectedly. Outside of this message.
I got called out on it by TAC, and they have documentation way preceding that message \
appearing visibly to point out where unexpected shutdowns have occurred.
There was a back and forth in the community on this, with a lot of people more \
interesting in making the message go away than trying to figure out if the system was \
okay or rebuild it.
I guess in some places it is normal to operate the infrastructure on car batteries or \
what have you. I really must be missing something as this feels like the old "put \
tape over the check engine light" .
Same thing I said there - personally, rebuild the thing when you can on your time \
table, instead of having it fail later, or during an upgrade.
CER seems to be the easiest thing to re-install - if you have exports you can replace \
the system functionality rather quickly even when DRF backups are no good.
Adam
From: cisco-voip <cisco-voip-bounces@puck.nether.net<mailto:cisco-voip-bounces@puck.nether.net>> \
On Behalf Of Lelio Fulgenzi
Sent: Tuesday, February 22, 2022 3:07 PM
To: Jonathan Charles <jonvoip@gmail.com<mailto:jonvoip@gmail.com>>; \
cisco-voip@puck.nether.net<mailto:cisco-voip@puck.nether.net>
Subject: Re: [cisco-voip] Fun message on CER after power outage...
Yes - those warnings were making their way around another forum. It all has to do \
with reviewing the log files for a corresponding manual shutdown for any bootup \
sequences.
There is a fix (?) for the core apps found here. Normally these should work on CER \
but it's not listed. Not sure why.
https://www.cisco.com/web/software/286319173/139477/ciscocm.add_utils_ungraceful_warn_ \
disable_v1.0.cop-README.pdf<https://nam12.safelinks.protection.outlook.com/?url=https% \
3A%2F%2Fwww.cisco.com%2Fweb%2Fsoftware%2F286319173%2F139477%2Fciscocm.add_utils_ungrac \
eful_warn_disable_v1.0.cop-README.pdf&data=04%7C01%7Cajp26%40buffalo.edu%7C9c8a6142dfe \
e47add90a08d9f6539cca%7C96464a8af8ed40b199e25f6b50a20250%7C0%7C0%7C637811663165959984% \
7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn \
0%3D%7C1000&sdata=ib%2Bo%2BoEy%2Ff6WGI6SiZmjpnVBevfzDl63KmD7vL1nioM%3D&reserved=0>
From the readme (above):
The fix is included natively in 12.5.1SU6 (12.5.1.16900-x) and higher and 14SU2 \
(14.0.1.12900-x) and higher.
Note: I don't think this fixes the issue, just removes the warning. If TAC reviews \
the logs and finds an ungraceful shutdown, they can start asking you to rebuild.
PS I don't see why a system can't recover without a rebuild either.
From: cisco-voip <cisco-voip-bounces@puck.nether.net<mailto:cisco-voip-bounces@puck.nether.net>> \
On Behalf Of Jonathan Charles
Sent: Tuesday, February 22, 2022 2:58 PM
To: cisco-voip@puck.nether.net<mailto:cisco-voip@puck.nether.net>
Subject: [cisco-voip] Fun message on CER after power outage...
CAUTION: This email originated from outside of the University of Guelph. Do not click \
links or open attachments unless you recognize the sender and know the content is \
safe. If in doubt, forward suspicious emails to \
IThelp@uoguelph.ca<mailto:IThelp@uoguelph.ca>
Only on the CLI...
WARNING: Ungraceful shutdown detected - A rebuild of this node is highly recommended \
to ensure no negative impact(such as configuration or file system corruption). For \
rebuild instructions, see the installation guide.
The bugs suggest it should only be on 12.5 and early... this is on CER 14...
Any recommendations? This seems a bit extreme...
The system appears to be working normally.
Jonathan
_______________________________________________
cisco-voip mailing list
cisco-voip@puck.nether.net<mailto:cisco-voip@puck.nether.net>
https://puck.nether.net/mailman/listinfo/cisco-voip<https://nam12.safelinks.protection \
.outlook.com/?url=https%3A%2F%2Fpuck.nether.net%2Fmailman%2Flistinfo%2Fcisco-voip&data \
=04%7C01%7Cajp26%40buffalo.edu%7C9c8a6142dfee47add90a08d9f6539cca%7C96464a8af8ed40b199 \
e25f6b50a20250%7C0%7C0%7C637811663165959984%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMD \
AiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Uxjjyb2ebwKjxw7Bp3qCE6oL%2F37sPMWoSoX55hC5M5A%3D&reserved=0>
[Attachment #3 (text/html)]
<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:CiscoSans;}
@font-face
{font-family:"Helvetica Neue";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal, \
li.gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal, \
div.gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal \
{mso-style-name:gmail-m_-8967088646148749108ydp7a627243yiv0037387415msonormal; \
mso-margin-top-alt:auto; margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">We \
rebuilt a bunch of them after a data center failure over summer. It did take up a \
bunch of time to schedule that maintenance and have someone run through it, but that \
was the worst of it.<o:p></o:p></span></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">In \
our lab things have been powered off / on forcefully before, and never any ill effect \
that I’ve run into that I can say is direct result, other than the experience \
I had with CER.<o:p></o:p></span></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">This \
document has been around for a number of years:<o:p></o:p></span></p> <p \
class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><a \
href="https://www.cisco.com/c/en/us/support/docs/unified-communications/unified-commun \
ications-manager-callmanager/116717-trouble-cucm-shutdown-00.html">https://www.cisco.c \
om/c/en/us/support/docs/unified-communications/unified-communications-manager-callmanager/116717-trouble-cucm-shutdown-00.html</a><o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">so \
I would imagine that TAC, especially now with a shortage of engineers/experience, \
might want to check that instead of chasing weird issues.<o:p></o:p></span></p> <p \
class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">We’d \
run into things where phone tracking would just stop operating, even with the process \
running. Or it would say it ran and nothing happened or updated until we restarted \
it.<o:p></o:p></span></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Since \
CER is such jank in the background, with little exposed to really play with or look \
at, it was way faster to export, backup, re-install, restore, than to grind through \
that with TAC – and it seemed to solve our problem.<o:p></o:p></span></p> <p \
class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">That \
being said restoring from backup is acceptable in these cases, and I have to wonder \
if it’s possible for data in the database to be bad/corrupted as well in the \
backup if it’s taken after that message is displayed. They didn’t care. I \
think the call was some sort of consistency checking instead of just asking for it to \
be rebuilt, but I don’t know if that would be delivered. <o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">CER \
documentation specifically seemed to have a lot more wording in it about making sure \
it is running, it’s working well, backed up, etc due to the nature of the \
service it is providing – likely to try and hedge against some sort of blame \
being placed on Cisco if an emergency call didn’t complete. \
<o:p></o:p></span></p> <p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Best,<o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Adam<o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Jonathan Charles \
<jonvoip@gmail.com> <br>
<b>Sent:</b> Tuesday, February 22, 2022 5:35 PM<br>
<b>To:</b> Lelio Fulgenzi <lelio@uoguelph.ca><br>
<b>Cc:</b> Nick Russo <russon81@yahoo.com>; cisco-voip@puck.nether.net; Adam \
Pawlowski <ajp26@buffalo.edu><br> <b>Subject:</b> Re: [cisco-voip] Fun message \
on CER after power outage...<o:p></o:p></span></p> </div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Yeah, that seems a bit extreme... <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Everything seems fine with the box... every check I have made \
says it is working fine... (DB Replication, status, test calls, phone \
tracking...)<o:p></o:p></p> </div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Jonathan<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Tue, Feb 22, 2022 at 3:11 PM Lelio Fulgenzi <<a \
href="mailto:lelio@uoguelph.ca">lelio@uoguelph.ca</a>> wrote:<o:p></o:p></p> \
</div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in \
0in 6.0pt;margin-left:4.8pt;margin-right:0in"> <div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">A UPS \
with comms available. In our datacenter we have a UPS but it’s not comms \
enabled.<o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">This is \
yet another “special requirement” for Cisco collab software that will \
drive people crazy. Including management.<o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">“Sorry, \
you took power away, I know have to spend the weekend rebuilding 8 servers (or \
more)”<o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">“But \
no one else is saying they have to rebuild servers”<o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">“Yeah, it’s \
another one of those special requirements”<o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b>From:</b> Nick Russo \
<<a href="mailto:russon81@yahoo.com" target="_blank">russon81@yahoo.com</a>> \
<br> <b>Sent:</b> Tuesday, February 22, 2022 4:07 PM<br>
<b>To:</b> Lelio Fulgenzi <<a href="mailto:lelio@uoguelph.ca" \
target="_blank">lelio@uoguelph.ca</a>>; Jonathan Charles <<a \
href="mailto:jonvoip@gmail.com" target="_blank">jonvoip@gmail.com</a>>; <a \
href="mailto:cisco-voip@puck.nether.net" \
target="_blank">cisco-voip@puck.nether.net</a>; Adam Pawlowski <<a \
href="mailto:ajp26@buffalo.edu" target="_blank">ajp26@buffalo.edu</a>><br> \
<b>Subject:</b> Re: [cisco-voip] Fun message on CER after power \
outage...<o:p></o:p></p> </div>
</div>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p> <div \
style="border:solid #9C6500 1.0pt;padding:2.0pt 2.0pt 2.0pt 2.0pt"> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:12.0pt;background:#FFEB9C">
<b><span style="font-size:10.0pt;color:black">CAUTION:</span></b><span \
style="font-size:10.0pt;color:black"> This email originated from outside of the \
University of Guelph. Do not click links or open attachments unless you recognize the \
sender and know the content is safe. If in doubt, forward suspicious emails to <a \
href="mailto:IThelp@uoguelph.ca" target="_blank"> \
IThelp@uoguelph.ca</a></span><o:p></o:p></p> </div>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p> \
<div> <div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.0pt;font-family:"Helvetica Neue",serif">This is my \
favorite new Cisco "feature". All the 14.x platforms have this. \
I think they implemented in 12.5(su4 or 5), but if the system goes down dirty, the \
official Cisco policy is to do a restore from backup. So far, I haven't had any \
actual issues after this happens, but if your system is in this state, TAC won't help \
you until you've rebuilt. There are a few options for graceful shutdown in \
VMWare, but your server needs to be on a UPS for them to work.</span><o:p></o:p></p> \
</div> <div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif"> </span><o:p></o:p></p> </div>
</div>
<div id="gmail-m_-8967088646148749108ydp7a627243yahoo_quoted_5948776264">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">On Tuesday, February 22, 2022, 01:01:39 PM PST, Adam \
Pawlowski <<a href="mailto:ajp26@buffalo.edu" \
target="_blank">ajp26@buffalo.edu</a>> wrote: </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> </div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> </div>
<div>
<div id="gmail-m_-8967088646148749108ydp7a627243yiv0037387415">
<div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica Neue",serif;color:#1F497D">I \
need to find it, but of course can’t right now, but I swear this is in the ER \
documentation somewhere, some version, that the system must be re-installed if it \
shuts down unexpectedly. Outside of this message. </span><o:p></o:p></p>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#1F497D"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica Neue",serif;color:#1F497D">I \
got called out on it by TAC, and they have documentation way preceding that message \
appearing visibly to point out where unexpected shutdowns have \
occurred.</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#1F497D"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#1F497D">There was a back and forth in the community on this, \
with a lot of people more interesting in making the message go away than trying to \
figure out if the system was okay or rebuild it. </span> <o:p></o:p></p>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica Neue",serif;color:#1F497D">I \
guess in some places it is normal to operate the infrastructure on car batteries or \
what have you. I really must be missing something as this feels like the old \
“put tape over the check engine light” .</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#1F497D"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#1F497D">Same thing I said there – personally, rebuild \
the thing when you can on your time table, instead of having it fail later, or \
during an upgrade. </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#1F497D">CER seems to be the easiest thing to re-install \
– if you have exports you can replace the system functionality rather quickly \
even when DRF backups are no good.</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#1F497D"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#1F497D">Adam</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#1F497D"> </span><o:p></o:p></p> <div \
style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt"> <div \
id="gmail-m_-8967088646148749108ydp7a627243yiv0037387415yqt60901"> <div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><b><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">From:</span></b><span \
style="font-size:10.0pt;font-family:"Helvetica Neue",serif;color:#26282A"> \
cisco-voip <<a href="mailto:cisco-voip-bounces@puck.nether.net" \
target="_blank">cisco-voip-bounces@puck.nether.net</a>> <b>On Behalf Of </b>Lelio \
Fulgenzi<br> <b>Sent:</b> Tuesday, February 22, 2022 3:07 PM<br>
<b>To:</b> Jonathan Charles <<a href="mailto:jonvoip@gmail.com" \
target="_blank">jonvoip@gmail.com</a>>; <a \
href="mailto:cisco-voip@puck.nether.net" \
target="_blank">cisco-voip@puck.nether.net</a><br> <b>Subject:</b> Re: [cisco-voip] \
Fun message on CER after power outage...</span><o:p></o:p></p> </div>
</div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">Yes – those warnings were making their way \
around another forum. It all has to do with reviewing the log files for a \
corresponding manual shutdown for any bootup sequences.</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">There is a fix (?) for the core apps found here. \
Normally these should work on CER but it’s not listed. Not sure \
why.</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"><a \
href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.cisco.com% \
2Fweb%2Fsoftware%2F286319173%2F139477%2Fciscocm.add_utils_ungraceful_warn_disable_v1.0 \
.cop-README.pdf&data=04%7C01%7Cajp26%40buffalo.edu%7C9c8a6142dfee47add90a08d9f6539 \
cca%7C96464a8af8ed40b199e25f6b50a20250%7C0%7C0%7C637811663165959984%7CUnknown%7CTWFpbG \
Zsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ib%2Bo%2BoEy%2Ff6WGI6SiZmjpnVBevfzDl63KmD7vL1nioM%3D&reserved=0" \
target="_blank">https://www.cisco.com/web/software/286319173/139477/ciscocm.add_utils_ungraceful_warn_disable_v1.0.cop-README.pdf</a></span><o:p></o:p></p>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">From the readme (above):</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">The fix is included natively in 12.5.1SU6 \
(12.5.1.16900-x) and higher and 14SU2 (14.0.1.12900-x) and \
higher.</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">Note: I don’t think this fixes the issue, just \
removes the warning. If TAC reviews the logs and finds an ungraceful shutdown, they \
can start asking you to rebuild.</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">PS I don’t see why a system can’t recover \
without a rebuild either.</span><o:p></o:p></p> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <div \
style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in"> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><b><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">From:</span></b><span \
style="font-size:10.0pt;font-family:"Helvetica Neue",serif;color:#26282A"> \
cisco-voip <<a href="mailto:cisco-voip-bounces@puck.nether.net" \
target="_blank">cisco-voip-bounces@puck.nether.net</a>> <b>On Behalf Of \
</b>Jonathan Charles<br> <b>Sent:</b> Tuesday, February 22, 2022 2:58 PM<br>
<b>To:</b> <a href="mailto:cisco-voip@puck.nether.net" \
target="_blank">cisco-voip@puck.nether.net</a><br> <b>Subject:</b> [cisco-voip] Fun \
message on CER after power outage...</span><o:p></o:p></p> </div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <div style="border:solid \
#9C6500 1.0pt;padding:2.0pt 2.0pt 2.0pt 2.0pt"> <p \
class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal" \
style="line-height:12.0pt;background:#FFEB9C"> <b><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:black">CAUTION:</span></b><span \
style="font-size:10.0pt;font-family:"Helvetica Neue",serif;color:black"> \
This email originated from outside of the University of Guelph. Do not click links \
or open attachments unless you recognize the sender and know the content is safe. If \
in doubt, forward suspicious emails to <a href="mailto:IThelp@uoguelph.ca" \
target="_blank">IThelp@uoguelph.ca</a></span><o:p></o:p></p> </div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> <div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal" \
style="text-align:justify"> <span \
style="font-size:10.5pt;font-family:CiscoSans;color:#212529">Only on the \
CLI...</span><o:p></o:p></p> <div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.5pt;font-family:CiscoSans;color:#212529"> </span><o:p></o:p></p>
</div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.5pt;font-family:CiscoSans;color:#212529">WARNING: Ungraceful \
shutdown detected - A rebuild of this node is highly recommended to ensure no \
negative impact(such as configuration or file system corruption). For rebuild \
instructions, see the installation guide.</span><o:p></o:p></p> <div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> </div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.5pt;font-family:CiscoSans;color:#212529">The bugs suggest it \
should only be on 12.5 and early... this is on CER 14...</span><o:p></o:p></p> </div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> </div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.5pt;font-family:CiscoSans;color:#212529">Any recommendations? \
This seems a bit extreme...</span><o:p></o:p></p> </div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> </div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.5pt;font-family:CiscoSans;color:#212529">The system appears to be \
working normally.</span><o:p></o:p></p> </div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> </div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> </div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A"> </span><o:p></o:p></p> </div>
<div>
<p class="gmail-m-8967088646148749108ydp7a627243yiv0037387415msonormal"><span \
style="font-size:10.5pt;font-family:CiscoSans;color:#212529">Jonathan</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div id="gmail-m_-8967088646148749108ydp7a627243yqt85945">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
style="font-size:10.0pt;font-family:"Helvetica \
Neue",serif;color:#26282A">_______________________________________________<br> \
cisco-voip mailing list<br> <a href="mailto:cisco-voip@puck.nether.net" \
target="_blank">cisco-voip@puck.nether.net</a><br> <a \
href="https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpuck.nether.ne \
t%2Fmailman%2Flistinfo%2Fcisco-voip&data=04%7C01%7Cajp26%40buffalo.edu%7C9c8a6142d \
fee47add90a08d9f6539cca%7C96464a8af8ed40b199e25f6b50a20250%7C0%7C0%7C63781166316595998 \
4%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6 \
Mn0%3D%7C1000&sdata=Uxjjyb2ebwKjxw7Bp3qCE6oL%2F37sPMWoSoX55hC5M5A%3D&reserved=0" \
target="_blank">https://puck.nether.net/mailman/listinfo/cisco-voip</a></span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</body>
</html>
_______________________________________________
cisco-voip mailing list
cisco-voip@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-voip
--===============5015907062369625823==--
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic