<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.apple-tab-span
{mso-style-name:apple-tab-span;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Good news on that matter,<br>
<br>
5.2.2.0 will have an option to ignore those events when they come from a client cluster.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="DE" style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual">Mit freundlichen Grüßen / Kind regards</span><span lang="DE" style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><b><span lang="DE" style="font-size:11.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual">Norbert Schuld<o:p></o:p></span></b></p>
<p class="MsoNormal" style="text-autospace:none"><b><span lang="DE" style="font-size:11.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual"><o:p> </o:p></span></b></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual">Software Engineer, Release Architect IBM Storage Scale<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual">IBM Systems / 00E636<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual"><o:p> </o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual">Brüsseler Straße 1-3<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual">60327 Frankfurt<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual">Phone: +49-160-7070335<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual">E-Mail:
</span><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual"><a href="mailto:nschuld@de.ibm.com"><span lang="DE" style="color:#0563C1">nschuld@de.ibm.com</span></a></span><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual"><o:p></o:p></span></p>
<table class="NormaleTabelle" border="0" cellspacing="0" cellpadding="0" width="1480" style="width:1110.0pt;border-collapse:collapse">
<tbody>
<tr>
<td width="1480" style="width:1110.25pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal"><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black"><o:p> </o:p></span></p>
</td>
</tr>
<tr>
<td width="1480" style="width:1110.25pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><i><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-ligatures:standardcontextual"><a href="https://www.ibm.com/privacy/us/en/"><span style="font-style:normal">IBM
Data Privacy Statement</span></a></span></i><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#A2A2A2;mso-ligatures:standardcontextual">
<o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="1480" style="width:1110.25pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#A2A2A2">IBM Deutschland Research & Development GmbH<o:p></o:p></span></p>
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span lang="DE" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#A2A2A2">Vorsitzender des Aufsichtsrats: Wolfgang Wendt / Geschäftsführung: David Faller<br>
Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294
<o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><span lang="DE" style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="DE" style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> gpfsug-discuss <gpfsug-discuss-bounces@gpfsug.org>
<b>On Behalf Of </b>Ryan Novosielski<br>
<b>Sent:</b> Friday, September 13, 2024 4:34 PM<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@gpfsug.org><br>
<b>Subject:</b> [EXTERNAL] Re: [gpfsug-discuss] mmhealth alerts too quickly<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">On Sep 13, 2024, at 08:</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white">\u200a</span><span style="font-size:1.0pt;color:white">15, Dietrich,
Stefan <stefan.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white">\u200a</span><span style="font-size:1.0pt;color:white">dietrich@</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white">\u200a</span><span style="font-size:1.0pt;color:white">desy.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white">\u200a</span><span style="font-size:1.0pt;color:white">de>
wrote: Hello Peter, Since we upgraded to 5.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white">\u200a</span><span style="font-size:1.0pt;color:white">1.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white">\u200a</span><span style="font-size:1.0pt;color:white">9-5
we're getting random nodes moaning about lost connections when ever a another machine is rebooted or stops working.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white">\u200a</span><span style="font-size:1.0pt;color:white"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white"><o:p></o:p></span></p>
</div>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">On Sep 13, 2024, at 08:15, Dietrich, Stefan <<a href="mailto:stefan.dietrich@desy.de">stefan.dietrich@desy.de</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">Hello Peter,<br>
<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal">Since we upgraded to 5.1.9-5 we're getting random nodes moaning about lost<br>
connections when ever a another machine is rebooted or stops working. This is<br>
great, however there does not seam to be any great way to acknowledge the<br>
alerts, or close the connections gracefully if the machine is turned off rather<br>
than actually failing.<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"><br>
it's possible to resolve event in mmhealth:<br>
<br>
# mmhealth event resolve<br>
Missing arguments.<br>
Usage:<br>
mmhealth event resolve {EventName} [Identifier]<br>
<br>
-> `mmhealth event resolve cluster_connections_down AFFECTED_IP` should do the trick.<br>
<br>
In our clusters, a regular reboot doesn't seem to trigger this event. All our nodes are running Scale >= 5.2.0<o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Our clusters (5.1.9-3 on the client side, and either 5.1.5-1 or 5.1.9-2 on the storage side) also show downed connections, but I wish this were somehow tunable. A single downed client that\u2019s not even part of the same cluster is not a reason
to alert us on our storage cluster. We monitor MMHEALTH via Nagios, and so we\u2019re occasionally getting messages about a single client.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">--<br>
#BlackLivesMatter<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">____<br>
|| <a href="file://UTGERS">\\UTGERS</a>, |---------------------------*O*---------------------------<br>
||_// the State<span class="apple-tab-span"> </span> | Ryan Novosielski - <a href="mailto:novosirj@rutgers.edu">novosirj@rutgers.edu</a><br>
|| \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus<br>
|| \\ of NJ<span class="apple-tab-span"> </span> | Office of Advanced Research Computing - MSB A555B, Newark<br>
`'<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
</div>
</div>
</div>
</body>
</html>