<div dir="ltr">Hello all,<div><br></div><div>/tmp/mmfs is being deleted every 10 days by a systemd service " <span style="background-color:rgba(209,211,224,0.15);color:rgb(20,20,34);font-family:Menlo,Consolas,"Roboto Mono","Ubuntu Monospace","Noto Mono","Oxygen Mono","Liberation Mono",monospace;font-size:0.86em">systemd-tmpfiles-setup.service ". That service calls a configuration file " </span> /usr/lib/tmpfiles.d/tmp.conf . What we did was add a drop in file in /etc/tmpfiles.d/tmp.conf <span style="color:rgb(20,20,34);font-family:system-ui,-apple-system,"Segoe UI",Roboto,Ubuntu,Cantarell,"Noto Sans",sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol","Noto Color Emoji";font-size:14px">to then create the directory /tmp/mmfs and then exclude deleting going forward. Here's our actual file and some commentary of what the options mean:<br><br></span># cat /etc/tmpfiles.d/tmp.conf <br># Create a /tmp/mmfs directory <br>d /tmp/mmfs 0755 root root 1s <-------- the " d " is to create directory <br>x /tmp/mmfs/* <-------- the " x " says to ignore it<span style="color:rgb(20,20,34);font-family:system-ui,-apple-system,"Segoe UI",Roboto,Ubuntu,Cantarell,"Noto Sans",sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol","Noto Color Emoji";font-size:14px"><br></span></div><div><br></div><div>That change helped us avoid /tmp/mmfs from being deleted every 10 days. </div><div><br></div><div>In addition I think also did a %systemctl daemon-reload ( but I don't have it in my notes, wouldn't hurt to run it ) </div><div><br></div><div>Hope this helps,</div><div>Lior </div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Nov 8, 2021 at 7:00 AM <<a href="mailto:gpfsug-discuss-request@spectrumscale.org">gpfsug-discuss-request@spectrumscale.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Send gpfsug-discuss mailing list submissions to<br>
<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=slrrB7dE8n7gBJbeO0g-IQ&r=mpcjMHidaF8RcWRPB_iRCw&m=9QxnPQt1bSZxcCSYNtyRayTlYJXf34X5KKh3De5IgMDu-nH9CJqmaDSWLT8a55c6&s=vChJle7IBS3KbsRXb2h7akGKeDm_cjQUD6xeLHLSyDs&e=" rel="noreferrer" target="_blank">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=slrrB7dE8n7gBJbeO0g-IQ&r=mpcjMHidaF8RcWRPB_iRCw&m=9QxnPQt1bSZxcCSYNtyRayTlYJXf34X5KKh3De5IgMDu-nH9CJqmaDSWLT8a55c6&s=vChJle7IBS3KbsRXb2h7akGKeDm_cjQUD6xeLHLSyDs&e=</a> <br>
or, via email, send a message with subject or body 'help' to<br>
<a href="mailto:gpfsug-discuss-request@spectrumscale.org" target="_blank">gpfsug-discuss-request@spectrumscale.org</a><br>
<br>
You can reach the person managing the list at<br>
<a href="mailto:gpfsug-discuss-owner@spectrumscale.org" target="_blank">gpfsug-discuss-owner@spectrumscale.org</a><br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than "Re: Contents of gpfsug-discuss digest..."<br>
<br>
<br>
Today's Topics:<br>
<br>
1. /tmp/mmfs vanishes randomly? (Billich Heinrich Rainer (ID SD))<br>
2. Re: /tmp/mmfs vanishes randomly? (Olaf Weiser)<br>
3. Re: /tmp/mmfs vanishes randomly? (Jonathan Buzzard)<br>
<br>
<br>
----------------------------------------------------------------------<br>
<br>
Message: 1<br>
Date: Mon, 8 Nov 2021 09:20:24 +0000<br>
From: "Billich Heinrich Rainer (ID SD)" <<a href="mailto:heinrich.billich@id.ethz.ch" target="_blank">heinrich.billich@id.ethz.ch</a>><br>
To: gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a>><br>
Subject: [gpfsug-discuss] /tmp/mmfs vanishes randomly?<br>
Message-ID: <<a href="mailto:739922FB-051D-4239-A6F6-3B7782E9849D@id.ethz.ch" target="_blank">739922FB-051D-4239-A6F6-3B7782E9849D@id.ethz.ch</a>><br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
Hello,<br>
<br>
We use /tmp/mmfs as dataStructureDump directory. Since a while I notice that this directory randomly vanishes. Mmhealth does not complain but just notes that it will no longer monitor the directory. Still I doubt that trace collection and similar will create the directory when needed?<br>
<br>
Do you know of any spectrum scale internal mechanism that could cause /tmp/mmfs to get deleted? It happens on ESS nodes, with a plain IBM installation, too. It happens just on one or two nodes at a time, it's no cluster-wide cleanup or similar. We run scale 5.0.5 and ESS 6.0.2.2 and 6.0.2.2.<br>
<br>
Thank you,<br>
<br>
Mmhealth message:<br>
local_fs_path_not_found INFO The configured dataStructureDump path /tmp/mmfs does not exists. Skipping monitoring.<br>
<br>
Kind regards,<br>
<br>
Heiner<br>
---<br>
=======================<br>
Heinrich Billich<br>
ETH Z?rich<br>
Informatikdienste<br>
Tel.: +41 44 632 72 56<br>
<a href="mailto:heinrich.billich@id.ethz.ch" target="_blank">heinrich.billich@id.ethz.ch</a><br>
========================<br>
<br>
<br>
<br>
<br>
<br>
------------------------------<br>
<br>
Message: 2<br>
Date: Mon, 8 Nov 2021 09:53:04 +0000<br>
From: "Olaf Weiser" <<a href="mailto:olaf.weiser@de.ibm.com" target="_blank">olaf.weiser@de.ibm.com</a>><br>
To: <a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a><br>
Cc: <a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a><br>
Subject: Re: [gpfsug-discuss] /tmp/mmfs vanishes randomly?<br>
Message-ID:<br>
<<a href="mailto:OF2A5EBCF0.DD13F52D-ON00258787.0035D664-00258787.00364C25@ibm.com" target="_blank">OF2A5EBCF0.DD13F52D-ON00258787.0035D664-00258787.00364C25@ibm.com</a>><br>
Content-Type: text/plain; charset="us-ascii"<br>
<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_pipermail_gpfsug-2Ddiscuss_attachments_20211108_1d32c09e_attachment-2D0001.html&d=DwICAg&c=slrrB7dE8n7gBJbeO0g-IQ&r=mpcjMHidaF8RcWRPB_iRCw&m=9QxnPQt1bSZxcCSYNtyRayTlYJXf34X5KKh3De5IgMDu-nH9CJqmaDSWLT8a55c6&s=zpe2MuRXotkV_yDkY-UQSIE68CEBIWsRoj4Qya85nJU&e=" rel="noreferrer" target="_blank">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_pipermail_gpfsug-2Ddiscuss_attachments_20211108_1d32c09e_attachment-2D0001.html&d=DwICAg&c=slrrB7dE8n7gBJbeO0g-IQ&r=mpcjMHidaF8RcWRPB_iRCw&m=9QxnPQt1bSZxcCSYNtyRayTlYJXf34X5KKh3De5IgMDu-nH9CJqmaDSWLT8a55c6&s=zpe2MuRXotkV_yDkY-UQSIE68CEBIWsRoj4Qya85nJU&e=</a> ><br>
<br>
------------------------------<br>
<br>
Message: 3<br>
Date: Mon, 8 Nov 2021 09:54:18 +0000<br>
From: Jonathan Buzzard <<a href="mailto:jonathan.buzzard@strath.ac.uk" target="_blank">jonathan.buzzard@strath.ac.uk</a>><br>
To: <a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a><br>
Subject: Re: [gpfsug-discuss] /tmp/mmfs vanishes randomly?<br>
Message-ID: <<a href="mailto:e018a360-b63b-6425-9a70-47713fb14bf2@strath.ac.uk" target="_blank">e018a360-b63b-6425-9a70-47713fb14bf2@strath.ac.uk</a>><br>
Content-Type: text/plain; charset=utf-8; format=flowed<br>
<br>
On 08/11/2021 09:20, Billich Heinrich Rainer (ID SD) wrote:<br>
<br>
> Hello,<br>
> <br>
> We use /tmp/mmfs as dataStructureDump directory. Since a while I<br>
> notice that this directory randomly vanishes. Mmhealth does not<br>
> complain but just notes that it will no longer monitor the directory.<br>
> Still I doubt that trace collection and similar will create the<br>
> directory when needed?<br>
> <br>
> Do you know of any spectrum scale internal mechanism that could cause<br>
> /tmp/mmfs to get deleted? It happens on ESS nodes, with a plain IBM<br>
> installation, too. It happens just on one or two nodes at a time,<br>
> it's no cluster-wide cleanup or similar. We run scale 5.0.5 and ESS<br>
> 6.0.2.2 and 6.0.2.2.<br>
> <br>
<br>
I know several Linux distributions clear the contents of /tmp at boot <br>
time. Could that explain it?<br>
<br>
I would say using /tmp like you are doing is not a sensible idea anyway <br>
and that you should be using something under /var.<br>
<br>
<br>
JAB.<br>
<br>
-- <br>
Jonathan A. Buzzard Tel: +44141-5483420<br>
HPC System Administrator, ARCHIE-WeSt.<br>
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG<br>
<br>
<br>
------------------------------<br>
<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" rel="noreferrer" target="_blank">spectrumscale.org</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=slrrB7dE8n7gBJbeO0g-IQ&r=mpcjMHidaF8RcWRPB_iRCw&m=9QxnPQt1bSZxcCSYNtyRayTlYJXf34X5KKh3De5IgMDu-nH9CJqmaDSWLT8a55c6&s=vChJle7IBS3KbsRXb2h7akGKeDm_cjQUD6xeLHLSyDs&e=" rel="noreferrer" target="_blank">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=slrrB7dE8n7gBJbeO0g-IQ&r=mpcjMHidaF8RcWRPB_iRCw&m=9QxnPQt1bSZxcCSYNtyRayTlYJXf34X5KKh3De5IgMDu-nH9CJqmaDSWLT8a55c6&s=vChJle7IBS3KbsRXb2h7akGKeDm_cjQUD6xeLHLSyDs&e=</a> <br>
<br>
<br>
End of gpfsug-discuss Digest, Vol 118, Issue 4<br>
**********************************************<br>
</blockquote></div>