<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.ph
{mso-style-name:ph;}
span.tablecap
{mso-style-name:tablecap;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">So it could be that we didn\u2019t really know what we were doing when our system was installed (and still don\u2019t by some of the messages
I post *<b>cough</b>*) but basically I think we\u2019re quite similar to other shops where we resell GPFS to departmental users internally and it just made some sense to break down each one into a fileset. We can then snapshot each one individually (7402 snapshots
at the moment) and apply quotas.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">I know your question was why independent and not dependent \u2013 but I honestly don\u2019t know. I assume it\u2019s to do with not crossing the streams
if you\u2019ll excuse the obvious film reference. <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Richard<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> gpfsug-discuss-bounces@spectrumscale.org [mailto:gpfsug-discuss-bounces@spectrumscale.org]
<b>On Behalf Of </b>Stephen Ulmer<br>
<b>Sent:</b> 18 May 2017 15:48<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject:</b> Re: [gpfsug-discuss] What is an independent fileset? was: mmbackup with fileset : scope errors<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Each independent fileset is an allocation area, and they are (I believe) handled separately. There are a set of allocation managers for each file system, and when you need to create a file you ask one of them to do it. Each one has a pre-negotiated
range of inodes to hand out, so there isn\u2019t a single point of contention for creating files. I\u2019m pretty sure that means that they all have to have a range for each inode space. This is based on my own logic, and could be complete nonsense.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">While I\u2019m sure that limit could be changed eventually, there\u2019s probably some efficiencies in not making it much bigger than it needs to be. I don\u2019t know if it would take an on-disk format change or not.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">So how do you decide that a use case gets it\u2019s own fileset, and do you just always use independent or is there an evaluation? I\u2019m just curious because I like to understand lots of different points of view \u2014 feel free to tell me to go away.
:)<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="color:black">-- <br>
Stephen<br>
<br>
<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">On May 18, 2017, at 10:32 AM, Sobey, Richard A <<a href="mailto:r.sobey@imperial.ac.uk">r.sobey@imperial.ac.uk</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Thanks, I was just about to post that, and I guess is still the reason a dependent fileset is still the default without the \u2013inode-space new option fileset creation.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">I do wonder why there is a limit of 1000, whether it\u2019s just IBM not envisaging any customer needing more than that? We\u2019ve only got 414 at the moment but that
will grow to over 500 this year.<span class="apple-converted-space"> </span></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Richard</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><span style="color:purple">gpfsug-discuss-bounces@spectrumscale.org</span></a><span class="apple-converted-space"> </span>[<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><span style="color:purple">mailto:gpfsug-discuss-bounces@spectrumscale.org</span></a>]<b>On
Behalf Of<span class="apple-converted-space"> </span></b>David D. Johnson<br>
<b>Sent:</b><span class="apple-converted-space"> </span>18 May 2017 15:24<br>
<b>To:</b><span class="apple-converted-space"> </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org"><span style="color:purple">gpfsug-discuss@spectrumscale.org</span></a>><br>
<b>Subject:</b><span class="apple-converted-space"> </span>Re: [gpfsug-discuss] What is an independent fileset? was: mmbackup with fileset : scope errors</span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Here is one big reason independent filesets are problematic:<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal" style="background:white;vertical-align:baseline"><span class="ph"><span style="font-family:"Arial",sans-serif;color:#323232;border:none windowtext 1.0pt;padding:0cm">A5.13:</span></span><o:p></o:p></p>
</div>
<div>
<div>
<table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" summary="" style="margin-left:36.0pt;border-collapse:collapse">
<thead>
<tr>
<td colspan="3" style="border:none;padding:12.0pt 15.0pt 12.0pt 15.0pt">
<div>
<p class="MsoNormal"><span class="tablecap"><span style="border:none windowtext 1.0pt;padding:0cm">Table 43. Maximum number of filesets</span></span><o:p></o:p></p>
</div>
</td>
</tr>
<tr>
<td width="22%" valign="bottom" style="width:22.0%;border:solid #E0E0E0 1.0pt;padding:12.0pt 15.0pt 12.0pt 15.0pt">
<p class="MsoNormal" align="center" style="text-align:center"><b>Version of GPFS</b><o:p></o:p></p>
</td>
<td width="36%" valign="bottom" style="width:36.0%;border:solid #E0E0E0 1.0pt;border-left:none;padding:12.0pt 15.0pt 12.0pt 15.0pt">
<p class="MsoNormal" align="center" style="text-align:center"><b>Maximum Number of Dependent Filesets</b><o:p></o:p></p>
</td>
<td width="40%" valign="bottom" style="width:40.0%;border:solid #E0E0E0 1.0pt;border-left:none;padding:12.0pt 15.0pt 12.0pt 15.0pt">
<p class="MsoNormal" align="center" style="text-align:center"><b>Maximum Number of Independent Filesets</b><o:p></o:p></p>
</td>
</tr>
</thead>
<tbody>
<tr style="font-size:inherit">
<td width="22%" valign="top" style="width:22.0%;border:solid #E0E0E0 1.0pt;border-top:none;padding:12.0pt 15.0pt 12.0pt 15.0pt;font-size:inherit">
<div>
<p class="MsoNormal">IBM Spectrum Scale V4<o:p></o:p></p>
</div>
</td>
<td width="36%" valign="top" style="width:36.0%;border-top:none;border-left:none;border-bottom:solid #E0E0E0 1.0pt;border-right:solid #E0E0E0 1.0pt;padding:12.0pt 15.0pt 12.0pt 15.0pt;font-size:inherit">
<div>
<p class="MsoNormal">10,000<o:p></o:p></p>
</div>
</td>
<td width="40%" valign="top" style="width:40.0%;border-top:none;border-left:none;border-bottom:solid #E0E0E0 1.0pt;border-right:solid #E0E0E0 1.0pt;padding:12.0pt 15.0pt 12.0pt 15.0pt;font-size:inherit">
<div>
<p class="MsoNormal">1,000<o:p></o:p></p>
</div>
</td>
</tr>
<tr style="font-size:inherit">
<td width="22%" valign="top" style="width:22.0%;border:solid #E0E0E0 1.0pt;border-top:none;padding:12.0pt 15.0pt 12.0pt 15.0pt;font-size:inherit">
<div>
<p class="MsoNormal">GPFS V3.5<o:p></o:p></p>
</div>
</td>
<td width="36%" valign="top" style="width:36.0%;border-top:none;border-left:none;border-bottom:solid #E0E0E0 1.0pt;border-right:solid #E0E0E0 1.0pt;padding:12.0pt 15.0pt 12.0pt 15.0pt;font-size:inherit">
<div>
<p class="MsoNormal">10,000<o:p></o:p></p>
</div>
</td>
<td width="40%" valign="top" style="width:40.0%;border-top:none;border-left:none;border-bottom:solid #E0E0E0 1.0pt;border-right:solid #E0E0E0 1.0pt;padding:12.0pt 15.0pt 12.0pt 15.0pt;font-size:inherit">
<div>
<p class="MsoNormal">1,000<o:p></o:p></p>
</div>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Another is that each independent fileset must be sized (and resized) for the number of inodes it is expected to contain.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">If that runs out (due to growth or a runaway user job), new files cannot be created until the inode limit is bumped up.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">This is true of the root namespace as well, but there\u2019s only one number to watch per filesystem. <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> \u2014 ddj<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Dave Johnson<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Brown University<o:p></o:p></p>
</div>
</div>
</div>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at<span class="apple-converted-space"> </span></span><a href="http://spectrumscale.org/"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif;color:purple">spectrumscale.org</span></a><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif"><br>
</span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif;color:purple">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></a><o:p></o:p></p>
</div>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</body>
</html>