<font size=2 face="sans-serif">And this behavior can be changed using
the enforceFilesetQuotaOnRoot options ( check mmchconfig man page)</font><br><font size=2 face="sans-serif"><br>Regards,<br><br>Tomer Perry<br>Scalable I/O Development (Spectrum Scale)<br>email: tomp@il.ibm.com<br>1 Azrieli Center, Tel Aviv 67021, Israel<br>Global Tel: +1 720 3422758<br>Israel Tel: +972 3 9188625<br>Mobile: +972 52 2554625<br></font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">"Markus Rohwedder"
<rohwedder@de.ibm.com></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">gpfsug main discussion
list <gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Cc:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">26/10/2017 10:18</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">Re: [gpfsug-discuss]
Fileset quotas enforcement</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=2>Please also note that when you write as root, you are
not restricted by the quota limits.</font><font size=3><br></font><font size=2><br>See example:</font><font size=3><br></font><font size=2 face="Courier New"><br>Write as non root user and run into hard limit:<br>[mr@home-11 limited]$ dd if=/dev/urandom of=testfile2 bs=1000 count=100000<br>dd: error writing ‘testfile2’: Disk quota exceeded<br>29885+0 records in<br>29884+0 records out<br>29884000 bytes (30 MB) copied, 3.38491 s, 8.8 MB/s</font><font size=3><br></font><font size=2 face="Courier New"><br>[root@home-11 limited]# mmrepquota gpfs0<br>Block Limits | File Limits<br>Name type KB quota limit in_doubt grace | files quota limit in_doubt grace<br>...<br>limited FILESET 322176 214784 322304 128 7 days | 5 0 0 0 none</font><font size=3><br></font><font size=2 face="Courier New"><br>Now write as root user and exceed hard limit:<br>[root@home-11 limited]# dd if=/dev/urandom of=testfile2 bs=1000 count=100000<br>100000+0 records in<br>100000+0 records out<br>100000000 bytes (100 MB) copied, 12.8355 s, 7.8 MB/s</font><font size=3><br></font><font size=2 face="Courier New"><br>[root@home-11 limited]# mmrepquota gpfs0<br>Block Limits | File Limits<br>Name type KB quota limit in_doubt grace | files quota limit in_doubt grace<br>...<br>limited FILESET 390656 214784 322304 8939520 7 days | 5 0 0 40 none</font><font size=3><br></font><font size=1 face="Arial"><br>Mit freundlichen Gren / Kind regards</font><font size=3><br></font><font size=1 face="Arial"><b><br>Dr. Markus Rohwedder</b></font><font size=3><br></font><font size=1 color=#0060a0 face="Arial"><br>Spectrum Scale GUI Development</font><table width=497 style="border-collapse:collapse;"><tr height=8><td width=497 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><hr><tr height=8><td width=497 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><img align=bottom src=cid:_1_E46716A4E467141C003256C7C22581C5 width=1 height=1 style="border:0px solid;"><tr height=8><td width=36 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">Phone:</font><td width=160 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">+49
7034 6430190</font><td width=214 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">IBM
Deutschland</font><td width=87 rowspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=right><img align=bottom src=cid:_1_E4642530E4641FB0003256C7C22581C5 style="border:0px solid;"></div><tr height=8><td width=36 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">E-Mail:</font><td width=160 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">rohwedder@de.ibm.com</font><td width=214 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">Am
Weiher 24</font><tr height=8><td width=36 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><img align=bottom src=cid:_1_E463FD50E463FAF8003256C7C22581C5 width=1 height=1 style="border:0px solid;"><td width=160 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><img align=bottom src=cid:_1_E46402D0E4640078003256C7C22581C5 width=1 height=1 style="border:0px solid;"><td width=214 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">65451
Kelsterbach</font><tr height=8><td width=36 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><img align=bottom src=cid:_1_E4641128E4640ED0003256C7C22581C5 width=1 height=1 style="border:0px solid;"><td width=160 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><img align=bottom src=cid:_1_E46416A8E4641450003256C7C22581C5 width=1 height=1 style="border:0px solid;"><td width=214 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">Germany</font><tr height=8><td width=497 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><hr><tr height=8><td width=497 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><img align=bottom src=cid:_1_E4644278E4643FF0003256C7C22581C5 width=1 height=1 style="border:0px solid;"><tr height=8><td width=497 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#a2a2a2 face="Arial">IBM
Deutschland Research & Development GmbH / Vorsitzender des Aufsichtsrats:
Martina Kderitz <br>Geschftsfhrung: Dirk Wittkopp<br>Sitz der Gesellschaft: Bblingen / Registergericht: Amtsgericht Stuttgart,
HRB 243294 </font></table><br><font size=3><br><br></font><img src=cid:_1_E460E9D8E466F160003256C7C22581C5 alt="Inactive hide details for "Jaime Pinto" ---10/26/2017 12:18:45 AM---Did you try to run mmcheckquota on the device I observed th" style="border:0px solid;"><font size=2 color=#424282>"Jaime
Pinto" ---10/26/2017 12:18:45 AM---Did you try to run mmcheckquota
on the device I observed that in the most recent versions (for the l</font><font size=3><br></font><font size=2 color=#5f5f5f><br>From: </font><font size=2>"Jaime Pinto" <pinto@scinet.utoronto.ca></font><font size=2 color=#5f5f5f><br>To: </font><font size=2>"gpfsug main discussion list" <gpfsug-discuss@spectrumscale.org>,
"Emmanuel Barajas Gonzalez" <vanfalen@mx1.ibm.com></font><font size=2 color=#5f5f5f><br>Cc: </font><font size=2>gpfsug-discuss@spectrumscale.org</font><font size=2 color=#5f5f5f><br>Date: </font><font size=2>10/26/2017 12:18 AM</font><font size=2 color=#5f5f5f><br>Subject: </font><font size=2>Re: [gpfsug-discuss] Fileset quotas enforcement</font><font size=2 color=#5f5f5f><br>Sent by: </font><font size=2>gpfsug-discuss-bounces@spectrumscale.org</font><font size=3><br></font><hr noshade><font size=3><br><br></font><tt><font size=2><br>Did you try to run mmcheckquota on the device<br><br>I observed that in the most recent versions (for the last 3 years) <br>there is a real long lag for GPFS to process the internal accounting. <br>So there is a slippage effects that skews quota operations. <br>mmcheckquota is supposed to reset and zero all those cumulative deltas
<br>effective immediately.<br><br>Jaime<br><br>Quoting "Emmanuel Barajas Gonzalez" <vanfalen@mx1.ibm.com>:<br><br>> Hello spectrum scale team! I'm working on the implementation
of<br>> quotas per fileset and I followed the basic instructions described
in<br>> the documentation. Currently the gpfs device has per-fileset quotas<br>> and there is one fileset with a block soft and a hard limit set. My<br>> problem is that I'm being able to write more and more files beyond<br>> the quota (the grace period has expired as well). How can I
make<br>> sure quotas will be enforced and that no user will be able to consume<br>> more space than specified? mmrepquota smfslv0<br>>
Block Limits<br>> |<br>> Name fileset type
KB quota
limit<br>> in_doubt grace |<br>> root root USR
512 0
0<br>> 0 none |<br>> root cp1 USR
64128 0
0<br>> 0 none |<br>> system root GRP
512 0
0<br>> 0 none |<br>> system cp1 GRP
64128 0
0<br>> 0 none |<br>> valid root GRP
0 0
0<br>> 0 none |<br>> root root FILESET
512 0
0<br>> 0 none |<br>> cp1 root FILESET
64128 2048 2048<br>> 0 expired |<br>> Thanks in advance ! Best regards,<br>> __________________________________________________________________________________<br>> Emmanuel Barajas Gonzalez TRANSPARENT CLOUD TIERING FOR DS8000<br>><br>>
Phone:<br>> 52-33-3669-7000 x5547 E-mail: vanfalen@mx1.ibm.com[1] Follow me:<br>> @van_falen<br>>
2200 Camino
A El Castillo<br>>
El Salto, JAL 45680<br>>
Mexico<br>><br>><br>><br>><br>> Links:<br>> ------<br>> [1] </font></tt><a href=mailto:vanfalen@mx1.ibm.com><tt><font size=2 color=blue><u>mailto:vanfalen@mx1.ibm.com</u></font></tt></a><tt><font size=2><br>><br><br><br><br><br><br><br> ************************************<br> TELL US ABOUT YOUR SUCCESS STORIES<br> </font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.scinethpc.ca_testimonials&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=mno73q7nVmqF-YTzo7pAF50B_45epo6ZzccTAwcroRU&e="><tt><font size=2 color=blue><u>https://urldefense.proofpoint.com/v2/url?u=http-3A__www.scinethpc.ca_testimonials&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=mno73q7nVmqF-YTzo7pAF50B_45epo6ZzccTAwcroRU&e=</u></font></tt></a><tt><font size=2><br> ************************************<br>---<br>Jaime Pinto<br>SciNet HPC Consortium - Compute/Calcul Canada<br></font></tt><a href=www.scinet.utoronto.ca><tt><font size=2>www.scinet.utoronto.ca</font></tt></a><tt><font size=2>- </font></tt><a href=www.computecanada.ca><tt><font size=2>www.computecanada.ca</font></tt></a><tt><font size=2><br>University of Toronto<br>661 University Ave. (MaRS), Suite 1140<br>Toronto, ON, M5G1M1<br>P: 416-978-2755<br>C: 416-505-1477<br><br>----------------------------------------------------------------<br>This message was sent using IMP at SciNet Consortium, University of Toronto.<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font></tt><tt><font size=2 color=blue><u><br></u></font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=F6chd4olb-U3RlL5pcqBPagIccRSJd963K0FFS7auko&e="><tt><font size=2 color=blue><u>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=F6chd4olb-U3RlL5pcqBPagIccRSJd963K0FFS7auko&e=</u></font></tt></a><tt><font size=2><br></font></tt><font size=3><br><br><br></font><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=mLPyKeOa1gNDrORvEXBgMw&m=RxLph-CHLj5Iq5-RYe9eqHId7vsI_uuX4W-Y145ETD8&s=3cgWIXnSFvb65_5JkJDygm3hnSOeeCfYnDnPJdX-hWY&e="><tt><font size=2>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=mLPyKeOa1gNDrORvEXBgMw&m=RxLph-CHLj5Iq5-RYe9eqHId7vsI_uuX4W-Y145ETD8&s=3cgWIXnSFvb65_5JkJDygm3hnSOeeCfYnDnPJdX-hWY&e=</font></tt></a><tt><font size=2><br></font></tt><br><br><BR>