<font size=2 face="sans-serif">I still see the following statement* regarding
with the use of LROC in FAQ (URL #1).</font><br><font size=2 face="sans-serif">Are there any issues anticipated to
use LROC on protocol nodes?</font><br><br><font size=2 face="sans-serif">Q8.3: What are some configuration considerations
when deploying the protocol functionality?</font><br><font size=2 face="sans-serif">A8.3: Configuration considerations include:</font><br><font size=2 face="sans-serif"> (... many lines are snipped
...)</font><br><font size=2 face="sans-serif">Several GPFS configuration aspects have
not been explicitly tested with the protocol function:</font><br><font size=2 face="sans-serif"> (... many lines are snipped
...)</font><br><font size=2 face="sans-serif">Local Read Only Cache*</font><br><font size=2 face="sans-serif"> (... many lines are snipped
...)</font><br><br><font size=2 face="sans-serif">Q2.25: What are the current requirements
when using local read-only cache?</font><br><font size=2 face="sans-serif">A2.25: The current requirements/limitations
for using local read-only cache include:</font><br><font size=2 face="sans-serif">- A minimum of IBM Spectrum Scale V4.1.0.1.</font><br><font size=2 face="sans-serif">- Local read-only cache is only supported
on Linux x86 and Power.</font><br><font size=2 face="sans-serif">- The minimum size of a local read-only
cache device is 4 GB.</font><br><font size=2 face="sans-serif">- The local read-only cache requires
memory equal to 1% of the local read-only device's capacity.</font><br><font size=2 face="sans-serif">Note: Use of local read-only cache does
not require a server license</font><br><br><font size=2 face="sans-serif">[1] IBM Spectrum Scale\u2122 Frequently
Asked Questions and Answers (November 2016)</font><br><a href=https://www.ibm.com/support/knowledgecenter/STXKQY/gpfsclustersfaq.html><font size=2 color=blue face="sans-serif">https://www.ibm.com/support/knowledgecenter/STXKQY/gpfsclustersfaq.html</font></a><br><br><font size=2 face="sans-serif">---<br>Keigo Matsubara, Industry Architect, IBM Japan<br>TEL: +81-50-3150-0595, T/L: 6205-0595<br></font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">"Olaf Weiser"
<olaf.weiser@de.ibm.com></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">gpfsug main discussion
list <gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">2016/12/21 05:31</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">Re: [gpfsug-discuss]
LROC</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=2 face="sans-serif">it's all true and right, but please
have in mind.. with MFTC and the number of nodes in the ( remote
and local ) cluster, you 'll need token mem<br>since R42 token Mem is allocated automatically .. so the old tokenMEMLimit
is more or less obsolete.. but you should have your overall configuration
in mind, when raising MFTC clusterwide...</font><font size=3><br></font><font size=2 face="sans-serif"><br>just a hint.. </font><font size=3><br></font><font size=2 face="sans-serif"><br>have fun...</font><br><font size=2 face="sans-serif">Mit freundlichen Grüßen / Kind regards</font><font size=3><br></font><font size=2 face="sans-serif"><br> <br>Olaf Weiser<br><br>EMEA Storage Competence Center Mainz, German / IBM Systems, Storage Platform,<br>-------------------------------------------------------------------------------------------------------------------------------------------<br>IBM Deutschland<br>IBM Allee 1<br>71139 Ehningen<br>Phone: +49-170-579-44-66<br>E-Mail: olaf.weiser@de.ibm.com<br>-------------------------------------------------------------------------------------------------------------------------------------------<br>IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter<br>Geschäftsführung: Martina Koederitz (Vorsitzende), Susanne Peter, Norbert
Janzen, Dr. Christian Keller, Ivo Koerner, Markus Koerner<br>Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart,
HRB 14562 / WEEE-Reg.-Nr. DE 99369940 </font><font size=3><br><br><br></font><font size=1 color=#5f5f5f face="sans-serif"><br>From: </font><font size=1 face="sans-serif">"Oesterlin,
Robert" <Robert.Oesterlin@nuance.com></font><font size=1 color=#5f5f5f face="sans-serif"><br>To: </font><font size=1 face="sans-serif">gpfsug
main discussion list <gpfsug-discuss@spectrumscale.org></font><font size=1 color=#5f5f5f face="sans-serif"><br>Date: </font><font size=1 face="sans-serif">12/20/2016
08:19 PM</font><font size=1 color=#5f5f5f face="sans-serif"><br>Subject: </font><font size=1 face="sans-serif">Re:
[gpfsug-discuss] LROC</font><font size=1 color=#5f5f5f face="sans-serif"><br>Sent by: </font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><font size=3><br></font><hr noshade><font size=3><br><br></font><font size=2 face="Calibri"><br>We\u2019re currently deploying LROC in many of our compute nodes \u2013 results
so far have been excellent. We\u2019re putting in 240gb SSDs, because we have
mostly small files. As far as I know, the amount of inodes and directories
in LROC are not limited, except by the size of the cache disk.<br> <br>Look at these config options for LROC:<br> </font><font size=2 face="Courier"><b><br>lrocData</b></font><font size=2 face="Arial"><br>Controls whether user data is populated into the local read-only cache.
Other configuration options can be used to select the data that is eligible
for the local read-only cache. When using more than one such configuration
option, data that matches any of the specified criteria is eligible to
be saved.<br>Valid values are <b>yes</b> or <b>no</b>. The default value is <b>yes</b>.<br>If <b>lrocData</b> is set to <b>yes</b>, by default the data that was not
already in the cache when accessed by a user is subsequently saved to the
local read-only cache. The default behavior can be overridden using the<b>lrocDataMaxFileSize</b>and <b>lrocDataStubFileSize</b>configuration options to save all data from
small files or all data from the initial portion of large files.</font><font size=2 face="Courier"><b><br>lrocDataMaxFileSize</b></font><font size=2 face="Arial"><br>Limits the data that may be saved in the local read-only cache to only
the data from small files.<br>A value of -1 indicates that all data is eligible to be saved. A value
of 0 indicates that small files are not to be saved. A positive value indicates
the maximum size of a file to be considered for the local read-only cache.
For example, a value of 32768 indicates that files with 32 KB of data or
less are eligible to be saved in the local read-only cache. The default
value is 0.</font><font size=2 face="Courier"><b><br>lrocDataStubFileSize</b></font><font size=2 face="Arial"><br>Limits the data that may be saved in the local read-only cache to only
the data from the first portion of all files.<br>A value of -1 indicates that all file data is eligible to be saved. A value
of 0 indicates that stub data is not eligible to be saved. A positive value
indicates that the initial portion of each file that is eligible is to
be saved. For example, a value of 32768 indicates that the first 32 KB
of data from each file is eligible to be saved in the local read-only cache.
The default value is 0.</font><font size=2 face="Courier"><b><br>lrocDirectories</b></font><font size=2 face="Arial"><br>Controls whether directory blocks is populated into the local read-only
cache. The option also controls other file system metadata such as indirect
blocks, symbolic links, and extended attribute overflow blocks.<br>Valid values are <b>yes</b> or <b>no</b>. The default value is <b>yes</b>.</font><font size=2 face="Courier"><b><br>lrocInodes</b></font><font size=2 face="Arial"><br>Controls whether inodes from open files is populated into the local read-only
cache; the cache contains the full inode, including all disk pointers,
extended attributes, and data.<br>Valid values are <b>yes</b> or <b>no</b>. The default value is <b>yes</b>.</font><font size=2 face="Calibri"><br> <br> </font><font size=3 face="Calibri"><br>Bob Oesterlin<br>Sr Principal Storage Engineer, Nuance<br>507-269-0413</font><font size=3 face="Times New Roman"><br> </font><font size=2 face="Calibri"><br> <br> </font><font size=3 face="Calibri"><b><br>From: </b><gpfsug-discuss-bounces@spectrumscale.org> on behalf of
Matt Weil <mweil@wustl.edu><b><br>Reply-To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Date: </b>Tuesday, December 20, 2016 at 1:13 PM<b><br>To: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><b><br>Subject: </b>[EXTERNAL] Re: [gpfsug-discuss] LROC</font><font size=3 face="Times New Roman"><br> </font><p><font size=3 face="Times New Roman">as many as possible and both</font><p><font size=3 face="Times New Roman">have maxFilesToCache 128000</font><p><font size=3 face="Times New Roman">and maxStatCache 40000</font><p><font size=3 face="Times New Roman">do these effect what sits on the
LROC as well? Are those to small? 1million seemed excessive.<br> <br>On 12/20/16 11:03 AM, Sven Oehme wrote:<br>how much files do you want to cache ? <br>and do you only want to cache metadata or also data associated to the files
?<br> <br>sven<br> <br> <br> <br>On Tue, Dec 20, 2016 at 5:35 PM Matt Weil <</font><a href=mailto:mweil@wustl.edu><font size=3 color=blue face="Times New Roman"><u>mweil@wustl.edu</u></font></a><font size=3 face="Times New Roman">>
wrote:</font><font size=3 color=blue><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ibm.com_developerworks_community_wikis_home-3Flang-3Den-23-2521_wiki_General-2520Parallel-2520File-2520System-2520-2528GPFS-2529_page_Flash-2520Storage&d=DgMD-g&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=D9PgR75CqOuL7nxcynOJv1fayX8BDPrsoSt83TFc8sE&s=6G1jlkjDVKTD9tPVCnAIlmVwgzjLahUX8GYNQrSmvBM&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/General%20Parallel%20File%20System%20(GPFS)/page/Flash%20Storage</u></font></a><font size=3 face="Times New Roman"><br><br>Hello all,<br><br>Are there any tuning recommendations to get these to cache more metadata?<br><br>Thanks<br><br>Matt<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__spectrumscale.org&d=DgMD-g&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=D9PgR75CqOuL7nxcynOJv1fayX8BDPrsoSt83TFc8sE&s=H8L4Lw9j9AYJkyQbnBT3li4LKSJ83994bWWYdc3GylU&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>spectrumscale.org</u></font></a><font size=3 color=blue><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DgMD-g&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=D9PgR75CqOuL7nxcynOJv1fayX8BDPrsoSt83TFc8sE&s=nAjj-yiG02HTaf_5AiE5LZA-gYS27y2Diy_FcbIDT-0&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></a><font size=3 face="Times New Roman"><br><br></font><font size=3><br></font><font size=2><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font><font size=3 color=blue><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DgMD-g&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=D9PgR75CqOuL7nxcynOJv1fayX8BDPrsoSt83TFc8sE&s=nAjj-yiG02HTaf_5AiE5LZA-gYS27y2Diy_FcbIDT-0&e="><font size=2 color=blue><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></a><font size=3 face="Times New Roman"><br></font><tt><font size=2><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font></tt><font size=3 color=blue><u><br></u></font><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2 color=blue><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></tt></a><font size=3><br><br></font><p><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size=2><br></font></tt><p><p><BR>