<font size=2 face="sans-serif">Transferring the small files with AFM +
NFS over high latency networks is always a challenge. For example,
for each small file replication AFM performs a lookup, create, write
and set mtime operation. If the latency is 10ms, replication of each
file takes minimum (10 * 4 = 40 ms) amount of time. AFM is not a
network acceleration tool and also it does not use compression. If
the file sizes are big, AFM parallel IO and parallel mounts feature can
be used. Aspera can be used to transfer the small files over high
latency network with better utilization of the network bandwidth.</font><br><br><a href="https://www.ibm.com/support/knowledgecenter/no/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/b1lins_afmparalleldatatransferwithremotemounts.htm"><font size=2 color=blue face="sans-serif">https://www.ibm.com/support/knowledgecenter/no/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/b1lins_afmparalleldatatransferwithremotemounts.htm</font></a><br><a href="https://www.ibm.com/support/knowledgecenter/no/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1ins_paralleldatatransfersafm.htm"><font size=2 color=blue face="sans-serif">https://www.ibm.com/support/knowledgecenter/no/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1ins_paralleldatatransfersafm.htm</font></a><br><br><font size=2 face="sans-serif">~Venkat (vpuvvada@in.ibm.com)</font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">Chris Schlipalius <chris.schlipalius@pawsey.org.au></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif"><gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">02/27/2020 05:54 AM</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">[EXTERNAL] Re:
[gpfsug-discuss] AFM Alternative? Aspera?</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><tt><font size=2>Maybe the following would assist? I do think tarring
up files first is best, but you could always check out:<br></font></tt><a href="http://www.redbooks.ibm.com/redpapers/pdfs/redp5527.pdf"><tt><font size=2>http://www.redbooks.ibm.com/redpapers/pdfs/redp5527.pdf</font></tt></a><tt><font size=2><br></font></tt><a href="https://www.spectrumscaleug.org/wp-content/uploads/2019/05/SSSD19DE-Day-2-B02-Integration-of-Spectrum-Scale-and-Aspera-Sync.pdf"><tt><font size=2>https://www.spectrumscaleug.org/wp-content/uploads/2019/05/SSSD19DE-Day-2-B02-Integration-of-Spectrum-Scale-and-Aspera-Sync.pdf</font></tt></a><tt><font size=2><br><br>Aspera sync integration<br><br>(non html links added for your use \u2013 how they don\u2019t get scrubbed:<br></font></tt><a href="www.spectrumscaleug.org/wp-content/uploads/2019/05/SSSD19DE-Day-2-B02-Integration-of-Spectrum-Scale-and-Aspera-Sync.pdf"><tt><font size=2>www.spectrumscaleug.org/wp-content/uploads/2019/05/SSSD19DE-Day-2-B02-Integration-of-Spectrum-Scale-and-Aspera-Sync.pdf</font></tt></a><tt><font size=2><br></font></tt><a href="www.redbooks.ibm.com/redpapers/pdfs/redp5527.pdf"><tt><font size=2>www.redbooks.ibm.com/redpapers/pdfs/redp5527.pdf</font></tt></a><tt><font size=2><br>)<br>Regards,<br>Chris Schlipalius<br> <br>Team Lead, Data Storage Infrastructure, Data & Visualisation, Pawsey
Supercomputing Centre (CSIRO)<br>1 Bryce Avenue<br>Kensington WA 6151<br>Australia<br> <br>Tel +61 8 6436 8815 <br>Email chris.schlipalius@pawsey.org.au<br>Web </font></tt><a href="www.pawsey.org.au"><tt><font size=2>www.pawsey.org.au</font></tt></a><tt><font size=2><</font></tt><a href="http://www.pawsey.org.au/"><tt><font size=2>http://www.pawsey.org.au/</font></tt></a><tt><font size=2>><br> <br> <br> <br><br><br>On 26/2/20, 9:39 pm, "gpfsug-discuss-bounces@spectrumscale.org on
behalf of gpfsug-discuss-request@spectrumscale.org" <gpfsug-discuss-bounces@spectrumscale.org
on behalf of gpfsug-discuss-request@spectrumscale.org> wrote:<br><br> Re: AFM Alternative?<br><br><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size=2><br><br></font></tt><br><br><BR>