<font size=2 face="sans-serif">I believe this error is result of preallocation
failure, but traces are needed to confirm this. AFM caching modes
does not support preallocation of blocks (ex. using fallocate()). This
feature is supported only in AFM DR.</font><br><br><font size=2 face="sans-serif">~Venkat (vpuvvada@in.ibm.com)</font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">"Simon Thompson
(IT Research Support)" <S.J.Thompson@bham.ac.uk></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">gpfsug main discussion
list <gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">08/23/2017 03:48 PM</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">Re: [gpfsug-discuss]
AFM weirdness</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><tt><font size=2>OK so I checked and if I run directly on the "AFM"
FS in a different "non<br>AFM" directory, it works fine, so its something AFM related ...<br><br>Simon<br><br>On 23/08/2017, 11:11, "gpfsug-discuss-bounces@spectrumscale.org on
behalf<br>of Simon Thompson (IT Research Support)"<br><gpfsug-discuss-bounces@spectrumscale.org on behalf of<br>S.J.Thompson@bham.ac.uk> wrote:<br><br>>We're using an AFM cache from our HPC nodes to access data in another
GPFS<br>>cluster, mostly this seems to be working fine, but we've just come
across<br>>an interesting problem with a user using gfortran from the GCC 5.2.0<br>>toolset.<br>><br>>When linking their code, they get a "no space left on device"
error back<br>>from the linker. If we do this on a node that mounts the file-system<br>>directly (I.e. Not via AFM cache), then it works fine.<br>><br>>We tried with GCC 4.5 based tools and it works OK, but the difference<br>>there is that 4.x uses ld and 5x uses ld.gold.<br>><br>>If we strike the ld.gold when using AFM, we see:<br>><br>>stat("program", {st_mode=S_IFREG|0775, st_size=248480, ...})
= 0<br>>unlink("program")
= 0<br>>open("program", O_RDWR|O_CREAT|O_TRUNC|O_CLOEXEC, 0777) =
30<br>>fstat(30, {st_mode=S_IFREG|0775, st_size=0, ...}) = 0<br>>fallocate(30, 0, 0, 248480)
= -1 ENOSPC (No space left on<br>>device)<br>><br>><br>><br>>Vs when running directly on the file-system:<br>>stat("program", {st_mode=S_IFREG|0775, st_size=248480, ...})
= 0<br>>unlink("program")
= 0<br>>open("program", O_RDWR|O_CREAT|O_TRUNC|O_CLOEXEC, 0777) =
30<br>>fstat(30, {st_mode=S_IFREG|0775, st_size=0, ...}) = 0<br>>fallocate(30, 0, 0, 248480)
= 0<br>><br>><br>><br>>Anyone seen anything like this before?<br>><br>>... Actually I'm about to go off and see if its a function of AFM,
or<br>>maybe something to do with the FS in use (I.e. Make a local directory
on<br>>the filesystem on the "AFM" FS and see if that works ...)<br>><br>>Thanks<br>><br>>Simon<br>><br>>_______________________________________________<br>>gpfsug-discuss mailing list<br>>gpfsug-discuss at spectrumscale.org<br>></font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=92LOlNh2yLzrrGTDA7HnfF8LFr55zGxghLZtvZcZD7A&m=UqTzoU-bx454OgyeB4f0Nrruvs7yYAxFutzIe2eKmnc&s=8E5opHyyAwomLS8kdxpvKCvf6sdKBLlfZvx6wDdaZy4&e="><tt><font size=2>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=92LOlNh2yLzrrGTDA7HnfF8LFr55zGxghLZtvZcZD7A&m=UqTzoU-bx454OgyeB4f0Nrruvs7yYAxFutzIe2eKmnc&s=8E5opHyyAwomLS8kdxpvKCvf6sdKBLlfZvx6wDdaZy4&e=</font></tt></a><tt><font size=2><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=92LOlNh2yLzrrGTDA7HnfF8LFr55zGxghLZtvZcZD7A&m=UqTzoU-bx454OgyeB4f0Nrruvs7yYAxFutzIe2eKmnc&s=8E5opHyyAwomLS8kdxpvKCvf6sdKBLlfZvx6wDdaZy4&e="><tt><font size=2>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=92LOlNh2yLzrrGTDA7HnfF8LFr55zGxghLZtvZcZD7A&m=UqTzoU-bx454OgyeB4f0Nrruvs7yYAxFutzIe2eKmnc&s=8E5opHyyAwomLS8kdxpvKCvf6sdKBLlfZvx6wDdaZy4&e=</font></tt></a><tt><font size=2><br><br></font></tt><br><br><BR>