<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
Hi All,
<div class=""><br class="">
</div>
<div class="">We have a small test cluster that is CCR enabled. It only had/has 3 NSD servers (testnsd1, 2, and 3) and maybe 3-6 clients. testnsd3 died a while back. I did nothing about it at the time because it was due to be life-cycled as soon as I finished
a couple of higher priority projects.</div>
<div class=""><br class="">
</div>
<div class="">Yesterday, testnsd1 also died, which took the whole cluster down. So now resolving this has become higher priority\u2026 ;-)</div>
<div class=""><br class="">
</div>
<div class="">I took two other boxes and set them up as testnsd1 and 3, respectively. I\u2019ve done a \u201cmmsdrrestore -p testnsd2 -R /usr/bin/scp\u201d on both of them. I\u2019ve also done a "mmccr setup -F\u201d and copied the ccr.disks and ccr.nodes files from testnsd2 to them.
And I\u2019ve copied /var/mmfs/gen/mmsdrfs from testnsd2 to testnsd1 and 3. In case it\u2019s not obvious from the above, networking is fine \u2026 ssh without a password between those 3 boxes is fine.</div>
<div class=""><br class="">
</div>
<div class="">However, when I try to startup GPFS \u2026 or run any GPFS command I get:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">/root</div>
<div class="">root@testnsd2# mmstartup -a</div>
<div class="">get file failed: Not enough CCR quorum nodes available (err 809)</div>
<div class="">gpfsClusterInit: Unexpected error from ccr fget mmsdrfs. Return code: 158</div>
<div class="">mmstartup: Command failed. Examine previous error messages to determine cause.</div>
<div class="">/root</div>
<div class="">root@testnsd2#</div>
<div class=""><br class="">
</div>
<div class="">I\u2019ve got to run to a meeting right now, so I hope I\u2019m not leaving out any crucial details here \u2026 does anyone have an idea what I need to do? Thanks\u2026</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">\u2014</div>
<div class="">Kevin Buterbaugh - Senior System Administrator</div>
<div class="">Vanderbilt University - Advanced Computing Center for Research and Education</div>
<div class=""><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" class="">Kevin.Buterbaugh@vanderbilt.edu</a> - (615)875-9633</div>
<div class=""><br class="">
</div>
<br class="Apple-interchange-newline">
</div>
<br class="">
</div>
</body>
</html>