<HTML><BODY><FONT style='white-space:pre-wrap;font-family: Helvetica Neue, Helvetica, Arial, sans-serif;margin: 1em 0;'>Because they both require a different distribution of OFED, which are mutual exclusive to install.<br>in theory if you deploy plain OFED it might work, but that will be hard to find somebody to support.<br><br><br>Sent from IBM Verse</FONT><br><br><div class="domino-section"><div class="domino-section-head"><span class="domino-section-title"><font color="#424282">Aaron Knister --- Re: [gpfsug-discuss] EDR and omnipath --- </font></span></div><div class="domino-section-body"><br><table width="100%" border="0" cellspacing="0" cellpadding="0"><tr valign="top"><td width="1%" style="width: 96px;"><font size="2" color="#5F5F5F">From:</font></td><td width="100%" style="width: auto;"><font size="2">"Aaron Knister" <aaron.s.knister@nasa.gov></font></td></tr><tr valign="top"><td width="1%" style="width: 96px;"><font size="2" color="#5F5F5F">To:</font></td><td width="100%" style="width: auto;"><font size="2">gpfsug-discuss@spectrumscale.org</font></td></tr><tr valign="top"><td width="1%" style="width: 96px;"><font size="2" color="#5F5F5F">Date:</font></td><td width="100%" style="width: auto;"><font size="2">Mon, Sep 19, 2016 1:35 PM</font></td></tr><tr valign="top"><td width="1%" style="width: 96px;"><font size="2" color="#5F5F5F">Subject:</font></td><td width="100%" style="width: auto;"><font size="2">Re: [gpfsug-discuss] EDR and omnipath</font></td></tr></table><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br></div><html><body><div style="opacity: 0.87;"><pre style="white-space:pre-wrap;"><font color="#000000">I must admit, I'm curious as to why one cannot use GPFS with IB and OPA <br/>both in RDMA mode. Granted, I know very little about OPA but if it just <br/>presents as another verbs device I wonder why it wouldn't "Just work" as <br/>long as GPFS is configured correctly.<br/><br/>-Aaron<br/><br/>On 9/19/16 3:11 AM, Vic Cornell wrote:<br/><!-- -->> Bump<br/><!-- -->><br/><!-- -->> I can see no reason why that wouldn't work. But it would be nice to a<br/><!-- -->> have an official answer or evidence that it works.<br/><!-- -->><br/><!-- -->> Vic<br/><!-- -->><br/><!-- -->><br/><!-- -->><!-- -->> On 15 Sep 2016, at 5:49 pm, Brian Marshall <!-- --><mimarsh2@vt.edu<br/><!-- -->><!-- -->> <!-- --><mailto:mimarsh2@vt.edu<!-- -->><!-- -->> wrote:<br/><!-- -->><!-- -->><br/><!-- -->><!-- -->> All,<br/><!-- -->><!-- -->><br/><!-- -->><!-- -->> I see in the GPFS FAQ A6.3 the statement below. Is it possible to<br/><!-- -->><!-- -->> have GPFS do RDMA over EDR infiniband and non-RDMA communication over<br/><!-- -->><!-- -->> omnipath (IP over fabric) when each NSD server has an EDR card and a<br/><!-- -->><!-- -->> OPA card installed?<br/><!-- -->><!-- -->><br/><!-- -->><!-- -->><br/><!-- -->><!-- -->><br/><!-- -->><!-- -->> RDMA is not supported on a node when both Mellanox HCAs and Intel<br/><!-- -->><!-- -->> Omni-Path HFIs are enabled for RDMA.<br/><!-- -->><!-- -->><br/><!-- -->><!-- -->> _______________________________________________<br/><!-- -->><!-- -->> gpfsug-discuss mailing list<br/><!-- -->><!-- -->> gpfsug-discuss at spectrumscale.org <!-- --><http://spectrumscale.org<!-- -->><br/><!-- -->><!-- -->> http://gpfsug.org/mailman/listinfo/gpfsug-discuss<br/><!-- -->><br/><!-- -->><br/><!-- -->><br/><!-- -->> _______________________________________________<br/><!-- -->> gpfsug-discuss mailing list<br/><!-- -->> gpfsug-discuss at spectrumscale.org<br/><!-- -->> http://gpfsug.org/mailman/listinfo/gpfsug-discuss<br/><!-- -->><br/><br/>-- <br/>Aaron Knister<br/>NASA Center for Climate Simulation (Code 606.2)<br/>Goddard Space Flight Center<br/>(301) 286-2776<br/>_______________________________________________<br/>gpfsug-discuss mailing list<br/>gpfsug-discuss at spectrumscale.org<br/>http://gpfsug.org/mailman/listinfo/gpfsug-discuss<br/><br/></font></pre></div><BR>
</body></html></BODY></HTML>