<HTML>
<HEAD>
<TITLE>Re: [Paraview] PV & multiple video cards</TITLE>
</HEAD>
<BODY>
<FONT FACE="Calibri, Verdana, Helvetica, Arial"><SPAN STYLE='font-size:11pt'>I think this is a good suggestion. I don’t think the fact that it relies on processes being assigned in a particular order is a big deal. The default allocation is usually to place contiguous ranks in the same node anyway. The tiled display options also have heavy reliance on the order in which processes are assigned, and I don’t recall complaints about that.<BR>
<BR>
The only change I would suggest is to <I>not </I>have an option named --number-of-gpu-per-host change the display parameter. The option name should reflect the fact that it is going to override the display environment variable. Offhand, I cannot think of a single option name that reflects both the fact that you are changing the display and providing the number of screen ids to use. Perhaps you would have two options, the --number-of-gpu-per-host as you described and a something like --set-display-server-id-by-process-id. Since one does not make sense without the other, you could give an error if one is used independently.<BR>
<BR>
-Ken<BR>
<BR>
<BR>
On 6/22/10 12:31 PM, "burlen" <<a href="burlen.loring@gmail.com">burlen.loring@gmail.com</a>> wrote:<BR>
<BR>
</SPAN></FONT><BLOCKQUOTE><FONT FACE="Calibri, Verdana, Helvetica, Arial"><SPAN STYLE='font-size:11pt'>Hi,<BR>
<BR>
I realized that my suggestion relies on processes being assigned in a<BR>
particular order. So something slightly more complicated would need to<BR>
be done to determine the number of processes running on each host. Still<BR>
it would be pretty simple way to make folks lives easier. Let me know<BR>
what you think.<BR>
<BR>
Burlen<BR>
<BR>
burlen wrote:<BR>
> Hi,<BR>
><BR>
> currently we suggest users rely on details particular to specific MPI<BR>
> implementations<BR>
> (<a href="http://paraview.org/Wiki/Setting_up_a_ParaView_Server#Multiple_GPUs_Per_Node">http://paraview.org/Wiki/Setting_up_a_ParaView_Server#Multiple_GPUs_Per_Node</a>)<BR>
> to set up PV server on clusters with multiple graphics cards per node.<BR>
> It seems to me that this reliance on non standard implementation<BR>
> details isn't necessary for the most common case and it can introduce<BR>
> some complication to get PV running on various installations.<BR>
><BR>
> There is something simple that we could do to make users life easier.<BR>
> ParaView could handle a common configuration of multiple graphics<BR>
> cards seamlessly with very little effort via an additional command<BR>
> line option.<BR>
><BR>
> Two common ways to address multiple video devices in X11 via the<BR>
> DISPLAY variable are, 1) by server id (":[server].0") or 2) by screen<BR>
> id (":0.[screen]"). It depends on how X11 is setup, but I think the<BR>
> latter is the most common.<BR>
><BR>
> If the user were to tell PV how many video devices are available on<BR>
> each node via the following command line variable, PV could assign<BR>
> rendering contexts cyclically across the available devices by setting<BR>
> the DISPLAY variable for the user.<BR>
><BR>
> --number-of-gpu-per-host=N<BR>
><BR>
> as each server starts he will make the computation to set the DISPLAY<BR>
> variable so that render contexts are cycled across the available devices.<BR>
><BR>
> For example, something like the folowing could be added to<BR>
> Filters/vtkPVMain.cxx<BR>
><BR>
> if (numGpuPerHost)<BR>
> {<BR>
> int screenId=LocalProcId%numGpuPerHost<BR>
> setenv("DISPALY=:0.%i",screenId)<BR>
> }<BR>
><BR>
> This would conflict with the "-display" option, if both are present PV<BR>
> would exit and print some error message.<BR>
><BR>
> Do you guys think this would be a reasonable approach to handle a<BR>
> common use case?<BR>
> Burlen<BR>
><BR>
<BR>
_______________________________________________<BR>
Powered by www.kitware.com<BR>
<BR>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html">http://www.kitware.com/opensource/opensource.html</a><BR>
<BR>
Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView">http://paraview.org/Wiki/ParaView</a><BR>
<BR>
Follow this link to subscribe/unsubscribe:<BR>
<a href="http://www.paraview.org/mailman/listinfo/paraview">http://www.paraview.org/mailman/listinfo/paraview</a><BR>
<BR>
<BR>
</SPAN></FONT></BLOCKQUOTE><FONT FACE="Calibri, Verdana, Helvetica, Arial"><SPAN STYLE='font-size:11pt'><BR>
</SPAN></FONT><FONT SIZE="2"><FONT FACE="Consolas, Courier New, Courier"><SPAN STYLE='font-size:10pt'><BR>
**** Kenneth Moreland<BR>
*** Sandia National Laboratories<BR>
*********** <BR>
*** *** *** email: <a href="kmorel@sandia.gov">kmorel@sandia.gov</a><BR>
** *** ** phone: (505) 844-8919<BR>
*** web: <a href="http://www.cs.unm.edu/~kmorel">http://www.cs.unm.edu/~kmorel</a><BR>
</SPAN></FONT></FONT><FONT FACE="Calibri, Verdana, Helvetica, Arial"><SPAN STYLE='font-size:11pt'><BR>
</SPAN></FONT>
</BODY>
</HTML>