<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Consolas","serif";}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Burlen and David,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Many thanks for all the useful information. I will try the suggestions and report back if I run into further issues.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks again,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hong<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> David E DeMarle [mailto:dave.demarle@kitware.com]
<br>
<b>Sent:</b> Friday, June 07, 2013 1:38 PM<br>
<b>To:</b> Burlen Loring<br>
<b>Cc:</b> Hong Yi; paraview@paraview.org<br>
<b>Subject:</b> Re: [Paraview] Compiling Paraview errors on Oak Ridge HPC Titan<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Try using the paraview superbuild to build static lib paraview on titan.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">To do that do a git fetch from:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New";background:#F9F9F9">git://<a href="http://paraview.org/ParaViewSuperbuild.git" target="_blank">paraview.org/ParaViewSuperbuild.git</a></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Then make two build directories.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">In the first, <span style="font-size:10.0pt;font-family:"Arial","sans-serif"">set CROSS_BUILD_STAGE to "TOOLS", set CROSS_TARGET to "xk7_gnu", and build.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif"">In the next, set CROSS_BUILD_STAGE to "CROSS", and point PARAVIEW_HOSTTOOLS_DIR to the first build directory and build.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif"">If it doesn't work let us know. It has been a couple of months since I built there, and until I get a nightly dashboard up on titan, I can't assert that something hasn't broken
it.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial","sans-serif"">Note that this the build will use the gnu compiler chain. I haven't tried any of the other compilers recently on a cray, but I'm sure we can make it work and then add another CROSS_TARGET for
them if your codes require something else.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial","sans-serif"">As Burlen suggested, with static builds library order can easily be a sticking point that result in late stage linking errors. As a workaround you can make VERBOSE=1 to see the link line, and
edit it and reenter it to see if this is the problem. The longer term fix for me was to add the MPI library set to the HDF5_LIBRARIES set, which makes cmake infer the proper link order. (see the bgp_xlc target's ParaViewDefaults.cmake to see that approach).</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal">David E DeMarle<br>
Kitware, Inc.<br>
R&D Engineer<br>
21 Corporate Drive<br>
Clifton Park, NY 12065-8662<br>
Phone: 518-881-4909<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Fri, Jun 7, 2013 at 12:11 PM, Burlen Loring <<a href="mailto:bloring@lbl.gov" target="_blank">bloring@lbl.gov</a>> wrote:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><br>
You may be missing a gni library? use nm on the .a files to figure out if it has the missing symbols. Also with static linking the order you list the libraries matters. in your case you'll need to list the gni library(ies) before the mpich libarary on the link
line. You could check if that's your problem by running "make VERBOSE=1" and examining the order that's used. You could potentiall force the linker to not care about library order by enclosing mpi and it's dependencies in --start-group , --end-group linker
options...<br>
<br>
It's a little more work but in my experience things will go smoother for you if you avoid the CC wrappers when building ParaView. also pgi is used relatively rarely compared to gcc so you're asking for problems. Fine if you're prepared to dig in a deal with
them, but if you want it just to work, then use gcc.<br>
<br>
to avoid cc wrappers one thing you need to do is find mpi and its dependencies. if you run "CC --verbose" you can see the link options used by CC. You want to extract just the ones you need and no others. then since you want static linking you might need determine
the order of the libraries. to give you some ideas about what you're after, I'll attach result of this process from NERSC's Cray XC30 Edison, but watch out I used dynamic linking so it's not exactly what you need.<br>
<br>
hope this will help<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><br>
<br>
On 06/07/2013 07:02 AM, Hong Yi wrote:<o:p></o:p></p>
</div>
</div>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I’ve been working on building ParaView on Oak Ridge HPC Titan (Cray HPC system) for its coprocessing/catalyst libraries to be linked to PHASTA simulation code running on Titan for
in-situ coprocessing as well as live monitoring via pvserver which are already built and can run successfully on Oak Ridge visualization cluster Lens. There are some “undefined references” errors while building ParaView on Titan which I already contacted Titan
HPC support specialist but we are currently out of ideas on what to try next to fix these compilation errors. So I am hoping to get some ideas from people on this list who might have experienced such issues and might have some fresh ideas to help us move forward.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Specifically, we have to build ParaView on titan with “BUILD_SHARED_LIB” off so it can be statically linked to PHASTA simulation code and run on the Titan compute nodes. I set “apron”
as MPIEXEC, set Cray pgi wrapper compilers CC, cc, ftn as MPI_CXX_COMPILER, MPI_C_COMPILER, and MPI_FORTRAN_COMPILER, set Cray_mpich2/5.6.3 as MPI libraries to link to. First, I tried to use gnu compilers as CMAKE compilers and was able to configure and
then build ParaView, but got the following “undefined references” errors in libmpich.a such as the following when it was about 51% built:<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p>------------------------------------<o:p></o:p></p>
<p>Linking CXX executable ../../../bin/vtkpython<o:p></o:p></p>
<p>/opt/cray/mpt/5.6.3/gni/mpich2-pgi/119/lib/libmpich.a(gni_poll.o): In function `MPID_nem_gni_process_async_mhndl_ack':<o:p></o:p></p>
<p>gni_poll.c:(.text+0x3d): undefined reference to `GNI_SmsgRelease'<o:p></o:p></p>
<p>gni_poll.c:(.text+0x58): undefined reference to `gni_err_str'<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">--------------------------------<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Then as suggested by HPC support specialist, I changed to use cray pgi wrapper compilers CC, cc, ftn as corresponding CMAKE compilers (rather than use gnu compilers as I initially
did), however, I got the following “undefined references” errors when it was about 19% built:<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p>--------------------------------<o:p></o:p></p>
<p>/ccs/proj/nfi010/ParaView/ParaView-3.98.1-source/VTK/Utilities/KWSys/vtksys/SystemTools.cxx:1768: warning: Using 'getpwnam' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking<o:p></o:p></p>
<p>/opt/pgi/12.10.0/linux86-64/12.10/lib/libCmpz.a(eh_util.o): In function `std::uncaught_exception(void)':<o:p></o:p></p>
<p>eh_util.c:(.text+0x307): undefined reference to `__zceh_uncaught_exception'<o:p></o:p></p>
<p>/usr/bin/ld: link errors found, deleting executable `../../../bin/vtkHashSource-pv3.98'<o:p></o:p></p>
<p>child process exit status 1: /sw/xk6/altd/bin/ld<o:p></o:p></p>
<p>make[2]: *** [bin/vtkHashSource-pv3.98] Error 2<o:p></o:p></p>
<p>make[1]: *** [VTK/Utilities/HashSource/CMakeFiles/vtkHashSource.dir/all] Error 2<o:p></o:p></p>
<p>make: *** [all] Error 2<o:p></o:p></p>
<p>---------------------------------------<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Not sure why pgi compiler is trying to use glibc which then leads to the undefined reference error as shown above with libCmpz.a. This problem does not happen if we use gnu compilers
for CMake compilers but we got another set of undefined references in libmpich.a as described above.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Anybody has any ideas on what is wrong here and what we should try next to resolve these “undefined references” errors?<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Many thanks for any suggestions you can provide!<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hong<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
</div>
</div>
<div>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a><o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a><o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank">http://paraview.org/Wiki/ParaView</a><o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Follow this link to subscribe/unsubscribe:<o:p></o:p></pre>
<pre><a href="http://www.paraview.org/mailman/listinfo/paraview" target="_blank">http://www.paraview.org/mailman/listinfo/paraview</a><o:p></o:p></pre>
</div>
</blockquote>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">
http://www.kitware.com/opensource/opensource.html</a><br>
<br>
Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank">
http://paraview.org/Wiki/ParaView</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://www.paraview.org/mailman/listinfo/paraview" target="_blank">http://www.paraview.org/mailman/listinfo/paraview</a><o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>