<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";
mso-fareast-language:EN-GB;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Utkarsh
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I’m just using process explorer, which is why I said it may not be a real leak. I’m only seeing gross heap usage, and as you know when free blocks are consumed
the heap can grow even though the actual usage is stable (especially true with this quite small change I’m seeing). I’ll do some more tests, when I get time – or just leave this running overnight and see if it grows unboundedly.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><img width="391" height="124" id="Picture_x0020_1" src="cid:image002.png@01CCCFB4.4A5B1D90"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Utkarsh Ayachit [mailto:utkarsh.ayachit@kitware.com]
<br>
<b>Sent:</b> 10 January 2012 16:00<br>
<b>To:</b> Biddiscombe, John A.<br>
<b>Cc:</b> Takuya OSHIMA; paraview@paraview.org<br>
<b>Subject:</b> Re: [Paraview] Unreclaimed memory in coprocessing? (PV 3.12.0 and git-master)<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">John,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">What did you use for your memory profiling? <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Utkarsh<o:p></o:p></p>
<div>
<p class="MsoNormal">On Tue, Jan 10, 2012 at 9:51 AM, Biddiscombe, John A. <<a href="mailto:biddisco@cscs.ch">biddisco@cscs.ch</a>> wrote:<o:p></o:p></p>
<div>
<div>
<p>Takuya<o:p></o:p></p>
<p> <o:p></o:p></p>
<p>Running a test of coprocessing on a very small simulation using just 2 cores on the desktop, I am seeing what looks like a very small leak. Over about 30 iterations, it’s of the order of 30MB, so might not be real (need to test on a bigger domain to see
if it grows faster), but the trend looks credible. I’ll see if I can pinpoint where the loss is occurring.<o:p></o:p></p>
<p> <o:p></o:p></p>
<p>JB<o:p></o:p></p>
<p> <o:p></o:p></p>
<p><img border="0" width="1726" height="155" id="_x0000_i1025" src="cid:image003.png@01CCCFB4.4A5B1D90"><o:p></o:p></p>
<div>
<div>
<p> <o:p></o:p></p>
<p><span lang="EN-US">-----Original Message-----<br>
From: <a href="mailto:paraview-bounces@paraview.org" target="_blank">paraview-bounces@paraview.org</a> [mailto:<a href="mailto:paraview-bounces@paraview.org" target="_blank">paraview-bounces@paraview.org</a>] On Behalf Of Takuya OSHIMA<br>
Sent: 10 January 2012 15:11<br>
To: <a href="mailto:paraview@paraview.org" target="_blank">paraview@paraview.org</a><br>
Subject: Re: [Paraview] Unreclaimed memory in coprocessing? (PV 3.12.0 and git-master)</span><o:p></o:p></p>
<p> <o:p></o:p></p>
<p>Attached in the previous mail is a sample Python coprocessing script that exhibits the problem (written by the coprocessing script generator of git-master as of today).<o:p></o:p></p>
<p> <o:p></o:p></p>
<p>Takuya<o:p></o:p></p>
<p> <o:p></o:p></p>
<p>Takuya OSHIMA, Ph.D.<o:p></o:p></p>
<p>Faculty of Engineering, Niigata University<o:p></o:p></p>
<p>8050 Ikarashi-Ninocho, Nishi-ku, Niigata, 950-2181, JAPAN<o:p></o:p></p>
<p> <o:p></o:p></p>
<p>From: Takuya OSHIMA <<a href="mailto:oshima@eng.niigata-u.ac.jp" target="_blank"><span style="color:windowtext;text-decoration:none">oshima@eng.niigata-u.ac.jp</span></a>><o:p></o:p></p>
<p>Subject: Unreclaimed memory in coprocessing? (PV 3.12.0 and git-master)<o:p></o:p></p>
<p>Date: Tue, 10 Jan 2012 23:08:21 +0900 (JST)<o:p></o:p></p>
<p> <o:p></o:p></p>
<p>> Hi,<o:p></o:p></p>
<p>> <o:p></o:p></p>
<p>> I am having a problem where the memory usage of my simulation program <o:p></o:p></p>
<p>> which links with the PV coprocessing library grows until it gets <o:p></o:p></p>
<p>> killed by the operating system.<o:p></o:p></p>
<p>> <o:p></o:p></p>
<p>> I have the following piece of code for triggering coprocessing and if <o:p></o:p></p>
<p>> I watch the memory usage with the ps/top commands it grows only at the <o:p>
</o:p></p>
<p>> timestep where this->Processor->CoProcess() is called. My simulation <o:p></o:p></p>
<p>> program uses vtkImageData as underlying data structure so no data <o:p></o:p></p>
<p>> format adaptation (that may involve allocating extra memory for data<o:p></o:p></p>
<p>> copy) is performed.<o:p></o:p></p>
<p>> <o:p></o:p></p>
<p>> this->DataDescription->SetTimeData(this->TimeInfo->GetTimeValue(),<o:p></o:p></p>
<p>> this->TimeInfo->GetTIter());<o:p></o:p></p>
<p>> if (this->Processor->RequestDataDescription(this->DataDescription))<o:p></o:p></p>
<p>> {<o:p></o:p></p>
<p>> vtkCPInputDataDescription *idd<o:p></o:p></p>
<p>> = this->DataDescription->GetInputDescriptionByName("input");<o:p></o:p></p>
<p>> // obtain vtkImageData to coprocess from my simulation program<o:p></o:p></p>
<p>> vtkImageData *grid = this->TimeInfo->GetGrid();<o:p></o:p></p>
<p>> idd->SetWholeExtent(grid->GetWholeExtent());<o:p></o:p></p>
<p>> idd->SetGrid(grid);<o:p></o:p></p>
<p>> // now call the coprocessing library<o:p></o:p></p>
<p>> this->Processor->CoProcess(this->DataDescription);<o:p></o:p></p>
<p>> }<o:p></o:p></p>
<p>> <o:p></o:p></p>
<p>> Besides, the Apple's "leaks" tool shows no meaningful leaks which <o:p></o:p></p>
<p>> makes me wonder if e.g. there are un-unregistered proxies than simply <o:p></o:p></p>
<p>> unmatched New()/Delete() or new/delete pairs.<o:p></o:p></p>
<p>> <o:p></o:p></p>
<p>> The problem is same for PV 3.12.0 and the git master as of today.<o:p></o:p></p>
<p>> Is anybody else having the problem? Any ideas?<o:p></o:p></p>
<p>> <o:p></o:p></p>
<p>> Thanks,<o:p></o:p></p>
<p>> Takuya<o:p></o:p></p>
<p>> <o:p></o:p></p>
<p>> Takuya OSHIMA, Ph.D.<o:p></o:p></p>
<p>> Faculty of Engineering, Niigata University<o:p></o:p></p>
<p>> 8050 Ikarashi-Ninocho, Nishi-ku, Niigata, 950-2181, JAPAN<o:p></o:p></p>
<p>_______________________________________________<o:p></o:p></p>
<p>Powered by <a href="http://www.kitware.com" target="_blank"><span style="color:windowtext;text-decoration:none">www.kitware.com</span></a><o:p></o:p></p>
<p> <o:p></o:p></p>
<p>Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">
<span style="color:windowtext;text-decoration:none">http://www.kitware.com/opensource/opensource.html</span></a><o:p></o:p></p>
<p> <o:p></o:p></p>
<p>Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank">
<span style="color:windowtext;text-decoration:none">http://paraview.org/Wiki/ParaView</span></a><o:p></o:p></p>
<p> <o:p></o:p></p>
<p>Follow this link to subscribe/unsubscribe:<o:p></o:p></p>
<p><a href="http://www.paraview.org/mailman/listinfo/paraview" target="_blank"><span style="color:windowtext;text-decoration:none">http://www.paraview.org/mailman/listinfo/paraview</span></a><o:p></o:p></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">
http://www.kitware.com/opensource/opensource.html</a><br>
<br>
Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank">
http://paraview.org/Wiki/ParaView</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://www.paraview.org/mailman/listinfo/paraview" target="_blank">http://www.paraview.org/mailman/listinfo/paraview</a><o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>