I am simply applying a (Python) Programmable Filter after loading in the data so the data itself does not get touched or modified before the Programmable Filter is applied. Rebuilding paraview from git won't be a problem since I've branched a few git versions in the past. If possible, any workaround (including the previously suggested) would be great since I'd rather not code my own MPI ghost cell trading logic inside of my parallel programmable filter as I'm already performing computations every single time I run the filter. I'd imagine it would be much slower than having the ghost data already present or generating such ghost data beforehand.<br>
<br>On Tue, Jul 17, 2012 at 2:05 PM, David E DeMarle <span dir="ltr"><<a href="mailto:dave.demarle@kitware.com" target="_blank">dave.demarle@kitware.com</a>></span> wrote:<br><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote">
Also remember this gem, which may help you.<br><br>
>Note also that there is a "feature" in the python programmable filter<br>
>that comes into play with structured data. That feature says that<br>
>structured data is not split at all by default. If you want structured<br>
>data to actually be parallel you need to put this code in your python<br>
>programmable filter.<br>
><br>
>from paraview import util<br>
>self.GetExecutive().<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">SetExtentTranslator(self.GetExecutive().GetOutputInformation(0),<br>
>vtk.vtkExtentTranslator())</blockquote></blockquote>
<div> <br>Yes, I currently use that command to split my data for my Programmable Filter. I ran into this "feature" last year.<br></div><br>Thank you,<br>Jesus<br><br><div class="gmail_quote">On Tue, Jul 17, 2012 at 2:02 PM, Berk Geveci <span dir="ltr"><<a href="mailto:berk.geveci@kitware.com" target="_blank">berk.geveci@kitware.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">One more question. What are you doing after reading the data? Depending on what you are doing, I might be able to give you a piece of code that uses George's filter to generate ghost levels using MPI. You will need to use ParaView built from git.<div>
<br></div><div>Next week, George and I will start working on updating ParaView's structured data readers to generate ghost levels using MPI under covers. We waited way too long to do it...</div><span class="HOEnZb"><font color="#888888"><div>
<br></div></font></span><div><span class="HOEnZb"><font color="#888888">-berk</font></span><div><div class="h5"><br>
<br><div class="gmail_quote">On Tue, Jul 17, 2012 at 3:34 PM, Jesus Pulido <span dir="ltr"><<a href="mailto:jpulido@ucdavis.edu" target="_blank">jpulido@ucdavis.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Yes, appended raw mode. It has an ascii header then the data itself is binary after a specified underscore delimiter.<span><font color="#888888"><br><br>Jesus</font></span><div><div>
<br><br><div class="gmail_quote">On Tue, Jul 17, 2012 at 1:17 PM, Berk Geveci <span dir="ltr"><<a href="mailto:berk.geveci@kitware.com" target="_blank">berk.geveci@kitware.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Actually, I think that I noticed this too. It may be a bug specific to the programmable filter. I will check it out. By the way, what do you mean by "raw" vti? Appended raw mode?<span><font color="#888888"><div>
<br></div></font></span><div><span><font color="#888888">-berk</font></span><div><div><br><br><div class="gmail_quote">
On Tue, Jul 17, 2012 at 12:22 PM, Jesus Pulido <span dir="ltr"><<a href="mailto:jpulido@ucdavis.edu" target="_blank">jpulido@ucdavis.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Thank you Berk.<br><br>I was under the impression that this command would trigger the reader to automatically load in the additional # of requested ghost levels. I tested the command and each data piece still has the same extents as before.<br>
<br>Is there any additional way to load in ghost level that's parallel friendly? I am aware of the D3 filter but, from the memory usage, it seems that it will load in the entire dataset into each processor and this is not feasible for large datasets.<br>
<br>I am using binary, "raw" vti piece files each with their own extent of the data and a header pvti file.<br>The data has no encoded ghost layers between pieces so I was hoping to have paraview do that for me.<span><font color="#888888"><br>
<br>Jesus</font></span><div><div><br><br><div class="gmail_quote">On Tue, Jul 17, 2012 at 7:29 AM, Berk Geveci <span dir="ltr"><<a href="mailto:berk.geveci@kitware.com" target="_blank">berk.geveci@kitware.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p style="margin-top:0px;margin-bottom:0px;margin-left:0px;margin-right:0px;text-indent:0px">self.GetExecutive().GetOutputInformation(0).Set(vtk.vtkStreamingDemandDrivenPipeline.UPDATE_NUMBER_OF_GHOST_LEVELS(), 1)</p><p style="margin-top:0px;margin-bottom:0px;margin-left:0px;margin-right:0px;text-indent:0px">
<br></p><p style="margin-top:0px;margin-bottom:0px;margin-left:0px;margin-right:0px;text-indent:0px">in RequestUpdateExtent script. Of course, this requires that the reader or a filter before the programmable filter is able to provide ghost levels.</p>
<p style="margin-top:0px;margin-bottom:0px;margin-left:0px;margin-right:0px;text-indent:0px"><br></p><p style="margin-top:0px;margin-bottom:0px;margin-left:0px;margin-right:0px;text-indent:0px">-berk</p><br><div class="gmail_quote">
<div><div>
On Wed, Jul 11, 2012 at 3:04 PM, Jesus Pulido <span dir="ltr"><<a href="mailto:jpulido@ucdavis.edu" target="_blank">jpulido@ucdavis.edu</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div><div>
<div class="gmail_quote">Hello,<br><br>I am trying to request ghost data
in my python programmable filter but I am not sure how to go about and
do so. I am assuming the call would go into the RequestUpdateExtent
Script.<br><br>In the C++ equivalent filters that do request ghost data, the call to is something along the lines of<br>
vtkStreamingDemandDrivenPipeline::UPDATE_NUMBER_OF_GHOST_LEVELS()
, and there are examples of that in the Paraview source but the way the
objects are defined and called does not translate into Paraview VTK
Python. What would be the appropriate call?<br>
<br>Thank<font color="#888888"> you,</font><span><font color="#888888"><br>Jesus<br>
</font></span></div><br>
<br></div></div>_______________________________________________<br>
Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a><br>
<br>
Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a><br>
<br>
Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView" target="_blank">http://paraview.org/Wiki/ParaView</a><br>
<br>
Follow this link to subscribe/unsubscribe:<br>
<a href="http://www.paraview.org/mailman/listinfo/paraview" target="_blank">http://www.paraview.org/mailman/listinfo/paraview</a><br>
<br></blockquote></div><br>
</blockquote></div><br>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br>