Hi,<br><br><div>This is a known issue when a VTK XML file has an appended data section larger than 2GB(<a href="http://public.kitware.com/Bug/view.php?id=6938">http://public.kitware.com/Bug/view.php?id=6938</a>).<br><br><div>

To work around the problem you can look at writing out the file as any of the following:</div><div><ul><li>Partitioned VTK XML</li><li>Ensight Gold Binary</li><li>Exodus II ( Will require you too link to the exodus library found at <a href="http://sourceforge.net/projects/exodusii/">http://sourceforge.net/projects/exodusii/</a> )</li>

</ul><br>On Tue, Jan 4, 2011 at 5:45 AM, Guenter Bartsch &lt;<a href="mailto:guenter.bartsch@googlemail.com">guenter.bartsch@googlemail.com</a>&gt; wrote:<br>&gt;<br>&gt; hi all,<br>&gt;<br>&gt; we have run into a problem reading a pretty large (3.6 GB) .vtu file.<br>

&gt; the file was produced by a fortran program that writes vtk data in the<br>&gt; old ascii format which results in a 17G ascii file which takes very<br>&gt; long to load in paraview (and results in an error message). so, we<br>

&gt; have written a converter program that reads the ascii file and outputs<br>&gt; xml:<br>&gt;<br>&gt;<br>&gt; int main(int argc, char *argp[])<br>&gt; {<br>&gt;  if (argc != 2) {<br>&gt;    cerr &lt;&lt; &quot;usage: &quot; &lt;&lt; argp[0] &lt;&lt; &quot; &lt;vtk filename&gt;\n\n&quot;;<br>

&gt;    return 1;<br>&gt;  }<br>&gt;<br>&gt;  char *filename = argp[1];<br>&gt;<br>&gt;  cout &lt;&lt; &quot;Input filename: &quot; &lt;&lt; filename &lt;&lt; &quot;\n&quot;;<br>&gt;<br>&gt;  vtkSmartPointer&lt;vtkUnstructuredGridReader&gt; reader =<br>

&gt; vtkSmartPointer&lt;vtkUnstructuredGridReader&gt;::New();<br>&gt;  reader-&gt;SetFileName(filename);<br>&gt;<br>&gt;  char *ofilename = &quot;foo.vtu&quot;;<br>&gt;  cout &lt;&lt; &quot;Output filename: &quot; &lt;&lt; ofilename &lt;&lt; &quot;\n&quot;;<br>

&gt;  vtkSmartPointer&lt;vtkXMLUnstructuredGridWriter&gt; writer =<br>&gt; vtkSmartPointer&lt;vtkXMLUnstructuredGridWriter&gt;::New();<br>&gt;  writer-&gt;SetFileName(ofilename);<br>&gt;  writer-&gt;SetInputConnection(reader-&gt;GetOutputPort());<br>

&gt;  writer-&gt;Write();<br>&gt;<br>&gt;  return EXIT_SUCCESS;<br>&gt; }<br>&gt;<br>&gt; this program runs fine. now, if i open the resulting file in paraview,<br>&gt; i run into this error as soon as i hit apply:<br>&gt;<br>

&gt; ERROR: In /opt/paraview-3.8.1/src/ParaView-3.8.1/VTK/IO/vtkXMLUnstructuredDataReader.cxx,<br>&gt; line 652<br>&gt; vtkXMLUnstructuredGridReader (0x143f0c40): Cannot read cell<br>&gt; connectivity from Cells in piece 0 because the &quot;connectivity&quot; array is<br>

&gt; not long enough.<br>&gt;<br>&gt; the converter did work on a smaller test data set and paraview could<br>&gt; open it - only now with the large data set paraview fails. here is the<br>&gt; header of the failing file:<br>

&gt;<br>&gt; &lt;?xml version=&quot;1.0&quot;?&gt;<br>&gt; &lt;VTKFile type=&quot;UnstructuredGrid&quot; version=&quot;0.1&quot;<br>&gt; byte_order=&quot;LittleEndian&quot; compressor=&quot;vtkZLibDataCompressor&quot;&gt;<br>

&gt;  &lt;UnstructuredGrid&gt;<br>&gt;    &lt;Piece NumberOfPoints=&quot;106496000&quot;<br>&gt; NumberOfCells=&quot;105122745&quot;           &gt;<br>&gt;      &lt;PointData Vectors=&quot;vectors&quot;&gt;<br>&gt;        &lt;DataArray type=&quot;Float32&quot; Name=&quot;vectors&quot;<br>

&gt; NumberOfComponents=&quot;3&quot; format=&quot;appended&quot; RangeMin=&quot;0.0021820231521&quot;<br>&gt;  RangeMax=&quot;24.459394872&quot;         offset=&quot;0&quot;                   /&gt;<br>&gt;      &lt;/PointData&gt;<br>

&gt;      &lt;CellData&gt;<br>&gt;      &lt;/CellData&gt;<br>&gt;      &lt;Points&gt;<br>&gt;        &lt;DataArray type=&quot;Float32&quot; Name=&quot;Points&quot; NumberOfComponents=&quot;3&quot;<br>&gt; format=&quot;appended&quot; RangeMin=&quot;0&quot;<br>

&gt; RangeMax=&quot;5007.1818403&quot;         offset=&quot;1580185620&quot;          /&gt;<br>&gt;      &lt;/Points&gt;<br>&gt;      &lt;Cells&gt;<br>&gt;        &lt;DataArray type=&quot;Int64&quot; Name=&quot;connectivity&quot; format=&quot;appended&quot;<br>

&gt; RangeMin=&quot;&quot;                     RangeMax=&quot;&quot;<br>&gt; offset=&quot;2045521660&quot;          /&gt;<br>&gt;        &lt;DataArray type=&quot;Int64&quot; Name=&quot;offsets&quot; format=&quot;appended&quot;<br>

&gt; RangeMin=&quot;&quot;                     RangeMax=&quot;&quot;<br>&gt; offset=&quot;3504937336&quot;          /&gt;<br>&gt;        &lt;DataArray type=&quot;UInt8&quot; Name=&quot;types&quot; format=&quot;appended&quot;<br>

&gt; RangeMin=&quot;&quot;                     RangeMax=&quot;&quot;<br>&gt; offset=&quot;3671971228&quot;          /&gt;<br>&gt;      &lt;/Cells&gt;<br>&gt;    &lt;/Piece&gt;<br>&gt;  &lt;/UnstructuredGrid&gt;<br>&gt;  &lt;AppendedData encoding=&quot;base64&quot;&gt;<br>

&gt;   _WJgAAACAAAAAAAAAvXYAALF2AADJdgAAUHcAA...<br>&gt;<br>&gt; does anyone know what could be going on here? do we need to configure<br>&gt; paraview to handle larger files? is this a bug? could the original<br>&gt; ascii data set have been corrupt and the error reflects now in the xml<br>

&gt; file?<br>&gt;<br>&gt; thanks in advance and best regards,<br>&gt;<br>&gt;   guenter<br>&gt; _______________________________________________<br>&gt; Powered by <a href="http://www.kitware.com">www.kitware.com</a><br>
&gt;<br>
&gt; Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html">http://www.kitware.com/opensource/opensource.html</a><br>&gt;<br>&gt; Please keep messages on-topic and check the ParaView Wiki at: <a href="http://paraview.org/Wiki/ParaView">http://paraview.org/Wiki/ParaView</a><br>

&gt;<br>&gt; Follow this link to subscribe/unsubscribe:<br>&gt; <a href="http://www.paraview.org/mailman/listinfo/paraview">http://www.paraview.org/mailman/listinfo/paraview</a><br><br><br><br>--<br>Robert Maynard<br></div>

</div>