View Issue Details Jump to Notes ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0014296ParaView(No Category)public2013-09-24 19:162016-08-12 09:59
ReporterAlan Scott 
Assigned ToKitware Robot 
PriorityhighSeverityminorReproducibilityhave not tried
StatusclosedResolutionmoved 
PlatformOSOS Version
Product Versiongit-master 
Target VersionFixed in Version 
Summary0014296: CAM raw reader is HORRIBLE in parallel
DescriptionThe CAM raw reader is horrible in parallel. It is horrible from a memory perspective as well as a performance perspective.

My test is as follows:
* Read famip5_ne240b.cam.h3.2001-09-09-03600.nc. This is a parallel reader.
* Enable opacity mapping for surfaces. (I don't think this is the issue).
* Plane (offset left side of screen). Texture map. Clip.
* Plane (offset right side of screen). Texture map. Clip.

Running remote server, performance is as follows:
* 1 cores - 14 seconds final render - 1.58 GB/core
* 2 cores - ?? seconds final render - 1.62 GB/core
* 4 cores - ?? seconds final render - 1.24 GB/core
* 8 cores - 26 seconds final render - 1.04 GB/core (8.45 total)

So, 8 cores runs about half the speed of 1 core, and takes around 6 times as much memory. Ouch!!

Please don't work on this until it has been discussed at a bi-weekly meeting, or you talk to Utkarsh or me.

I have a few more observations, will include them in and additional post.
TagsNo tags attached.
ProjectSandia
Topic Name
Typeperformance
Attached Filesjpg file icon camReader8processes.jpg [^] (114,677 bytes) 2013-09-25 17:19

 Relationships

  Notes
(0031619)
Alan Scott (manager)
2013-09-24 19:17

Changing to high priority, since this basically makes this a serial reader, and the CAM reader is important.
(0031624)
Alan Scott (manager)
2013-09-25 16:57

Also, this reader does seem to be spreading the file across the map. Attached is a screenshot that shows this.
(0031626)
Alan Scott (manager)
2013-09-25 21:54

One place taking a lot of time is here:

vtkKdTree::DoMedianFind, FP=7fff9a263660
vtkKdTree::DivideRegion, FP=7fff9a263780
vtkKdTree::DivideRegion, FP=7fff9a263890
vtkKdTree::DivideRegion, FP=7fff9a2639a0
vtkKdTree::DivideRegion, FP=7fff9a263ab0
vtkKdTree::DivideRegion, FP=7fff9a263bc0
vtkKdTree::DivideRegion, FP=7fff9a263cd0
vtkKdTree::DivideRegion, FP=7fff9a263de0
vtkKdTree::DivideRegion, FP=7fff9a263ef0
vtkKdTree::DivideRegion, FP=7fff9a264000
vtkKdTree::DivideRegion, FP=7fff9a264110
vtkKdTree::DivideRegion, FP=7fff9a264220
vtkKdTree::DivideRegion, FP=7fff9a264330
vtkKdTree::DivideRegion, FP=7fff9a264440
vtkKdTree::BuildLocatorFromPoints, FP=7fff9a264890
vtkMergeCells::MapPointsToIdsUsingLocator, FP=7fff9a264be0
vtkMergeCells::MergeDataSet, FP=7fff9a264e70
vtkDistributedDataFilter::MergeGrids, FP=7fff9a264fb0
vtkDistributedDataFilter::ExchangeMergeSubGridsFast, FP=7fff9a265250
vtkDistributedDataFilter::ExchangeMergeSubGrids, FP=7fff9a2652f0
vtkDistributedDataFilter::MPIRedistribute, FP=7fff9a2653b0
vtkDistributedDataFilter::RedistributeDataSet, FP=7fff9a265410
vtkDistributedDataFilter::RequestDataInternal, FP=7fff9a2657b0
vtkDistributedDataFilter::RequestData, FP=7fff9a265ce0
vtkDataObjectAlgorithm::ProcessRequest, FP=7fff9a265da0
(0038447)
Kitware Robot (administrator)
2016-08-12 09:59

Resolving issue as `moved`.

This issue tracker is no longer used. Further discussion of this issue may take place in the current ParaView Issues page linked in the banner at the top of this page.

 Issue History
Date Modified Username Field Change
2013-09-24 19:16 Alan Scott New Issue
2013-09-24 19:17 Alan Scott Note Added: 0031619
2013-09-24 19:17 Alan Scott Priority normal => high
2013-09-25 16:57 Alan Scott Note Added: 0031624
2013-09-25 17:19 Alan Scott File Added: camReader8processes.jpg
2013-09-25 21:54 Alan Scott Note Added: 0031626
2016-08-12 09:59 Kitware Robot Note Added: 0038447
2016-08-12 09:59 Kitware Robot Status backlog => closed
2016-08-12 09:59 Kitware Robot Resolution open => moved
2016-08-12 09:59 Kitware Robot Assigned To => Kitware Robot


Copyright © 2000 - 2018 MantisBT Team