View Issue Details [ Jump to Notes ] | [ Print ] | ||||||||
ID | Project | Category | View Status | Date Submitted | Last Update | ||||
0014296 | ParaView | (No Category) | public | 2013-09-24 19:16 | 2016-08-12 09:59 | ||||
Reporter | Alan Scott | ||||||||
Assigned To | Kitware Robot | ||||||||
Priority | high | Severity | minor | Reproducibility | have not tried | ||||
Status | closed | Resolution | moved | ||||||
Platform | OS | OS Version | |||||||
Product Version | git-master | ||||||||
Target Version | Fixed in Version | ||||||||
Summary | 0014296: CAM raw reader is HORRIBLE in parallel | ||||||||
Description | The CAM raw reader is horrible in parallel. It is horrible from a memory perspective as well as a performance perspective. My test is as follows: * Read famip5_ne240b.cam.h3.2001-09-09-03600.nc. This is a parallel reader. * Enable opacity mapping for surfaces. (I don't think this is the issue). * Plane (offset left side of screen). Texture map. Clip. * Plane (offset right side of screen). Texture map. Clip. Running remote server, performance is as follows: * 1 cores - 14 seconds final render - 1.58 GB/core * 2 cores - ?? seconds final render - 1.62 GB/core * 4 cores - ?? seconds final render - 1.24 GB/core * 8 cores - 26 seconds final render - 1.04 GB/core (8.45 total) So, 8 cores runs about half the speed of 1 core, and takes around 6 times as much memory. Ouch!! Please don't work on this until it has been discussed at a bi-weekly meeting, or you talk to Utkarsh or me. I have a few more observations, will include them in and additional post. | ||||||||
Tags | No tags attached. | ||||||||
Project | Sandia | ||||||||
Topic Name | |||||||||
Type | performance | ||||||||
Attached Files | camReader8processes.jpg [^] (114,677 bytes) 2013-09-25 17:19
| ||||||||
Relationships | |
Relationships |
Notes | |
(0031619) Alan Scott (manager) 2013-09-24 19:17 |
Changing to high priority, since this basically makes this a serial reader, and the CAM reader is important. |
(0031624) Alan Scott (manager) 2013-09-25 16:57 |
Also, this reader does seem to be spreading the file across the map. Attached is a screenshot that shows this. |
(0031626) Alan Scott (manager) 2013-09-25 21:54 |
One place taking a lot of time is here: vtkKdTree::DoMedianFind, FP=7fff9a263660 vtkKdTree::DivideRegion, FP=7fff9a263780 vtkKdTree::DivideRegion, FP=7fff9a263890 vtkKdTree::DivideRegion, FP=7fff9a2639a0 vtkKdTree::DivideRegion, FP=7fff9a263ab0 vtkKdTree::DivideRegion, FP=7fff9a263bc0 vtkKdTree::DivideRegion, FP=7fff9a263cd0 vtkKdTree::DivideRegion, FP=7fff9a263de0 vtkKdTree::DivideRegion, FP=7fff9a263ef0 vtkKdTree::DivideRegion, FP=7fff9a264000 vtkKdTree::DivideRegion, FP=7fff9a264110 vtkKdTree::DivideRegion, FP=7fff9a264220 vtkKdTree::DivideRegion, FP=7fff9a264330 vtkKdTree::DivideRegion, FP=7fff9a264440 vtkKdTree::BuildLocatorFromPoints, FP=7fff9a264890 vtkMergeCells::MapPointsToIdsUsingLocator, FP=7fff9a264be0 vtkMergeCells::MergeDataSet, FP=7fff9a264e70 vtkDistributedDataFilter::MergeGrids, FP=7fff9a264fb0 vtkDistributedDataFilter::ExchangeMergeSubGridsFast, FP=7fff9a265250 vtkDistributedDataFilter::ExchangeMergeSubGrids, FP=7fff9a2652f0 vtkDistributedDataFilter::MPIRedistribute, FP=7fff9a2653b0 vtkDistributedDataFilter::RedistributeDataSet, FP=7fff9a265410 vtkDistributedDataFilter::RequestDataInternal, FP=7fff9a2657b0 vtkDistributedDataFilter::RequestData, FP=7fff9a265ce0 vtkDataObjectAlgorithm::ProcessRequest, FP=7fff9a265da0 |
(0038447) Kitware Robot (administrator) 2016-08-12 09:59 |
Resolving issue as `moved`. This issue tracker is no longer used. Further discussion of this issue may take place in the current ParaView Issues page linked in the banner at the top of this page. |
Notes |
Issue History | |||
Date Modified | Username | Field | Change |
2013-09-24 19:16 | Alan Scott | New Issue | |
2013-09-24 19:17 | Alan Scott | Note Added: 0031619 | |
2013-09-24 19:17 | Alan Scott | Priority | normal => high |
2013-09-25 16:57 | Alan Scott | Note Added: 0031624 | |
2013-09-25 17:19 | Alan Scott | File Added: camReader8processes.jpg | |
2013-09-25 21:54 | Alan Scott | Note Added: 0031626 | |
2016-08-12 09:59 | Kitware Robot | Note Added: 0038447 | |
2016-08-12 09:59 | Kitware Robot | Status | backlog => closed |
2016-08-12 09:59 | Kitware Robot | Resolution | open => moved |
2016-08-12 09:59 | Kitware Robot | Assigned To | => Kitware Robot |
Issue History |
Copyright © 2000 - 2018 MantisBT Team |