Comments (3)
Hi @ekluzek , Yes, this is expected. A different number of MPI tasks changes orders of basinID (hru dimension) and reachID (seg dimension) in history file.
If basinID and reachID in one history file are sorted to the ones in another history file with different MPI task run, both should be identical. I have a python script to sort the netcdf.
Roughly speaking, the array order associated with hru and seg are determined based on independent river basins defined based on the MPI tasks numbers
from mizuroute.
Ahhh, OK. So right now we could run the python script to show that answers are identical.
In the short term I think it would be good to have that script in the repository so that it would be easy to run the PEM test and then verify that answers are identical with the script. Could you add the script somewhere in the repo?
In the medium to longer term it would be good to have a mode where the sorting was done inside the code, so that you don't need the external sorting script. In the coupler we have a trigger like this that slows things down a little bit, but ensures that answers will be identical on different number of processors. That trigger is already turned on for testing, we just need something similar for mizuRoute. A slow simple solution would be fine to start with. A future advancement could be to speed it up. Since, you wouldn't normally run in this mode it's OK for it to be slower.
How hard would it be to add such a flag that would do the sorting needed to make sure answers are identical?
from mizuroute.
We talked about this and we want to look into using the python script to first just be able to do this checking. And then add some automatic tests that run the script so that we know answers don't change. If we can do that we wouldn't need to get this into the code. @nmizukami did work on this, but it was really slow.
from mizuroute.
Related Issues (20)
- HDMAmz_amazon grid fails in reading in mesh file HOT 2
- Have the buildnml set continue_run in the control file HOT 1
- Negative runoff for some HRU's for f19_f19_rHDMAlk_mg17 HOT 3
- Rename gauge history files to *.h_gauge.*.nc HOT 1
- Have history filenames depend on the frequency HOT 2
- Update history attributes for time according to new CESM standards
- Filenames for daily history filenames are off by one from CLM history filenames HOT 4
- ERP tests are failing in attempt to open history file HOT 2
- Serial exact restarts fail to be identical HOT 1
- Issue on time variable in history file for sub-daily simulation
- Change format of input control file to a standard format? HOT 9
- floodplain implementation
- NAG compiler complains when swap function is called on identical inputs HOT 2
- PIO free decomp should not be done each time the file is closed... HOT 4
- MPI tests are failing to run on izumi HOT 2
- MPI_ADDREDUCE needs to have a different receive buffer than send buffer HOT 2
- ERP tests failing to run HOT 18
- Lake initial volume HOT 1
- Only create PIO decompositions once...
- RUN_REFCASE branch cases seem to start back at START_TIME rather than RUN_REFDATE, causes ERI tests to fail HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mizuroute.