Comments (4)
christophernhill
commented on August 28, 2024
1
@leios do you want to chat briefly about “zarr” -
https://www.unidata.ucar.edu/blogs/news/entry/netcdf-and-native-cloud-storage
sometime this week?
Oliver has been tinkering with zarr over the last month. He seems
relatively pleased with it. He has high standards and good judgement, so it
might be worth a quick chat?
Thanks,
Chris
…On Tue, Feb 25, 2020 at 17:47 Simon Byrne ***@***.***> wrote:
@leios <https://github.com/leios> will look into parallel netcdf
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#50>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AA27DYFQBRJINN7NELQVPS3REWNXDANCNFSM4GT7FCCA>
.
from climatemachine.jl.
simonbyrne
commented on August 28, 2024
From discussion today:
We need:
Interface
- Specify checkpoint interval
--checkpoint-wallclock/--checkpoint-simtime
-Option to checkpoint at end
--checkpoint-atend
--checkpoint-remove-old to keep only the most recent checkpoint
Format
- 1 file per checkpoint per rank
- if we have parallel I/O we can do 1 file per checkpoint
-would need to precompute offsets - NetCDF for now
- checkpoint state / aux / t
- figure out how to handle multistate
- checkpoint grid at start vgeo/sgeo
- probably not now, only if necessary
Restart
--restart=filename?- Does the user provide the filename, or do we autodetect?
- For the time being, we assume
--nprocs/topology is the same- To support different number of ranks we will need a mechanism to reorder topology layout
from climatemachine.jl.
simonbyrne
commented on August 28, 2024
@leios will look into parallel netcdf
from climatemachine.jl.
akshaysridhar
commented on August 28, 2024
#576 provides a start based on existing DGmodel.jl functionality.
from climatemachine.jl.
Related Issues (20)
- Modify RHS parameter functions
- Missing documentation and errors in SurfaceFluxes.get_flux_coefficients HOT 4
- Implement driver for point jet on sphere
- Implement driver for shallow water setup on the sphere
- Bring triply-period do-nothing box flow driver into master
- Implement driver for dry baroclinic wave in a channel HOT 1
- Perform quality checks on current benchmarks & bring them into QA pipeline
- Single stack diagnostics clobbers some quantities
- Some ocean variables have characters that don't always render
- Slow AtmosModel when using balance-law problems HOT 6
- Inconsistent maxiter values in thermo dispatchers and inner constructors
- Enforce initialization of state.ρ as aux.ref_state.ρ in Anelastic1D model. HOT 3
- Grid imprinting in specific variables (per unit mass) due to filtering, and energy-momentum leakage HOT 2
- Burgers single stack tutorials all show the same figures
- Shear used in EDMF sources from precomputed args becomes negative HOT 7
- fall back on BalanceLaw method for eq_tends HOT 1
- Computation of gradients in a compressible SingleStack HOT 7
- calculation of soil properties
- update language in tutorials
- OrdinaryDiffEq.jl v6 LinearSolve.jl HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from climatemachine.jl.