marrabld / planarradpy Goto Github PK
View Code? Open in Web Editor NEWPython batch scripts for running [planarrad] (http://www.planarrad.com/index.php?title=PlanarRad)
License: GNU General Public License v2.0
Python batch scripts for running [planarrad] (http://www.planarrad.com/index.php?title=PlanarRad)
License: GNU General Public License v2.0
Some runs take longer than others. The code runs batches, and waits until all of the runs are complete before executing the next batch. If one run takes a long time it will hold up the computer from starting the next batch
'05/19/2015 09:35:53 PM' :: libplanarradpy :: WARNING :: Missing report file inbatch_report.txt
'05/19/2015 09:35:57 PM' :: libplanarradpy :: ERROR :: Parameter :: rrs :: Not in report
Traceback (most recent call last):
File "/home/marrabld/projects/rod_planarradpy/libplanarradpy/planrad.py", line 1129, in write_batch_report
if parameter_dir:
UnboundLocalError: local variable 'parameter_dir' referenced before assignment
I am totally new to planarrad, I have tried to run with a given batch parameter file provided by this website, but seems failed because I did not set up the "report_parameter=Rrs" correctly.
I have downloaded the code from official website and Github, and unzip the file to a folder.
then I run in a virtual environment:
python planarrad.py -i /home/usrname/Water_Model/planarradenv/planarradpy/inputs/batch_files/batch.txt
where the batch.txt is either from this release or copied and pasted from this given example.
and the output indicates there is something wrong with Rrs setting.
If I set the
# Set the parameter to report
#--------------------------------------------------#
report_parameter = Rrs
the log file says:
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(_self._args, *_self._kwargs)
File "/home/usrname/Water_Model/planarradenv/planarradpy/libplanarradpy/planrad.py", line 632, in _run
run_dict = file_tools.read_param_file_to_dict(os.path.join(run_dir, 'batch.txt'))
File "/home/usrname/Water_Model/planarradenv/planarradpy/libplanarradpy/planrad.py", line 880, in read_param_file_to_dict
data = loadtxt(file_name, delimiter='=', dtype=scipy.string0)
File "/home/usrname/Water_Model/planarradenv/local/lib/python2.7/site-packages/numpy/lib/npyio.py", line 738, in loadtxt
fh = iter(open(fname, 'U'))
IOError: [Errno 20] Not a directory: '/home/usrname/Water_Model/planarradenv/planarradpy/outputs/DirectionalRrsTest/batch_report.txt/batch.txt'
'07/20/2015 12:31:28 PM' :: libplanarradpy :: INFO :: Starting processing block of :: 1 processes
'07/20/2015 12:31:28 PM' :: libplanarradpy :: DEBUG :: report.txt
'07/20/2015 12:31:28 PM' :: libplanarradpy :: DEBUG :: /home/usrname/Water_Model/planarradenv/planarradpy/outputs/DirectionalRrsTest/SAA90.0_SZA0.0_P0.01_X0.1_Y1.0_G0.1_S0.014_Z10.0/report.txt
'07/20/2015 12:31:28 PM' :: libplanarradpy :: DEBUG :: report size is :: 956
'07/20/2015 12:31:28 PM' :: libplanarradpy :: WARNING :: Report file found :: /home/usrname/Water_Model/planarradenv/planarradpy/outputs/DirectionalRrsTest/SAA90.0_SZA0.0_P0.01_X0.1_Y1.0_G0.1_S0.014_Z10.0/report.txt not redoing run
'07/20/2015 12:31:28 PM' :: libplanarradpy :: INFO :: Starting Process :: Process ID :: 2779
'07/20/2015 12:31:28 PM' :: libplanarradpy :: DEBUG :: /home/usrname/Water_Model/planarradenv/planarradpy/outputs/DirectionalRrsTest/SAA90.0_SZA0.0_P0.01_X0.1_Y1.0_G0.1_S0.014_Z10.0
'07/20/2015 12:31:28 PM' :: libplanarradpy :: INFO :: Processing remainder
'07/20/2015 12:31:28 PM' :: libplanarradpy :: INFO :: Ending batch run at :: 0.117134
'07/20/2015 12:31:28 PM' :: libplanarradpy :: INFO :: Time taken ::0.0047
'07/20/2015 12:31:28 PM' :: libplanarradpy :: ERROR :: Parameter :: Rrs :: Not in report
Traceback (most recent call last):
File "/home/usrname/Water_Model/planarradenv/planarradpy/libplanarradpy/planrad.py", line 1108, in write_batch_report
param_val = report[parameter]
KeyError: 'Rrs'
'07/20/2015 12:31:28 PM' :: libplanarradpy :: ERROR :: Parameter :: Rrs :: Not in report
Traceback (most recent call last):
File "/home/usrname/Water_Model/planarradenv/planarradpy/libplanarradpy/planrad.py", line 1150, in write_batch_report
param_val = report[parameter]
KeyError: 'Rrs'
If I set the parameter as":
report_parameter = Rrs@16:45
Then the log file says:
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(_self._args, *_self._kwargs)
File "/home/usrname/Water_Model/planarradenv/planarradpy/libplanarradpy/planrad.py", line 632, in _run
run_dict = file_tools.read_param_file_to_dict(os.path.join(run_dir, 'batch.txt'))
File "/home/usrname/Water_Model/planarradenv/planarradpy/libplanarradpy/planrad.py", line 880, in read_param_file_to_dict
data = loadtxt(file_name, delimiter='=', dtype=scipy.string0)
File "/home/usrname/Water_Model/planarradenv/local/lib/python2.7/site-packages/numpy/lib/npyio.py", line 738, in loadtxt
fh = iter(open(fname, 'U'))
IOError: [Errno 20] Not a directory: '/home/usrname/Water_Model/planarradenv/planarradpy/outputs/DirectionalRrsTest/batch_report.txt/batch.txt'
'07/20/2015 12:38:17 PM' :: libplanarradpy :: INFO :: Starting processing block of :: 1 processes
'07/20/2015 12:38:17 PM' :: libplanarradpy :: DEBUG :: report.txt
'07/20/2015 12:38:17 PM' :: libplanarradpy :: DEBUG :: /home/usrname/Water_Model/planarradenv/planarradpy/outputs/DirectionalRrsTest/SAA90.0_SZA0.0_P0.01_X0.1_Y1.0_G0.1_S0.014_Z10.0/report.txt
'07/20/2015 12:38:17 PM' :: libplanarradpy :: DEBUG :: report size is :: 956
'07/20/2015 12:38:17 PM' :: libplanarradpy :: WARNING :: Report file found :: /home/usrname/Water_Model/planarradenv/planarradpy/outputs/DirectionalRrsTest/SAA90.0_SZA0.0_P0.01_X0.1_Y1.0_G0.1_S0.014_Z10.0/report.txt not redoing run
'07/20/2015 12:38:17 PM' :: libplanarradpy :: INFO :: Starting Process :: Process ID :: 2882
'07/20/2015 12:38:17 PM' :: libplanarradpy :: DEBUG :: /home/usrname/Water_Model/planarradenv/planarradpy/outputs/DirectionalRrsTest/SAA90.0_SZA0.0_P0.01_X0.1_Y1.0_G0.1_S0.014_Z10.0
'07/20/2015 12:38:17 PM' :: libplanarradpy :: INFO :: Processing remainder
'07/20/2015 12:38:17 PM' :: libplanarradpy :: INFO :: Ending batch run at :: 0.079834
'07/20/2015 12:38:17 PM' :: libplanarradpy :: INFO :: Time taken ::0.003366
'07/20/2015 12:38:17 PM' :: libplanarradpy :: ERROR :: Parameter :: Rrs :: Not in report
Traceback (most recent call last):
File "/home/usrname/Water_Model/planarradenv/planarradpy/libplanarradpy/planrad.py", line 1108, in write_batch_report
param_val = report[parameter]
KeyError: 'Rrs'
'07/20/2015 12:38:17 PM' :: libplanarradpy :: DEBUG :: calculating the directional Rrs
'07/20/2015 12:38:17 PM' :: libplanarradpy :: ERROR :: Parameter :: Rrs :: Not in report
Traceback (most recent call last):
File "/home/usrname/Water_Model/planarradenv/planarradpy/libplanarradpy/planrad.py", line 1148, in write_batch_report
param_val = self.calc_directional_aop(report, parameter, parameter_dir)
File "/home/usrname/Water_Model/planarradenv/planarradpy/libplanarradpy/planrad.py", line 1009, in calc_directional_aop
tmp_zenith.append(report['Quad_solid_angle_mean_point_theta'][i_iter][:].split(',')[0]) #that was a pain!
KeyError: 'Quad_solid_angle_mean_point_theta'
'04/10/2014 11:20:20 AM' :: libplanarradpy :: ERROR :: Problem reading file :: /home/marrabld/projects/planarradpy/inputs/iop_files/a_phi.csv
None
'04/10/2014 11:20:20 AM' :: libplanarradpy :: ERROR :: Problem reading file :: /home/marrabld/projects/planarradpy/inputs/iop_files/a_phi.csv
Traceback (most recent call last):
File "/home/boulefi/PycharmProjects/planarradpy/libplanarradpy/planrad.py", line 344, in read_aphi_from_file
self.a_phi = self._read_iop_from_file(file_name)
File "/home/boulefi/PycharmProjects/planarradpy/libplanarradpy/planrad.py", line 396, in _read_iop_from_file
raise IOError
IOError
'04/10/2014 11:20:20 AM' :: libplanarradpy :: INFO :: ============
'04/10/2014 11:20:20 AM' :: libplanarradpy :: INFO :: Initialising
'04/10/2014 11:20:20 AM' :: libplanarradpy :: INFO :: ============
'04/10/2014 11:20:20 AM' :: libplanarradpy :: INFO :: Creating batch project directory
'04/10/2014 11:20:20 AM' :: libplanarradpy :: INFO :: Reading water absorption from file
'04/10/2014 11:20:20 AM' :: libplanarradpy :: INFO :: Reading :: /home/boulefi/PycharmProjects/planarradpy/inputs/iop_files/a_water.csv :: and interpolating to [[ 410. 430. 450. 470. 490. 510. 530. 550. 570. 590. 610. 630.
The sky parameters files are getting the incorrect solar geometry
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.