Comments (9)
Hi Angeline, thanks for reporting the bug! There's an issue with the variable name change in release/0.3.4; I made a commit on that branch. If you need the change now, maybe you could try to install hydra 0.3.4 from the source?
from hydra.
Thank you for the quick solution, Tony! That fixed the fast_local
setting, but still getting the same error for the local
setting.
from hydra.
I wasn't able to reproduce the error for the local
setting. But it seems like docker/
and resources/
folders weren't installed along with hydra
using pip install hydra-ml
from hydra.
I moved these folders withrelease/0.3.5
, that branch should solve the issue.
from hydra.
Hi Tony, I'm not sure if that resolved the issue. I encountered another problem after re-trying with your solution when I re-installed hydra from source.
Instead of /Users/<my_username>/miniconda3/envs/<my_env>/lib/python3.7/site-packages/hydra/cloud/../../docker/local_execution.sh
,
it is now looking for the docker files under /Users/<my_username>/miniconda3/envs/<my_env>/lib/python3.7/site-packages/hydra_ml-0.3.5-py3.7.egg/hydra/cloud/../../docker/local_execution.sh
.
This is now making the pointer to the docker wrong since docker is in site-packages
folder, but it's looking for it under hydra_ml-0.3.4-py3.7.egg
from hydra.
@angeliney I'm looking into this 👍
from hydra.
Looks like 0.3.5
still has an issue with fast_local
when i ran hydra train -m model.py --cloud=fast_local
i got this stacktrace
(hydra) ➜ hydra-ml-projects git:(demo) hydra train -m model.py --cloud=fast_local
[Hydra Info]: Executing experiments with the following options:
[{}]
[Hydra Info]: Runnning experiment #0 with the following options:
{}
Traceback (most recent call last):
File "/Users/faisalanees/.conda/envs/hydra/bin/hydra", line 33, in <module>
sys.exit(load_entry_point('hydra-ml', 'console_scripts', 'hydra')())
File "/Users/faisalanees/.conda/envs/hydra/lib/python3.8/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/Users/faisalanees/.conda/envs/hydra/lib/python3.8/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/Users/faisalanees/.conda/envs/hydra/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/Users/faisalanees/.conda/envs/hydra/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/Users/faisalanees/.conda/envs/hydra/lib/python3.8/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/Users/faisalanees/work/hydra/hydra/cli.py", line 124, in train
platform.train()
File "/Users/faisalanees/work/hydra/hydra/cloud/fast_local_platform.py", line 9, in train
os.system(" ".join([self.options, 'python3', self.model_path]))
TypeError: sequence item 0: expected str instance, dict found
And when i ran hydra train -m model.py --cloud=local
I got this stacktrace
(hydra) ➜ hydra-ml-projects git:(demo) hydra train -m model.py --cloud=local
[Hydra Info]: Executing experiments with the following options:
[{}]
[Hydra Info]: Runnning experiment #0 with the following options:
{}
Sending build context to Docker daemon 10.75kB
Step 1/4 : FROM continuumio/miniconda3
---> b4adc22212f1
Step 2/4 : WORKDIR /home
---> Using cache
---> 4152e1608fdb
Step 3/4 : COPY entry.py .
---> Using cache
---> 5930063d9f74
Step 4/4 : ENTRYPOINT ["python", "entry.py"]
---> Using cache
---> 4d9a6a285086
Successfully built 4d9a6a285086
Successfully tagged hydra_image:latest
Cloning into '.'...
remote: Invalid username or password.
fatal: Authentication failed for 'https://ca28989fcf5968ab2ad1836ee48f1e370ebcbaab:[email protected]/georgianpartners/hydra-ml-projects.git/'
fatal: not a git repository (or any of the parent directories): .git
SpecNotFound: Invalid name, try the format: user/package
EnvironmentLocationNotFound: Not a conda environment: /opt/conda/envs/hydra
EnvironmentLocationNotFound: Not a conda environment: /opt/conda/envs/hydra
/Users/faisalanees/work/hydra-ml-projects
Investigating further
from hydra.
Cloning into '.'...
remote: Invalid username or password.
fatal: Authentication failed for 'https://ca28989fcf5968ab2ad1836ee48f1e370ebcbaab:[email protected]/georgianpartners/hydra-ml-projects.git/'
fatal: not a git repository (or any of the parent directories): .git
This issue seems to be caused from an invalid github authentication key.
from hydra.
@coder46 I just updated to hydra 0.3.5 (installing from pip) and got following error, same as yours above for fast_local with empty options:
Command: hydra train -y tiny_run.yaml --cloud fast_local -o '{}'
Stacktrace:
[Hydra Info]: Loading run info from tiny_run.yaml...
Traceback (most recent call last):
File "/Users/angelineyasodhara/miniconda3/bin/hydra", line 8, in <module>
sys.exit(cli())
File "/Users/angelineyasodhara/miniconda3/lib/python3.7/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/Users/angelineyasodhara/miniconda3/lib/python3.7/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/Users/angelineyasodhara/miniconda3/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/Users/angelineyasodhara/miniconda3/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/Users/angelineyasodhara/miniconda3/lib/python3.7/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/Users/angelineyasodhara/miniconda3/lib/python3.7/site-packages/hydra/cli.py", line 113, in train
options_list_inflated = inflate_options(options_list)
File "/Users/angelineyasodhara/miniconda3/lib/python3.7/site-packages/hydra/utils/utils.py", line 8, in inflate_options
dictionary_list_inflated += dict_product(dictionary)
File "/Users/angelineyasodhara/miniconda3/lib/python3.7/site-packages/hydra/utils/utils.py", line 20, in dict_product
for key, values in dictionary.items():
AttributeError: 'str' object has no attribute 'items'
I think Tony's fix was not propagated since I'm still getting an error for fast_local with options passed in:
Command: hydra train -y tiny_run.yaml --cloud fast_local
Stacktrace:
[Hydra Info]: Loading run info from tiny_run.yaml...
[Hydra Info]: Executing experiments with the following options:
[{'batch_size': 1, 'epoch': 5, 'learning_rate': 0.0001}]
[Hydra Info]: Runnning experiment #0 with the following options:
{'batch_size': 1, 'epoch': 5, 'learning_rate': 0.0001}
Traceback (most recent call last):
File "/Users/angelineyasodhara/miniconda3/envs/temp/bin/hydra", line 33, in <module>
sys.exit(load_entry_point('hydra-ml', 'console_scripts', 'hydra')())
File "/Users/angelineyasodhara/miniconda3/envs/temp/lib/python3.9/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/Users/angelineyasodhara/miniconda3/envs/temp/lib/python3.9/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/Users/angelineyasodhara/miniconda3/envs/temp/lib/python3.9/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/Users/angelineyasodhara/miniconda3/envs/temp/lib/python3.9/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/Users/angelineyasodhara/miniconda3/envs/temp/lib/python3.9/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/Users/angelineyasodhara/Documents/GitHub/hydra/hydra/cli.py", line 124, in train
platform.train()
File "/Users/angelineyasodhara/Documents/GitHub/hydra/hydra/cloud/fast_local_platform.py", line 9, in train
os.system(" ".join([self.options, 'python3', self.model_path]))
TypeError: sequence item 0: expected str instance, dict found
from hydra.
Related Issues (20)
- IAC - Include Auto-Scaling policy in MLFlow ECS Cluster
- Containerize MLFlow server into a Docker image
- IAC - Automate Container Deployment in ECS Fargate
- IAC - Add optional modules to allow VPC and subnet creation within Terraform
- Store & Fetch DB Credentials in AWS Secrets Manager
- AWS Batch - create separate queues for CPU and GPU workloads
- Create hydra init in Hydra
- IAC for AWS Batch Infra
- Add git dependency as a toggle in run.yaml OR using git patch as alternative
- Support local/fast_local modes in Windows OS
- Add Database to store metadata of each run
- Add abstraction layer API to store metrics (Mlflow, RDS, comet.ml, etc)
- Beam GCP Bug fix
- Address Onboarding Bugfixes Encountered with Disco
- Use smart_open to support YAML config files using cloud object storage
- Create Hydra library
- Cost estimation in hydra
- Remove hard coded values
- Move to smart open to handle remote yaml files in cli.py
- Parallelize the job scheduling
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hydra.