a3data / rony Goto Github PK
View Code? Open in Web Editor NEWData Engineering made simple - An opinionated Data Engineering framework
License: Apache License 2.0
Data Engineering made simple - An opinionated Data Engineering framework
License: Apache License 2.0
Hi guys. I ran rony's CI on gitlab but the policy does not get printed as it should by iamlive. Below is a screenshot of the final logs of the pipeline:
aws_s3_bucket_object.job_spark: Creation complete after 1s [id=emr-code/pyspark/spark_censo_escolar_to_parquet.py]
aws_lambda_function.decompresss3: Still creating... [10s elapsed]
aws_lambda_function.decompresss3: Still creating... [20s elapsed]
aws_lambda_function.decompresss3: Creation complete after 22s [id=prod-prod_censo_ingestion_igti-ney]
Apply complete! Resources: 11 added, 0 changed, 0 destroyed.
PERMISSIONS USED:
cat: ./policy.json: No such file or directory
Cleaning up file based variables
00:00
ERROR: Job failed: exit code 1
Any help? Many thanks!!!
Ao chamar o comando new com a opção de provider sendo um provider não existente o rony cria um projeto vazio.
Idealmente ele deveria avisar o usuário que a opção de provider não existe.
When creating GCP projects, AWS enviromental variables are added to github workflow files and to CI docker-compose file
Após a tentativa de criação do projeto rony no sistema operacional PopOS com versão do Shell ZSH 5.8, foi detectada uma falha no bloco de código os.system(f"python -m venv {env_name}"), o erro é causado pois o compilador do python não está cetado no caminho /usr/bin/python e sim /usr/bin/python3, sendo assim não reconhecido com o comando python.
Cadastrado em PR pelo @carlosbpy
build_lambda.sh
not working properly. It shows problems with "[[".
There is a small problem with the .gitlab-ci.yml
file. In the Production Apply step it is set
Production Plan:
stage: Production Plan
script:
- chmod -R +x ./CI/scripts
- ./CI/scripts/plan.sh staging prod
rules:
- if: '$CI_COMMIT_BRANCH == "master"'
In the second script line, the word staging is wrong. I'll submit a PR to fix it.
State locking is not implemented yet, so if any terraform operations that alter its state are run simultaneously, it will break its state.
It may happen if more than one user are working at the same time, or if more than one commit is pushed to github in a short period of time, for example.
I couldn't find a way to use rony at all. It throws me back the following error when I try to execute the rony info
command:
Traceback (most recent call last):
File "/home/guilherme/miniconda3/envs/rony/bin/rony", line 5, in <module>
from rony.cli import cli
File "/home/guilherme/miniconda3/envs/rony/lib/python3.9/site-packages/rony/__init__.py", line 1, in <module>
from .cli import *
File "/home/guilherme/miniconda3/envs/rony/lib/python3.9/site-packages/rony/cli.py", line 46, in <module>
def new(ctx, project_name, **kwargs):
File "/home/guilherme/miniconda3/envs/rony/lib/python3.9/site-packages/click/decorators.py", line 308, in decorator
_param_memo(f, OptionClass(param_decls, **option_attrs))
File "/home/guilherme/miniconda3/envs/rony/lib/python3.9/site-packages/click/core.py", line 2495, in __init__
super().__init__(param_decls, type=type, multiple=multiple, **attrs)
TypeError: __init__() got an unexpected keyword argument 'autocompletion
Steps to reproduce:
Other info:
Python Version: 3.9.7
You can contact me for any additional information.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.