karsany / vau Goto Github PK
View Code? Open in Web Editor NEWData Vault data model and ETL generator for Oracle Databases
License: BSD 3-Clause "New" or "Revised" License
Data Vault data model and ETL generator for Oracle Databases
License: BSD 3-Clause "New" or "Revised" License
Production code should be generated in the same directory:
new tree will be:
Currently it generates target/doc/source_table_grants.sql.
Instead of that it should generate target/src/grant/grant_from_{schema_name}.sql
Every line in grant_from_{schema_name}.sql should be unique
Example: attr name typ ora(timestamp(6))...
target directory: target/src/sequence/{sequence_name}.sql
sometimes the documentation generation is slow.
vau should have a command line argument, to enable or disable the documentation generation
SOURCE_TABLE_NAMES column in lineage_columns.csv is empty when generating parameters are set in simplemap
update_audit_id = audit_id of the process, wich updates the end_date col.
Example in oracle-hr project
Link definition:
link EMPLOYEE_MANAGER between EMPLOYEE and EMPLOYEE;
The generated LINK table contains the same column name two times.
There is a need to connect the same entity with itself.
error in generated code:
[...]
Begin
column('LNK_EMPLOYEE_MANAGER','EMPLOYEE_MANAGER_ID','NUMBER(20)','SK for EMPLOYEE_MANAGER');
column('LNK_EMPLOYEE_MANAGER','EMPLOYEE_ID','NUMBER(20)','SK for hub EMPLOYEE');
column('LNK_EMPLOYEE_MANAGER','EMPLOYEE_ID','NUMBER(20)','SK for hub EMPLOYEE');
column('LNK_EMPLOYEE_MANAGER','C$SOURCE_SYSTEM','VARCHAR2(10)','Source System');
column('LNK_EMPLOYEE_MANAGER','C$LOAD_DATE','DATE','First Load Date');
column('LNK_EMPLOYEE_MANAGER','C$AUDIT_ID','NUMBER(20)','Audit ID');
uniq('LNK_EMPLOYEE_MANAGER','EMPLOYEE_MANAGER_ID');
uniq('LNK_EMPLOYEE_MANAGER','EMPLOYEE_ID, EMPLOYEE_ID');
end;
Error:
ORA-00957: duplicate column name
ORA-06512: at line 44
ORA-06512: at line 59
The grammars handle the load method "CDC", but the generator does not do it yet.
The generators should handle the CDC loading method.
new function should be added VAU's simplemap grammar and parser.
should handle link mappings too.
map for entity EMPLOYEE {
source {
[...]
}
business key EMPLOYEE_ID;
attributes {
[...]
}
#### new from here ####
link with JOB through JOB_ID {
datagroup [...]
}
#### new to here ####
}
new file: target/src/install.sql
should contain a reference installer script for all generated database objects.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.