Git Product home page Git Product logo

avro's Introduction

Avro

Plugin to enable Avro as a target in Hackolade data modeling. Requires prior download of the Hackolade application from our download page

Hackolade exposes its core data modeling engine through a plugin architecture. Each plugin applies the Hackolade data modeling capabilities to a specific target technology, whether for data-at-rest (databases) or data-in-motion (communications.) Each plugin matches the specific aspects of the target in terms of terminology, storage model, data types, and communication protocol.

To enable data modeling capabilities for a target, you must first download and install the plugin, following these instructions.

Plugins can be customized by following these instructions.

avro's People

Contributors

arzamastsevvladyslav avatar beardimonr avatar bigorn0 avatar dannleed avatar edikdolynskyi avatar kostia-ts avatar kostia1359 avatar kpilkevich avatar lenchvolodymyr avatar maksymslobodianyk avatar mtseluiko avatar pdesmarets avatar serhii-filonenko avatar taras-dubyk avatar thomas-jakemeyn avatar viktormasnyi avatar vitalii4as avatar vitaliibedletskyi avatar wilhelmwesser avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

avro's Issues

Reverse engineering Avro schema from file blanks Hackolade

Hackolade version: 6.10.20
Avro plugin version: 0.1.128

Actions leading to the issue:

  • Create new Hackolade model with target Apache Avro Schema
  • Tools > Reverse-Engineer > Avro schema or data file > File System...
  • Select .avsc file and click OK (option "Combine schema" or "Separate schema" lead to same issue)
  • Processing dialog displays and processing seems to happen (CPU fan spins up)

When processing (presumably) finishes, Hackolade blanks to white canvas, menu bar still showing but all options greyed out.

If more than one instant of Hackolade running at the time, the following error message is displayed in the console after a minute or so:

Error sending from webFrameMain: Error: Render frame was disposed before WebFrameMain could be accessed
at s.send (node:electron/js2c/browser_init:2:86358)
at _.send (node:electron/js2c/browser_init:2:71969)
at sendCompressed (/home/olav/Downloads/Hackolade-linux-x64/resources/app/main.js:86:71055)
at /home/olav/Downloads/Hackolade-linux-x64/resources/app/main.js:86:52977
at process.processTicksAndRejections (node:internal/process/task_queues:96:5)

Reverse-engineering issue for Avro schema with multiple items with union types

Hi, I wrote an Avro schema which we've been using. The Avro schema has been validated against Apache 1.8.2 and has been working within XMLSpy. I tried to reverse-engineer the schema in Hackolade using the Avro plug-in but noticed that it drops all field using "union" except for the last one in the schema.
You can try the 3 versions of the same schema in the attached zip file and will see that only the last field with union is kept.

Thanks,
Claude Marchand

person.zip

Avro annotations support

To my understanding the current Avro plugin version doesn't support the definiton annotations at entity or field level.

I wanted to start this thread to discuss the usage of "Configure custom properties" at entity or field level, to feed annotation "Tags" on the generated avro schema.

AVSC Sample:

{
  "type" : "record",
  "name" : "Customer",
  "fields" : [ {
    "name" : "CustomerFullName",
    "type" : {
      "type" : "string",
      "tags" : [ "PII","Sensitive" ]
    }
  }
],
 "tags" : [ "PII","Sensitive" ]
}

IDL sample:

 @tags(["PII", "Sensitive"])
  record Customer {
     @tags(["PII", "Sensitive"])
      string CustomerFullName;
  }

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.