Git Product home page Git Product logo

generatedata's Introduction

generatedata.com

Build Status

This is the repo for the downloadable version of generatedata.com. The script is essentially an engine to generate any sort of random data in any format. It currently comes with 30 or so Data Types (types of data it generates), 12 Export Types (formats for the data, like CSV, SQL, JSON), plus around 32 data sets for specific countries (city names, regions etc). But more importantly it can be extended in any way you want. Check out the developer documentation for more information on that.

Programmatic generation

The current major version of the script is 4.x, which was a big change over earlier releases. Earlier versions were written in PHP and MYSQL and 3.x offered a REST API to let you generate the data programmatically rather than via an API. While this is still planned for 4.x it's not currently offered, and the plan it to tackle that after making the script available as an npm package - which we feel will be a more convenient way to programmatically generate data over the more agnostic REST approach.

Requirements

  • Docker
  • node
  • nvm

See the Installation instructions for full details.

How to Install / Documentation

For installation instructions, user and developer documentation, check out: https://benkeen.github.io/generatedata/

License

This script is freely available under the GPL 3 license. See license.txt in the root folder. Please note that all contributors agree that all code is released under this license.

Contributors

In addition to the many fine folk who submit bug reports, a big thanks to the following for their help extending the script: https://github.com/benkeen/generatedata/graphs/contributors

Ben Keen @vancouverben

generatedata's People

Contributors

adibaby avatar alicanipek avatar andrefortin avatar apmuthu avatar benkeen avatar bjo3rnf avatar conradhagemans avatar dependabot[bot] avatar derdeagle avatar devender-yadav avatar edwindijkstranl avatar fareez-ahamed avatar fferegrino avatar fmarques56 avatar gigaplus avatar harish81 avatar jamesking56 avatar kehh avatar kkirby avatar krishooper avatar mintobit avatar moali191 avatar mroca avatar niozero avatar ntauch avatar psauvetre avatar tayeb-ali avatar twindual avatar unullmass avatar wingsline avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

generatedata's Issues

Unable to Generate Composite Data Types

Multiple attempts, different platforms/browsers, different output formats, to generate Composite Data Types
Reduced to simplest form: {$Row1}

all return:

Fatal error: Uncaught exception 'SmartyException' with message 'Unable to load template file 'eval.tpl'' in /home/generatedata_com/alpha.generatedata.com/resources/libs/smarty/sysplugins/smarty_internal_templatebase.php:127 Stack trace: #0 /home/generatedata_com/alpha.generatedata.com/plugins/dataTypes/Composite/Composite.class.php(41): Smarty_Internal_TemplateBase->fetch('eval.tpl') #1 /home/generatedata_com/alpha.generatedata.com/resources/classes/Generator.class.php(218): DataType_Composite->generate(Object(Generator), Array) #2 /home/generatedata_com/alpha.generatedata.com/plugins/exportTypes/JSON/JSON.class.php(18): Generator->generateExportData() #3 /home/generatedata_com/alpha.generatedata.com/resources/classes/Generator.class.php(88): JSON->generate(Object(Generator)) #4 /home/generatedata_com/alpha.generatedata.com/generate.php(7): Generator->generate() #5 {main} thrown in /home/generatedata_com/alpha.generatedata.com/resources/libs/smarty/sysplugins/smarty_internal_templatebase.php on line 127

Composite type?

Maybe I'm not doing this correctly but I'd like to generate a username based on the firstname / lastname of the user.
So given that:

{$ROW2|truncate:1}{$ROW3|truncate:8}

But no matter what I enter it returns blank.

Even if I just do {$ROW2} it returns blank.

Is there any known problems with the smarty templates system?

Notification message on Accounts tab missing

When you load the page on the Account tab and there are no accounts, it shows a nice message in a blue box. But when you click to a different tab then back to the Accounts tab again, it's gone.

Noticed on the live site (that I can see only), but it's almost certainly in the main build as well.

"Total rows generated" not accurate

This is a pain. That value currently only reflects the data sets currently stored - not what's been deleted.

Need to re-add the custom DB field to store this value.

Save form with POST ajax

I was working on a big form last time, with more than 80 fields. Some fields were custom lists, with a lot of possible values.

When saving the form, I received a Fatal error in a javascript alert. Looking at apache error log, I saw it was because the URI was too long (request failed: URI too long (longer than 8190)). I was surprised the ajax request was made with GET method!

So I changed the call in io.js to use POST method, and now it works! File scripts/io.js, line 87 before " data: data_str,", add
type: "POST",

So, maybe it would be wise by default to use POST method for the form saving?

I used tag v2.3.9.

Your app rocks, it saved me a lot of time! Thanks again.

Main Dialog highlighting rows - 2 bugs

  1. It shouldn't highlight the rows in red - just grey or something non-committal.
  2. Selecting/unselecting all should highlight/de-highlight the rows as well.

Column Order "munged"

Demo Web App: Column Header Order "munged"

Defined:

"IP1",
"IP2",
"IP3",
"IP4",
"KillChainPhase",
"IOC_ID",
"EarliestSeen",
"LatestSeen",
"Class",
"Type"

Outputs:
{
"cols": [
"IP1",
"Type",
"IP2",
"IP3",
"IP4",
"KillChainPhase",
"IOC_ID",
"EarliestSeen",
"LatestSeen",
"Class"
],
"data": [
[
"253",
"199",
"176",
"3",
"Exploit",
"5DE0727E-A1DE-BB7E-2385-3193-F542B591",
"Sun, 01 Jul 2012 19:00:55 -0700",
"Sun, 18 Dec 2011 00:33:01 -0800",
"Network",
"ipv4Addr"
],

Feature Proposal

Hey Ben,

I forked your project to pitch in v3 if I can.

I see even though you mention a ton of bugs to squash on the site, here there are only three issues out there. If you have more somewhere else, that would be a good place for me to start.

However... I do have a feature idea that might be interesting, however I definitely feel it only appropriate to discuss it before I get down and dirty with it.

You can reach me on email on my profile, or at skype: menashe.borbely

All the best.

Need to add password reminder option to UI

Bah! A scenario I neglected: if the installation is configured to allow anonymous access, no user can access the password reminder tab that appears on the login page (not the modal). Need to update the login modal to include the option to have password reset.

Programming Language -> Perl generation bug

Two things:

  1. If Programming Language Export Type is selected, perhaps "Column Title" should read "var/property name"
  2. If there's spaces in the var name, it generates dud code.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.