psteiwer / analyzethis Goto Github PK
View Code? Open in Web Editor NEWEasily transform a CSV file/Table/SQL query into a personalized preview of DeepSee/InterSystems IRIS BI
License: MIT License
Easily transform a CSV file/Table/SQL query into a personalized preview of DeepSee/InterSystems IRIS BI
License: MIT License
If a row in a source file contains non-numeric data for a field that is being used as an integer measure, that row is not included in the generated source table (and therefore isn't included in the cube either). The Import Data dialog gives no indication that any errors occurred.
The following source data from https://www.baseball-reference.com/teams/BOS/ reproduces this issue when the "GB" (games back) column is included as an integer measure - 19 rows are skipped because they contain "--" to represent 0 in that field:
redsox_seasons.csv
When trying to view a listing, I am seeing this error:
ERROR #5540: SQLCODE: -1 Message: ( expected, , found^ SELECT TOP ? ID , DATE , (4)
The following SQL was generated:
SELECT TOP 1000 ID, date, location, newcases, newdeaths, totalcases, totaldeaths FROM AnalyzeThis_Generated.coronavirus source WHERE source.%ID IN (SELECT _DSsourceId FROM AnalyzeThis_Generated_coronavirusCube.Listing WHERE _DSqueryKey = 'en1665844046')
This is because date is a reserved word and should be escaped
Width is slightly off due to some padding. This is causing a horizontal scroll bar
The UI is now separate from the generate methods. Previously the generate methods were with the UI and they updated the buttons depending on what was generated. In particular, the show scorecard button no longer appears even when a scorecard is generated. I also believe that the dashboard button does not work. The footer buttons need to be evaluated and possibly refactored
UnitTests.TestRegexLine.TestNoEndQuote Fails
As title says, make user portal link pretty
After the import and generation is completed, there is an option to view some cube info. This includes some null statistics. This should be replaced with the full metadata table information
Currently line limit is not stored so refreshing the data from the UI will pull in all data from the data source
If a user does not use the Browse button and simply pastes a file path into the text box, the Next button is not enabled
It would be nice to be able to install AnalyzeThis using the following structure:
Step 0: Download the zip file and extract it to
Step 1: s path="\AnalyzeThis-master"
Step 2: do $system.OBJ.Load(path_"/AnalyzeThis/Installer.cls","ck")
Step 3: do ##class(AnalyzeThis.Installer).RunInstaller(path)
This way, you can copy and paste steps 2 and 3.
In addition to the Readme file change, the RunInstaller function will need to add a path parameter.
Numeric values formatted with , are causing issues when trying to import them as measures.
Compile errors on initial load when IRISLIB is mounted as read only
Coul you autodetect for the measures upon the values? e.g. it's a measure if first 10 values are integers
Would be great
Trying to import a "bad csv file" with null headers causes an error. This is the most common "bad csv file" issue I have seen.
If an empty column header is detected, we should ignore that column. If there is a row with data in that column, we should ignore the row. This generally happens because a row is formatted incorrectly and a single cell's data is split across more than 1 cell. This shifts the rest of the cells over and will create a new column if there is data in the last column
I am getting this error while trying to test:
First 16 characters of CubeName must be unique from existing CubeNames. Inpatients is not unique from Inpatients2
Automatically detect the date format when a user selects the date type
Installed via zpm on a mac, IRIS 2019.34, but cannot see any link in the analytics user portal. Install reported no errors and AnalyzeThis_ThirdParty.js is in the csp/user/ directory.
I'm not really familiar with Zen so not sure how it loads js files, but inspecting the loading in developer tools in Chrome it looks like that is just not happening
Allow restriction of file size based on input value
Imported the file which goes with repo - inpatient.csv
Import never ends.
IRIS for UNIX (Ubuntu Server LTS for x86-64 Containers) 2019.3 (Build 309U) Wed Sep 11 2019 16:20:03 EDT
I removed [ SqlTableName = SalesTransaction ] from HoleFoods.Transaction and tried to select it as my source class. I then received this error.
ERROR #5001: SQLToJSON Error. SQLCODE: Invalid SQL statement
SOURCE ELEMENT: %ZEN.Component.html (htmlContent)
Currently all temporary streams are saved and never removed
Since dashboard exists, section of code is skipped and undefined error is hit:
zGenerateSampleDashboards+374^AnalyzeThis.Dashboard.AutoPivot.1 *scores(13)
This is due to recent changes, probably need to check for the checked property instead of value
$h is not a date format option on the property check page, this should be made available
When a date uses MM/DD/YY format, the system assumes it is 19YY instead of 20YY. Perhaps there should be two options to replace the current MM/DD/[YY]YY with:
MM/DD/19YY or
MM/DD/20YY
using 20YY as the default.
to let me put the URL for CSV in the cloud: on Github, in AWS S3, Google Bucket, etc
Mini-analyzer option should be removed from the generated widgets
Hello,
It would be nice to have an API to generate sample dashboard and scorecard from an existing DeepSee Cube.
If one already exists, would you be able to document it?
Thanks in advance!
Asaf
Imported a value of Saint Barthélemy, it was imported as Saint Barthélemy. This is how the string appears in the data global
AnalyzeThis.Dashboard.AutoPivot:GenerateSampleDashboards() contains code that logs the "scores" of different factors. If these scores are then within a certain range, a pre-defined widget type is used and it dynamically adds the factors with correct scores.
At this time, adding new chart types and modifying factors is not a simple process. This process should be broken down into easier to manage stages.
If a cell has a line break in it, the Regex reading in the CSV file does not work properly and splits this cell into two CSV lines instead of ignoring the line break and treating it as data
UnitTests.TestRegexLine.TestCRLFadv fails
Temporary file name of "importfromlocal" is used instead of the Cube Name property
Error invoking instance method: SwitchSourceType:
zSwitchSourceType+13^AnalyzeThis.UI.Dialog.CSVImport.1 *sourceClassFile
Set %ret = %obj.SwitchSourceType()
%obj='[email protected]'
This is a property used to store metadata about the file being imported, this overwrites the data node called "Type" if defined
Currently, %DeepSee.WizardUtils does not handle "TIMESTAMP" properties. Once this is implemented, AnalyzeThis can take advantage
An error like this can occur when importing after selecting %TimeStamp as a level type:
The error message is
ERROR #5475: Error compiling routine: AnalyzeThis.Generated.CubeName.1 Errors: ERROR: AnalyzeThis.Generated.CubeName.cls(buildDateSet+2) #1010: Missing right parenthesis: 'pVal=+$zdth(pVal,1,,5,"99" }'...
Currently Carriage Return+Line Feed is the only accepted line terminator
Change this to default and allow users to define their own
It appears that the status is always empty in AnalyzeThis.UI.CSVImport:drawDone(), this is causing the Import button to always be disabled
Currently, the last line of a file is not read if there is no final line feed
UnitTests.TestRegexLine.TestNoFinalLineFeed Fails
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.