Comments (6)
@OriHoch Thanks for reporting this. Please, could you check now, it works fine. Probably, it took time to pass pipeline and upload to the frontend. Good point about file size, for now, there is no limit for this, but we will take it into consideration.
from datahub-qa.
still crashes the page for me
I guess it's browser-related, I'm using Chrome Version 58.0.3029.110 (64-bit) - on Linux
I tested on Firefox 55.0.2 (64-bit) and it doesn't crash, but hangs and becomes very unresponsive, also table doesn't load:
from datahub-qa.
on firefox it worked eventually (not sure how long it took, but a long time)
It seems that currently the frontend loads all dataset to memory, this makes it unusable for large datasets
from datahub-qa.
@OriHoch thanks for report - and we had this high on the todo list already since we ran into it already during testing! We know what we want to do to fix for large datasets which is to cache a partial "preview" version of the dataset - loading into memory isn't going to work. (A nicer solution would be a frontend system that loads incrementally but that is quite a lot harder to do ...)
from datahub-qa.
@Mikanebu i believe this is fixed. Can you confirm and close if it is
from datahub-qa.
@OriHoch Thank you for your patience. It is FIXED
now, you just need to republish your data, so it triggers pipelines. If it is still taking a long time to load the page, it should be fixed here - datopian/assembler#32 - where we will use only 1k rows for preview. I am going to close this issue, for now, if something goes wrong, please, do not hesitate to reopen it.
from datahub-qa.
Related Issues (20)
- Data Package viewer / preview tool
- Make sure all certified datasets are fine
- Missing data between old.datahub.io and datahub.io? HOT 2
- too hard to find your own datasets HOT 1
- Redirect not working for https://data.okfn.org/tools/view HOT 1
- Broken link on the home page HOT 1
- Unable to Signup HOT 7
- Text overlap on collections while resizing HOT 1
- Server 521 Error, unable to access site at all HOT 3
- Revision processing fails for personal and organization accounts HOT 1
- Datopian logo is not displayed on home page HOT 1
- GitHub login is not working HOT 1
- Cannot login to the datahub HOT 1
- Resources on datahub not accessible (server timeout) HOT 1
- Visualising Data Using Vega-Lite
- Can't Register with GitHub Authentication HOT 1
- Emails to [email protected] are being rejected HOT 3
- Special Character '/' in Dataset names not being processed correctly HOT 6
- SSL Certification Error when connecting to Tableau
- Character '.' (dot) in dataset names is not displayed properly (creating containers) HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datahub-qa.