Git Product home page Git Product logo

Comments (6)

Mikanebu avatar Mikanebu commented on June 16, 2024

@OriHoch Thanks for reporting this. Please, could you check now, it works fine. Probably, it took time to pass pipeline and upload to the frontend. Good point about file size, for now, there is no limit for this, but we will take it into consideration.

from datahub-qa.

OriHoch avatar OriHoch commented on June 16, 2024

still crashes the page for me

I guess it's browser-related, I'm using Chrome Version 58.0.3029.110 (64-bit) - on Linux

I tested on Firefox 55.0.2 (64-bit) and it doesn't crash, but hangs and becomes very unresponsive, also table doesn't load:
image

from datahub-qa.

OriHoch avatar OriHoch commented on June 16, 2024

on firefox it worked eventually (not sure how long it took, but a long time)

It seems that currently the frontend loads all dataset to memory, this makes it unusable for large datasets

from datahub-qa.

rufuspollock avatar rufuspollock commented on June 16, 2024

@OriHoch thanks for report - and we had this high on the todo list already since we ran into it already during testing! We know what we want to do to fix for large datasets which is to cache a partial "preview" version of the dataset - loading into memory isn't going to work. (A nicer solution would be a frontend system that loads incrementally but that is quite a lot harder to do ...)

from datahub-qa.

rufuspollock avatar rufuspollock commented on June 16, 2024

@Mikanebu i believe this is fixed. Can you confirm and close if it is 😄

from datahub-qa.

Mikanebu avatar Mikanebu commented on June 16, 2024

@OriHoch Thank you for your patience. It is FIXED now, you just need to republish your data, so it triggers pipelines. If it is still taking a long time to load the page, it should be fixed here - datopian/assembler#32 - where we will use only 1k rows for preview. I am going to close this issue, for now, if something goes wrong, please, do not hesitate to reopen it.

from datahub-qa.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.