Git Product home page Git Product logo

Comments (2)

douweschulte avatar douweschulte commented on May 20, 2024

The benchmarks created in the above commit now have these timings:

Open - small: average time over 633 runs:
        4ms 883μs ± 921μs 509ns

Open - big: average time over 6 runs:
        2s 913ms ± 104ms 260μs

Transformation - small: average time over 264555 runs:
        12μs 586ns ± 38μs 721ns

Transformation - big: average time over 945 runs:
        3ms 47μs ± 348μs 701ns

Remove - small: average time over 80650 runs:
        33μs 719ns ± 65μs 246ns

Remove - big: average time over 673 runs:
        4ms 892μs ± 1331μs 326ns

Iteration - small: average time over 212770 runs:
        11μs 805ns ± 33μs 152ns

Iteration - big: average time over 829 runs:
        3ms 17μs ± 829μs 609ns

Validate - small: average time over 1005 runs:
        98ns ± 91ns

Validate - big: average time over 1005 runs:
        62ms 277μs ± 2ms 210μs

Renumber - small: average time over 231486 runs:
        12μs 137ns ± 28μs 964ns

Renumber - big: average time over 1317 runs:
        2ms 194μs ± 729μs 230ns

Clone - small: average time over 58167 runs:
        57μs 690ns ± 74μs 75ns

Clone - big: average time over 217 runs:
        12ms 479μs ± 2ms 656μs

Save - small: average time over 259 runs:
        11ms 565μs ± 890μs 219ns

Save - big: average time over 8 runs:
        785ms 135μs ± 8ms 434μs

As this is built using a custom framework some work has to be done to get it to a continuous benchmarking system.

from pdbtbx.

douweschulte avatar douweschulte commented on May 20, 2024

I would assume that no big performance jumps are expected between commits so running benchmarks on each commit could be quite redundant. Besides that cloud systems are not the most reliable to find small regressions in code performance: https://bheisler.github.io/post/benchmarking-in-the-cloud/. So until this codebase is developed by a bigger team and used in more performance critical environments I would propose to run benchmarks locally once in a while.

from pdbtbx.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.