Git.readBlob is too slow. about isomorphic-git HOT 9 OPEN

I don't think that we can do anything to make it faster. This is the limitation of NodeJS and FS. NodeGit uses libgit library that is written in C, that's why it's probably faster.

But if you want to contribute and increase the performance of the library you're welcome to do so.

from isomorphic-git.

Hi @zFitness

I also experienced slow performance with huge repository.
After profiling the lib with my implementation it seemed the issue was located inside a small function massively called.
The fix has been integrated in v1.25.3.

Could you retry and see if it also fixed your use case ?

from isomorphic-git.

Hi @zFitness

I also experienced slow performance with huge repository. After profiling the lib with my implementation it seemed the issue was located inside a small function massively called. The fix has been integrated in v1.25.3.

Could you retry and see if it also fixed your use case ?您可以重试并看看它是否也修复了您的用例吗？关闭

Maybe it's a little fast, but it is faster to use the cache parameter

    ✓ isomorphic-git-cache (835 ms)
    ✓ isomorphic-git (12870 ms)

from isomorphic-git.

    ✓ isomorphic-git (13353 ms)
    ✓ node-git (132 ms)
    ✓ fs (51 ms)
    ✓ child_process (11518 ms)

from isomorphic-git.

Seems to be slower than child_process + git.

from isomorphic-git.

I don't think that we can do anything to make it faster. This is the limitation of NodeJS and FS. NodeGit uses libgit library that is written in C, that's why it's probably faster.

我认为我们无法采取任何措施来加快速度。这是 NodeJS 和 FS 的限制。 NodeGit 使用用 C 编写的 libgit 库，这就是它可能更快的原因。关闭

But if you want to contribute and increase the performance of the library you're welcome to do so.

ok, thanks

from isomorphic-git.

I don't think that we can do anything to make it faster. This is the limitation of NodeJS and FS. NodeGit uses libgit library that is written in C, that's why it's probably faster.

But if you want to contribute and increase the performance of the library you're welcome to do so.

Hello, I found that the cache parameter can improve the speed

await git1.readBlob({
        fs: fs,
        dir: projectDir,
        oid,
        cache,
        filepath: file.replace(projectDir, ""),
      });

Now, I implemented an exists function to determine whether files and directories exist under a branch.
Please optimize it for me.Thanks @jcubic

      exists: async (path: string) => {
        try {
          await git.readBlob({
            fs: fs,
            dir: this.gitBasePath,
            oid,
            filepath: path.replace(this.gitBasePath, "").replace(/^\//, ""),
          });
          return true;
        } catch (e) {
          try {
            await git.readTree({
              fs: fs,
              dir: this.gitBasePath,
              oid,
              filepath: path.replace(this.gitBasePath, "").replace(/^\//, ""),
            });
            return true;
          } catch (e) {
            return false;
          }
        }
      },

from isomorphic-git.

Hi @zFitness

I also experienced slow performance with huge repository. After profiling the lib with my implementation it seemed the issue was located inside a small function massively called. The fix has been integrated in v1.25.3.

Could you retry and see if it also fixed your use case ?您可以重试并看看它是否也修复了您的用例吗？关闭

ok, i will retry

from isomorphic-git.

Nice, it probably means your use case was not dependent to the fix.
Cache works pretty well for you !

from isomorphic-git.