Reading existing .bk files about bigstatsr HOT 5 CLOSED

It's working now, thank you!

from bigstatsr.

Thanks for pointing to this.

I have now

• added the documentation of big_attach() to the website
• added an example of big_attach() in the documentation of FBM
• mentioned that you should read only once from text files (and use big_attach() instead) in the corresponding vignette

Hope this will make things clearer.

from bigstatsr.

What you need to do is to use $save() the first time, this will create a corresponding .rds file, on which you can use big_attach() to get the FBM object in another session.

from bigstatsr.

That's great

Also, it would be useful to know where you have looked for this information, in case I may be able to improve the documentation a bit.

from bigstatsr.

I see that the $save() method is in the FBM documentation, but me and the previous developer both found it difficult to understand what its purpose was until your clarification. It was a little confusing that it generates an .rds file that points to the .bk file until it finally worked. The example in the documentation for big_attach() was extremely useful:

X <- FBM(10, 10)$save()

rdsfile <- sub_bk(X$backingfile, ".rds")
X2 <- big_attach(rdsfile)

all.equal(X[], X2[])

However, big_attach() isn't included in the pkgdown website, so I wouldn't have found it without your help. Just including this function and example on the website would help a lot, and a small vignette detailing the write/read process and the relationship between the .rds and .bk files would be even better.

from bigstatsr.