[Request] Make it Colab or heroku compatible about opendirectorydownloader HOT 16 CLOSED

I don't know about Google Collab, but adding support for Heroku is only partially possible.

You can create Heroku addons than can be installed alongside your server (meaning ODD could be downloaded and added to the PATH variable), but you don't have any kind of console access, which means you'd need a wrapping server.

Another way to use the binary is by using my Node.js wrapper, which automatically downloads the latest binary for you.

I've actually done just that and created https://open-directory-downloader.herokuapp.com (URL subject to change), which runs on Heroku, uses my wrapper to handle the binary and has source code available here.
So in case someone wants to set up their own instance (for whatever reason), they can easily do it :)

from opendirectorydownloader.

Thank u so much @KoalaBear84 didn't expect such quick reply

from opendirectorydownloader.

I think that is technically not that possible.

It already works for the normal indexes:

https://www.reddit.com/r/opendirectories/comments/hhjtpf/od_indexer_in_colab/

And I have no knowledge about Heroku.

from opendirectorydownloader.

Thanks for the

I think that is technically not that possible.

It already works for the normal indexes:

https://www.reddit.com/r/opendirectories/comments/hhjtpf/od_indexer_in_colab/

And I have no knowledge about Heroku.

Thanks for the quick reply, i saw that link and downloaded .ipynb file. But there is no any option to use it to download from google index sites. I think its for downloading normal index websites. Will you look into that file and made necessary changes to make it work with google index?
it would be nice if you add that link in your readme and instructions how to use it.

from opendirectorydownloader.

For Google Drive you need an extra file, which you might copy to Colab, not sure how that works.

The GoIndex (Google Drive alternatives) ones would already work.

from opendirectorydownloader.

For Google Drive you need an extra file, which you might copy to Colab, not sure how that works.

The GoIndex (Google Drive alternatives) ones would already work.

I am getting this error, it doesnt not work. OR am i doing anything wrong?
and btw where do i find crawled links file?

from opendirectorydownloader.

You did it correctly. Looks like this has another format or implementation, will check it.

It uses this one, ANOTHER one, how much more are they going to make! :P

https://github.com/LeeluPradhan/G-Index

from opendirectorydownloader.

I've added support and created a new release for it. If you use this new release in it, it should work:

https://github.com/KoalaBear84/OpenDirectoryDownloader/releases/tag/v1.5.2.0

from opendirectorydownloader.

I've added support and created a new release for it. If you use this new release in it, it should work:

https://github.com/KoalaBear84/OpenDirectoryDownloader/releases/tag/v1.5.2.0

I'm here for colab script of this script to use it more efficiently, so please make official colab script.

from opendirectorydownloader.

I have no knowledge of it.

from opendirectorydownloader.

Someone with experience could provide some guidance on this. Can this be added to this repository as a file? Or how do you work with this?

from opendirectorydownloader.

Can i get the colab file

from opendirectorydownloader.

It's expired in reddit

from opendirectorydownloader.

I didn't knew I still had it somewhere on my computer, as I'm not the poster of it.

ODindexer.zip

from opendirectorydownloader.

Official support is now added:

https://github.com/KoalaBear84/OpenDirectoryDownloader/#google-colab--jupyter-notebook

from opendirectorydownloader.

Thanks to @Chaphasilor it is greatly improved!

from opendirectorydownloader.