Should `huggingface_hub` be added to requirements.txt? about litgpt HOT 5 CLOSED

Good idea. But you should add it to the howtos about downloading data, not the README

from litgpt.

Downloading weights is not strictly required to use the project. For instance, to pretrain the model.

This is why that package is not part of requirements.txt

from litgpt.

Makes sense! If desired, I can edit the README to add pip install huggingface_hub where required.

from litgpt.

#97

from litgpt.

I ran into the issue after following the tutorial here again: https://lightning.ai/pages/blog/falcon-a-guide-to-finetune-and-inference/

Maybe a idea would be to use the extras_require feature in the setup.py and create multiple versions?

extras_require={
    'download':  ['huggingface_hub'],  # These are additional requirements for the "download" version
},

Then we could add pip install .[download] to the documentation.
I think it would be important to add this in the main readme.md.

from litgpt.