Fine-tuning on other programming languages than Python about starcoder HOT 5 CLOSED

Hello, my fine-tuning snippet is working now and you may close this ticket. Thank you for the help!

from starcoder.

By the way, it is because our team is more often working with Gaming design languages like C-sharp.

from starcoder.

Hi, we used the same pre-training framework Megatron-LM to do the fine-tuning on the Python dataset, that you can use with any other dataset, or use the code provided in this repository, with the dataset of your choice.

from starcoder.

Thanks a lot for the update. I am not familiar with code implementations in Megatron-LM, however. May I know with which file(s) should I follow to understand the fine-tuning logic?

Thanks in advance!

from starcoder.

Hi,

I am looking into the examples directory and will update this ticket once it has been executed properly. Thanks.

from starcoder.