Support Parquet Read and Write from/to GCS about parquet4s HOT 3 CLOSED

Hi @aravindr18!
Thanks for your interest in your library!
Let me first understand your issue. If I understand correctly you want to read and write from GS and you want to configure GS file system programmatically. Wouldn't it work for you if you would just put required properties in core-site.xml at your classpath (as in docu that you refer to)?
Nevertheless it might be a good idea to allow developers to optionally pass Hadoop Configuration to reader and/or writer. Your PRs are welcome :)

from parquet4s.

Hi @mjakubowski84, thanks so much for your reply!
I tried the core-site.xml approach after submitting this issue yesterday and, this worked without requiring those additional changes :) (funny that I didn't think of doing this earlier). Using the core-site.xml is a much cleaner and more straightforward approach.
I can submit the PR to pass these confs programmatically if you think it would add some value to the lib. Otherwise, I can just update the readme to include a section about configuring for GCS

Thanks once again

from parquet4s.

I think that having the possibility to pass Hadoop configuration programmatically might be a good addon. You're very welcome to do the PR. Thanks!

from parquet4s.