uw-madison-hep / xrootd-hdfs Goto Github PK

Hi all,

Seeing as this plugin is no longer part of the OSG documentation, I assume it is being phased out.

Are there any plans regarding

• future developments
• archiving this repo
• talks with the xrootd team to change ownership?

If there are no plans: Could you please add a LICENSE to make clear if future modification/forks are allowed?

hdfsRead has a few pipelining- and readahead-related improvements over hdfsPread. However, it can only be used when the remote client is streaming the file (no skips).

However, that should be easy to detect - use hdfsRead until a non-contiguous read is detected, then switch to hdfsPread.

gfal-rename fails with davs arguments. This bug may possibly occur with any kind of protocol. The error may be related to this message:

hdfsBuilderConnect(forceNewInstance=1, nn=default, port=0, kerbTicketCachePath=(NULL), userName=) error:
IllegalArgumentException: Null userjava.lang.IllegalArgumentException: Null user

Since 2.5.0 release, Hadoop supports xattr and it could set the checksum values as xattr and not files under /cksums dir as it is right now.

Hi,
Checksum fails when it is enabled on the server and client also marks -K ADLER32 flag. (https is know yet not supporte)

$ gfal-copy listing root://transfer-2.ultralight.org:1095//store/temp/user/jjj.112/listing201 -K ADLER32
Copying file:///afs/cern.ch/user/j/jbalcas/listing   [FAILED]  after 0s
gfal-copy error: 21 (Is a directory) - Error on XrdCl::CopyProcess::Run(): [ERROR] Server responded with an error: [3016] Unable to fchmod /store/temp/user/jjj.112/listing201; is a directory

From the server:

180714 03:07:06 20533 ofs_open: jbalcas.27779:[email protected] Unable to fchmod /store/temp/user/jjj.112/listing201; is a directory
Resulting PFN: /store/temp/user/jjj.112/listing201
180714 03:07:06 20533 jbalcas.27779:[email protected] ofs_close: use=0 fn=dummy

Let me know if more info is needed or should I increase verbose mode.

Thanks