e2data / e2datayarn Goto Github PK

When the naming scheme is not followed (i.e., yarn.io/gpu instead of yarn.io/gpu-geforcegtx1080), start-yarn.sh prints a cryptic error message:

$ sbin/start-yarn.sh
Starting resourcemanager
Starting nodemanagers
localhost: ERROR: Cannot set priority of nodemanager process 15665

This error is caused by an java.lang.ArrayIndexOutOfBoundsException because the split in the following line does not work as expected. This error should be handled more gracefully.

The build instructions suggest to replace etc/hadoop with sample_conf and adapt it to the local machine. However, to figure out what has changed, it is useful to run a diff of sample_conf against a pristine configuration directory. However, when replacing hadoop-yarn-project, the files yarn-site.xml and yarn-env.sh are missing from etc/hadoop.