Hadoop – Apache ozie loading Sharelib failed

I got the following oozie.log:

org.apache.oozie.service.ServiceException: E0104: Could not fully initialize service [org.apache.oozie.service.ShareLibService], Not able to cache sharelib. An Admin needs to install the sharelib with oozie-setup.sh and issue the'oozie admin' CLI command to update the sharelib

I run the following command:

oozie-setup.sh sharelib create -fs hdfs://localhost:54310
oozied.sh start

hdfs dfs -ls /user/hduser/share/lib
15/02/24 18:05:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Found 3 items
drwxr-xr-x-hduser supergroup 0 2015-02-24 17:19 /user/hduser/share/lib/lib_20150224171855
drwxr- xr-x-hduser supergroup 0 2015-02-24 17:19 /user/hduser/share/lib/lib_20150224171908
drwxr-xr-x-hduser supergroup 0 2015-02-24 17:29 /user/hduser /share/lib/lib_20150224 172857

But:

oozie admin -shareliblist -oozie http://localhost:11000/oozie
[Available ShareLib]

oozie admin -sharelibupdate -oozie http://localhost:11000/oozie
null

My oozie-site.xml contains:


oozie.service.WorkflowAppService.system.libpath
/user/${user.name}/share/lib/< /value>



oozie.service.HadoopAccessorService.hadoop.configurations
* =hadoop-conf

Do you know my mistake?

I tried to fix the same error for a few days, and I finally solved it.

It is related to finding the sharelib folder on the local file system instead of the sharelib service of my hdfs.

So solve it:

Stop oozie

< p>Edit conf/oozie-site.xml

 
oozie.service.HadoopAccessorService.hadoop.configurations
*=/usr/local/hadoop/etc/hadoop/

Restart oozie.

And voila!

By default, the value of this attribute is set to *= hadoop-conf. I still don’t know what hadoop-conf should point to, but in my case, it is not the configuration folder hadoop so I changed For * = /usr/local/hadoop / etc / hadoop /.

I got the following oozie.log:

org.apache.oozie.service.ServiceException: E0104: Could not fully initialize service [org.apache.oozie.service.ShareLibService], Not able to cache sharelib. An Admin needs to install the sharelib with oozie- setup.sh and issue the'oozie admin' CLI command to update the sharelib

I run the following command:

oozie-setup.sh sharelib create- fs hdfs://localhost:54310
oozied.sh start

hdfs dfs -ls /user/hduser/share/lib
15/02/24 18:05:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Found 3 items
drwxr-xr-x-hduser supergroup 0 2015-02-24 17:19 /user/hduser/share/lib/lib_20150224171855
drwxr-xr-x-hduser supergroup 0 2015-02-24 17:19 /user/hduser/share/lib/lib_20 150224171908
drwxr-xr-x-hduser supergroup 0 2015-02-24 17:29 /user/hduser/share/lib/lib_20150224172857

But:

oozie admin -shareliblist -oozie http://localhost:11000/oozie
[Available ShareLib]

oozie admin -sharelibupdate -oozie http://localhost:11000/ oozie
null

My oozie-site.xml contains:


oozie.service. WorkflowAppService.system.libpath
/user/${user.name}/share/lib/



oozie.service.HadoopAccessorService.hadoop.configurations
*=hadoop-conf

Do you know my mistake?

I tried to fix the same error for a few days, and I finally solved it.

It’s the same as finding on the local file system The sharelib folder is not related to the sharelib service of my hdfs.

So solve it:

Stop oozie

Edit conf/oozie-site.xml

p>

 
oozie.service.HadoopAccessorService.hadoop.configurations
*=/usr/local/hadoop /etc/hadoop/

Restart oozie.

And look!

By default, the value of this attribute is set to *= hadoop-conf. I still don’t know what hadoop-conf should point to, but in my case, it is not the configuration folder hadoop so I changed *= /usr/local/hadoop/etc/hadoop/.

Leave a Comment

Your email address will not be published.