Tuesday, November 11, 2014

Oozie job fails for some random “begin > end in range” reason

You submit an oozie job and it fails. If you see the following error followed by a stack trace in the Logs:


Launcher exception: begin > end in range (begin, end): (1415382327807, 1415382308114)


-AND/OR this-


java.lang.IllegalArgumentException: begin > end in range (begin, end): (1415382327807, 1415382308114)


Check the system time on all your hadoop nodes. Those times are not coming from your query – they’re coming from your hadoop nodes comparing their system times.


$> date


If they’re skewed even a little bit, that error will come up. So, make sure you’ve got ntp running on all the servers and make sure they’re all pointed at the same ntp server.


Here’s an existing Jira task in the Apache project for Oozie that I finally came across while searching (the submitter mentions just an 8 second time skew causing this):


http://ift.tt/1B4G9oc





No comments:

Post a Comment