Question

I want to run a python function using jython..

Taking the example from this site.

http://sundaycomputing.blogspot.com/2011/01/python-udfs-from-pig-scripts.html

Now when i run the script (pig -f myscript.pig

It returns me this error

     Pig Stack Trace
---------------
ERROR 2998: Unhandled internal error. org/python/core/PyException

java.lang.NoClassDefFoundError: org/python/core/PyException
    at org.apache.pig.scripting.jython.JythonScriptEngine.registerFunctions(JythonScriptEngine.java:127)
    at org.apache.pig.PigServer.registerCode(PigServer.java:567)
    at org.apache.pig.tools.grunt.GruntParser.processRegister(GruntParser.java:421)
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:419)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
    at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
    at org.apache.pig.Main.run(Main.java:427)
    at org.apache.pig.Main.main(Main.java:108)
Caused by: java.lang.ClassNotFoundException: org.python.core.PyException
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    ... 9 more
================================================================================

I am guessing its because of the first line.. REGISTER udf.py USING jython AS udf;

and that I have to specify jython path? (since i am running this code on cluster.. i dont think i have set this thing up)..
Now… since i dont know much of java.. hence switched on python … but how do i make this code run??

What sort of setup i have to do on my env… to debug this problem.
Thanks

Answer 1

Add $PIG_HOME/lib/jython.jar to your PIG_CLASSPATH environment variable.