Big downloads fail with bad hive udf operation (issue field)

15598
Reporter: omeyn
Assignee: fmendez
Type: Bug
Summary: Big downloads fail with bad hive udf operation (issue field)
Priority: Blocker
Resolution: Fixed
Status: Resolved
Created: 2014-05-08 15:16:16.257
Updated: 2014-05-09 00:13:36.393
Resolved: 2014-05-09 00:13:36.369
        
Description: I moved the dev env to use the new dev cluster but i think this bug is not introduced by me. Small downloads appear to work, but big downloads fail when they try to run the CleanDelimiters udf on the (apparently multi-valued) issue column.

FAILED: SemanticException [Error 10014]: Line 6:10235 Wrong arguments 'issue': No matching method for class org.gbif.occurrence.hive.udf.CleanDelimiterCharsUDF with (array). Possible choices: _FUNC_(string)
Log file: /mnt/disk_d/mapred/local/taskTracker/occurrence-download/jobcache/job_201405011729_0128/attempt_201405011729_0128_m_000000_0/work/hive-oozie-job_201405011729_0128.log  not present. Therefore no Hadoop jobids found
Intercepting System.exit(10014)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [10014]

See: http://c2n1.gbif.org:50060/tasklog?attemptid=attempt_201405011729_0128_m_000000_0&all=true]]>
    

Author: fmendez@gbif.org
Comment: GbifTerm.issue is an array and is not processed as a regular column
Created: 2014-05-09 00:13:36.391
Updated: 2014-05-09 00:13:36.391