Some downloads crash with uniquetable constraint violation in hive metadata

14601
Reporter: omeyn
Assignee: fmendez
Type: Bug
Summary: Some downloads crash with uniquetable constraint violation in hive metadata
Priority: Blocker
Resolution: CantReproduce
Status: Closed
Created: 2014-01-08 11:14:45.568
Updated: 2014-01-22 15:06:07.288
Resolved: 2014-01-22 15:06:07.258
        
Description: At least one case we know of shows this error after completing the big download step. Seems the table name (the temp download table) is not unique when being written to the hive metadata, which causes the job to fail. Leaving as Major unless we see it again:

Launching Job 3 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201312111438_8780, Tracking URL = http://c1n10.gbif.org:50030/jobdetails.jsp?jobid=job_201312111438_8780
Kill Command = /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/bin/hadoop job  -kill job_201312111438_8780
Hadoop job information for Stage-3: number of mappers: 3; number of reducers: 0
2014-01-07 16:55:02,349 Stage-3 map = 0%,  reduce = 0%
2014-01-07 16:55:08,368 Stage-3 map = 33%,  reduce = 0%, Cumulative CPU 4.65 sec
2014-01-07 16:55:09,373 Stage-3 map = 33%,  reduce = 0%, Cumulative CPU 4.65 sec
2014-01-07 16:55:10,379 Stage-3 map = 100%,  reduce = 0%, Cumulative CPU 19.78 sec
2014-01-07 16:55:11,383 Stage-3 map = 100%,  reduce = 0%, Cumulative CPU 19.78 sec
2014-01-07 16:55:12,389 Stage-3 map = 100%,  reduce = 0%, Cumulative CPU 19.78 sec
2014-01-07 16:55:13,394 Stage-3 map = 100%,  reduce = 100%, Cumulative CPU 19.78 sec
MapReduce Total cumulative CPU time: 19 seconds 780 msec
Ended Job = job_201312111438_8780
Moving data to: hdfs://c1n8.gbif.org:8020/user/hive/warehouse/download_tmp_vpovilaitis_c110bcabb7a844ec82e04c5229d77e9a
FAILED: Error in metadata: MetaException(message:javax.jdo.JDODataStoreException: Insert of object "org.apache.hadoop.hive.metastore.model.MTable@7aca4b5b" using statement "INSERT INTO "TBLS" ("TBL_ID","VIEW_ORIGINAL_TEXT","RETENTION","VIEW_EXPANDED_TEXT","OWNER","LAST_ACCESS_TIME","SD_ID","TBL_TYPE","TBL_NAME","DB_ID","CREATE_TIME") VALUES (?,?,?,?,?,?,?,?,?,?,?)" failed : ERROR: duplicate key value violates unique constraint "UNIQUETABLE"
NestedThrowables:
org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "UNIQUETABLE")
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
MapReduce Jobs Launched:
Job 0: Map: 141   Cumulative CPU: 3066.5 sec   HDFS Read: 42057057295 HDFS Write: 718051908 SUCCESS
Job 1: Map: 3   Cumulative CPU: 19.78 sec   HDFS Read: 718265487 HDFS Write: 718051908 SUCCESS
Total MapReduce CPU Time Spent: 51 minutes 26 seconds 280 msec
Log file: /mnt/disk_e/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_8768/attempt_201312111438_8768_m_000000_0/work/hive-oozie-job_201312111438_8768.log  not present. Therefore no Hadoop jobids found
Intercepting System.exit(1)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [1]]]>
    

Author: omeyn@gbif.org
Created: 2014-01-08 16:57:38.422
Updated: 2014-01-08 16:57:38.422
        
Another one:

Moving data to: hdfs://c1n8.gbif.org:8020/tmp/hive-occurrence-download/hive_2014-01-08_15-32-40_158_4525253335887231479/-ext-10001
Moving data to: hdfs://c1n8.gbif.org:8020/user/hive/warehouse/download_tmp_kim1801_4254737201af41bd823b869e82d0a5e9
FAILED: Error in metadata: AlreadyExistsException(message:Table download_tmp_kim1801_4254737201af41bd823b869e82d0a5e9 already exists)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
    

Author: omeyn@gbif.org
Created: 2014-01-09 14:38:49.703
Updated: 2014-01-09 14:38:49.703
        
Another:

Task Logs: 'attempt_201312111438_10006_m_000000_0'



stdout logs

Oozie Launcher starts

Heart beat
Starting the execution of prepare actions
Completed the execution of prepare actions successfully

Files in current dir:/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/.
======================
File: hive-default.xml
Dir: tmp
File: action.xml
File: query.q
File: 0
File: .action.xml.crc

Oozie Java/Map-Reduce/Pig action launcher-job configuration
=================================================================
Workflow job id   : 0000777-140106101727269-oozie-oozi-W
Workflow action id: 0000777-140106101727269-oozie-oozi-W@big_download

Classpath         :
------------------------
  /var/run/cloudera-scm-agent/process/3583-mapreduce-TASKTRACKER
  /etc/alternatives/java_sdk/lib/tools.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.3.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.3.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.3.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar
  /usr/share/cmf/lib/plugins/tt-instrumentation-4.7.0.jar
  /usr/share/cmf/lib/plugins/event-publish-4.7.0-shaded.jar
  /usr/share/cmf/lib/plugins/navigator-plugin-4.7.0-shaded.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-codec-1.4.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/asm-3.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-io-2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.3.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/servlet-api-2.5.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jsp-api-2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/guava-11.0.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-lang-2.5.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/xmlenc-0.52.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-el-1.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/log4j-1.2.17.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jline-0.9.94.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jersey-core-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-cli-1.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jersey-server-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.3.0-tests.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.3.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/paranamer-2.3.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-codec-1.4.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/asm-3.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-collections-3.2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-compress-1.4.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jets3t-0.6.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-io-2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/avro-1.7.4.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/kfs-0.3.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-httpclient-3.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/activation-1.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/zookeeper-3.4.5-cdh4.3.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-core-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/servlet-api-2.5.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/hue-plugins-2.3.0-cdh4.3.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsp-api-2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jaxb-api-2.2.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/guava-11.0.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/slf4j-api-1.6.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-math-2.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsch-0.1.42.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-json-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-net-3.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-configuration-1.6.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/mockito-all-1.8.5.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/stax-api-1.0.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-lang-2.5.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-beanutils-1.7.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/xmlenc-0.52.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jettison-1.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-xc-1.8.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jasper-runtime-5.5.23.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-el-1.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/snappy-java-1.0.4.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/log4j-1.2.17.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jline-0.9.94.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-core-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-digester-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-logging-1.1.1.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/protobuf-java-2.4.0a.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-cli-1.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-server-1.8.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/junit-4.8.2.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsr305-1.3.9.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jasper-compiler-5.5.23.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/xz-1.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common-2.0.0-cdh4.3.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-auth-2.0.0-cdh4.3.0.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-auth.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-annotations.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common-2.0.0-cdh4.3.0-tests.jar
  /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-annotations-2.0.0-cdh4.3.0.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/5598303286833811648_320246763_1989469843/c1n8.gbif.org/user/occurrence-download/oozie-oozi/0000777-140106101727269-oozie-oozi-W/big_download--hive/hive-launcher.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/-260439400420431863_-835318923_1732111263/c1n8.gbif.org/occurrence-download/prod/lib/JavaEWAH-0.3.2.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/-5025798879766738970_-239974262_1732111298/c1n8.gbif.org/occurrence-download/prod/lib/ST4-4.0.4.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/350472584498404866_-705414785_1732111328/c1n8.gbif.org/occurrence-download/prod/lib/activation-1.1.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/-5529365882996471636_328449030_1732111374/c1n8.gbif.org/occurrence-download/prod/lib/akka-actor-2.0.5.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/-8176264457390766638_-1305754808_1732111405/c1n8.gbif.org/occurrence-download/prod/lib/antlr-2.7.7.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-4626881170808059539_-104540877_1732111441/c1n8.gbif.org/occurrence-download/prod/lib/antlr-3.4.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/-6328647643346778306_1796439048_1732111470/c1n8.gbif.org/occurrence-download/prod/lib/antlr-runtime-3.4.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/-5715552070178659398_-1536349459_1732111490/c1n8.gbif.org/occurrence-download/prod/lib/aopalliance-1.0.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/8453353063444693058_1340548296_1732111522/c1n8.gbif.org/occurrence-download/prod/lib/asm-3.1.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/-9001395499696286058_-1905120200_1732111562/c1n8.gbif.org/occurrence-download/prod/lib/avro-1.7.3.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/6607362882140018571_-125126965_1732111616/c1n8.gbif.org/occurrence-download/prod/lib/avro-ipc-1.5.3.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/-9204631438360592132_627493132_1732111646/c1n8.gbif.org/occurrence-download/prod/lib/avro-mapred-1.5.3.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/6213223580814745342_1243567198_1732111700/c1n8.gbif.org/occurrence-download/prod/lib/cglib-2.2.2.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/267209244329421911_881389565_1732111736/c1n8.gbif.org/occurrence-download/prod/lib/commons-beanutils-1.8.3.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/1873252574542120495_607640729_1732111769/c1n8.gbif.org/occurrence-download/prod/lib/commons-beanutils-core-1.8.3.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/-8419535336926304505_-1959715095_1732111813/c1n8.gbif.org/occurrence-download/prod/lib/commons-cli-1.2.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/-419485179067654933_1222464177_1732111862/c1n8.gbif.org/occurrence-download/prod/lib/commons-codec-1.4.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/-5153502563808121117_-350502289_1732111905/c1n8.gbif.org/occurrence-download/prod/lib/commons-collections-3.2.1.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/9213587743276967342_1883614920_1732111958/c1n8.gbif.org/occurrence-download/prod/lib/commons-compress-1.4.1.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/4157559057722682290_1175339279_1732112005/c1n8.gbif.org/occurrence-download/prod/lib/commons-configuration-1.6.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/8876246316725631021_2038954216_1732112029/c1n8.gbif.org/occurrence-download/prod/lib/commons-daemon-1.0.3.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/2267189283231152561_940793602_1732112067/c1n8.gbif.org/occurrence-download/prod/lib/commons-dbcp-1.4.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/-1495015746851621938_1902280120_1732112102/c1n8.gbif.org/occurrence-download/prod/lib/commons-digester-1.8.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/490548104557380624_-1889869979_1732112141/c1n8.gbif.org/occurrence-download/prod/lib/commons-digester3-3.2.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/8848413736880423467_-458663542_1732112169/c1n8.gbif.org/occurrence-download/prod/lib/commons-el-1.0.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/-6987834495169712268_1081042895_1732112198/c1n8.gbif.org/occurrence-download/prod/lib/commons-fileupload-1.2.1.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/8609880655509744019_-738877637_1732112224/c1n8.gbif.org/occurrence-download/prod/lib/commons-httpclient-3.1.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/-9156754092708899721_1295296233_1732112262/c1n8.gbif.org/occurrence-download/prod/lib/commons-io-2.1.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/1897862395863216009_2134243037_1732112287/c1n8.gbif.org/occurrence-download/prod/lib/commons-lang-2.5.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/64396321986284068_-741681021_1732112318/c1n8.gbif.org/occurrence-download/prod/lib/commons-lang3-3.1.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/-5783971357704713405_939486280_1732112348/c1n8.gbif.org/occurrence-download/prod/lib/commons-logging-1.1.1.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-6813128188306161541_1108213182_1732112381/c1n8.gbif.org/occurrence-download/prod/lib/commons-logging-api-1.1.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/-5918422067706795988_885919111_1732112424/c1n8.gbif.org/occurrence-download/prod/lib/commons-math-2.1.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/1170339139100830451_710402347_1732112453/c1n8.gbif.org/occurrence-download/prod/lib/commons-net-3.1.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/1205694907187558498_178183946_1732112486/c1n8.gbif.org/occurrence-download/prod/lib/commons-pool-1.5.4.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/2572635071883410163_927589555_1732112521/c1n8.gbif.org/occurrence-download/prod/lib/commons-validator-1.4.0.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/7127885490000058168_-49116316_1732112556/c1n8.gbif.org/occurrence-download/prod/lib/concurrentlinkedhashmap-lru-1.2.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/2577495056088509015_-136234545_1732112589/c1n8.gbif.org/occurrence-download/prod/lib/config-0.3.1.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/-5561830238251189322_842014193_1732112653/c1n8.gbif.org/occurrence-download/prod/lib/core-3.1.1.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/-4294419936344910351_1629725196_1732112677/c1n8.gbif.org/occurrence-download/prod/lib/curator-client-1.3.3.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/6055317800980970260_-574617369_1732112712/c1n8.gbif.org/occurrence-download/prod/lib/curator-client-2.1.0-incubating.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/-7146750718809921530_-1200811369_1732112735/c1n8.gbif.org/occurrence-download/prod/lib/curator-framework-1.3.3.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/-5393563162664690877_883254140_1732112770/c1n8.gbif.org/occurrence-download/prod/lib/curator-framework-2.1.0-incubating.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/-7879202459498196275_-297033776_1732112799/c1n8.gbif.org/occurrence-download/prod/lib/curator-recipes-1.3.3.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-4466520052801456796_-693466973_1732112829/c1n8.gbif.org/occurrence-download/prod/lib/curator-recipes-2.1.0-incubating.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/-6593871430427534604_1613581842_1732112854/c1n8.gbif.org/occurrence-download/prod/lib/datanucleus-connectionpool-2.0.3.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/4848923677502203982_-479388211_1732112923/c1n8.gbif.org/occurrence-download/prod/lib/datanucleus-core-2.0.3.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/-4939391483586104806_-794153400_1732112949/c1n8.gbif.org/occurrence-download/prod/lib/datanucleus-enhancer-2.0.3.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/7780346700603398924_-1678705010_1732112983/c1n8.gbif.org/occurrence-download/prod/lib/datanucleus-rdbms-2.0.3.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/-5779562683327946410_-927949557_1732113042/c1n8.gbif.org/occurrence-download/prod/lib/derby-10.6.1.0.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/5618934193143566173_-367580410_1732113066/c1n8.gbif.org/occurrence-download/prod/lib/dwc-api-1.3.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/8697894956318852015_-1334391345_1732113095/c1n8.gbif.org/occurrence-download/prod/lib/dwca-reader-1.13.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/4550019170252145715_105522662_1732113130/c1n8.gbif.org/occurrence-download/prod/lib/freemarker-2.3.19.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/-7797966577574588255_1475381351_1732113163/c1n8.gbif.org/occurrence-download/prod/lib/gbif-api-0.10.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/5778144775580641332_-1024671762_1732113190/c1n8.gbif.org/occurrence-download/prod/lib/gbif-common-0.14.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/921044040376415902_597601460_1732113219/c1n8.gbif.org/occurrence-download/prod/lib/gbif-common-search-0.13.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/-2922185024392029124_1299424535_1732113245/c1n8.gbif.org/occurrence-download/prod/lib/gbif-common-service-0.8.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/3656553837644907915_-691014358_1732113274/c1n8.gbif.org/occurrence-download/prod/lib/gbif-common-ws-0.11.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/-5081720746018617895_879811230_1732113304/c1n8.gbif.org/occurrence-download/prod/lib/gbif-httputils-0.5.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/-897691813063120577_-439711234_1732113331/c1n8.gbif.org/occurrence-download/prod/lib/gbif-metadata-profile-1.0.2.2.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/-8515022861163843122_466551731_1732113362/c1n8.gbif.org/occurrence-download/prod/lib/gbif-parsers-0.5.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/820061850632270855_1697348918_1732113387/c1n8.gbif.org/occurrence-download/prod/lib/gbif-wrangler-0.2.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/-2985098597738822000_-929475067_1732113433/c1n8.gbif.org/occurrence-download/prod/lib/guava-14.0.1.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/-5625765278799005403_1263360391_1732113465/c1n8.gbif.org/occurrence-download/prod/lib/guice-3.0.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/-1053728465208211764_-1992432625_1732113494/c1n8.gbif.org/occurrence-download/prod/lib/guice-servlet-3.0.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/3674935447591417676_-637241968_1732113524/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-annotations-2.0.0-cdh4.2.1.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/5853835904537060319_-474098284_1732113552/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-auth-2.0.0-cdh4.2.1.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/-1366707889557843162_-923687465_1732113605/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-common-2.0.0-cdh4.2.1.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/4047291253337350236_-1396565334_1732113679/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-core-2.0.0-mr1-cdh4.2.1.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/-8953564266697481778_1302068917_1732113752/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-hdfs-2.0.0-cdh4.2.1.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-6889215589076696438_-1207051488_1732113780/c1n8.gbif.org/occurrence-download/prod/lib/haivvreo-1.0.7-cdh-4.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/-5641049108514634922_-1913704932_1732113851/c1n8.gbif.org/occurrence-download/prod/lib/hbase-0.94.2-cdh4.2.1.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/-7715842747792353564_-1774941530_1732113891/c1n8.gbif.org/occurrence-download/prod/lib/hbase-utils-0.4.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/563355201803488579_-1963890117_1732113922/c1n8.gbif.org/occurrence-download/prod/lib/high-scale-lib-1.1.1.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/108948589272023703_-159472406_1732113943/c1n8.gbif.org/occurrence-download/prod/lib/hive-builtins-0.10.0-cdh4.2.1.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/1563509652734641420_2005597700_1732113971/c1n8.gbif.org/occurrence-download/prod/lib/hive-cli-0.10.0-cdh4.2.1.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/-5303962187888564729_-151527985_1732113998/c1n8.gbif.org/occurrence-download/prod/lib/hive-common-0.10.0-cdh4.2.1.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/-1532163425875072354_1286011691_1732114028/c1n8.gbif.org/occurrence-download/prod/lib/hive-contrib-0.10.0-cdh4.2.1.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/-7262447726594731301_-720395607_1732114124/c1n8.gbif.org/occurrence-download/prod/lib/hive-exec-0.10.0-cdh4.2.1.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/1552131157880913067_-1507877138_1732114151/c1n8.gbif.org/occurrence-download/prod/lib/hive-hbase-handler-0.10.0-cdh4.2.1.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/8761598456904389142_-691250968_1732114205/c1n8.gbif.org/occurrence-download/prod/lib/hive-metastore-0.10.0-cdh4.2.1.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/8180279606720343849_-828749533_1732114240/c1n8.gbif.org/occurrence-download/prod/lib/hive-serde-0.10.0-cdh4.2.1.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/10163147547981464_-920105841_1732114279/c1n8.gbif.org/occurrence-download/prod/lib/hive-service-0.10.0-cdh4.2.1.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/7454811126037384437_-390840374_1732114313/c1n8.gbif.org/occurrence-download/prod/lib/hive-shims-0.10.0-cdh4.2.1.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/-336689790619495649_-146952429_1732114346/c1n8.gbif.org/occurrence-download/prod/lib/hsqldb-1.8.0.10.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/-2998540049949682697_-1332005833_1732114384/c1n8.gbif.org/occurrence-download/prod/lib/httpclient-4.2.5.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/7038206152221497690_128886662_1732114410/c1n8.gbif.org/occurrence-download/prod/lib/httpcore-4.2.2.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/-6336280111340839862_-226131538_1732114436/c1n8.gbif.org/occurrence-download/prod/lib/httpmime-4.2.5.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/7640980207820784750_-2129725006_1732114466/c1n8.gbif.org/occurrence-download/prod/lib/jackson-core-asl-1.9.12.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/-4842407636894111044_-1956287612_1732114487/c1n8.gbif.org/occurrence-download/prod/lib/jackson-jaxrs-1.9.12.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/-2486089868607138956_1309057236_1732114522/c1n8.gbif.org/occurrence-download/prod/lib/jackson-mapper-asl-1.9.12.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/8545415283679417167_-1279138351_1732114561/c1n8.gbif.org/occurrence-download/prod/lib/jackson-xc-1.9.12.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/6217471989720454136_1519941855_1732114582/c1n8.gbif.org/occurrence-download/prod/lib/jamon-runtime-2.3.1.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/-418817414303618117_874347431_1732114612/c1n8.gbif.org/occurrence-download/prod/lib/jasper-compiler-5.5.23.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/1836111643558476923_-1473022568_1732114639/c1n8.gbif.org/occurrence-download/prod/lib/jasper-runtime-5.5.23.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-4843967837113840151_-76186449_1732114664/c1n8.gbif.org/occurrence-download/prod/lib/javax.inject-1.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/9036384441403889395_-1433213626_1732114701/c1n8.gbif.org/occurrence-download/prod/lib/jaxb-api-2.1.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/4429674835565898361_995961614_1732114751/c1n8.gbif.org/occurrence-download/prod/lib/jaxb-impl-2.2.3-1.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/6548935745569930054_1432949973_1732114777/c1n8.gbif.org/occurrence-download/prod/lib/jdo2-api-2.3-ec.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/-2746460879226410179_-1642004151_1732114795/c1n8.gbif.org/occurrence-download/prod/lib/jersey-apache-client-1.17.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/-2603241107548874286_-1377148272_1732114821/c1n8.gbif.org/occurrence-download/prod/lib/jersey-apache-client4-1.17.1.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/-8840323435911174724_-1296397452_1732114848/c1n8.gbif.org/occurrence-download/prod/lib/jersey-client-1.17.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/1591751299274380776_922419592_1732114880/c1n8.gbif.org/occurrence-download/prod/lib/jersey-core-1.17.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/-3857947524141179472_-1094368167_1732114914/c1n8.gbif.org/occurrence-download/prod/lib/jersey-guice-1.17.1.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/4946524617542594636_-60345839_1732114943/c1n8.gbif.org/occurrence-download/prod/lib/jersey-json-1.17.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/-1756035087607310456_-1833154_1732114974/c1n8.gbif.org/occurrence-download/prod/lib/jersey-server-1.8.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/2294065460741816759_515489025_1732115012/c1n8.gbif.org/occurrence-download/prod/lib/jersey-servlet-1.17.1.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/421416832905951975_-1046523149_1732115048/c1n8.gbif.org/occurrence-download/prod/lib/jets3t-0.6.1.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-4139994195844151979_-871242415_1732115077/c1n8.gbif.org/occurrence-download/prod/lib/jettison-1.1.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/-8980132386339732189_1946421571_1732115105/c1n8.gbif.org/occurrence-download/prod/lib/jetty-6.1.26.cloudera.2.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/-1658827504915287224_1362044128_1732115131/c1n8.gbif.org/occurrence-download/prod/lib/jetty-util-6.1.26.cloudera.2.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/756023477025639367_129082047_1732115159/c1n8.gbif.org/occurrence-download/prod/lib/jline-0.9.94.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/7539982097511131939_-1160918037_1732115187/c1n8.gbif.org/occurrence-download/prod/lib/joda-time-2.2.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/-5360939987703623919_-348089780_1732115212/c1n8.gbif.org/occurrence-download/prod/lib/jopt-simple-3.2.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/7908987011136040559_-323522649_1732115367/c1n8.gbif.org/occurrence-download/prod/lib/jruby-complete-1.6.5.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/-3315665620851073932_-331598188_1732115389/c1n8.gbif.org/occurrence-download/prod/lib/jsch-0.1.42.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/478812850482965289_1858366142_1732115427/c1n8.gbif.org/occurrence-download/prod/lib/json-20090211.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/-1530185874031312616_1368679110_1732115484/c1n8.gbif.org/occurrence-download/prod/lib/jsp-2.1-6.1.14.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/-4496936051466332606_1537688723_1732115509/c1n8.gbif.org/occurrence-download/prod/lib/jsp-api-2.1-6.1.14.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/-6492383907475108779_541089520_1732115534/c1n8.gbif.org/occurrence-download/prod/lib/jsp-api-2.1.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/6222953860112717342_13153573_1732115555/c1n8.gbif.org/occurrence-download/prod/lib/jsr250-api-1.0.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-6535351037881621956_1305628132_1732115583/c1n8.gbif.org/occurrence-download/prod/lib/jsr305-2.0.0.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/6944304148225047830_1486772142_1732115607/c1n8.gbif.org/occurrence-download/prod/lib/jta-1.1.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/1035282656007364110_426312921_1732115639/c1n8.gbif.org/occurrence-download/prod/lib/jts-1.13.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/6852004602127668214_1557303820_1732115660/c1n8.gbif.org/occurrence-download/prod/lib/kfs-0.3.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/-7890816602095991614_-1051857417_1732115690/c1n8.gbif.org/occurrence-download/prod/lib/libfb303-0.9.0.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/-5888185374424763265_-475619842_1732115720/c1n8.gbif.org/occurrence-download/prod/lib/libthrift-0.9.0.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/-3211043878779418749_-1237547158_1732115750/c1n8.gbif.org/occurrence-download/prod/lib/log4j-1.2.17.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/-1433965904356854810_-511890137_1732115787/c1n8.gbif.org/occurrence-download/prod/lib/lucene-analyzers-common-4.4.0.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/-4139856674418993616_-407461078_1732115855/c1n8.gbif.org/occurrence-download/prod/lib/lucene-analyzers-kuromoji-4.4.0.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/5703443690631601491_-1388735534_1732115873/c1n8.gbif.org/occurrence-download/prod/lib/lucene-analyzers-phonetic-4.4.0.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/5346480158894686683_-1647885003_1732115903/c1n8.gbif.org/occurrence-download/prod/lib/lucene-codecs-4.4.0.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/-4389655143863321501_-1796656717_1732115954/c1n8.gbif.org/occurrence-download/prod/lib/lucene-core-4.4.0.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/8719369223477702475_-408482481_1732115980/c1n8.gbif.org/occurrence-download/prod/lib/lucene-grouping-4.4.0.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/4486903305180018599_1938530199_1732116005/c1n8.gbif.org/occurrence-download/prod/lib/lucene-highlighter-4.4.0.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/7396950458723801466_-1880057135_1732116028/c1n8.gbif.org/occurrence-download/prod/lib/lucene-memory-4.4.0.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/-6367062738465621213_1395201478_1732116082/c1n8.gbif.org/occurrence-download/prod/lib/lucene-misc-4.4.0.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/-2711828268121676778_787708018_1732116111/c1n8.gbif.org/occurrence-download/prod/lib/lucene-queries-4.4.0.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/-3474629337420303665_14468689_1732116153/c1n8.gbif.org/occurrence-download/prod/lib/lucene-queryparser-4.4.0.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/5432066084720754180_474956052_1732116199/c1n8.gbif.org/occurrence-download/prod/lib/lucene-spatial-4.4.0.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/8415343228982220058_-894198124_1732116266/c1n8.gbif.org/occurrence-download/prod/lib/lucene-suggest-4.4.0.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/-2594026275785501735_1595066215_1732116293/c1n8.gbif.org/occurrence-download/prod/lib/metrics-core-2.1.2.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/328270558321573218_1449052457_1732116337/c1n8.gbif.org/occurrence-download/prod/lib/mockito-all-1.8.5.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/5761725643892888159_1843731191_1732116371/c1n8.gbif.org/occurrence-download/prod/lib/mysql-connector-java-5.1.21.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/-3065465309779995011_764939554_1732116396/c1n8.gbif.org/occurrence-download/prod/lib/name-parser-2.2.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/239797381939706135_-1504859724_1732116428/c1n8.gbif.org/occurrence-download/prod/lib/netty-3.2.2.Final.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/-2767819604922084045_-1673744602_1732116449/c1n8.gbif.org/occurrence-download/prod/lib/noggit-0.5.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-5251872584193262415_-1701060712_1732116492/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-common-0.11.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/7280876622223065793_575404658_1732116514/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-download-common-0.14.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/-6827396456814151275_-2121084666_1732116543/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-download-workflow-0.14.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/8928485792886052695_1064465572_1732116572/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-persistence-0.11.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/-8235681321170028963_1543962517_1732116595/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-search-0.11.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/4678320814689723547_678721860_1732116628/c1n8.gbif.org/occurrence-download/prod/lib/org.restlet-2.1.1.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/494598533059851865_-972369158_1732116654/c1n8.gbif.org/occurrence-download/prod/lib/org.restlet.ext.servlet-2.1.1.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/-8502501176977502171_-2007504069_1732116680/c1n8.gbif.org/occurrence-download/prod/lib/paranamer-2.3.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/7740408284607716361_304456492_1732116721/c1n8.gbif.org/occurrence-download/prod/lib/protobuf-java-2.4.0a.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/6056343211260583425_-1661602915_1732116762/c1n8.gbif.org/occurrence-download/prod/lib/registry-metadata-2.9.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/-8039946085912175705_-1094501024_1732116786/c1n8.gbif.org/occurrence-download/prod/lib/registry-ws-client-2.9.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/-3763055859535164624_-1250618364_1732116901/c1n8.gbif.org/occurrence-download/prod/lib/scala-library-2.9.2.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/1026759815693467035_-897684843_1732116928/c1n8.gbif.org/occurrence-download/prod/lib/servlet-api-2.5-6.1.14.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-1910063001499584474_1173559086_1732116955/c1n8.gbif.org/occurrence-download/prod/lib/servlet-api-2.5.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/-6947527855978385148_-833123128_1732116978/c1n8.gbif.org/occurrence-download/prod/lib/slf4j-api-1.7.5.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/719991854492345165_729470284_1732117029/c1n8.gbif.org/occurrence-download/prod/lib/slf4j-log4j12-1.6.1.jar
  /mnt/disk_c/mapred/local/taskTracker/distcache/702144756550774326_-1404143423_1732117065/c1n8.gbif.org/occurrence-download/prod/lib/snappy-java-1.0.4.1.jar
  /mnt/disk_d/mapred/local/taskTracker/distcache/3679375393276310401_-3066381_1732117114/c1n8.gbif.org/occurrence-download/prod/lib/solr-core-4.4.0.jar
  /mnt/disk_e/mapred/local/taskTracker/distcache/-2457145435586107082_1053993552_1732117151/c1n8.gbif.org/occurrence-download/prod/lib/solr-solrj-4.4.0.jar
  /mnt/disk_f/mapred/local/taskTracker/distcache/-1278677101427617133_-50393846_1732117176/c1n8.gbif.org/occurrence-download/prod/lib/spatial4j-0.3.jar
  /mnt/disk_g/mapred/local/taskTracker/distcache/217454975790945344_-225683954_1732117199/c1n8.gbif.org/occurrence-download/prod/lib/stax-api-1.0.1.jar
  /mnt/disk_h/mapred/local/taskTracker/distcache/2370357174540130246_564637924_1732117227/c1n8.gbif.org/occurrence-download/prod/lib/stringtemplate-3.2.1.jar
  /mnt/disk_i/mapred/local/taskTracker/distcache/6960532762663612994_2067883790_1732117251/c1n8.gbif.org/occurrence-download/prod/lib/super-csv-2.0.1.jar
  /mnt/disk_j/mapred/local/taskTracker/distcache/1477450800734437973_481121426_1732117276/c1n8.gbif.org/occurrence-download/prod/lib/validation-api-1.0.0.GA.jar
  /mnt/disk_k/mapred/local/taskTracker/distcache/3640510859799820638_-856005934_1732117305/c1n8.gbif.org/occurrence-download/prod/lib/velocity-1.7.jar
  /mnt/disk_l/mapred/local/taskTracker/distcache/5122644551233782763_1321255772_1732117339/c1n8.gbif.org/occurrence-download/prod/lib/wstx-asl-3.2.7.jar
  /mnt/disk_m/mapred/local/taskTracker/distcache/-8747867656172993172_1118420615_1732117369/c1n8.gbif.org/occurrence-download/prod/lib/xmlenc-0.52.jar
  /mnt/disk_a/mapred/local/taskTracker/distcache/-5259164505165800663_417762548_1732117397/c1n8.gbif.org/occurrence-download/prod/lib/xz-1.0.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/2636633128071846517_572707341_1732117429/c1n8.gbif.org/occurrence-download/prod/lib/zookeeper-3.4.5.jar
  /mnt/disk_b/mapred/local/taskTracker/distcache/-8786125525612179573_1681337991_2032699653/c1n8.gbif.org/user/oozie/share/lib/oozie/json-simple-1.1.jar
  /mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work
------------------------

Main class        : org.apache.oozie.action.hadoop.HiveMain

Maximum output    : 2048

Arguments         :

Java System Properties:
------------------------
#
#Thu Jan 09 11:38:34 CET 2014
java.runtime.name=OpenJDK Runtime Environment
hadoop.tasklog.taskid=attempt_201312111438_10006_m_000000_0
oozie.action.externalChildIDs.properties=/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/externalChildIds.properties
sun.boot.library.path=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/amd64
java.vm.version=24.45-b08
hadoop.root.logger=INFO,TLA
java.vm.vendor=Oracle Corporation
java.vendor.url=http\://java.oracle.com/
path.separator=\:
java.vm.name=OpenJDK 64-Bit Server VM
file.encoding.pkg=sun.io
user.country=US
sun.java.launcher=SUN_STANDARD
sun.os.patch.level=unknown
java.vm.specification.name=Java Virtual Machine Specification
user.dir=/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work
java.runtime.version=1.7.0_45-mockbuild_2013_10_23_08_18-b00
java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
java.endorsed.dirs=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/endorsed
os.arch=amd64
oozie.job.id=0000777-140106101727269-oozie-oozi-W
oozie.action.id=0000777-140106101727269-oozie-oozi-W@big_download
java.io.tmpdir=/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/tmp
line.separator=\n
oozie.action.output.properties=/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/output.properties
hadoop.tasklog.totalLogFileSize=0
java.vm.specification.vendor=Oracle Corporation
os.name=Linux
log4j.configuration=task-log4j.properties
sun.jnu.encoding=UTF-8
java.library.path=/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/native/Linux-amd64-64\:/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work
oozie.action.conf.xml=/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/action.xml
java.specification.name=Java Platform API Specification
java.class.version=51.0
sun.management.compiler=HotSpot 64-Bit Tiered Compilers
os.version=2.6.32-358.6.2.el6.x86_64
user.home=/var/lib/hadoop-mapreduce
user.timezone=Europe/Copenhagen
java.awt.printerjob=sun.print.PSPrinterJob
file.encoding=UTF-8
java.specification.version=1.7
java.class.path=/var/run/cloudera-scm-agent/process/3583-mapreduce-TASKTRACKER\:/etc/alternatives/java_sdk/lib/tools.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar\:/usr/share/cmf/lib/plugins/tt-instrumentation-4.7.0.jar\:/usr/share/cmf/lib/plugins/event-publish-4.7.0-shaded.jar\:/usr/share/cmf/lib/plugins/navigator-plugin-4.7.0-shaded.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-io-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jsp-api-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-lang-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/xmlenc-0.52.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-el-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jline-0.9.94.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jersey-core-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jersey-server-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.3.0-tests.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs-2.0.0-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-hdfs/hadoop-hdfs.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/paranamer-2.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-codec-1.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/asm-3.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-collections-3.2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-compress-1.4.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jets3t-0.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-io-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/avro-1.7.4.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/kfs-0.3.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-httpclient-3.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/activation-1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/zookeeper-3.4.5-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-core-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/servlet-api-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/hue-plugins-2.3.0-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsp-api-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jaxb-api-2.2.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/guava-11.0.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/slf4j-api-1.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-math-2.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsch-0.1.42.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-json-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-net-3.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-configuration-1.6.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/mockito-all-1.8.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/stax-api-1.0.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-lang-2.5.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-beanutils-1.7.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/xmlenc-0.52.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jettison-1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jackson-xc-1.8.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jasper-runtime-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-el-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/snappy-java-1.0.4.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/log4j-1.2.17.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jline-0.9.94.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-core-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-digester-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-logging-1.1.1.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/protobuf-java-2.4.0a.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/commons-cli-1.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jersey-server-1.8.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/junit-4.8.2.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jsr305-1.3.9.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/jasper-compiler-5.5.23.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/xz-1.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common-2.0.0-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-auth-2.0.0-cdh4.3.0.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-auth.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-annotations.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-common-2.0.0-cdh4.3.0-tests.jar\:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/hadoop-annotations-2.0.0-cdh4.3.0.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/5598303286833811648_320246763_1989469843/c1n8.gbif.org/user/occurrence-download/oozie-oozi/0000777-140106101727269-oozie-oozi-W/big_download--hive/hive-launcher.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/-260439400420431863_-835318923_1732111263/c1n8.gbif.org/occurrence-download/prod/lib/JavaEWAH-0.3.2.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/-5025798879766738970_-239974262_1732111298/c1n8.gbif.org/occurrence-download/prod/lib/ST4-4.0.4.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/350472584498404866_-705414785_1732111328/c1n8.gbif.org/occurrence-download/prod/lib/activation-1.1.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/-5529365882996471636_328449030_1732111374/c1n8.gbif.org/occurrence-download/prod/lib/akka-actor-2.0.5.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/-8176264457390766638_-1305754808_1732111405/c1n8.gbif.org/occurrence-download/prod/lib/antlr-2.7.7.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-4626881170808059539_-104540877_1732111441/c1n8.gbif.org/occurrence-download/prod/lib/antlr-3.4.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-6328647643346778306_1796439048_1732111470/c1n8.gbif.org/occurrence-download/prod/lib/antlr-runtime-3.4.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-5715552070178659398_-1536349459_1732111490/c1n8.gbif.org/occurrence-download/prod/lib/aopalliance-1.0.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/8453353063444693058_1340548296_1732111522/c1n8.gbif.org/occurrence-download/prod/lib/asm-3.1.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-9001395499696286058_-1905120200_1732111562/c1n8.gbif.org/occurrence-download/prod/lib/avro-1.7.3.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/6607362882140018571_-125126965_1732111616/c1n8.gbif.org/occurrence-download/prod/lib/avro-ipc-1.5.3.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/-9204631438360592132_627493132_1732111646/c1n8.gbif.org/occurrence-download/prod/lib/avro-mapred-1.5.3.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/6213223580814745342_1243567198_1732111700/c1n8.gbif.org/occurrence-download/prod/lib/cglib-2.2.2.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/267209244329421911_881389565_1732111736/c1n8.gbif.org/occurrence-download/prod/lib/commons-beanutils-1.8.3.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/1873252574542120495_607640729_1732111769/c1n8.gbif.org/occurrence-download/prod/lib/commons-beanutils-core-1.8.3.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/-8419535336926304505_-1959715095_1732111813/c1n8.gbif.org/occurrence-download/prod/lib/commons-cli-1.2.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/-419485179067654933_1222464177_1732111862/c1n8.gbif.org/occurrence-download/prod/lib/commons-codec-1.4.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/-5153502563808121117_-350502289_1732111905/c1n8.gbif.org/occurrence-download/prod/lib/commons-collections-3.2.1.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/9213587743276967342_1883614920_1732111958/c1n8.gbif.org/occurrence-download/prod/lib/commons-compress-1.4.1.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/4157559057722682290_1175339279_1732112005/c1n8.gbif.org/occurrence-download/prod/lib/commons-configuration-1.6.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/8876246316725631021_2038954216_1732112029/c1n8.gbif.org/occurrence-download/prod/lib/commons-daemon-1.0.3.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/2267189283231152561_940793602_1732112067/c1n8.gbif.org/occurrence-download/prod/lib/commons-dbcp-1.4.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-1495015746851621938_1902280120_1732112102/c1n8.gbif.org/occurrence-download/prod/lib/commons-digester-1.8.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/490548104557380624_-1889869979_1732112141/c1n8.gbif.org/occurrence-download/prod/lib/commons-digester3-3.2.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/8848413736880423467_-458663542_1732112169/c1n8.gbif.org/occurrence-download/prod/lib/commons-el-1.0.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-6987834495169712268_1081042895_1732112198/c1n8.gbif.org/occurrence-download/prod/lib/commons-fileupload-1.2.1.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/8609880655509744019_-738877637_1732112224/c1n8.gbif.org/occurrence-download/prod/lib/commons-httpclient-3.1.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/-9156754092708899721_1295296233_1732112262/c1n8.gbif.org/occurrence-download/prod/lib/commons-io-2.1.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/1897862395863216009_2134243037_1732112287/c1n8.gbif.org/occurrence-download/prod/lib/commons-lang-2.5.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/64396321986284068_-741681021_1732112318/c1n8.gbif.org/occurrence-download/prod/lib/commons-lang3-3.1.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/-5783971357704713405_939486280_1732112348/c1n8.gbif.org/occurrence-download/prod/lib/commons-logging-1.1.1.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-6813128188306161541_1108213182_1732112381/c1n8.gbif.org/occurrence-download/prod/lib/commons-logging-api-1.1.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-5918422067706795988_885919111_1732112424/c1n8.gbif.org/occurrence-download/prod/lib/commons-math-2.1.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/1170339139100830451_710402347_1732112453/c1n8.gbif.org/occurrence-download/prod/lib/commons-net-3.1.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/1205694907187558498_178183946_1732112486/c1n8.gbif.org/occurrence-download/prod/lib/commons-pool-1.5.4.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/2572635071883410163_927589555_1732112521/c1n8.gbif.org/occurrence-download/prod/lib/commons-validator-1.4.0.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/7127885490000058168_-49116316_1732112556/c1n8.gbif.org/occurrence-download/prod/lib/concurrentlinkedhashmap-lru-1.2.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/2577495056088509015_-136234545_1732112589/c1n8.gbif.org/occurrence-download/prod/lib/config-0.3.1.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-5561830238251189322_842014193_1732112653/c1n8.gbif.org/occurrence-download/prod/lib/core-3.1.1.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/-4294419936344910351_1629725196_1732112677/c1n8.gbif.org/occurrence-download/prod/lib/curator-client-1.3.3.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/6055317800980970260_-574617369_1732112712/c1n8.gbif.org/occurrence-download/prod/lib/curator-client-2.1.0-incubating.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/-7146750718809921530_-1200811369_1732112735/c1n8.gbif.org/occurrence-download/prod/lib/curator-framework-1.3.3.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/-5393563162664690877_883254140_1732112770/c1n8.gbif.org/occurrence-download/prod/lib/curator-framework-2.1.0-incubating.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/-7879202459498196275_-297033776_1732112799/c1n8.gbif.org/occurrence-download/prod/lib/curator-recipes-1.3.3.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-4466520052801456796_-693466973_1732112829/c1n8.gbif.org/occurrence-download/prod/lib/curator-recipes-2.1.0-incubating.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-6593871430427534604_1613581842_1732112854/c1n8.gbif.org/occurrence-download/prod/lib/datanucleus-connectionpool-2.0.3.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/4848923677502203982_-479388211_1732112923/c1n8.gbif.org/occurrence-download/prod/lib/datanucleus-core-2.0.3.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/-4939391483586104806_-794153400_1732112949/c1n8.gbif.org/occurrence-download/prod/lib/datanucleus-enhancer-2.0.3.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/7780346700603398924_-1678705010_1732112983/c1n8.gbif.org/occurrence-download/prod/lib/datanucleus-rdbms-2.0.3.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-5779562683327946410_-927949557_1732113042/c1n8.gbif.org/occurrence-download/prod/lib/derby-10.6.1.0.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/5618934193143566173_-367580410_1732113066/c1n8.gbif.org/occurrence-download/prod/lib/dwc-api-1.3.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/8697894956318852015_-1334391345_1732113095/c1n8.gbif.org/occurrence-download/prod/lib/dwca-reader-1.13.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/4550019170252145715_105522662_1732113130/c1n8.gbif.org/occurrence-download/prod/lib/freemarker-2.3.19.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/-7797966577574588255_1475381351_1732113163/c1n8.gbif.org/occurrence-download/prod/lib/gbif-api-0.10.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/5778144775580641332_-1024671762_1732113190/c1n8.gbif.org/occurrence-download/prod/lib/gbif-common-0.14.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/921044040376415902_597601460_1732113219/c1n8.gbif.org/occurrence-download/prod/lib/gbif-common-search-0.13.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/-2922185024392029124_1299424535_1732113245/c1n8.gbif.org/occurrence-download/prod/lib/gbif-common-service-0.8.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/3656553837644907915_-691014358_1732113274/c1n8.gbif.org/occurrence-download/prod/lib/gbif-common-ws-0.11.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-5081720746018617895_879811230_1732113304/c1n8.gbif.org/occurrence-download/prod/lib/gbif-httputils-0.5.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-897691813063120577_-439711234_1732113331/c1n8.gbif.org/occurrence-download/prod/lib/gbif-metadata-profile-1.0.2.2.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/-8515022861163843122_466551731_1732113362/c1n8.gbif.org/occurrence-download/prod/lib/gbif-parsers-0.5.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/820061850632270855_1697348918_1732113387/c1n8.gbif.org/occurrence-download/prod/lib/gbif-wrangler-0.2.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-2985098597738822000_-929475067_1732113433/c1n8.gbif.org/occurrence-download/prod/lib/guava-14.0.1.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/-5625765278799005403_1263360391_1732113465/c1n8.gbif.org/occurrence-download/prod/lib/guice-3.0.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-1053728465208211764_-1992432625_1732113494/c1n8.gbif.org/occurrence-download/prod/lib/guice-servlet-3.0.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/3674935447591417676_-637241968_1732113524/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-annotations-2.0.0-cdh4.2.1.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/5853835904537060319_-474098284_1732113552/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-auth-2.0.0-cdh4.2.1.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/-1366707889557843162_-923687465_1732113605/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-common-2.0.0-cdh4.2.1.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/4047291253337350236_-1396565334_1732113679/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-core-2.0.0-mr1-cdh4.2.1.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/-8953564266697481778_1302068917_1732113752/c1n8.gbif.org/occurrence-download/prod/lib/hadoop-hdfs-2.0.0-cdh4.2.1.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-6889215589076696438_-1207051488_1732113780/c1n8.gbif.org/occurrence-download/prod/lib/haivvreo-1.0.7-cdh-4.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-5641049108514634922_-1913704932_1732113851/c1n8.gbif.org/occurrence-download/prod/lib/hbase-0.94.2-cdh4.2.1.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-7715842747792353564_-1774941530_1732113891/c1n8.gbif.org/occurrence-download/prod/lib/hbase-utils-0.4.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/563355201803488579_-1963890117_1732113922/c1n8.gbif.org/occurrence-download/prod/lib/high-scale-lib-1.1.1.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/108948589272023703_-159472406_1732113943/c1n8.gbif.org/occurrence-download/prod/lib/hive-builtins-0.10.0-cdh4.2.1.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/1563509652734641420_2005597700_1732113971/c1n8.gbif.org/occurrence-download/prod/lib/hive-cli-0.10.0-cdh4.2.1.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/-5303962187888564729_-151527985_1732113998/c1n8.gbif.org/occurrence-download/prod/lib/hive-common-0.10.0-cdh4.2.1.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-1532163425875072354_1286011691_1732114028/c1n8.gbif.org/occurrence-download/prod/lib/hive-contrib-0.10.0-cdh4.2.1.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/-7262447726594731301_-720395607_1732114124/c1n8.gbif.org/occurrence-download/prod/lib/hive-exec-0.10.0-cdh4.2.1.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/1552131157880913067_-1507877138_1732114151/c1n8.gbif.org/occurrence-download/prod/lib/hive-hbase-handler-0.10.0-cdh4.2.1.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/8761598456904389142_-691250968_1732114205/c1n8.gbif.org/occurrence-download/prod/lib/hive-metastore-0.10.0-cdh4.2.1.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/8180279606720343849_-828749533_1732114240/c1n8.gbif.org/occurrence-download/prod/lib/hive-serde-0.10.0-cdh4.2.1.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/10163147547981464_-920105841_1732114279/c1n8.gbif.org/occurrence-download/prod/lib/hive-service-0.10.0-cdh4.2.1.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/7454811126037384437_-390840374_1732114313/c1n8.gbif.org/occurrence-download/prod/lib/hive-shims-0.10.0-cdh4.2.1.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-336689790619495649_-146952429_1732114346/c1n8.gbif.org/occurrence-download/prod/lib/hsqldb-1.8.0.10.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/-2998540049949682697_-1332005833_1732114384/c1n8.gbif.org/occurrence-download/prod/lib/httpclient-4.2.5.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/7038206152221497690_128886662_1732114410/c1n8.gbif.org/occurrence-download/prod/lib/httpcore-4.2.2.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-6336280111340839862_-226131538_1732114436/c1n8.gbif.org/occurrence-download/prod/lib/httpmime-4.2.5.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/7640980207820784750_-2129725006_1732114466/c1n8.gbif.org/occurrence-download/prod/lib/jackson-core-asl-1.9.12.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-4842407636894111044_-1956287612_1732114487/c1n8.gbif.org/occurrence-download/prod/lib/jackson-jaxrs-1.9.12.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/-2486089868607138956_1309057236_1732114522/c1n8.gbif.org/occurrence-download/prod/lib/jackson-mapper-asl-1.9.12.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/8545415283679417167_-1279138351_1732114561/c1n8.gbif.org/occurrence-download/prod/lib/jackson-xc-1.9.12.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/6217471989720454136_1519941855_1732114582/c1n8.gbif.org/occurrence-download/prod/lib/jamon-runtime-2.3.1.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/-418817414303618117_874347431_1732114612/c1n8.gbif.org/occurrence-download/prod/lib/jasper-compiler-5.5.23.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/1836111643558476923_-1473022568_1732114639/c1n8.gbif.org/occurrence-download/prod/lib/jasper-runtime-5.5.23.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-4843967837113840151_-76186449_1732114664/c1n8.gbif.org/occurrence-download/prod/lib/javax.inject-1.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/9036384441403889395_-1433213626_1732114701/c1n8.gbif.org/occurrence-download/prod/lib/jaxb-api-2.1.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/4429674835565898361_995961614_1732114751/c1n8.gbif.org/occurrence-download/prod/lib/jaxb-impl-2.2.3-1.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/6548935745569930054_1432949973_1732114777/c1n8.gbif.org/occurrence-download/prod/lib/jdo2-api-2.3-ec.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-2746460879226410179_-1642004151_1732114795/c1n8.gbif.org/occurrence-download/prod/lib/jersey-apache-client-1.17.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-2603241107548874286_-1377148272_1732114821/c1n8.gbif.org/occurrence-download/prod/lib/jersey-apache-client4-1.17.1.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/-8840323435911174724_-1296397452_1732114848/c1n8.gbif.org/occurrence-download/prod/lib/jersey-client-1.17.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/1591751299274380776_922419592_1732114880/c1n8.gbif.org/occurrence-download/prod/lib/jersey-core-1.17.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/-3857947524141179472_-1094368167_1732114914/c1n8.gbif.org/occurrence-download/prod/lib/jersey-guice-1.17.1.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/4946524617542594636_-60345839_1732114943/c1n8.gbif.org/occurrence-download/prod/lib/jersey-json-1.17.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/-1756035087607310456_-1833154_1732114974/c1n8.gbif.org/occurrence-download/prod/lib/jersey-server-1.8.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/2294065460741816759_515489025_1732115012/c1n8.gbif.org/occurrence-download/prod/lib/jersey-servlet-1.17.1.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/421416832905951975_-1046523149_1732115048/c1n8.gbif.org/occurrence-download/prod/lib/jets3t-0.6.1.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-4139994195844151979_-871242415_1732115077/c1n8.gbif.org/occurrence-download/prod/lib/jettison-1.1.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-8980132386339732189_1946421571_1732115105/c1n8.gbif.org/occurrence-download/prod/lib/jetty-6.1.26.cloudera.2.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-1658827504915287224_1362044128_1732115131/c1n8.gbif.org/occurrence-download/prod/lib/jetty-util-6.1.26.cloudera.2.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/756023477025639367_129082047_1732115159/c1n8.gbif.org/occurrence-download/prod/lib/jline-0.9.94.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/7539982097511131939_-1160918037_1732115187/c1n8.gbif.org/occurrence-download/prod/lib/joda-time-2.2.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-5360939987703623919_-348089780_1732115212/c1n8.gbif.org/occurrence-download/prod/lib/jopt-simple-3.2.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/7908987011136040559_-323522649_1732115367/c1n8.gbif.org/occurrence-download/prod/lib/jruby-complete-1.6.5.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-3315665620851073932_-331598188_1732115389/c1n8.gbif.org/occurrence-download/prod/lib/jsch-0.1.42.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/478812850482965289_1858366142_1732115427/c1n8.gbif.org/occurrence-download/prod/lib/json-20090211.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/-1530185874031312616_1368679110_1732115484/c1n8.gbif.org/occurrence-download/prod/lib/jsp-2.1-6.1.14.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/-4496936051466332606_1537688723_1732115509/c1n8.gbif.org/occurrence-download/prod/lib/jsp-api-2.1-6.1.14.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/-6492383907475108779_541089520_1732115534/c1n8.gbif.org/occurrence-download/prod/lib/jsp-api-2.1.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/6222953860112717342_13153573_1732115555/c1n8.gbif.org/occurrence-download/prod/lib/jsr250-api-1.0.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-6535351037881621956_1305628132_1732115583/c1n8.gbif.org/occurrence-download/prod/lib/jsr305-2.0.0.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/6944304148225047830_1486772142_1732115607/c1n8.gbif.org/occurrence-download/prod/lib/jta-1.1.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/1035282656007364110_426312921_1732115639/c1n8.gbif.org/occurrence-download/prod/lib/jts-1.13.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/6852004602127668214_1557303820_1732115660/c1n8.gbif.org/occurrence-download/prod/lib/kfs-0.3.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-7890816602095991614_-1051857417_1732115690/c1n8.gbif.org/occurrence-download/prod/lib/libfb303-0.9.0.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-5888185374424763265_-475619842_1732115720/c1n8.gbif.org/occurrence-download/prod/lib/libthrift-0.9.0.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/-3211043878779418749_-1237547158_1732115750/c1n8.gbif.org/occurrence-download/prod/lib/log4j-1.2.17.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-1433965904356854810_-511890137_1732115787/c1n8.gbif.org/occurrence-download/prod/lib/lucene-analyzers-common-4.4.0.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/-4139856674418993616_-407461078_1732115855/c1n8.gbif.org/occurrence-download/prod/lib/lucene-analyzers-kuromoji-4.4.0.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/5703443690631601491_-1388735534_1732115873/c1n8.gbif.org/occurrence-download/prod/lib/lucene-analyzers-phonetic-4.4.0.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/5346480158894686683_-1647885003_1732115903/c1n8.gbif.org/occurrence-download/prod/lib/lucene-codecs-4.4.0.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/-4389655143863321501_-1796656717_1732115954/c1n8.gbif.org/occurrence-download/prod/lib/lucene-core-4.4.0.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/8719369223477702475_-408482481_1732115980/c1n8.gbif.org/occurrence-download/prod/lib/lucene-grouping-4.4.0.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/4486903305180018599_1938530199_1732116005/c1n8.gbif.org/occurrence-download/prod/lib/lucene-highlighter-4.4.0.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/7396950458723801466_-1880057135_1732116028/c1n8.gbif.org/occurrence-download/prod/lib/lucene-memory-4.4.0.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-6367062738465621213_1395201478_1732116082/c1n8.gbif.org/occurrence-download/prod/lib/lucene-misc-4.4.0.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/-2711828268121676778_787708018_1732116111/c1n8.gbif.org/occurrence-download/prod/lib/lucene-queries-4.4.0.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-3474629337420303665_14468689_1732116153/c1n8.gbif.org/occurrence-download/prod/lib/lucene-queryparser-4.4.0.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/5432066084720754180_474956052_1732116199/c1n8.gbif.org/occurrence-download/prod/lib/lucene-spatial-4.4.0.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/8415343228982220058_-894198124_1732116266/c1n8.gbif.org/occurrence-download/prod/lib/lucene-suggest-4.4.0.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-2594026275785501735_1595066215_1732116293/c1n8.gbif.org/occurrence-download/prod/lib/metrics-core-2.1.2.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/328270558321573218_1449052457_1732116337/c1n8.gbif.org/occurrence-download/prod/lib/mockito-all-1.8.5.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/5761725643892888159_1843731191_1732116371/c1n8.gbif.org/occurrence-download/prod/lib/mysql-connector-java-5.1.21.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/-3065465309779995011_764939554_1732116396/c1n8.gbif.org/occurrence-download/prod/lib/name-parser-2.2.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/239797381939706135_-1504859724_1732116428/c1n8.gbif.org/occurrence-download/prod/lib/netty-3.2.2.Final.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/-2767819604922084045_-1673744602_1732116449/c1n8.gbif.org/occurrence-download/prod/lib/noggit-0.5.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-5251872584193262415_-1701060712_1732116492/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-common-0.11.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/7280876622223065793_575404658_1732116514/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-download-common-0.14.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-6827396456814151275_-2121084666_1732116543/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-download-workflow-0.14.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/8928485792886052695_1064465572_1732116572/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-persistence-0.11.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/-8235681321170028963_1543962517_1732116595/c1n8.gbif.org/occurrence-download/prod/lib/occurrence-search-0.11.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/4678320814689723547_678721860_1732116628/c1n8.gbif.org/occurrence-download/prod/lib/org.restlet-2.1.1.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/494598533059851865_-972369158_1732116654/c1n8.gbif.org/occurrence-download/prod/lib/org.restlet.ext.servlet-2.1.1.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/-8502501176977502171_-2007504069_1732116680/c1n8.gbif.org/occurrence-download/prod/lib/paranamer-2.3.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/7740408284607716361_304456492_1732116721/c1n8.gbif.org/occurrence-download/prod/lib/protobuf-java-2.4.0a.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/6056343211260583425_-1661602915_1732116762/c1n8.gbif.org/occurrence-download/prod/lib/registry-metadata-2.9.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/-8039946085912175705_-1094501024_1732116786/c1n8.gbif.org/occurrence-download/prod/lib/registry-ws-client-2.9.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/-3763055859535164624_-1250618364_1732116901/c1n8.gbif.org/occurrence-download/prod/lib/scala-library-2.9.2.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/1026759815693467035_-897684843_1732116928/c1n8.gbif.org/occurrence-download/prod/lib/servlet-api-2.5-6.1.14.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-1910063001499584474_1173559086_1732116955/c1n8.gbif.org/occurrence-download/prod/lib/servlet-api-2.5.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-6947527855978385148_-833123128_1732116978/c1n8.gbif.org/occurrence-download/prod/lib/slf4j-api-1.7.5.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/719991854492345165_729470284_1732117029/c1n8.gbif.org/occurrence-download/prod/lib/slf4j-log4j12-1.6.1.jar\:/mnt/disk_c/mapred/local/taskTracker/distcache/702144756550774326_-1404143423_1732117065/c1n8.gbif.org/occurrence-download/prod/lib/snappy-java-1.0.4.1.jar\:/mnt/disk_d/mapred/local/taskTracker/distcache/3679375393276310401_-3066381_1732117114/c1n8.gbif.org/occurrence-download/prod/lib/solr-core-4.4.0.jar\:/mnt/disk_e/mapred/local/taskTracker/distcache/-2457145435586107082_1053993552_1732117151/c1n8.gbif.org/occurrence-download/prod/lib/solr-solrj-4.4.0.jar\:/mnt/disk_f/mapred/local/taskTracker/distcache/-1278677101427617133_-50393846_1732117176/c1n8.gbif.org/occurrence-download/prod/lib/spatial4j-0.3.jar\:/mnt/disk_g/mapred/local/taskTracker/distcache/217454975790945344_-225683954_1732117199/c1n8.gbif.org/occurrence-download/prod/lib/stax-api-1.0.1.jar\:/mnt/disk_h/mapred/local/taskTracker/distcache/2370357174540130246_564637924_1732117227/c1n8.gbif.org/occurrence-download/prod/lib/stringtemplate-3.2.1.jar\:/mnt/disk_i/mapred/local/taskTracker/distcache/6960532762663612994_2067883790_1732117251/c1n8.gbif.org/occurrence-download/prod/lib/super-csv-2.0.1.jar\:/mnt/disk_j/mapred/local/taskTracker/distcache/1477450800734437973_481121426_1732117276/c1n8.gbif.org/occurrence-download/prod/lib/validation-api-1.0.0.GA.jar\:/mnt/disk_k/mapred/local/taskTracker/distcache/3640510859799820638_-856005934_1732117305/c1n8.gbif.org/occurrence-download/prod/lib/velocity-1.7.jar\:/mnt/disk_l/mapred/local/taskTracker/distcache/5122644551233782763_1321255772_1732117339/c1n8.gbif.org/occurrence-download/prod/lib/wstx-asl-3.2.7.jar\:/mnt/disk_m/mapred/local/taskTracker/distcache/-8747867656172993172_1118420615_1732117369/c1n8.gbif.org/occurrence-download/prod/lib/xmlenc-0.52.jar\:/mnt/disk_a/mapred/local/taskTracker/distcache/-5259164505165800663_417762548_1732117397/c1n8.gbif.org/occurrence-download/prod/lib/xz-1.0.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/2636633128071846517_572707341_1732117429/c1n8.gbif.org/occurrence-download/prod/lib/zookeeper-3.4.5.jar\:/mnt/disk_b/mapred/local/taskTracker/distcache/-8786125525612179573_1681337991_2032699653/c1n8.gbif.org/user/oozie/share/lib/oozie/json-simple-1.1.jar\:/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work
user.name=mapred
hadoop.tasklog.iscleanup=false
oozie.action.newId.properties=/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/newId.properties
java.vm.specification.version=1.7
sun.java.command=org.apache.hadoop.mapred.Child 127.0.0.1 34169 attempt_201312111438_10006_m_000000_0 /var/log/hadoop-0.20-mapreduce/userlogs/job_201312111438_10006/attempt_201312111438_10006_m_000000_0 -71277251
java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre
sun.arch.data.model=64
user.language=en
java.specification.vendor=Oracle Corporation
awt.toolkit=sun.awt.X11.XToolkit
hadoop.log.dir=/var/log/hadoop-0.20-mapreduce
java.vm.info=mixed mode
java.version=1.7.0_45
java.ext.dirs=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/ext\:/usr/java/packages/lib/ext
sun.boot.class.path=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/resources.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/rt.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/sunrsasign.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/jsse.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/jce.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/charsets.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/netx.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/plugin.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/rhino.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/lib/jfr.jar\:/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.45.x86_64/jre/classes
java.vendor=Oracle Corporation
file.separator=/
oozie.launcher.job.id=job_201312111438_10006
oozie.action.stats.properties=/mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/stats.properties
java.vendor.url.bug=http\://bugreport.sun.com/bugreport/
sun.io.unicode.encoding=UnicodeLittle
sun.cpu.endian=little
sun.cpu.isalist=
------------------------

=================================================================

>>> Invoking Main class now >>>


Oozie Hive action configuration
=================================================================

Using action configuration file /mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/action.xml
------------------------
Setting env property for mapreduce.job.credentials.binary to: /mnt/disk_l/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/jobToken
------------------------

Hive Configuration Properties:
------------------------
dfs.datanode.data.dir=file://${hadoop.tmp.dir}/dfs/data
dfs.namenode.checkpoint.txns=1000000
s3.replication=3
mapred.disk.healthChecker.interval=60000
dfs.datanode.failed.volumes.tolerated=0
hadoop.http.filter.initializers=org.apache.hadoop.http.lib.StaticUserWebFilter
mapred.task.tracker.http.address=0.0.0.0:50060
mapred.userlog.retain.hours=24
dfs.namenode.checkpoint.max-retries=3
mapred.local.dir.minspacestart=0
io.sort.spill.percent=0.8
dfs.https.server.keystore.resource=ssl-server.xml
hive.metastore.warehouse.dir=/user/hive/warehouse
dfs.domain.socket.path=/var/run/hdfs-sockets/dn
hadoop.http.authentication.kerberos.keytab=${user.home}/hadoop.keytab
mapred.job.classpath.files=/user/occurrence-download/oozie-oozi/0000777-140106101727269-oozie-oozi-W/big_download--hive/hive-launcher.jar:/occurrence-download/prod/lib/JavaEWAH-0.3.2.jar:/occurrence-download/prod/lib/ST4-4.0.4.jar:/occurrence-download/prod/lib/activation-1.1.jar:/occurrence-download/prod/lib/akka-actor-2.0.5.jar:/occurrence-download/prod/lib/antlr-2.7.7.jar:/occurrence-download/prod/lib/antlr-3.4.jar:/occurrence-download/prod/lib/antlr-runtime-3.4.jar:/occurrence-download/prod/lib/aopalliance-1.0.jar:/occurrence-download/prod/lib/asm-3.1.jar:/occurrence-download/prod/lib/avro-1.7.3.jar:/occurrence-download/prod/lib/avro-ipc-1.5.3.jar:/occurrence-download/prod/lib/avro-mapred-1.5.3.jar:/occurrence-download/prod/lib/cglib-2.2.2.jar:/occurrence-download/prod/lib/commons-beanutils-1.8.3.jar:/occurrence-download/prod/lib/commons-beanutils-core-1.8.3.jar:/occurrence-download/prod/lib/commons-cli-1.2.jar:/occurrence-download/prod/lib/commons-codec-1.4.jar:/occurrence-download/prod/lib/commons-collections-3.2.1.jar:/occurrence-download/prod/lib/commons-compress-1.4.1.jar:/occurrence-download/prod/lib/commons-configuration-1.6.jar:/occurrence-download/prod/lib/commons-daemon-1.0.3.jar:/occurrence-download/prod/lib/commons-dbcp-1.4.jar:/occurrence-download/prod/lib/commons-digester-1.8.jar:/occurrence-download/prod/lib/commons-digester3-3.2.jar:/occurrence-download/prod/lib/commons-el-1.0.jar:/occurrence-download/prod/lib/commons-fileupload-1.2.1.jar:/occurrence-download/prod/lib/commons-httpclient-3.1.jar:/occurrence-download/prod/lib/commons-io-2.1.jar:/occurrence-download/prod/lib/commons-lang-2.5.jar:/occurrence-download/prod/lib/commons-lang3-3.1.jar:/occurrence-download/prod/lib/commons-logging-1.1.1.jar:/occurrence-download/prod/lib/commons-logging-api-1.1.jar:/occurrence-download/prod/lib/commons-math-2.1.jar:/occurrence-download/prod/lib/commons-net-3.1.jar:/occurrence-download/prod/lib/commons-pool-1.5.4.jar:/occurrence-download/prod/lib/commons-validator-1.4.0.jar:/occurrence-download/prod/lib/concurrentlinkedhashmap-lru-1.2.jar:/occurrence-download/prod/lib/config-0.3.1.jar:/occurrence-download/prod/lib/core-3.1.1.jar:/occurrence-download/prod/lib/curator-client-1.3.3.jar:/occurrence-download/prod/lib/curator-client-2.1.0-incubating.jar:/occurrence-download/prod/lib/curator-framework-1.3.3.jar:/occurrence-download/prod/lib/curator-framework-2.1.0-incubating.jar:/occurrence-download/prod/lib/curator-recipes-1.3.3.jar:/occurrence-download/prod/lib/curator-recipes-2.1.0-incubating.jar:/occurrence-download/prod/lib/datanucleus-connectionpool-2.0.3.jar:/occurrence-download/prod/lib/datanucleus-core-2.0.3.jar:/occurrence-download/prod/lib/datanucleus-enhancer-2.0.3.jar:/occurrence-download/prod/lib/datanucleus-rdbms-2.0.3.jar:/occurrence-download/prod/lib/derby-10.6.1.0.jar:/occurrence-download/prod/lib/dwc-api-1.3.jar:/occurrence-download/prod/lib/dwca-reader-1.13.jar:/occurrence-download/prod/lib/freemarker-2.3.19.jar:/occurrence-download/prod/lib/gbif-api-0.10.jar:/occurrence-download/prod/lib/gbif-common-0.14.jar:/occurrence-download/prod/lib/gbif-common-search-0.13.jar:/occurrence-download/prod/lib/gbif-common-service-0.8.jar:/occurrence-download/prod/lib/gbif-common-ws-0.11.jar:/occurrence-download/prod/lib/gbif-httputils-0.5.jar:/occurrence-download/prod/lib/gbif-metadata-profile-1.0.2.2.jar:/occurrence-download/prod/lib/gbif-parsers-0.5.jar:/occurrence-download/prod/lib/gbif-wrangler-0.2.jar:/occurrence-download/prod/lib/guava-14.0.1.jar:/occurrence-download/prod/lib/guice-3.0.jar:/occurrence-download/prod/lib/guice-servlet-3.0.jar:/occurrence-download/prod/lib/hadoop-annotations-2.0.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hadoop-auth-2.0.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hadoop-common-2.0.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hadoop-core-2.0.0-mr1-cdh4.2.1.jar:/occurrence-download/prod/lib/hadoop-hdfs-2.0.0-cdh4.2.1.jar:/occurrence-download/prod/lib/haivvreo-1.0.7-cdh-4.jar:/occurrence-download/prod/lib/hbase-0.94.2-cdh4.2.1.jar:/occurrence-download/prod/lib/hbase-utils-0.4.jar:/occurrence-download/prod/lib/high-scale-lib-1.1.1.jar:/occurrence-download/prod/lib/hive-builtins-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hive-cli-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hive-common-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hive-contrib-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hive-exec-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hive-hbase-handler-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hive-metastore-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hive-serde-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hive-service-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hive-shims-0.10.0-cdh4.2.1.jar:/occurrence-download/prod/lib/hsqldb-1.8.0.10.jar:/occurrence-download/prod/lib/httpclient-4.2.5.jar:/occurrence-download/prod/lib/httpcore-4.2.2.jar:/occurrence-download/prod/lib/httpmime-4.2.5.jar:/occurrence-download/prod/lib/jackson-core-asl-1.9.12.jar:/occurrence-download/prod/lib/jackson-jaxrs-1.9.12.jar:/occurrence-download/prod/lib/jackson-mapper-asl-1.9.12.jar:/occurrence-download/prod/lib/jackson-xc-1.9.12.jar:/occurrence-download/prod/lib/jamon-runtime-2.3.1.jar:/occurrence-download/prod/lib/jasper-compiler-5.5.23.jar:/occurrence-download/prod/lib/jasper-runtime-5.5.23.jar:/occurrence-download/prod/lib/javax.inject-1.jar:/occurrence-download/prod/lib/jaxb-api-2.1.jar:/occurrence-download/prod/lib/jaxb-impl-2.2.3-1.jar:/occurrence-download/prod/lib/jdo2-api-2.3-ec.jar:/occurrence-download/prod/lib/jersey-apache-client-1.17.jar:/occurrence-download/prod/lib/jersey-apache-client4-1.17.1.jar:/occurrence-download/prod/lib/jersey-client-1.17.jar:/occurrence-download/prod/lib/jersey-core-1.17.jar:/occurrence-download/prod/lib/jersey-guice-1.17.1.jar:/occurrence-download/prod/lib/jersey-json-1.17.jar:/occurrence-download/prod/lib/jersey-server-1.8.jar:/occurrence-download/prod/lib/jersey-servlet-1.17.1.jar:/occurrence-download/prod/lib/jets3t-0.6.1.jar:/occurrence-download/prod/lib/jettison-1.1.jar:/occurrence-download/prod/lib/jetty-6.1.26.cloudera.2.jar:/occurrence-download/prod/lib/jetty-util-6.1.26.cloudera.2.jar:/occurrence-download/prod/lib/jline-0.9.94.jar:/occurrence-download/prod/lib/joda-time-2.2.jar:/occurrence-download/prod/lib/jopt-simple-3.2.jar:/occurrence-download/prod/lib/jruby-complete-1.6.5.jar:/occurrence-download/prod/lib/jsch-0.1.42.jar:/occurrence-download/prod/lib/json-20090211.jar:/occurrence-download/prod/lib/jsp-2.1-6.1.14.jar:/occurrence-download/prod/lib/jsp-api-2.1-6.1.14.jar:/occurrence-download/prod/lib/jsp-api-2.1.jar:/occurrence-download/prod/lib/jsr250-api-1.0.jar:/occurrence-download/prod/lib/jsr305-2.0.0.jar:/occurrence-download/prod/lib/jta-1.1.jar:/occurrence-download/prod/lib/jts-1.13.jar:/occurrence-download/prod/lib/kfs-0.3.jar:/occurrence-download/prod/lib/libfb303-0.9.0.jar:/occurrence-download/prod/lib/libthrift-0.9.0.jar:/occurrence-download/prod/lib/log4j-1.2.17.jar:/occurrence-download/prod/lib/lucene-analyzers-common-4.4.0.jar:/occurrence-download/prod/lib/lucene-analyzers-kuromoji-4.4.0.jar:/occurrence-download/prod/lib/lucene-analyzers-phonetic-4.4.0.jar:/occurrence-download/prod/lib/lucene-codecs-4.4.0.jar:/occurrence-download/prod/lib/lucene-core-4.4.0.jar:/occurrence-download/prod/lib/lucene-grouping-4.4.0.jar:/occurrence-download/prod/lib/lucene-highlighter-4.4.0.jar:/occurrence-download/prod/lib/lucene-memory-4.4.0.jar:/occurrence-download/prod/lib/lucene-misc-4.4.0.jar:/occurrence-download/prod/lib/lucene-queries-4.4.0.jar:/occurrence-download/prod/lib/lucene-queryparser-4.4.0.jar:/occurrence-download/prod/lib/lucene-spatial-4.4.0.jar:/occurrence-download/prod/lib/lucene-suggest-4.4.0.jar:/occurrence-download/prod/lib/metrics-core-2.1.2.jar:/occurrence-download/prod/lib/mockito-all-1.8.5.jar:/occurrence-download/prod/lib/mysql-connector-java-5.1.21.jar:/occurrence-download/prod/lib/name-parser-2.2.jar:/occurrence-download/prod/lib/netty-3.2.2.Final.jar:/occurrence-download/prod/lib/noggit-0.5.jar:/occurrence-download/prod/lib/occurrence-common-0.11.jar:/occurrence-download/prod/lib/occurrence-download-common-0.14.jar:/occurrence-download/prod/lib/occurrence-download-workflow-0.14.jar:/occurrence-download/prod/lib/occurrence-persistence-0.11.jar:/occurrence-download/prod/lib/occurrence-search-0.11.jar:/occurrence-download/prod/lib/org.restlet-2.1.1.jar:/occurrence-download/prod/lib/org.restlet.ext.servlet-2.1.1.jar:/occurrence-download/prod/lib/paranamer-2.3.jar:/occurrence-download/prod/lib/protobuf-java-2.4.0a.jar:/occurrence-download/prod/lib/registry-metadata-2.9.jar:/occurrence-download/prod/lib/registry-ws-client-2.9.jar:/occurrence-download/prod/lib/scala-library-2.9.2.jar:/occurrence-download/prod/lib/servlet-api-2.5-6.1.14.jar:/occurrence-download/prod/lib/servlet-api-2.5.jar:/occurrence-download/prod/lib/slf4j-api-1.7.5.jar:/occurrence-download/prod/lib/slf4j-log4j12-1.6.1.jar:/occurrence-download/prod/lib/snappy-java-1.0.4.1.jar:/occurrence-download/prod/lib/solr-core-4.4.0.jar:/occurrence-download/prod/lib/solr-solrj-4.4.0.jar:/occurrence-download/prod/lib/spatial4j-0.3.jar:/occurrence-download/prod/lib/stax-api-1.0.1.jar:/occurrence-download/prod/lib/stringtemplate-3.2.1.jar:/occurrence-download/prod/lib/super-csv-2.0.1.jar:/occurrence-download/prod/lib/validation-api-1.0.0.GA.jar:/occurrence-download/prod/lib/velocity-1.7.jar:/occurrence-download/prod/lib/wstx-asl-3.2.7.jar:/occurrence-download/prod/lib/xmlenc-0.52.jar:/occurrence-download/prod/lib/xz-1.0.jar:/occurrence-download/prod/lib/zookeeper-3.4.5.jar:/user/oozie/share/lib/oozie/json-simple-1.1.jar
mapred.reduce.parallel.copies=10
ha.failover-controller.new-active.rpc-timeout.ms=60000
ha.health-monitor.check-interval.ms=1000
io.file.buffer.size=65536
mapred.submit.replication=1
dfs.namenode.checkpoint.period=3600
mapred.local.dir.minspacekill=0
ipc.client.kill.max=10
mapred.task.profile=false
mapred.heartbeats.in.second=100
user.name=occurrence-download
mapred.output.compress=false
s3.stream-buffer-size=4096
mapred.healthChecker.interval=60000
mapred.task.timeout=600000
dfs.namenode.secondary.http-address=0.0.0.0:50090
mapred.temp.dir=${hadoop.tmp.dir}/mapred/temp
dfs.namenode.decommission.interval=30
dfs.namenode.http-address=c1n8.gbif.org:50070
dfs.encrypt.data.transfer=false
dfs.namenode.avoid.write.stale.datanode=false
dfs.datanode.address=0.0.0.0:50010
jobclient.completion.poll.interval=5000
hadoop.http.authentication.token.validity=36000
hadoop.security.group.mapping.ldap.search.filter.group=(objectClass=group)
mapred.queue.default.state=RUNNING
dfs.client.failover.max.attempts=15
mapred.create.symlink=yes
kfs.client-write-packet-size=65536
mapred.job.tracker.persist.jobstatus.active=false
dfs.client.failover.connection.retries.on.timeouts=0
mapred.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec
file.stream-buffer-size=4096
zlib.compress.level=DEFAULT_COMPRESSION
dfs.webhdfs.enabled=false
ipc.client.connection.maxidletime=10000
dfs.datanode.ipc.address=0.0.0.0:50020
mapred.job.shuffle.merge.percent=0.66
dfs.client.read.shortcircuit=false
mapred.map.max.attempts=4
dfs.namenode.safemode.extension=30000
hbase.zookeeper.quorum=c1n10.gbif.org:2181,c1n9.gbif.org:2181,c1n8.gbif.org:2181
ha.zookeeper.parent-znode=/hadoop-ha
io.skip.checksum.errors=false
mapred.job.reduce.input.buffer.percent=0.0
hadoop.http.authentication.kerberos.principal=HTTP/_HOST@LOCALHOST
fs.s3.maxRetries=4
mapred.task.cache.levels=2
io.sort.factor=64
mapred.jobtracker.instrumentation=org.apache.hadoop.mapred.JobTrackerMetricsInst
mapred.userlog.limit.kb=0
hadoop.kerberos.kinit.command=kinit
dfs.namenode.name.dir.restore=false
dfs.client.use.datanode.hostname=false
hadoop.util.hash.type=murmur
dfs.datanode.available-space-volume-choosing-policy.balanced-space-preference-fraction=0.75f
io.seqfile.lazydecompress=true
dfs.datanode.dns.interface=default
mapred.job.reduce.memory.mb=-1
mapred.skip.map.max.skip.records=0
mapred.job.tracker.jobhistory.lru.cache.size=5
mapred.job.tracker.persist.jobstatus.hours=0
hadoop.security.group.mapping.ldap.search.attr.group.name=cn
local.cache.size=10737418240
fs.df.interval=60000
mapred.job.tracker.handler.count=10
dfs.namenode.kerberos.internal.spnego.principal=${dfs.web.authentication.kerberos.principal}
mapreduce.job.reduce.shuffle.consumer.plugin.class=org.apache.hadoop.mapred.ReduceTask$ReduceCopier
mapreduce.jobtracker.address=c1n10.gbif.org:8021
dfs.journalnode.rpc-address=0.0.0.0:8485
dfs.namenode.fs-limits.max-blocks-per-file=1048576
mapreduce.job.acl-view-job=
dfs.client.block.write.replace-datanode-on-failure.policy=DEFAULT
dfs.namenode.replication.interval=3
mapred.cache.files=/occurrence-download/prod/hive-scripts/query.q#query.q,hdfs://c1n8.gbif.org:8020/user/occurrence-download/oozie-oozi/0000777-140106101727269-oozie-oozi-W/big_download--hive/hive-launcher.jar,/occurrence-download/prod/lib/0#0,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/JavaEWAH-0.3.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/ST4-4.0.4.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/activation-1.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/akka-actor-2.0.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/antlr-2.7.7.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/antlr-3.4.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/antlr-runtime-3.4.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/aopalliance-1.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/asm-3.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/avro-1.7.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/avro-ipc-1.5.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/avro-mapred-1.5.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/cglib-2.2.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-beanutils-1.8.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-beanutils-core-1.8.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-cli-1.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-codec-1.4.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-collections-3.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-compress-1.4.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-configuration-1.6.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-daemon-1.0.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-dbcp-1.4.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-digester-1.8.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-digester3-3.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-el-1.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-fileupload-1.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-httpclient-3.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-io-2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-lang-2.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-lang3-3.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-logging-1.1.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-logging-api-1.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-math-2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-net-3.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-pool-1.5.4.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/commons-validator-1.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/concurrentlinkedhashmap-lru-1.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/config-0.3.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/core-3.1.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/curator-client-1.3.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/curator-client-2.1.0-incubating.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/curator-framework-1.3.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/curator-framework-2.1.0-incubating.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/curator-recipes-1.3.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/curator-recipes-2.1.0-incubating.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/datanucleus-connectionpool-2.0.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/datanucleus-core-2.0.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/datanucleus-enhancer-2.0.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/datanucleus-rdbms-2.0.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/derby-10.6.1.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/dwc-api-1.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/dwca-reader-1.13.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/freemarker-2.3.19.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/gbif-api-0.10.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/gbif-common-0.14.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/gbif-common-search-0.13.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/gbif-common-service-0.8.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/gbif-common-ws-0.11.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/gbif-httputils-0.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/gbif-metadata-profile-1.0.2.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/gbif-parsers-0.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/gbif-wrangler-0.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/guava-14.0.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/guice-3.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/guice-servlet-3.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hadoop-annotations-2.0.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hadoop-auth-2.0.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hadoop-common-2.0.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hadoop-core-2.0.0-mr1-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hadoop-hdfs-2.0.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/haivvreo-1.0.7-cdh-4.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hbase-0.94.2-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hbase-utils-0.4.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/high-scale-lib-1.1.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-builtins-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-cli-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-common-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-contrib-0.10.0-cdh4.2.1.jar,/occurrence-download/prod/lib/hive-default.xml#hive-default.xml,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-exec-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-hbase-handler-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-metastore-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-serde-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-service-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hive-shims-0.10.0-cdh4.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/hsqldb-1.8.0.10.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/httpclient-4.2.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/httpcore-4.2.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/httpmime-4.2.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jackson-core-asl-1.9.12.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jackson-jaxrs-1.9.12.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jackson-mapper-asl-1.9.12.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jackson-xc-1.9.12.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jamon-runtime-2.3.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jasper-compiler-5.5.23.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jasper-runtime-5.5.23.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/javax.inject-1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jaxb-api-2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jaxb-impl-2.2.3-1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jdo2-api-2.3-ec.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jersey-apache-client-1.17.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jersey-apache-client4-1.17.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jersey-client-1.17.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jersey-core-1.17.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jersey-guice-1.17.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jersey-json-1.17.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jersey-server-1.8.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jersey-servlet-1.17.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jets3t-0.6.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jettison-1.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jetty-6.1.26.cloudera.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jetty-util-6.1.26.cloudera.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jline-0.9.94.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/joda-time-2.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jopt-simple-3.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jruby-complete-1.6.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jsch-0.1.42.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/json-20090211.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jsp-2.1-6.1.14.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jsp-api-2.1-6.1.14.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jsp-api-2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jsr250-api-1.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jsr305-2.0.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jta-1.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/jts-1.13.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/kfs-0.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/libfb303-0.9.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/libthrift-0.9.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/log4j-1.2.17.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-analyzers-common-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-analyzers-kuromoji-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-analyzers-phonetic-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-codecs-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-core-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-grouping-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-highlighter-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-memory-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-misc-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-queries-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-queryparser-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-spatial-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/lucene-suggest-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/metrics-core-2.1.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/mockito-all-1.8.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/mysql-connector-java-5.1.21.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/name-parser-2.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/netty-3.2.2.Final.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/noggit-0.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/occurrence-common-0.11.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/occurrence-download-common-0.14.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/occurrence-download-workflow-0.14.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/occurrence-persistence-0.11.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/occurrence-search-0.11.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/org.restlet-2.1.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/org.restlet.ext.servlet-2.1.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/paranamer-2.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/protobuf-java-2.4.0a.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/registry-metadata-2.9.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/registry-ws-client-2.9.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/scala-library-2.9.2.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/servlet-api-2.5-6.1.14.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/servlet-api-2.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/slf4j-api-1.7.5.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/slf4j-log4j12-1.6.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/snappy-java-1.0.4.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/solr-core-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/solr-solrj-4.4.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/spatial4j-0.3.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/stax-api-1.0.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/stringtemplate-3.2.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/super-csv-2.0.1.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/validation-api-1.0.0.GA.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/velocity-1.7.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/wstx-asl-3.2.7.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/xmlenc-0.52.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/xz-1.0.jar,hdfs://c1n8.gbif.org:8020/occurrence-download/prod/lib/zookeeper-3.4.5.jar,hdfs://c1n8.gbif.org:8020/user/oozie/share/lib/oozie/json-simple-1.1.jar
dfs.namenode.num.checkpoints.retained=2
dfs.datanode.directoryscan.threads=1
hadoop.security.group.mapping.ldap.ssl=false
dfs.heartbeat.interval=3
net.topology.script.number.args=100
dfs.client-write-packet-size=65536
hadoop.security.group.mapping.ldap.directory.search.timeout=10000
io.native.lib.available=true
dfs.client.failover.connection.retries=0
hive.warehouse.subdir.inherit.perms=true
dfs.blocksize=134217728
mapreduce.reduce.shuffle.maxfetchfailures=10
dfs.blockreport.initialDelay=0
io.sort.mb=256
ha.health-monitor.rpc-timeout.ms=45000
dfs.ha.tail-edits.period=60
mapred.combine.recordsBeforeProgress=10000
file.bytes-per-checksum=512
dfs.replication.max=512
dfs.namenode.max.extra.edits.segments.retained=10000
io.map.index.skip=0
mapred.task.profile.maps=0-2
mapred.map.tasks.speculative.execution=false
dfs.datanode.du.reserved=0
dfs.support.append=true
ftp.blocksize=67108864
dfs.client.file-block-storage-locations.num-threads=10
ipc.server.listen.queue.size=128
hadoop.ssl.hostname.verifier=DEFAULT
mapred.reduce.tasks=-1
hadoop.security.group.mapping.ldap.search.attr.member=member
mapreduce.tasktracker.outofband.heartbeat=false
dfs.namenode.delegation.token.renew-interval=86400000
mapred.min.split.size=0
hadoop.ssl.keystores.factory.class=org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory
dfs.datanode.sync.behind.writes=false
mapreduce.tasktracker.cache.local.numberdirectories=10000
dfs.client.read.shortcircuit.skip.checksum=false
mapreduce.job.credentials.binary=/mnt/disk_l/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/jobToken
dfs.datanode.handler.count=10
hadoop.ssl.require.client.cert=false
ftp.client-write-packet-size=65536
dfs.client.write.exclude.nodes.cache.expiry.interval.millis=600000
ipc.server.tcpnodelay=false
ha.health-monitor.connect-retry-interval.ms=1000
hadoop.fuse.connection.timeout=300
dfs.permissions.superusergroup=supergroup
fs.ftp.host.port=21
dfs.datanode.data.dir.perm=700
s3native.blocksize=67108864
mapred.tasktracker.dns.nameserver=default
dfs.namenode.replication.min=1
mapred.tasktracker.taskmemorymanager.monitoring-interval=5000
mapred.tasktracker.expiry.interval=600000
hadoop.security.uid.cache.secs=14400
map.sort.class=org.apache.hadoop.util.QuickSort
oozie.hive.params.size=4
fs.trash.checkpoint.interval=0
dfs.image.transfer.timeout=600000
mapred.max.tracker.failures=4
dfs.namenode.name.dir=file://${hadoop.tmp.dir}/dfs/name
fs.AbstractFileSystem.file.impl=org.apache.hadoop.fs.local.LocalFs
mapreduce.jobtracker.split.metainfo.maxsize=10000000
dfs.image.compression.codec=org.apache.hadoop.io.compress.DefaultCodec
mapreduce.job.complete.cancel.delegation.tokens=true
mapred.job.tracker.persist.jobstatus.dir=/jobtracker/jobsInfo
hadoop.security.group.mapping.ldap.search.filter.user=(&(objectClass=user)(sAMAccountName={0}))
io.sort.record.percent=0.05
job.end.retry.attempts=0
hadoop.security.auth_to_local=DEFAULT
kfs.bytes-per-checksum=512
dfs.namenode.backup.http-address=0.0.0.0:50105
hadoop.rpc.protection=authentication
dfs.namenode.https-address=c1n8.gbif.org:50470
mapred.reduce.tasks.speculative.execution=false
ftp.stream-buffer-size=4096
dfs.ha.log-roll.period=120
file.client-write-packet-size=65536
hadoop.http.authentication.simple.anonymous.allowed=true
mapred.task.tracker.task-controller=org.apache.hadoop.mapred.DefaultTaskController
dfs.datanode.drop.cache.behind.reads=false
dfs.image.transfer.bandwidthPerSec=0
mapred.jobtracker.maxtasks.per.job=-1
ha.failover-controller.cli-check.rpc-timeout.ms=20000
mapreduce.shuffle.ssl.address=0.0.0.0
dfs.namenode.write.stale.datanode.ratio=0.5f
io.mapfile.bloom.size=1048576
mapred.reduce.child.log.level=INFO
mapred.reduce.max.attempts=4
dfs.ha.fencing.ssh.connect-timeout=30000
s3.bytes-per-checksum=512
fs.automatic.close=true
mapred.cluster.max.map.memory.mb=-1
fs.trash.interval=1
hadoop.security.authentication=simple
fs.defaultFS=hdfs://c1n8.gbif.org:8020
hadoop.ssl.server.conf=ssl-server.xml
ipc.client.connect.max.retries=10
dfs.journalnode.http-address=0.0.0.0:8480
mapred.map.output.compression.codec=org.apache.hadoop.io.compress.SnappyCodec
net.topology.node.switch.mapping.impl=org.apache.hadoop.net.ScriptBasedMapping
dfs.namenode.replication.considerLoad=true
dfs.namenode.fs-limits.min-block-size=1048576
mapred.job.shuffle.input.buffer.percent=0.70
dfs.namenode.audit.loggers=default
mapreduce.job.counters.max=120
yarn.resourcemanager.address=c1n10.gbif.org:8021
mapred.user.jobconf.limit=5242880
dfs.client.block.write.retries=3
io.map.index.interval=128
mapred.child.java.opts= -Xmx1073741824
dfs.client.https.keystore.resource=ssl-client.xml
io.mapfile.bloom.error.rate=0.005
ipc.client.tcpnodelay=false
dfs.https.port=50470
hadoop.relaxed.worker.version.check=true
dfs.datanode.dns.nameserver=default
dfs.namenode.accesstime.precision=3600000
mapred.task.tracker.report.address=127.0.0.1:0
io.seqfile.compress.blocksize=1000000
keep.failed.task.files=false
hadoop.security.groups.cache.secs=300
datanucleus.plugin.pluginRegistryBundleCheck=LOG
mapreduce.reduce.input.limit=-1
mapreduce.fileoutputcommitter.marksuccessfuljobs=true
mapred.cluster.reduce.memory.mb=-1
tasktracker.http.threads=40
hadoop.security.authorization=false
mapreduce.job.map.output.collector.class=org.apache.hadoop.mapred.MapTask$MapOutputBuffer
fs.ftp.host=0.0.0.0
mapreduce.ifile.readahead=true
ha.zookeeper.session-timeout.ms=5000
dfs.namenode.avoid.read.stale.datanode=false
oozie.job.id=0000777-140106101727269-oozie-oozi-W
dfs.https.enable=false
mapred.acls.enabled=false
mapreduce.reduce.shuffle.read.timeout=180000
dfs.blockreport.intervalMsec=21600000
dfs.datanode.balance.bandwidthPerSec=1048576
mapred.max.tracker.blacklists=4
file.blocksize=67108864
mapred.tasktracker.indexcache.mb=10
mapreduce.jobtracker.staging.root.dir=${hadoop.tmp.dir}/mapred/staging
job.end.notification.url=http://c1n8.gbif.org:11000/oozie/callback?id=0000777-140106101727269-oozie-oozi-W@big_download&status=$jobStatus&
ipc.client.connect.max.retries.on.timeouts=45
hive.metastore.local=false
ha.zookeeper.acl=world:anyone:rwcda
mapred.skip.attempts.to.start.skipping=2
mapreduce.reduce.shuffle.connect.timeout=180000
dfs.block.access.key.update.interval=600
dfs.block.access.token.lifetime=600
mapred.tasktracker.reduce.tasks.maximum=2
mapred.job.name=
jobclient.output.filter=FAILED
mapred.jobtracker.restart.recover=false
mapred.local.dir=${hadoop.tmp.dir}/mapred/local
dfs.namenode.checkpoint.check.period=60
dfs.client.block.write.replace-datanode-on-failure.enable=true
dfs.datanode.directoryscan.interval=21600
mapred.job.tracker=c1n10.gbif.org:8021
dfs.default.chunk.view.size=32768
jobclient.progress.monitor.poll.interval=1000
hadoop.security.instrumentation.requires.admin=false
dfs.namenode.safemode.min.datanodes=0
hadoop.http.authentication.signature.secret.file=${user.home}/hadoop-http-auth-signature-secret
mapred.map.child.log.level=INFO
s3native.replication=3
dfs.datanode.https.address=0.0.0.0:50475
mapred.output.compression.type=BLOCK
mapreduce.jobhistory.cleaner.interval-ms=86400000
file.replication=1
hadoop.hdfs.configuration.version=1
mapred.job.tracker.retiredjobs.cache.size=1000
ipc.client.idlethreshold=4000
hadoop.tmp.dir=/tmp/hadoop-${user.name}
hadoop.skip.worker.version.check=false
oozie.HadoopAccessorService.created=true
dfs.namenode.decommission.nodes.per.interval=5
dfs.namenode.delegation.key.update-interval=86400000
fs.s3.buffer.dir=${hadoop.tmp.dir}/s3
mapred.tasktracker.dns.interface=default
dfs.namenode.support.allow.format=true
io.compression.codecs=org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.DeflateCodec,org.apache.hadoop.io.compress.SnappyCodec,org.apache.hadoop.io.compress.Lz4Codec
mapred.task.profile.reduces=0-2
mapred.cluster.map.memory.mb=-1
mapred.skip.reduce.auto.incr.proc.count=true
hadoop.work.around.non.threadsafe.getpwuid=false
dfs.ha.automatic-failover.enabled=false
dfs.namenode.stale.datanode.interval=30000
dfs.namenode.logging.level=info
ha.health-monitor.sleep-after-disconnect.ms=1000
dfs.namenode.checkpoint.edits.dir=${dfs.namenode.checkpoint.dir}
hadoop.rpc.socket.factory.class.default=org.apache.hadoop.net.StandardSocketFactory
oozie.action.id=0000777-140106101727269-oozie-oozi-W@big_download
oozie.hive.params.0=occurrence_record=prod.occurrence_hdfs
oozie.hive.params.1=select=cleanNull(id) AS id,
cleanNull(dataset_id) AS dataset_id,
cleanDelimiters(institution_code) AS institution_code,
cleanDelimiters(collection_code) AS collection_code,
cleanDelimiters(catalog_number) AS catalog_number,
getBorEnum(basis_of_record) AS basis_of_record,
cleanDelimiters(scientific_name) AS scientific_name,
cleanDelimiters(scientific_name_author) AS scientific_name_author,
cleanNull(taxon_id) AS taxon_id,
cleanDelimiters(kingdom) AS kingdom,
cleanDelimiters(phylum) AS phylum,
cleanDelimiters(class_) AS class_,
cleanDelimiters(order_) AS order_,
cleanDelimiters(family) AS family,
cleanDelimiters(genus) AS genus,
cleanDelimiters(specific_epithet) AS specific_epithet,
cleanNull(kingdom_id) AS kingdom_id,
cleanNull(phylum_id) AS phylum_id,
cleanNull(class_id) AS class_id,
cleanNull(order_id) AS order_id,
cleanNull(family_id) AS family_id,
cleanNull(genus_id) AS genus_id,
cleanNull(species_id) AS species_id,
cleanNull(country_code) AS country_code,
cleanDelimiters(host_country) AS host_country,
cleanNull(latitude) AS latitude,
cleanNull(longitude) AS longitude,
cleanNull(year) AS year,
cleanNull(month) AS month,
toISO8601(event_date) AS event_date,
cleanNull(elevation_in_meters) AS elevation_in_meters,
cleanNull(depth_in_meters) AS depth_in_meters,
cleanDelimiters(verbatim_scientific_name) AS verbatim_scientific_name,
cleanDelimiters(taxon_rank) AS taxon_rank,
cleanDelimiters(verbatim_kingdom) AS verbatim_kingdom,
cleanDelimiters(verbatim_phylum) AS verbatim_phylum,
cleanDelimiters(verbatim_class) AS verbatim_class,
cleanDelimiters(verbatim_order) AS verbatim_order,
cleanDelimiters(verbatim_family) AS verbatim_family,
cleanDelimiters(verbatim_genus) AS verbatim_genus,
cleanDelimiters(verbatim_specific_epithet) AS verbatim_specific_epithet,
cleanDelimiters(verbatim_infraspecific_epithet) AS verbatim_infraspecific_epithet,
cleanDelimiters(verbatim_latitude) AS verbatim_latitude,
cleanDelimiters(verbatim_longitude) AS verbatim_longitude,
cleanDelimiters(coordinate_precision) AS coordinate_precision,
cleanDelimiters(maximum_elevation_in_meters) AS maximum_elevation_in_meters,
cleanDelimiters(minimum_elevation_in_meters) AS minimum_elevation_in_meters,
cleanDelimiters(elevation_precision) AS elevation_precision,
cleanDelimiters(minimum_depth_in_meters) AS minimum_depth_in_meters,
cleanDelimiters(maximum_depth_in_meters) AS maximum_depth_in_meters,
cleanDelimiters(depth_precision) AS depth_precision,
cleanDelimiters(continent_ocean) AS continent_ocean,
cleanDelimiters(state_province) AS state_province,
cleanDelimiters(county) AS county,
cleanDelimiters(country) AS country,
cleanDelimiters(recorded_by) AS recorded_by,
cleanDelimiters(locality) AS locality,
cleanDelimiters(verbatim_year) AS verbatim_year,
cleanDelimiters(verbatim_month) AS verbatim_month,
cleanDelimiters(day) AS day,
cleanDelimiters(verbatim_basis_of_record) AS verbatim_basis_of_record,
cleanDelimiters(identified_by) AS identified_by,
cleanDelimiters(date_identified) AS date_identified,
toISO8601(created) AS created,
toISO8601(modified) AS modified
dfs.datanode.http.address=0.0.0.0:50075
dfs.namenode.edits.dir=${dfs.namenode.name.dir}
job.end.retry.interval=30000
hadoop.fuse.timer.period=5
oozie.hive.params.3=query_result=download_tmp_oliver_c6fc57a39c1e46b7affb99ffd7b963c4
oozie.hive.script=query.q
oozie.hive.params.2=query=(((taxon_id = 729 OR kingdom_id = 729 OR phylum_id = 729 OR class_id = 729 OR order_id = 729 OR family_id = 729 OR genus_id = 729 OR species_id = 729)) AND (country_code = 'CA'))
fs.AbstractFileSystem.viewfs.impl=org.apache.hadoop.fs.viewfs.ViewFs
mapred.queue.names=default
s3native.stream-buffer-size=4096
dfs.secondary.namenode.kerberos.internal.spnego.principal=${dfs.web.authentication.kerberos.principal}
dfs.datanode.available-space-volume-choosing-policy.balanced-space-threshold=10737418240
mapred.jobtracker.job.history.block.size=3145728
dfs.namenode.safemode.threshold-pct=0.999f
mapreduce.ifile.readahead.bytes=4194304
mapred.child.tmp=./tmp
hive.metastore.execute.setugi=true
s3native.bytes-per-checksum=512
mapred.cluster.max.reduce.memory.mb=-1
kfs.replication=3
mapred.line.input.format.linespermap=1
mapred.map.tasks=2
hadoop.http.authentication.type=simple
dfs.client.failover.sleep.base.millis=500
mapred.tasktracker.map.tasks.maximum=2
hadoop.jetty.logs.serve.aliases=true
ha.failover-controller.graceful-fence.rpc-timeout.ms=5000
hive.metastore.uris=thrift://c1n8.gbif.org:9083
dfs.datanode.max.transfer.threads=4096
dfs.namenode.handler.count=10
hadoop.ssl.client.conf=ssl-client.xml
hadoop.ssl.enabled=false
fs.AbstractFileSystem.hdfs.impl=org.apache.hadoop.fs.Hdfs
mapred.job.queue.name=default
kfs.stream-buffer-size=4096
mapreduce.task.classpath.user.precedence=true
dfs.namenode.invalidate.work.pct.per.iteration=0.32f
dfs.bytes-per-checksum=512
dfs.replication=3
dfs.permissions.enabled=true
mapred.jobtracker.taskScheduler=org.apache.hadoop.mapred.JobQueueTaskScheduler
dfs.datanode.use.datanode.hostname=false
dfs.namenode.fs-limits.max-directory-items=0
s3.client-write-packet-size=65536
mapred.skip.reduce.max.skip.groups=0
dfs.client.failover.sleep.max.millis=15000
dfs.namenode.fs-limits.max-component-length=0
s3.blocksize=67108864
kfs.blocksize=67108864
dfs.namenode.edits.journal-plugin.qjournal=org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager
mapred.job.tracker.http.address=0.0.0.0:50030
dfs.client.https.need-auth=false
mapreduce.jobhistory.max-age-ms=2592000000
mapred.healthChecker.script.timeout=600000
ftp.replication=3
fs.s3n.block.size=67108864
hive.exec.mode.local.auto=false
mapred.tasktracker.instrumentation=org.apache.hadoop.mapred.TaskTrackerMetricsInst
dfs.namenode.num.extra.edits.retained=1000000
hadoop.http.staticuser.user=dr.who
hive.exec.reducers.max=999
mapred.system.dir=${hadoop.tmp.dir}/mapred/system
mapred.job.reuse.jvm.num.tasks=1
dfs.namenode.checkpoint.dir=file://${hadoop.tmp.dir}/dfs/namesecondary
tfile.fs.input.buffer.size=262144
mapred.skip.map.auto.incr.proc.count=true
fs.s3.block.size=67108864
tfile.io.chunk.size=1048576
io.serializations=org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
mapred.inmem.merge.threshold=1000
hive.exec.reducers.bytes.per.reducer=1073741824
mapred.job.map.memory.mb=-1
dfs.namenode.backup.address=0.0.0.0:50100
mapred.reduce.slowstart.completed.maps=0.8
dfs.block.access.token.enable=false
io.seqfile.sorter.recordlimit=1000000
s3native.client-write-packet-size=65536
ftp.bytes-per-checksum=512
hadoop.security.group.mapping=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback
dfs.client.domain.socket.data.traffic=false
dfs.client.file-block-storage-locations.timeout=60
hive.exec.scratchdir=/tmp/hive-occurrence-download
mapred.tasktracker.tasks.sleeptime-before-sigkill=5000
dfs.namenode.max.objects=0
mapred.jobtracker.completeuserjobs.maximum=100
dfs.namenode.delegation.token.max-lifetime=604800000
mapred.job.restart.recover=true
mapred.compress.map.output=true
dfs.datanode.hdfs-blocks-metadata.enabled=true
dfs.datanode.readahead.bytes=4193404
dfs.image.compress=false
mapreduce.shuffle.ssl.enabled=${hadoop.ssl.enabled}
mapred.merge.recordsBeforeProgress=10000
dfs.stream-buffer-size=4096
tfile.fs.output.buffer.size=262144
fs.permissions.umask-mode=022
ha.failover-controller.graceful-fence.connection.retries=1
dfs.datanode.drop.cache.behind.writes=false
hadoop.common.configuration.version=0.23.0
dfs.namenode.replication.work.multiplier.per.iteration=2
mapreduce.job.acl-modify-job=
io.seqfile.local.dir=${hadoop.tmp.dir}/io/local
mapreduce.shuffle.ssl.port=50443
fs.s3.sleepTimeSeconds=10
------------------------

Current (local) dir = /mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work
------------------------
  hive-default.xml
  tmp
  action.xml
  hive-site.xml
  hive-exec-log4j.properties
  query.q
  0
  .action.xml.crc
  hive-log4j.properties
------------------------


Script [query.q] content:
------------------------
CREATE TEMPORARY FUNCTION cleanNull AS 'org.gbif.occurrencestore.hive.udf.NullStringRemoverUDF';
CREATE TEMPORARY FUNCTION getBorEnum AS 'org.gbif.occurrencestore.hive.udf.BasisOfRecordLookupUDF';
CREATE TEMPORARY FUNCTION contains AS 'org.gbif.occurrencestore.hive.udf.ContainsUDF';
CREATE TEMPORARY FUNCTION toISO8601 AS 'org.gbif.occurrencestore.hive.udf.ToISO8601UDF';
CREATE TEMPORARY FUNCTION cleanDelimiters AS 'org.gbif.occurrencestore.hive.udf.CleanDelimiterCharsUDF';

set mapred.output.compress=false;
set hive.exec.compress.output=false;
set hbase.client.scanner.caching=200;

CREATE TABLE ${query_result}
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'
AS
SELECT ${select}
FROM ${occurrence_record}
WHERE ${query};

------------------------

Parameters:
------------------------
  occurrence_record=prod.occurrence_hdfs
  select=cleanNull(id) AS id,
cleanNull(dataset_id) AS dataset_id,
cleanDelimiters(institution_code) AS institution_code,
cleanDelimiters(collection_code) AS collection_code,
cleanDelimiters(catalog_number) AS catalog_number,
getBorEnum(basis_of_record) AS basis_of_record,
cleanDelimiters(scientific_name) AS scientific_name,
cleanDelimiters(scientific_name_author) AS scientific_name_author,
cleanNull(taxon_id) AS taxon_id,
cleanDelimiters(kingdom) AS kingdom,
cleanDelimiters(phylum) AS phylum,
cleanDelimiters(class_) AS class_,
cleanDelimiters(order_) AS order_,
cleanDelimiters(family) AS family,
cleanDelimiters(genus) AS genus,
cleanDelimiters(specific_epithet) AS specific_epithet,
cleanNull(kingdom_id) AS kingdom_id,
cleanNull(phylum_id) AS phylum_id,
cleanNull(class_id) AS class_id,
cleanNull(order_id) AS order_id,
cleanNull(family_id) AS family_id,
cleanNull(genus_id) AS genus_id,
cleanNull(species_id) AS species_id,
cleanNull(country_code) AS country_code,
cleanDelimiters(host_country) AS host_country,
cleanNull(latitude) AS latitude,
cleanNull(longitude) AS longitude,
cleanNull(year) AS year,
cleanNull(month) AS month,
toISO8601(event_date) AS event_date,
cleanNull(elevation_in_meters) AS elevation_in_meters,
cleanNull(depth_in_meters) AS depth_in_meters,
cleanDelimiters(verbatim_scientific_name) AS verbatim_scientific_name,
cleanDelimiters(taxon_rank) AS taxon_rank,
cleanDelimiters(verbatim_kingdom) AS verbatim_kingdom,
cleanDelimiters(verbatim_phylum) AS verbatim_phylum,
cleanDelimiters(verbatim_class) AS verbatim_class,
cleanDelimiters(verbatim_order) AS verbatim_order,
cleanDelimiters(verbatim_family) AS verbatim_family,
cleanDelimiters(verbatim_genus) AS verbatim_genus,
cleanDelimiters(verbatim_specific_epithet) AS verbatim_specific_epithet,
cleanDelimiters(verbatim_infraspecific_epithet) AS verbatim_infraspecific_epithet,
cleanDelimiters(verbatim_latitude) AS verbatim_latitude,
cleanDelimiters(verbatim_longitude) AS verbatim_longitude,
cleanDelimiters(coordinate_precision) AS coordinate_precision,
cleanDelimiters(maximum_elevation_in_meters) AS maximum_elevation_in_meters,
cleanDelimiters(minimum_elevation_in_meters) AS minimum_elevation_in_meters,
cleanDelimiters(elevation_precision) AS elevation_precision,
cleanDelimiters(minimum_depth_in_meters) AS minimum_depth_in_meters,
cleanDelimiters(maximum_depth_in_meters) AS maximum_depth_in_meters,
cleanDelimiters(depth_precision) AS depth_precision,
cleanDelimiters(continent_ocean) AS continent_ocean,
cleanDelimiters(state_province) AS state_province,
cleanDelimiters(county) AS county,
cleanDelimiters(country) AS country,
cleanDelimiters(recorded_by) AS recorded_by,
cleanDelimiters(locality) AS locality,
cleanDelimiters(verbatim_year) AS verbatim_year,
cleanDelimiters(verbatim_month) AS verbatim_month,
cleanDelimiters(day) AS day,
cleanDelimiters(verbatim_basis_of_record) AS verbatim_basis_of_record,
cleanDelimiters(identified_by) AS identified_by,
cleanDelimiters(date_identified) AS date_identified,
toISO8601(created) AS created,
toISO8601(modified) AS modified
  query=(((taxon_id = 729 OR kingdom_id = 729 OR phylum_id = 729 OR class_id = 729 OR order_id = 729 OR family_id = 729 OR genus_id = 729 OR species_id = 729)) AND (country_code = 'CA'))
  query_result=download_tmp_oliver_c6fc57a39c1e46b7affb99ffd7b963c4
------------------------

Hive command arguments :
             --hivevar
             occurrence_record=prod.occurrence_hdfs
             --hivevar
             select=cleanNull(id) AS id,
cleanNull(dataset_id) AS dataset_id,
cleanDelimiters(institution_code) AS institution_code,
cleanDelimiters(collection_code) AS collection_code,
cleanDelimiters(catalog_number) AS catalog_number,
getBorEnum(basis_of_record) AS basis_of_record,
cleanDelimiters(scientific_name) AS scientific_name,
cleanDelimiters(scientific_name_author) AS scientific_name_author,
cleanNull(taxon_id) AS taxon_id,
cleanDelimiters(kingdom) AS kingdom,
cleanDelimiters(phylum) AS phylum,
cleanDelimiters(class_) AS class_,
cleanDelimiters(order_) AS order_,
cleanDelimiters(family) AS family,
cleanDelimiters(genus) AS genus,
cleanDelimiters(specific_epithet) AS specific_epithet,
cleanNull(kingdom_id) AS kingdom_id,
cleanNull(phylum_id) AS phylum_id,
cleanNull(class_id) AS class_id,
cleanNull(order_id) AS order_id,
cleanNull(family_id) AS family_id,
cleanNull(genus_id) AS genus_id,
cleanNull(species_id) AS species_id,
cleanNull(country_code) AS country_code,
cleanDelimiters(host_country) AS host_country,
cleanNull(latitude) AS latitude,
cleanNull(longitude) AS longitude,
cleanNull(year) AS year,
cleanNull(month) AS month,
toISO8601(event_date) AS event_date,
cleanNull(elevation_in_meters) AS elevation_in_meters,
cleanNull(depth_in_meters) AS depth_in_meters,
cleanDelimiters(verbatim_scientific_name) AS verbatim_scientific_name,
cleanDelimiters(taxon_rank) AS taxon_rank,
cleanDelimiters(verbatim_kingdom) AS verbatim_kingdom,
cleanDelimiters(verbatim_phylum) AS verbatim_phylum,
cleanDelimiters(verbatim_class) AS verbatim_class,
cleanDelimiters(verbatim_order) AS verbatim_order,
cleanDelimiters(verbatim_family) AS verbatim_family,
cleanDelimiters(verbatim_genus) AS verbatim_genus,
cleanDelimiters(verbatim_specific_epithet) AS verbatim_specific_epithet,
cleanDelimiters(verbatim_infraspecific_epithet) AS verbatim_infraspecific_epithet,
cleanDelimiters(verbatim_latitude) AS verbatim_latitude,
cleanDelimiters(verbatim_longitude) AS verbatim_longitude,
cleanDelimiters(coordinate_precision) AS coordinate_precision,
cleanDelimiters(maximum_elevation_in_meters) AS maximum_elevation_in_meters,
cleanDelimiters(minimum_elevation_in_meters) AS minimum_elevation_in_meters,
cleanDelimiters(elevation_precision) AS elevation_precision,
cleanDelimiters(minimum_depth_in_meters) AS minimum_depth_in_meters,
cleanDelimiters(maximum_depth_in_meters) AS maximum_depth_in_meters,
cleanDelimiters(depth_precision) AS depth_precision,
cleanDelimiters(continent_ocean) AS continent_ocean,
cleanDelimiters(state_province) AS state_province,
cleanDelimiters(county) AS county,
cleanDelimiters(country) AS country,
cleanDelimiters(recorded_by) AS recorded_by,
cleanDelimiters(locality) AS locality,
cleanDelimiters(verbatim_year) AS verbatim_year,
cleanDelimiters(verbatim_month) AS verbatim_month,
cleanDelimiters(day) AS day,
cleanDelimiters(verbatim_basis_of_record) AS verbatim_basis_of_record,
cleanDelimiters(identified_by) AS identified_by,
cleanDelimiters(date_identified) AS date_identified,
toISO8601(created) AS created,
toISO8601(modified) AS modified
             --hivevar
             query=(((taxon_id = 729 OR kingdom_id = 729 OR phylum_id = 729 OR class_id = 729 OR order_id = 729 OR family_id = 729 OR genus_id = 729 OR species_id = 729)) AND (country_code = 'CA'))
             --hivevar
             query_result=download_tmp_oliver_c6fc57a39c1e46b7affb99ffd7b963c4
             -f
             query.q

=================================================================

>>> Invoking Hive command line now >>>

Heart beat
Heart beat
Heart beat
 Hadoop Job IDs executed by Hive:

Intercepting System.exit(1)

<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [1]

Oozie Launcher failed, finishing Hadoop job gracefully


Oozie Launcher ends



stderr logs
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/mnt/disk_b/mapred/local/taskTracker/distcache/719991854492345165_729470284_1732117029/c1n8.gbif.org/occurrence-download/prod/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
Logging initialized using configuration in jar:file:/mnt/disk_f/mapred/local/taskTracker/distcache/-5303962187888564729_-151527985_1732113998/c1n8.gbif.org/occurrence-download/prod/lib/hive-common-0.10.0-cdh4.2.1.jar!/hive-log4j.properties
Hive history file=/tmp/mapred/hive_job_log_mapred_201401091138_1777708139.txt
OK
Time taken: 0.263 seconds
OK
Time taken: 0.006 seconds
OK
Time taken: 0.007 seconds
OK
Time taken: 0.003 seconds
OK
Time taken: 0.004 seconds
Total MapReduce jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201312111438_10007, Tracking URL = http://c1n10.gbif.org:50030/jobdetails.jsp?jobid=job_201312111438_10007
Kill Command = /opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop-0.20-mapreduce/bin/hadoop job  -kill job_201312111438_10007
Hadoop job information for Stage-1: number of mappers: 143; number of reducers: 0
2014-01-09 11:38:43,464 Stage-1 map = 0%,  reduce = 0%
2014-01-09 11:38:54,559 Stage-1 map = 2%,  reduce = 0%, Cumulative CPU 7.01 sec
2014-01-09 11:38:55,574 Stage-1 map = 2%,  reduce = 0%, Cumulative CPU 15.36 sec
2014-01-09 11:38:56,589 Stage-1 map = 3%,  reduce = 0%, Cumulative CPU 27.2 sec
2014-01-09 11:38:57,599 Stage-1 map = 6%,  reduce = 0%, Cumulative CPU 37.73 sec
2014-01-09 11:38:58,608 Stage-1 map = 12%,  reduce = 0%, Cumulative CPU 49.59 sec
2014-01-09 11:38:59,616 Stage-1 map = 18%,  reduce = 0%, Cumulative CPU 49.59 sec
2014-01-09 11:39:00,627 Stage-1 map = 21%,  reduce = 0%, Cumulative CPU 221.21 sec
2014-01-09 11:39:01,636 Stage-1 map = 26%,  reduce = 0%, Cumulative CPU 238.0 sec
2014-01-09 11:39:02,645 Stage-1 map = 33%,  reduce = 0%, Cumulative CPU 256.78 sec
2014-01-09 11:39:03,653 Stage-1 map = 36%,  reduce = 0%, Cumulative CPU 290.68 sec
2014-01-09 11:39:04,661 Stage-1 map = 42%,  reduce = 0%, Cumulative CPU 454.96 sec
2014-01-09 11:39:05,669 Stage-1 map = 48%,  reduce = 0%, Cumulative CPU 560.77 sec
2014-01-09 11:39:06,679 Stage-1 map = 52%,  reduce = 0%, Cumulative CPU 597.47 sec
2014-01-09 11:39:07,689 Stage-1 map = 58%,  reduce = 0%, Cumulative CPU 766.44 sec
2014-01-09 11:39:08,698 Stage-1 map = 63%,  reduce = 0%, Cumulative CPU 943.59 sec
2014-01-09 11:39:09,707 Stage-1 map = 67%,  reduce = 0%, Cumulative CPU 1425.78 sec
2014-01-09 11:39:10,742 Stage-1 map = 71%,  reduce = 0%, Cumulative CPU 1560.37 sec
2014-01-09 11:39:11,751 Stage-1 map = 72%,  reduce = 0%, Cumulative CPU 1999.18 sec
2014-01-09 11:39:12,760 Stage-1 map = 75%,  reduce = 0%, Cumulative CPU 2367.8 sec
2014-01-09 11:39:13,770 Stage-1 map = 79%,  reduce = 0%, Cumulative CPU 2487.53 sec
2014-01-09 11:39:14,781 Stage-1 map = 82%,  reduce = 0%, Cumulative CPU 2685.79 sec
2014-01-09 11:39:15,799 Stage-1 map = 84%,  reduce = 0%, Cumulative CPU 2973.35 sec
2014-01-09 11:39:16,809 Stage-1 map = 88%,  reduce = 0%, Cumulative CPU 3089.53 sec
2014-01-09 11:39:17,818 Stage-1 map = 89%,  reduce = 0%, Cumulative CPU 3303.89 sec
2014-01-09 11:39:18,828 Stage-1 map = 91%,  reduce = 0%, Cumulative CPU 3456.01 sec
2014-01-09 11:39:19,838 Stage-1 map = 92%,  reduce = 0%, Cumulative CPU 3498.29 sec
2014-01-09 11:39:20,864 Stage-1 map = 93%,  reduce = 0%, Cumulative CPU 3640.92 sec
2014-01-09 11:39:21,873 Stage-1 map = 94%,  reduce = 0%, Cumulative CPU 3671.09 sec
2014-01-09 11:39:22,883 Stage-1 map = 96%,  reduce = 0%, Cumulative CPU 3723.49 sec
2014-01-09 11:39:23,892 Stage-1 map = 97%,  reduce = 0%, Cumulative CPU 3766.83 sec
2014-01-09 11:39:24,902 Stage-1 map = 98%,  reduce = 0%, Cumulative CPU 3882.93 sec
2014-01-09 11:39:25,928 Stage-1 map = 98%,  reduce = 0%, Cumulative CPU 3967.12 sec
2014-01-09 11:39:26,938 Stage-1 map = 98%,  reduce = 0%, Cumulative CPU 4031.41 sec
2014-01-09 11:39:27,947 Stage-1 map = 98%,  reduce = 0%, Cumulative CPU 4031.41 sec
2014-01-09 11:39:28,956 Stage-1 map = 98%,  reduce = 0%, Cumulative CPU 4043.17 sec
2014-01-09 11:39:29,966 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4107.51 sec
2014-01-09 11:39:30,993 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4165.21 sec
2014-01-09 11:39:32,003 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4181.53 sec
2014-01-09 11:39:33,013 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4195.76 sec
2014-01-09 11:39:34,022 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4195.76 sec
2014-01-09 11:39:35,031 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4195.76 sec
2014-01-09 11:39:36,058 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4195.76 sec
2014-01-09 11:39:37,068 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4195.76 sec
2014-01-09 11:39:38,077 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4195.76 sec
2014-01-09 11:39:39,086 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4195.76 sec
2014-01-09 11:39:40,096 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4195.76 sec
2014-01-09 11:39:41,132 Stage-1 map = 99%,  reduce = 0%, Cumulative CPU 4195.76 sec
2014-01-09 11:39:42,141 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 4228.96 sec
2014-01-09 11:39:43,151 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 4228.96 sec
2014-01-09 11:39:44,160 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 4258.87 sec
2014-01-09 11:39:45,170 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 4258.87 sec
2014-01-09 11:39:46,187 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 4258.87 sec
MapReduce Total cumulative CPU time: 0 days 1 hours 10 minutes 58 seconds 870 msec
Ended Job = job_201312111438_10007
Ended Job = -650514965, job is filtered out (removed at runtime).
Ended Job = 862720204, job is filtered out (removed at runtime).
Moving data to: hdfs://c1n8.gbif.org:8020/tmp/hive-occurrence-download/hive_2014-01-09_11-38-35_094_862214480012816594/-ext-10001
Moving data to: hdfs://c1n8.gbif.org:8020/user/hive/warehouse/download_tmp_oliver_c6fc57a39c1e46b7affb99ffd7b963c4
FAILED: Error in metadata: MetaException(message:javax.jdo.JDODataStoreException: Insert of object "org.apache.hadoop.hive.metastore.model.MTable@4e7289ff" using statement "INSERT INTO "TBLS" ("TBL_ID","VIEW_ORIGINAL_TEXT","RETENTION","VIEW_EXPANDED_TEXT","OWNER","LAST_ACCESS_TIME","SD_ID","TBL_TYPE","TBL_NAME","DB_ID","CREATE_TIME") VALUES (?,?,?,?,?,?,?,?,?,?,?)" failed : ERROR: duplicate key value violates unique constraint "UNIQUETABLE"
NestedThrowables:
org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "UNIQUETABLE")
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
MapReduce Jobs Launched:
Job 0: Map: 143   Cumulative CPU: 4258.87 sec   HDFS Read: 42066575553 HDFS Write: 2456053598 SUCCESS
Total MapReduce CPU Time Spent: 0 days 1 hours 10 minutes 58 seconds 870 msec
Log file: /mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/hive-oozie-job_201312111438_10006.log  not present. Therefore no Hadoop jobids found
Intercepting System.exit(1)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [1]


syslog logs
2014-01-09 11:38:32,949 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2014-01-09 11:38:33,382 INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: /mnt/disk_e/mapred/local/taskTracker/distcache/-6765859702005568435_1005666746_1732111173/c1n8.gbif.org/occurrence-download/prod/hive-scripts/query.q <- /mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/query.q
2014-01-09 11:38:33,385 INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: /mnt/disk_g/mapred/local/taskTracker/distcache/-3520751687508023169_-1613452264_1732111234/c1n8.gbif.org/occurrence-download/prod/lib/0 <- /mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/0
2014-01-09 11:38:33,386 INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: /mnt/disk_h/mapred/local/taskTracker/distcache/-3150235297527902390_-586825880_1732114060/c1n8.gbif.org/occurrence-download/prod/lib/hive-default.xml <- /mnt/disk_g/mapred/local/taskTracker/occurrence-download/jobcache/job_201312111438_10006/attempt_201312111438_10006_m_000000_0/work/hive-default.xml
2014-01-09 11:38:33,424 WARN org.apache.hadoop.conf.Configuration: session.id is deprecated. Instead, use dfs.metrics.session-id
2014-01-09 11:38:33,425 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=MAP, sessionId=
2014-01-09 11:38:33,462 WARN org.apache.hadoop.conf.Configuration: slave.host.name is deprecated. Instead, use dfs.datanode.hostname
2014-01-09 11:38:33,711 INFO org.apache.hadoop.util.ProcessTree: setsid exited with exit code 0
2014-01-09 11:38:33,715 INFO org.apache.hadoop.mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5187868c
2014-01-09 11:38:33,966 INFO org.apache.hadoop.mapred.MapTask: Processing split: hdfs://c1n8.gbif.org:8020/user/occurrence-download/oozie-oozi/0000777-140106101727269-oozie-oozi-W/big_download--hive/input/dummy.txt:0+5
2014-01-09 11:38:33,983 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use FileInputFormatCounters as group name and  BYTES_READ as counter name instead
2014-01-09 11:38:33,986 INFO org.apache.hadoop.mapred.MapTask: numReduceTasks: 0

    

Author: omeyn@gbif.org
Comment: This is not speculative execution - there's only one map running at a time, and spec ex is not enabled in cdhmanager.
Created: 2014-01-09 15:03:24.47
Updated: 2014-01-09 15:03:24.47

Author: omeyn@gbif.org
Comment: I'm stuck, and handing over to Fede for a 2nd pair of eyes. I can't repeatably reproduce it.
Created: 2014-01-13 12:23:59.846
Updated: 2014-01-13 12:23:59.846