Refactor the occurrence download workflow

17525
Reporter: fmendez
Type: Task
Summary: Refactor the occurrence download workflow
Priority: Major
Status: Open
Created: 2015-03-24 22:31:05.795
Updated: 2015-03-25 20:20:27.439
        
Description:     - The DwC-A writer code is in particular difficult to follow
    - https://github.com/gbif/occurrence/tree/occurrence-0.21.x exists as a simplified project to tie together the HDFS-backed Hive table building and the download workflows, which are inherently dependent on each other.  This project is incomplete, but was greatly simplified from what already existed and uses templating to create HQL files.  Implementers are free to decide if they wish to build upon this project, or continue on the existing codebases.
   - consider that new formats will be added in the future.  E.g. KML, or some shapefile format etc.]]>