write udf to populate crawlId, harvestedDate and xmlSchema on sqoop out from mysql

13144
Reporter: omeyn
Assignee: omeyn
Type: Task
Summary: write udf to populate crawlId, harvestedDate and xmlSchema on sqoop out from mysql
Priority: Critical
Resolution: Fixed
Status: Closed
Created: 2013-04-15 11:25:48.717
Updated: 2013-12-17 15:17:04.395
Resolved: 2013-09-16 16:13:39.746
        
Description: Processing will mint new ids for incoming fragments if existing fragments are missing any of the required fields:
- datasetKey
- crawlId
- harvestedDate

and we'll have messy records if we don't start with a correct schemaType.]]>