Issue 11064

generate data export: georeferenced data for region South Europe

11064
Reporter: ahahn
Assignee: ahahn
Type: Task
Summary: generate data export: georeferenced data for region South Europe
Priority: Major
Resolution: Fixed
Status: Closed
Created: 2012-05-11 12:26:08.719
Updated: 2012-11-20 15:02:51.442
DueDate: 2012-06-15 00:00:00.0
Resolved: 2012-11-20 15:02:48.211
        
Description: requested by Natural Solutions, www.natural-solutions.eu ( "We are in the process of building a mobile data entry tool with the French IRD (Institut de Recherche pour le Developpement )  to prompt users with recommendations of potential species on the field.)

for communication, see helpdesk case 1872

background: web service response times out on large resultset]]>
    
Attachment CreateTableStatement_v3.txt
Attachment DownloadStatement_v3.txt


Author: ahahn@gbif.org
Comment: checking proposed export format with requester. Structure is not following the usual exports, but set to align to brief web service response
Created: 2012-05-11 12:34:39.319
Updated: 2012-05-11 12:35:46.43


Author: ahahn@gbif.org
Created: 2012-05-11 16:33:05.172
Updated: 2012-05-11 16:33:05.172
        
Format confirmed, export running

    


Author: ahahn@gbif.org
Comment: Export uploaded to ftp, requester informed
Created: 2012-05-15 11:18:50.925
Updated: 2012-05-15 11:18:50.925


Author: ahahn@gbif.org
Created: 2012-06-01 16:25:54.581
Updated: 2012-06-01 16:25:54.581
        
Issues reported:
1) resultset does not contain France or Spain
--> partially correct. filter chosen used country.region='SEU', while France is listed as 'WEU'. Change parameters to include. Spain, however, should be in:
SEU:
 AD               | ANDORRA
 AL               | ALBANIA
 BA               | BOSNIA AND HERZEGOVINA
 ES               | SPAIN
 GI               | GIBRALTAR
 GR               | GREECE
 HR               | CROATIA
 IT               | ITALY
 MK               | MACEDONIA, THE FORMER YUGOSLAV REPUBLIC OF
 MT               | MALTA
 PT               | PORTUGAL
 RS               | SERBIA
 SI               | SLOVENIA
 SM               | SAN MARINO
 VA               | HOLY SEE (VATICAN CITY STATE)

2) latitude / longitude out of range:
min('decimalLatitude') = -67.0999984741
max('decimalLatitude') = 138.6000000000
min('decimalLongitude') = -171.0600000000
max('decimalLongitude') = 177.4299926758
--> filter runs on raw_occurrence_record and only checks for NOT NULL. Include a bounding box in search.

3) taxon_concept id appears to be non-unique, or referring to wrong records
--> used o.taxon_concept_id, need to check whether this is wrong
    


Author: ahahn@gbif.org
Comment: Reported issues with export, need to fix and rerun
Created: 2012-06-01 16:42:01.488
Updated: 2012-06-01 16:42:01.488


Author: ahahn@gbif.org
Created: 2012-06-06 11:06:56.325
Updated: 2012-06-06 11:06:56.325
        
1) Added France explicitly
2) Set a bounding box search for lat/lon 34/-12 to 47/30
3) Confirmed that the web service indeed returns o.taxon_concept_id; that means the concept id is unique per data resource, not across the whole index.
    


Author: ahahn@gbif.org
Comment: Export regenerated; ftp upload pending ftp site to become available again.
Created: 2012-06-06 14:24:44.51
Updated: 2012-06-06 14:24:44.51


Author: ahahn@gbif.org
Comment: Uploaded, user notified
Created: 2012-06-07 13:41:09.073
Updated: 2012-06-07 13:41:09.073


Author: ahahn@gbif.org
Comment: Running modified version (added attributes)
Created: 2012-06-13 16:30:39.229
Updated: 2012-06-13 16:30:39.229


Author: ahahn@gbif.org
Comment: modified for new export structure
Created: 2012-06-13 16:35:34.509
Updated: 2012-06-13 16:35:34.509


Author: ahahn@gbif.org
Comment: export uploaded, user informed
Created: 2012-06-20 12:32:00.043
Updated: 2012-06-20 12:32:00.043


Author: ahahn@gbif.org
Comment: No further communication for requester - closing
Created: 2012-11-20 15:02:48.235
Updated: 2012-11-20 15:02:48.235