Issue 13997

Downloaded occurrence.txt missing characters

13997
Reporter: kbraak
Assignee: fmendez
Type: Bug
Summary: Downloaded occurrence.txt missing characters
Priority: Critical
Resolution: Fixed
Status: Closed
Created: 2013-09-19 14:49:48.679
Updated: 2013-09-25 14:26:45.306
Resolved: 2013-09-25 14:26:45.162
        
Description: Reported by 2 users to date: jacky.hy.lee@gmail.com and pedrodpg@lncc.br

Below follows evidence both users supplied:

I downloaded a data set of North American angiosperm species from 1993 onwards file code = 0000096-130906152512535 from your new data portal but this data set is missing letters and numbers within it such as  Solan m, North  merica, United States of  merica.

Sample from occurrence text file:
234660948    7133ff0a-f762-11e1-a439-00145eb45e9a    NY    Herbari m      7    7    PRESERVED_SPECIMEN    Solan m carolinense L.    L.    2932011    Plantae    Magnoliophyta    Magnoliopsida    Solanales    Solanaceae    Solan m    Solan m carolinense    6    49    220    1176    7717    2928997    2932011    US    43.313889    -86.081111    1998    8    903909600000            Solan m carolinense L.        Plantae    Magnoliophyta (flowering plants)            Solanaceae    Solan m    carolinense        43.313       - 6.  1111                                North  merica    Michigan    M skegon  o.    United States of  merica    W. Hess    Holton   ck Lake R ., S. end of the Rd. by M skegon river.    1              4    S            1268056158000    1296181125000
234660949    7133ff0a-f762-11e1-a439-00145eb45e9a    NY    Herbari m      7         PRESERVED_SPECIMEN    Solan m carolinense L.    L.    2932011    Plantae    Magnoliophyta    Magnoliopsida    Solanales    Solanaceae    Solan m    Solan m carolinense    6    49    220    1176    7717    2928997    2932011    US            1994    7    773013600000            Solan m carolinense L.        Plantae    Magnoliophyta (flowering plants)            Solanaceae    Solan m    carolinense                                            North  merica    Lo isiana        United States of  merica    R.  . Thomas    Parish:  addo.  Roadbank of I-  W at overpass two miles east of U.S. 7  and U.S.    exit east of Greenwood and west of Shreveport.    1  4     7     1    S            1268056158000    1296181125000
234663335    7133ff0a-f762-11e1-a439-00145eb45e9a    NY    Herbari m      7   7     PRESERVED_SPECIMEN    Solan m donian m Walp.    Walp.    2929566    Plantae    Magnoliophyta    Magnoliopsida    Solanales    Solanaceae    Solan m    Solan m donian m    6    49    220    1176    7717    2928997    2929566    MX    21.320833    -89.45    1996    11    849049200000            Solan m donian m Walp.        Plantae    Magnoliophyta (flowering plants)            Solanaceae    Solan m    donian m         1.3   33    -  .4                                      North  merica    Y catán        Mexico    G.  arnevali F.    M nicipio Telchac, Marlín en el área general de San  enito, 16 km al este de  hicx l b.    1  6    11     7    S    S.  . Knapp        1268056205000    1296181138000

*********

Search for all occurrences in Brazil, (http://uat.gbif.org/occurrence/search?country=BR#)

You will notice plenty characters missing, specially the first character in most words. Maybe it is a parsing bug or something like.

603698482    4fa7b334-ce0d-4e88-aaae-2e0c138d049e     U  LO    E IR     O S1 47   77    OBSERVATION    Trogon s rr c ra Vieillot, 1 17        2496634     nimalia     hordata     ves    Trogoniformes    Trogonidae    Trogon    Trogon s rr c ra    1    44    212    1449    9356    2496633    2496634    BR    -22.432099    -44.615456    2010    8    1281996000000        Trogon s rr c ra         nimalia     hordata     ves    Trogoniformes    Trogonidae (Trogons)    Trogon    s rr c ra        -  .43        -44.61 4 6                    Rio de Janeiro         razil        Parq e Nacional do Itatiaia      1           17    Observation            1335710759000    1345327315000

603698777    4fa7b334-ce0d-4e88-aaae-2e0c138d049e     U  LO    E IR     O S 7  36      OBSERVATION    Trichothra pis melanops (Vieillot, 1 1 )        2488778     nimalia     hordata     ves    Passeriformes    Thra pidae    Trichothra pis    Trichothra pis melanops    1    44    212    729    9352    2488777    2488778    BR    -22.3799999    -42.5508857    2010    8    1281132000000            Trichothra pis melanops         nimalia     hordata     ves    Passeriformes    Thra pidae (Tanagers and  llies)    Trichothra pis    melanops        -  .37         -4 .      7                                    Rio de Janeiro         razil        Serra dos T canos-- amboo Trail      1            7    Observation            1335710763000    1345327317000

603698778    4fa7b334-ce0d-4e88-aaae-2e0c138d049e     U  LO    E IR     O S 7  7 6     OBSERVATION    Trichothra pis melanops (Vieillot, 1 1 )        2488778     nimalia     hordata     ves    Passeriformes    Thra pidae    Trichothra pis    Trichothra pis melanops    1    44    212    729    9352    2488777    2488778    BR    -22.3799999    -42.5508857    2010    8    1281132000000            Trichothra pis melanops         nimalia     hordata     ves    Passeriformes    Thra pidae (Tanagers and  llies)    Trichothra pis    melanops        -  .37         -4 .      7                                    Rio de Janeiro         razil        Serra dos T canos-- amboo Trail      1            7    Observation            1335710763000    1345327317000]]>
    


Author: kbraak@gbif.org
Created: 2013-09-25 09:54:43.373
Updated: 2013-09-25 09:54:43.373
        
Yet another example from Pedro:

Your download 0000250-130906152512535 is ready at the following address: http://api.gbif.org/occurrence/download/request/0000250-130906152512535.zip
    


Author: fmendez@gbif.org
Comment: http://code.google.com/p/gbif-occurrencestore/source/detail?r=2179
Created: 2013-09-25 14:26:45.238
Updated: 2013-09-25 14:26:45.238