Handle non Linnean inter rank homonyms in nub lookup
10634
Reporter: mdoering
Assignee: mdoering
Type: NewFeature
Summary: Handle non Linnean inter rank homonyms in nub lookup
Priority: Critical
Status: Reopened
Created: 2012-01-16 12:39:56.178
Updated: 2016-04-14 11:23:29.834
Description: We are constantly encountering new, mainly inter rank homonyms which are not covered by IRMNG (which mostly focusses on the thousands of genus homonyms).
In order to deal with feedback in time we need a custom list of homonyms that we can manage ourselves.
For example the Radiolaria reported by Paco:
http://ecat-dev.gbif.org/usage/4298634]]>
Author: mdoering@gbif.org
Created: 2012-01-16 12:44:17.513
Updated: 2012-01-16 12:44:17.513
mostly Radiolaria is considered a subphylum:
http://ecat-dev.gbif.org/usage/109592134
But some occurrence records report it without a rank or classification:
http://data.gbif.org/occurrences/366298749/
So the trouble is even harder, as subphyla are not included in the nub and we therefore don't treat them as homonyms.
Maybe the homonym informer needs to know about any ranks, not only linnean?
Author: mdoering@gbif.org
Created: 2012-01-26 16:01:24.706
Updated: 2012-01-26 16:01:24.706
Reusing the ECAT provisional names list for homonyms:
http://code.google.com/p/gbif-ecat/source/browse/trunk/ecat-checklists/provisional_new_names.txt
Author: trobertson@gbif.org
Comment: Insecta map shows is not fixed. Reopening and pointing Paco Pando at this issue
Created: 2012-04-26 10:15:45.69
Updated: 2012-04-26 10:15:45.69
Author: mdoering@gbif.org
Created: 2012-04-27 22:48:27.867
Updated: 2012-04-27 22:48:27.867
The problem has resurfaced since we generate the higher taxonomy based on CoL alone again. Before we included names found in the provisional_new_names.txt, but now they are excluded.
WoRMS knows about the subphylum Radiolaria: http://ecat-dev.gbif.org/usage/109592134
Option 1) would be to include many more of such non linen rank names as "inter rank homonyms" and point them to the next higher, accepted linen rank taxon. That way the nub is aware of those homonyms and can disambiguate them if enough information is at hand or the nub lookup would return null if it can't. Those artificial "inter rank synonyms" need to be displayed carefully in web services and the portal - maybe even excluded altogether. The status exists already as we used this "hack" in older nubs already. Downside here is that we need to somehow filter the inter rank homonyms.
Option 2) is to only update the nub lookup and do a second check against all checklists when a name matches only as a monomial, not a bi or even trinomial. If we get a single hit with a monomial against the nub we can consult CLB for other usages of different ranks for the same name. This seems a good idea at first glance, but might be error prone when we get more and more checklists with lots of varying quality and treatments of the same name. Lots of higher taxa are considered to be different ranks across checklists.
Option 3) include the inter rank homonyms in the homonym informer - this actually *should* already be the case. Need to investigate why this is failing right now...
Author: mdoering@gbif.org
Created: 2012-04-27 22:49:28.08
Updated: 2012-04-27 22:49:28.08
A nub look up for Radiolaria without any further hint returns the insect synonym genus as of April 2012:
http://cache.gbif.org/ws-nub/nub?name=Radiolaria
Author: mdoering@gbif.org
Created: 2012-05-23 15:41:22.228
Updated: 2012-05-23 15:50:01.915
To give an idea on the data available to solve the Radiolaria problem, here are all current CLB usages that have Radiolaria as their canonical name:
{noformat}
id |checklist| scientific_name | rank | synonym/status| kingdom | phylum | class | order | family | genus
----------+---------+-----------------------------+-----------+---------------+-----------+------------+---------------+-------------+------------+-----------
4298634 | 1 | Radiolaria Provancher, 1886 | genus | t synonym | Animalia | Arthropoda | Insecta | Hymenoptera | Braconidae | Dacnusa
113452125 | 4 | Radiolaria Provancher, 1886 | genus | t synonym | Animalia | Arthropoda | Insecta | Hymenoptera | | Dacnusa
107209491 | 1012 | Radiolaria Provancher, 1886 | genus | t invalid | Animalia | Arthropoda | Insecta | Hymenoptera | Braconidae | Dacnusa
107209490 | 1012 | Radiolaria Provancher, 1886 | genus | t invalid | Animalia | Arthropoda | Insecta | Hymenoptera | Braconidae | Dacnusa
102866243 | 1037 | Radiolaria | genus | f | | | | | | Radiolaria
102320823 | 1037 | Radiolaria Provancher, 1886 | genus | f | Animalia | Arthropoda | Insecta | Hymenoptera | Braconidae | Radiolaria
107907271 | 1003 | Radiolaria J. Müller, 1858 | order | f | Animalia | Protozoa | Sarcodina | Radiolaria | |
107301032 | 1012 | Radiolaria | order | t invalid | Protozoa | Protozoa | Labyrinthulea | Radiolaria | |
107301031 | 1012 | Radiolaria | order | f valid | Protozoa | Protozoa | Labyrinthulea | Radiolaria | |
107730308 | 1013 | Radiolaria | class | f | | Actinopoda | Radiolaria | | |
113452126 | 4 | Radiolaria | subphylum | f accepted | Protozoa | | | | |
109592134 | 1007 | Radiolaria Muller, 1858 | subphylum | t unaccepted | Chromista | Radiozoa | | | |
106910450 | 1010 | Radiolaria | | t | | | | | |
110509263 | 1050 | Radiolaria | | f | | | | | |
110406200 | 1051 | Radiolaria (Müller, 1858) | | f | | | | | |
{noformat}
Author: mdoering@gbif.org
Created: 2012-05-23 16:16:56.754
Updated: 2012-05-23 16:17:44.132
more investigations into actual CLB data showing some other inter rank homonyms:
Many subgeneric variants for the same name:
{noformat}
scientific_name | count | distinct ranks
Abies Amabiles | 4 | section,series,subsection,subseries
Abies Balsamea | 6 | section,series,subgenus,subsection,subseries
Abies Bracteatae | 3 | series,subsection,subseries
Abies Cephalonicae | 4 | section,series,subsection,subseries
Abies Cilicicae | 3 | series,subsection,subseries
Abies Concolores | 3 | series,subsection,subseries
Abies Faxonianae | 3 | series,subsection,subseries
Abies Firmae | 4 | series,subsection,subseries
Abies Grandes | 4 | section,series,subsection,subseries
Abies Homolepides | 6 | section,series,subsection,subseries
{noformat}
10 higher potential inter rank homonyms, but not all have non linnean ranks that are causing the trouble:
{noformat}
scientific_name | count | distinct ranks
Acarina | 5 | genus,order,subclass
Acoela | 11 | class,order,phylum,subphylum
Acrania | 6 | genus,phylum,subphylum
Aculeata | 8 | family,genus,infraorder,suborder
Amphisbaenia | 6 | family,infraorder,order,suborder,supragenericname
Anomalodesmacea | 4 | order,subclass,superfamily
Anoplura | 11 | genus,order,suborder
Archaea | 12 | domain,genus,kingdom
Articulata | 14 | class,order,subclass,suborder
Ascophora | 21 | genus,infraorder,suborder
{noformat}
Author: mdoering@gbif.org
Created: 2012-05-23 17:26:09.01
Updated: 2012-05-23 17:26:09.01
Some more details for some of the above names:
NOTE: checklist 1=NUB, 3=IRMNG HOMONYMS, all other can be resolved via urls like ecat-dev.gbif.org/checklist/1013
*Blattaria*
{noformat}
id | checklist_fk | scientific_name | rank | is_synonym | status | kingdom | phylum | class | order | genus | species
-----------+--------------+----------------------------+----------+------------+----------+----------+---------------+---------------+-----------------+-----------+---------
102361307 | 1037 | Blattaria Voet, ?, 1806 | genus | f | | Animalia | Arthropoda | Insecta | Coleoptera | Blattaria |
3260789 | 1 | Blattaria Voet, ?, 1806 | genus | f | accepted | Animalia | Arthropoda | Insecta | Coleoptera | Blattaria |
102361247 | 1037 | Blattaria Weyenbergh, 1874 | genus | f | | Animalia | Arthropoda | Insecta | Orthoptera | Blattaria |
100489432 | 3 | Blattaria Weyenbergh, 1874 | genus | f | | Animalia | Arthropoda | Insecta | Orthoptera | Blattaria |
3259759 | 1 | Blattaria Weyenbergh, 1874 | genus | f | accepted | Animalia | Arthropoda | Insecta | Orthoptera | Blattaria |
100489445 | 3 | Blattaria Voet, ?, 1806 | genus | f | | Animalia | Arthropoda | Insecta | Coleoptera | Blattaria |
100489446 | 3 | Blattaria O. Kuntze, 1891 | genus | f | | Plantae | Magnoliophyta | Magnoliopsida | Malvales | Blattaria |
102361309 | 1037 | Blattaria P. Miller, 1754 | genus | f | | Plantae | Magnoliophyta | Magnoliopsida | Lamiales | Blattaria |
100489447 | 3 | Blattaria P. Miller, 1754 | genus | f | | Plantae | Magnoliophyta | Magnoliopsida | Lamiales | Blattaria |
3233430 | 1 | Blattaria P. Miller, 1754 | genus | f | accepted | Plantae | Magnoliophyta | Magnoliopsida | Scrophulariales | Blattaria |
3234036 | 1 | Blattaria O. Kuntze, 1891 | genus | f | accepted | Plantae | Magnoliophyta | Magnoliopsida | Malvales | Blattaria |
102361308 | 1037 | Blattaria O. Kuntze, 1891 | genus | f | | Plantae | Magnoliophyta | Magnoliopsida | Malvales | Blattaria |
102607183 | 1037 | Blattaria | genus | f | | | | | | Blattaria |
110855954 | 1056 | Blattaria | order | f | | Animalia | Arthropoda | Insecta | Blattaria | |
107654026 | 1013 | Blattaria | order | f | | Metazoa | Arthropoda | Insecta | Blattaria | |
107153443 | 1012 | Blattaria | suborder | f | valid | Animalia | Arthropoda | Insecta | Dictyoptera | |
{noformat}
*Coccidia*
{noformat}
id | checklist_fk | scientific_name | rank | is_synonym | status | kingdom | phylum | class | order | genus | species
-----------+--------------+----------------------------+----------+------------+---------------+-----------+-------------+-----------------+-------------------+--------------+---------
106387612 | 1010 | Coccidia | class | f | | | Apicomplexa | Coccidia | | |
113786198 | 1007 | Coccidiasina | subclass | f | accepted | Chromista | Myzozoa | Conoidasida | | |
107301102 | 1012 | Coccidia | subclass | f | valid | Protozoa | Protozoa | Sporozoa | | |
107907337 | 1003 | Coccidia Leuckart, 1879 | order | f | | Animalia | Protozoa | Sporozoa | Coccidia | |
105018711 | 10 | Coccidiascus | genus | f | accepted name | Fungi | Ascomycota | Saccharomycetes | Saccharomycetales | Coccidiascus |
100761550 | 1037 | Coccidiascus Chatton, 1913 | genus | f | accepted | Fungi | Ascomycota | Saccharomycetes | Saccharomycetales | Coccidiascus |
2599644 | 1 | Coccidiascus Chatton | genus | f | accepted | Fungi | Ascomycota | Saccharomycetes | Saccharomycetales | Coccidiascus |
102372903 | 1037 | Coccidia | genus | f | | Protista | Apicomplexa | Sporozoa | Neogregarinida | Coccidia |
4895097 | 1 | Coccidia | genus | f | accepted | Protozoa | | Sporozoa | | Coccidia |
102638080 | 1037 | Coccidia | genus | f | | | | | | Coccidia |
102638081 | 1037 | Coccidiascus | genus | f | | | | | | Coccidiascus |
{noformat}
*Cornuta*
{noformat}
id | checklist_fk | scientific_name | rank | is_synonym | status | kingdom | phylum | class | order | genus | species
-----------+--------------+-----------------------------+-------+------------+---------------+----------+-------------------+---------------+------------+-----------------+---------
100480919 | 3 | Cornuta | class | f | | Animalia | Echinodermata | Cornuta | | |
102249254 | 1037 | Cornuta | class | f | | Animalia | Echinodermata | Cornuta | | |
102253172 | 1037 | Cornuta | order | f | | Animalia | Echinodermata | Stylophora | Cornuta | |
100481152 | 3 | Cornuta | order | f | | Animalia | Echinodermata | Stylophora | Cornuta | |
107665071 | 1013 | Cornuta | order | f | | Metazoa | Echinodermata | Stylophora | Cornuta | |
2023897 | 1 | Cornutalis Sakakibara, 1998 | genus | f | accepted | Animalia | Arthropoda | Insecta | Hemiptera | Cornutalis |
102252501 | 1037 | Cornutalis Sakakibara, 1998 | genus | f | | Animalia | Arthropoda | Insecta | Hemiptera | Cornutalis |
1142792 | 1 | Cornutaemospila Pic, 1927 | genus | f | accepted | Animalia | Arthropoda | Insecta | Coleoptera | Cornutaemospila |
105014338 | 10 | Cornutalis | genus | f | accepted name | Animalia | Arthropoda | Insecta | Hemiptera | Cornutalis |
101969302 | 1037 | Cornutaemospila Pic, 1927 | genus | f | | Animalia | Arthropoda | Insecta | Coleoptera | Cornutaemospila |
6172438 | 1 | Cornuta L. | genus | f | accepted | Plantae | Magnoliophyta | Magnoliopsida | Lamiales | Cornuta |
102238431 | 1037 | Cornutanna Haeckel, 1881 | genus | f | | Protista | Sarcomastigophora | Polycystina | | Cornutanna |
4889483 | 1 | Cornutanna Haeckel, 1881 | genus | f | accepted | Protozoa | Sarcomastigophora | Polycystina | | Cornutanna |
102643911 | 1037 | Cornutaemospila | genus | f | | | | | | Cornutaemospila |
102643913 | 1037 | Cornutanna | genus | f | | | | | | Cornutanna |
102643912 | 1037 | Cornutalis | genus | f | | | | | | Cornutalis |
{noformat}
*Filosa*
{noformat}
id | checklist_fk | scientific_name | rank | is_synonym | status | kingdom | phylum | class | order | genus | species
-----------+--------------+-----------------------+-----------+------------+----------+-----------+-------------------+------------+-----------------------+--------+---------
109533892 | 1007 | Filosa | subphylum | f | accepted | Chromista | Cercozoa | | | |
102545026 | 1037 | Filosa | class | f | | Protista | Sarcomastigophora | Filosa | | |
100533095 | 3 | Filosa | class | f | | Protista | Sarcomastigophora | Filosa | | |
109542145 | 1007 | Filosa incertae sedis | order | f | accepted | Chromista | Cercozoa | | Filosa incertae sedis | |
5429437 | 1 | Filosa Böttger, 1877 | genus | f | accepted | Animalia | Mollusca | Gastropoda | Stylommatophora | Filosa |
100472313 | 3 | Filosa Böttger, 1877 | genus | f | valid | Animalia | Mollusca | Gastropoda | Stylommatophora | Filosa |
100975156 | 1037 | Filosa Böttger, 1877 | genus | f | valid | Animalia | Mollusca | Gastropoda | Stylommatophora | Filosa |
102692725 | 1037 | Filosa | genus | f | | | | | | Filosa |
{noformat}
*Enteropneusta*
{noformat}
id | checklist_fk | scientific_name | rank | is_synonym | status | kingdom | phylum | class | order | genus | species
-----------+--------------+-------------------------------+--------+------------+---------------+----------+---------------+---------------+---------------+-------+---------
107907128 | 1003 | Enteropneusta Gegenbaur, 1870 | phylum | f | | Animalia | Enteropneusta | | | |
114323830 | 10 | Enteropneusta | class | f | accepted name | Animalia | Hemichordata | Enteropneusta | | |
277 | 1 | Enteropneusta Gegenbaur, 1870 | class | f | accepted | Animalia | Hemichordata | Enteropneusta | | |
107215858 | 1012 | Enteropneusta | class | f | valid | Animalia | Hemichordata | Enteropneusta | | |
102255623 | 1037 | Enteropneusta | class | f | | Animalia | Hemichordata | Enteropneusta | | |
111473300 | 3 | Enteropneusta | class | f | | Animalia | Hemichordata | Enteropneusta | | |
109583762 | 1007 | Enteropneusta Gegenbaur, 1870 | class | f | accepted | Animalia | Hemichordata | Enteropneusta | | |
113588961 | 1087 | Enteropneusta | class | f | | Animalia | Hemichordata | Enteropneusta | | |
107675462 | 1013 | Enteropneusta | class | f | | Metazoa | Hemichordata | Enteropneusta | | |
105920367 | 1010 | Enteropneusta | class | f | | Metazoa | Hemichordata | Enteropneusta | | |
109580707 | 1007 | Enteropneusta | order | f | accepted | Animalia | Hemichordata | Enteropneusta | Enteropneusta | |
109613497 | 1007 | Enteropneusta incertae sedis | family | f | accepted | Animalia | Hemichordata | Enteropneusta | | |
{noformat}
*Heteropoda*
{noformat}
id | checklist_fk | scientific_name | rank | is_synonym | status | kingdom | phylum | class | order | genus | species
-----------+--------------+----------------------------------------+-------------+------------+---------------+----------+------------+------------+-----------------+-----------------+---------
110869364 | 1056 | Heteropoda | order | f | | Animalia | Mollusca | Gastropoda | Heteropoda | |
107686719 | 1013 | Heteropoda | suborder | f | | Metazoa | Mollusca | Gastropoda | Neotaenioglossa | |
107286656 | 1012 | Heteropoda Lamarck, 1801 | superfamily | t | invalid | Animalia | Mollusca | Gastropoda | Neotaenioglossa | |
109553051 | 1007 | Heteropoda Lamarck, 1812 | superfamily | t | unaccepted | Animalia | Mollusca | Gastropoda | Littorinimorpha | |
2308978 | 1 | Heteropodarke Hartmann-Schroeder, 1962 | genus | f | accepted | Animalia | Annelida | Polychaeta | Phyllodocida | Heteropodarke |
107477570 | 1012 | Heteropodarke Hartmann-Schroeder, 1962 | genus | f | valid | Animalia | Annelida | Polychaeta | Aciculata | Heteropodarke |
109710066 | 1007 | Heteropodarke Pleijel, 1999 | genus | f | accepted | Animalia | Annelida | Polychaeta | Phyllodocida | Heteropodarke |
114382880 | 10 | Heteropodarke | genus | f | accepted name | Animalia | Annelida | Polychaeta | Phyllodocida | Heteropodarke |
101285069 | 1037 | Heteropodarke Hartmann-Schröder, 1962 | genus | f | valid | Animalia | Annelida | Polychaeta | Phyllodocida | Heteropodarke |
110731768 | 1040 | Heteropodagrion | genus | f | | Animalia | Arthropoda | Insecta | Odonata | Heteropodagrion |
104900604 | 10 | Heteropodagrion | genus | f | accepted name | Animalia | Arthropoda | Insecta | Odonata | Heteropodagrion |
1424363 | 1 | Heteropodagrion Selys, 1885 | genus | f | accepted | Animalia | Arthropoda | Insecta | Odonata | Heteropodagrion |
100505283 | 3 | Heteropoda Latreille, 1804 | genus | f | valid | Animalia | Arthropoda | Arachnida | Araneae | Heteropoda |
107407278 | 1012 | Heteropodagrion Selys, 1885 | genus | f | valid | Animalia | Arthropoda | Insecta | Odonata | Heteropodagrion |
2161605 | 1 | Heteropoda Latreille, 1804 | genus | f | accepted | Animalia | Arthropoda | Arachnida | Araneae | Heteropoda |
110855164 | 1056 | Heteropoda | genus | f | | Animalia | Arthropoda | Arachnida | Araneae | Heteropoda |
107890490 | 1031 | Heteropoda | genus | f | to determine | Animalia | Arthropoda | Arachnida | Araneae | Heteropoda |
102408054 | 1037 | Heteropoda Latreille, 1804 | genus | f | valid | Animalia | Arthropoda | Arachnida | Araneae | Heteropoda |
101809934 | 1037 | Heteropodagrion Selys, 1885 | genus | f | valid | Animalia | Arthropoda | Insecta | Odonata | Heteropodagrion |
104922583 | 10 | Heteropoda | genus | f | accepted name | Animalia | Arthropoda | Arachnida | Araneae | Heteropoda |
3242038 | 1 | Heteropoda Nuttall, 1834 | genus | f | accepted | Animalia | Chordata | Aves | | Heteropoda |
102408017 | 1037 | Heteropoda Nuttall, 1834 | genus | f | | Animalia | Chordata | Aves | | Heteropoda |
100505274 | 3 | Heteropoda Nuttall, 1834 | genus | f | | Animalia | Chordata | Aves | | Heteropoda |
105946632 | 1010 | Heteropodarke | genus | f | | Metazoa | Annelida | Polychaeta | Phyllodocida | Heteropodarke |
105981950 | 1010 | Heteropoda | genus | f | | Metazoa | Arthropoda | Arachnida | Araneae | Heteropoda |
{noformat}
*Xenarthra*
{noformat}
id | checklist_fk | scientific_name | rank | is_synonym | status | kingdom | phylum | class | order | genus | species
-----------+--------------+----------------------------------+------------+------------+----------+----------+------------+----------+------------+----------------+---------
106641650 | 1010 | Xenarthra | superorder | f | | Metazoa | Chordata | Mammalia | | |
111013750 | 1047 | Xenarthra | order | f | | Animalia | Chordata | Mammalia | Xenarthra | |
102249046 | 1037 | Xenarthra | order | f | | Animalia | Chordata | Mammalia | Xenarthra | |
100480906 | 3 | Xenarthra | order | f | | Animalia | Chordata | Mammalia | Xenarthra | |
107752832 | 1013 | Xenarthra | order | f | | Metazoa | Chordata | | | |
107363434 | 1012 | Xenarthra Cope, 1889 | order | t | invalid | | | | | |
107907919 | 1003 | Xenarthra Cope, 1889 | suborder | f | | Animalia | | Mammalia | Edentata | |
100482604 | 3 | Xenarthra Baly, 1861 | genus | f | | Animalia | Arthropoda | Insecta | Coleoptera | Xenarthra |
102278792 | 1037 | Xenarthra Baly, 1861 | genus | f | | Animalia | Arthropoda | Insecta | Coleoptera | Xenarthra |
5430855 | 1 | Xenarthra Baly, 1861 | genus | f | accepted | Animalia | Arthropoda | Insecta | Coleoptera | Xenarthra |
4760413 | 1 | Xenarthracella Laboissière, 1940 | genus | f | accepted | Animalia | Arthropoda | Insecta | Coleoptera | Xenarthracella |
102311277 | 1037 | Xenarthracella Laboissière, 1940 | genus | f | | Animalia | Arthropoda | Insecta | Coleoptera | Xenarthracella |
102937674 | 1037 | Xenarthra | genus | f | | | | | | Xenarthra |
102937675 | 1037 | Xenarthracella | genus | f | | | | | | Xenarthracella |
{noformat}
Author: mdoering@gbif.org
Created: 2012-05-23 17:32:25.603
Updated: 2012-05-23 17:32:25.603
We are getting to the conclusion that if no further (classification) hint is given in an occurrence record with a monomial only as the scientific name, there is hardly anything we can do which is trustworthy. It might be best to not match those records to anything at all.
Tagging datasets with a shared classification context might in a second step increase the number of matches again.