18084
Reporter: kbraak
Type: Bug
Summary: Validator must use latest extension versions
Priority: Blocker
Status: Open
Created: 2015-12-14 18:48:02.193
Updated: 2016-07-11 12:23:43.672
Description: Note this issue refers the online DwC-A validator: to http://tools.gbif.org/dwca-validator/
The problem is, that terms recently added to Darwin Core (such as dc:license and dwc:organismQuantity) are reported as Unknown terms (see screenshot).
The reason this happens when validating the meta.xml/Occurrence extension, is because it checks against an outdated version of the extension. Note http://rs.gbif.org/core/dwc_occurrence.xml has been replaced by a newer version: http://rs.gbif.org/core/dwc_occurrence_2015-07-02.xml
In fact, GBIF extensions and vocabularies are now versionable. For more information about the versioning policy for extensions and vocabularies, see here: https://github.com/gbif/rs.gbif.org/blob/master/versioning.md
Therefore to fix this problem, the validator should always try to validate the meta.xml against the latest version of each extension. Ideally, it should also report terms that have been deprecated (previously but no longer included in the extension).
]]>
Author: mdoering@gbif.org
Comment: The validator uses the json discovery files fron rs.gbif.ord. Do these always contain only the latest version?
Created: 2015-12-14 22:15:07.527
Updated: 2015-12-14 22:15:07.527
Author: kbraak@gbif.org
Comment: The json discovery files contain all registered extensions. Comparison by issued data must be done to determine the latest version.
Created: 2015-12-14 22:45:05.842
Updated: 2015-12-14 22:45:05.842
Author: mdoering@gbif.org
Created: 2015-12-15 09:23:05.194
Updated: 2015-12-15 09:23:51.721
That is a huge change impacting all applications using that list. The validator for sure must barf at that new list and probably just picks one more or less randomly.
Would it not have been better to keep a list of just the latest versions and maybe another full one for versioning aware apps?
Author: mdoering@gbif.org
Comment: This likely also effects the dwca-assistant
Created: 2016-02-24 16:11:02.758
Updated: 2016-02-24 16:11:02.758
Author: mblissett
Comment: I've made TOOL-6 for the assistant, since I've fixed the problem, although it will need a manual update for any future occurrence or taxon extension.
Created: 2016-02-24 17:07:47.419
Updated: 2016-02-24 17:07:47.419
Author: kbraak@gbif.org
Comment: As part of fixing this issue, we'll also need to fix the registered extensions page http://tools.gbif.org/dwca-validator/extensions.do (see attached screenshot). - Thanks Paco for reporting this.
Created: 2016-07-11 12:23:43.636
Updated: 2016-07-11 12:23:43.636
