Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Checklistbank
    • Labels:

      Description

      After a new backbone is built a new dwc archive of the latest backbone needs to be created and placed under the currently registered endpoint: http://rs.gbif.org/datasets/backbone/backbone.zip

      Could be done by the nubchanged checklistbank cli that listens to BackboneChanged already and updates the sources network and nub dataset metadata

        Gliffy Diagrams

        Issue Links

          Activity

          Hide
          Markus Döring added a comment -

          It would be nice to have the regular dwca being the fully normalized file with all records.
          In addition to that the archive should have 3 extra files for spreadsheet users as this format has been often requested at the gbif helpdesk:

          • the normalized higher taxonomy down to families
          • list of all genera with their denormalised higher classification and familyID pointer
          • list of all species or infraspecific names with denormalized higher classification and genusID pointer
          Show
          Markus Döring added a comment - It would be nice to have the regular dwca being the fully normalized file with all records. In addition to that the archive should have 3 extra files for spreadsheet users as this format has been often requested at the gbif helpdesk: the normalized higher taxonomy down to families list of all genera with their denormalised higher classification and familyID pointer list of all species or infraspecific names with denormalized higher classification and genusID pointer
          Hide
          Markus Döring added a comment - - edited

          Keep archive and associated log and change files in a folder by date:
          /backbone_releases/2015-12-24

          Should we use HDFS for storing many copies?

          Show
          Markus Döring added a comment - - edited Keep archive and associated log and change files in a folder by date: /backbone_releases/2015-12-24 Should we use HDFS for storing many copies?
          Hide
          Markus Döring added a comment -

          the CLB admin cli now supports a manual dwca export command. I have used it to manually create a dwca copy of the current backbone and place it here: http://rs.gbif.org/datasets/backbone/ specifically http://rs.gbif.org/datasets/backbone/backbone-2016-04-13.dwca.gz

          Show
          Markus Döring added a comment - the CLB admin cli now supports a manual dwca export command. I have used it to manually create a dwca copy of the current backbone and place it here: http://rs.gbif.org/datasets/backbone/ specifically http://rs.gbif.org/datasets/backbone/backbone-2016-04-13.dwca.gz
          Hide
          Markus Döring added a comment -

          As we do not update the nub too frequently this can remain a slightly manual process of exporting the dwca and placing it on rs.gbif.org. The registered symlink http://rs.gbif.org/datasets/backbone/backbone-current.zip should always point to the recent copy

          Show
          Markus Döring added a comment - As we do not update the nub too frequently this can remain a slightly manual process of exporting the dwca and placing it on rs.gbif.org. The registered symlink http://rs.gbif.org/datasets/backbone/backbone-current.zip should always point to the recent copy

            People

            • Assignee:
              Markus Döring
              Reporter:
              Markus Döring
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: