Uploaded image for project: 'Portal'
  1. Portal
  2. POR-309

Create BackboneChangedMessage occurrence listener

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None

      Description

      When a new nub is build there are many tasks to be done afterwards that should be automated when a new BackboneChanged message is issued. Tasks to consider:

      • update/restart nub lookup
      • match all non nub checklists to the new nub via the lookup service
      • match all occurrences to the new nub via the lookup service
      • backfill all occurrence metrics
      • backfill all checklist metrics
      • backfill all density tiles

      Consider if this needs to be done while the/some indexing is offline or if we can run (some of) these tasks in parallel.

      As the incremental backbone changes will be rather small figure out if we can do an incremental update to occurrences and name usages easily. This is tricky because of changes in the taxonomic tree hierarchy effect the denormed classificaiton we store for nub matches in occurrences and name usages.

        Gliffy Diagrams

        Issue Links

          Activity

          Hide
          Markus Döring added a comment -

          Basic version exists for the clb-clis:
          https://github.com/gbif/checklistbank/tree/master/checklistbank-cli/src/main/java/org/gbif/checklistbank/cli/nubchanged

          it does the checklist matching and should build a new backbone dwca for download

          Show
          Markus Döring added a comment - Basic version exists for the clb-clis: https://github.com/gbif/checklistbank/tree/master/checklistbank-cli/src/main/java/org/gbif/checklistbank/cli/nubchanged it does the checklist matching and should build a new backbone dwca for download
          Hide
          Markus Döring added a comment -

          The occurrence manipulations that need to be part of the occurrence-clis will be implemented in the next iteration. The first backbone will trigger a manual update of the occurrences & cubes

          Show
          Markus Döring added a comment - The occurrence manipulations that need to be part of the occurrence-clis will be implemented in the next iteration. The first backbone will trigger a manual update of the occurrences & cubes
          Hide
          Markus Döring added a comment -

          we are unlikely to fully automate the nub build task in the near future

          Show
          Markus Döring added a comment - we are unlikely to fully automate the nub build task in the near future

            People

            • Assignee:
              Unassigned
              Reporter:
              Markus Döring
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: