Issue 17260

Pensoft publishes same dataset twice

17260
Reporter: mdoering
Assignee: trobertson
Type: Bug
Summary: Pensoft publishes same dataset twice
Priority: Critical
Resolution: Fixed
Status: Closed
Created: 2015-02-19 11:58:43.334
Updated: 2015-07-20 14:43:01.962
Resolved: 2015-07-20 14:43:01.923
        
Description: At least for the Biodiversity Data Journal Pensoft publishes both a checklist dataset and an occurrence dataset based on the same data. The cehcklist also includes the exact same occurrences.

This is a duplication of the occurrences and we should delete all occurrence datasets that also have checklists with an occurrence extension. Also Pensoft needs to be notified to only publish checklists in the future.

Examples:
http://www.gbif.org/dataset/2e864ccb-74ab-4b09-9f40-d2d7d16dc254
http://www.gbif.org/dataset/d67cb7c8-9c55-4034-a3b9-5973efa445b3

0cf17b49-d15b-468b-be52-a092c12ae7ad: Neoniphon pencei, a new species of holocentrid (Teleostei: Beryciformes) from Rarotonga, Cook Islands
d314a5d4-ef46-465b-a008-00337afcd1f0: Neoniphon pencei, a new species of holocentrid (Teleostei: Beryciformes) from Rarotonga, Cook Islands

51ef1487-eed4-467e-9029-69c99ecd7123: Terrestrial gastropods of Srebarna Nature Reserve, North-Eastern Bulgaria (Gastropoda)
0aee2de1-e151-42ff-91ee-4bc66b4e3cbb: Terrestrial gastropods of Srebarna Nature Reserve, North-Eastern Bulgaria (
]]>
    


Author: ahahn@gbif.org
Comment: The email archive contains a related exchange in February 2015, proposing to delete the occurrence datasets at source and only keep the checklist dataset at source where both exist, but offering assistance with removal. The response suggests deletions would happen on our end, but require time for publisher review first. Follow-up mail sent 16.7.15 to inquire about status.
Created: 2015-07-16 16:04:43.347
Updated: 2015-07-16 16:04:43.347


Author: ahahn@gbif.org
Created: 2015-07-16 17:17:38.297
Updated: 2015-07-16 17:20:51.617
        
Agreed procedure:
- link the two data sets (mark the occurrence dataset as a duplicate of the checklist dataset)
- delete the occurrence record data sets so that the records are removed and only the checklist version shows up in lists and other aggregates. However, if someone already used the UUID of the occurence dataset, they could still find the deleted dataset with a note that it was removed as a duplicat of the checklist version.
Only one version of each occurrence record should be left, indexed from the checklist dataset.

concerned datasets:
|	OCCURRENCE UUIDs	|	corresponding CHECKLIST UUIDs	|
|	57523568-4931-402a-a490-e9514bbfb54e	|	c0306ec4-6f34-44a5-8fef-687ed876468c	|
|	4bde5856-6d9f-41cd-880a-2d64eac05b0d	|	4ad58f82-6f64-4c95-9471-6ed136668cb6	|
|	0cf17b49-d15b-468b-be52-a092c12ae7ad	|	d314a5d4-ef46-465b-a008-00337afcd1f0	|
|	51ef1487-eed4-467e-9029-69c99ecd7123	|	0aee2de1-e151-42ff-91ee-4bc66b4e3cbb	|
|	bbf2e576-f7bc-4092-a14a-e99e308e2810	|	21a4ef4f-d25f-428e-be15-03c3ef839942	|
|	c61fe2ab-980b-49eb-b701-f3eaebf05e1e	|	271fbd67-c524-4ffd-aefa-3a9188a63c60	|
|	6248b578-0e9d-4f15-b646-c9698fdc7558	|	ec60eeee-3fbe-425e-b10a-cbe54a05279f	|
|	ae90522a-a302-468f-b64c-3ea5c3ba994a	|	1fb89c2a-2c5c-4084-ae73-28cc753fe206	|
|	2a3c4bec-d3f6-4906-9999-f5b0a265d5de	|	530feb0e-61cd-4058-bb50-328e2230ea82	|
|	96b04524-65c4-4bbf-8e81-d6bb8d986d17	|	afd142ab-4a12-4ff9-b41f-abb59603f350	|
|	ac701e9a-df0a-4114-b702-9976ddec37c8	|	b83909b4-2562-41c4-a67e-1e191786ea0a	|
|	8f506017-9c2f-48b2-ab51-c53bd194cac0	|	f3a1e772-2b73-4375-9dd6-2ec4805856f2	|
|	e1ad3abd-9570-418f-9d8d-ecd8bd7436a2	|	de4ddd94-937b-4acc-9009-3d9e348c9ea1	|
|	2e864ccb-74ab-4b09-9f40-d2d7d16dc254	|	d67cb7c8-9c55-4034-a3b9-5973efa445b3	|
|	de355078-b3b7-4344-b5a2-8f3999b8c4a0	|	036ec3ff-7852-41ae-86ce-5abe097a6943	|
|	a28823ca-50a6-4716-adf8-adbf9a2e58e3	|	54bcd51c-1807-4ea9-9d73-4c04019a8282	|
|	e861ff23-01ec-4664-b635-adba4e5eb626	|	d3210a10-1449-4e51-a9c0-0cff2fafdd6e	|
|	99ae7b99-dd10-48f2-8102-c3f8683b3c6e	|	58744932-8838-4eae-adda-2b82dec3b264	|
|	d46ac697-0181-4d7f-ab0b-766fa5176ab5	|	8c48aedb-a93b-4a6e-acfe-8c0e75758f64	|
|	ffce9ad0-87dd-48a1-8d43-e2b3f1fafc3e	|	b1a45d42-f677-473b-93d1-f93b117efe1e	|
|	47ce9ad5-19ad-4166-ac0a-dbb02b5f1aa2	|	3a8a3458-675f-46f1-abbc-6e089059e5e8	|
|	a41be56f-a195-41fc-baf5-abd2018b94a8	|	e756296a-275f-4c05-af4c-3f244b78cfd1	|
|	60df8aae-3e33-4dae-8a42-126683e09e59	|	cd19892b-3d23-4af3-8ef6-b30e5dc41a7b	|
|	d3cae837-f8fd-4147-989f-738c8ca747ab	|	0f791b93-f49e-4500-b803-b97709e03fe2	|
|	a9e3239b-6226-4d26-9240-e6c20c9bd383	|	d9000678-9f65-48a9-891b-dd8e00b138ca	|
|	26a71adb-5f5a-443a-9e6f-5d8eef0d5745	|	5750f6b5-ffbe-4bb2-a943-86c5a7870f0d	|
|	7f8b1b4e-32c9-46fe-8520-4399bdb6e4b6	|	1e343fa3-d1cc-435b-b40b-ccbd7cfaa2cb	|
|	d8f69e3e-6271-4871-9207-9ad10933841c	|	312ddc7c-1f8e-4975-bf0b-833356ba0041	|
|	2e8b8a16-6c14-4821-9634-cc6cdd5b7c77	|	8fafef67-c923-435d-b74f-b5c4d5b4d7d5	|
|	b2ae8929-4b97-4356-b3c9-c25e01218bb3	|	38b7571b-5011-49ed-a157-d07330a84836	|
|	5ed5f820-2391-495a-bf8b-706ddf4fb052	|	a015770c-a808-4211-a6ba-4d29b6176976	|
|	25a9ede2-5a97-4a80-b44c-ae9d21e01bb2	|	80365675-8ac8-4f77-8969-f5cddc6a7400	|
|	56c3dc3d-dd4c-4b22-b5eb-4c1a8ed82322	|	abc084cd-d0b4-420a-98f9-4df66c867326	|
|	8c3a6513-1b3c-4a79-9d96-460a0a57f329	|	314ffb47-7e25-4f72-bf98-5f8cc7195f76	|
|	99ae7e90-b185-451c-bdc8-42fcc9ad6767	|	0f83e46d-1a5a-4d3b-97a4-6156b615f297	|
|	60538813-4292-4eb2-b35c-e1b0c6be11d0	|	aa5192d3-8c98-42aa-8ea6-c25b83ded118	|
|	5ce5ad1f-e7c6-41a7-9d32-cbbca7866426	|	41e719e4-15f2-4e25-9d97-647811680e08	|
|	41cb1252-f524-402c-be18-9b6b2f4e1dc5	|	bb6113e0-9d52-4828-b9a8-4a37c2d6e95d	|
|	0b87ed0f-05ee-468f-a63f-74b940278103	|	1bb01740-9d11-42b4-9536-9de9a87c8c5c	|
|	06bc2650-bea2-4d37-be2d-3c7b9e313b38	|	2ab222f2-2293-4398-9bdf-0223462d9399	|
|	12b52c47-8d72-4515-a755-721f2908d343	|	88ce1fb7-0566-4486-bd63-9c1fbc422b30	|
|	cbf608fc-58f6-45e1-ad71-116827d3dddf	|	8743becd-77f2-4982-a115-02f167f52cae	|
|	31b4021b-4b7f-410f-9aa3-3f61e8f97a90	|	580f0e0f-f68f-40a5-969c-d4881f9d7105	|
|	f9bb5b38-4c68-4a0a-9f91-54f1ea73efa9	|	0ee9877b-755d-4527-923e-5b848ea41eb6	|
|	2d11a934-b721-47f4-b97a-6f83b18f04d6	|	78f68965-9110-4c4c-bae8-cff085ac6b15	|
|	b32a1423-e25d-455e-a83e-ef0781864460	|	5d2cdc99-e29f-473b-a71c-9f3a211c5fed	|
|	6a771467-656b-44c2-b48e-53e27681f9de	|	4fbe8c40-8690-4b7e-99b1-60d5d90cab60	|
|	c96a046b-5628-4149-929b-24e471497e52	|	651c1377-8d3d-401f-a09d-03b834a989fb	|
|	05f5ac1a-857b-4c97-83b0-ead2ba741d13	|	0cda423c-7e01-45ee-927b-565794631cbe	|
|	6f2078e5-e24f-4c83-9efa-c889c7ee16f5	|	af26be01-b563-49a2-b71e-8adac2b83560	|
|	579196d1-e614-4545-9d37-a9bd363f9d90	|	0c5beccc-2e5d-4095-9a6a-92095ecd09d2	|
|	12047331-df95-4ba2-8579-afad850cc321	|	3d115034-84b5-47d0-a0c4-78722640684c	|
|	20274f22-5218-4c1f-b0cb-f9fd123454a4	|	c21fb84e-d228-46ec-a3a0-d90beedd3ea3	|
|	dea824ab-e751-41aa-9244-b296a04cabdd	|	2fad476b-71d3-4743-9ab5-b782693974f8	|
|	d6bbe9e9-5001-4dd0-919a-2d3bb1d946bf	|	914d133e-5cd4-4e3a-91a7-82c0da6c37c6	|
|	54dfe2b8-fe8a-44fb-8814-4be9ac39cbd3	|	c847dc2a-049b-442c-85ac-20c27cb4f634	|
|	6f5078d7-9d5c-4b3d-bfb9-b5f1d152d2c5	|	a5262686-e9bc-45b4-8b4f-ec2d2321bb3b	|
|	50127eb8-8191-41b0-bd64-cff773065b1b	|	0f7e074d-c7da-40c9-89a3-b9eef2007698	|
|	70fd2fd1-b2a7-49e0-b585-e519f38c88f4	|	1372b1bf-9c86-401e-ae32-d37d5a019652	|
|	dee7feb2-6d52-498c-aaee-2dc5e54a9a7c	|	da38edde-3b90-4d0e-8b46-e733c0ba1fe2	|
|	26079e48-a6cc-4c81-a595-d503bc1cde39	|	e0971ffe-6108-4a29-9007-d68a8eaa5b26	|
|	53cced00-bcc4-4155-a11e-b6299bd35b0d	|	8047c58c-c53a-4c05-b1a0-6d36f7dd1886	|
|	68d9d71a-c5d8-4b54-b0f4-02ef9ffa2e58	|	3b6eb0c3-6695-4869-80b8-910ac0fd6537	|
|	1e9159f5-6376-48e0-879b-22e207316a50	|	88bcfa1b-e4d5-4d52-9feb-2231e8f03ff7	|
|	f43a10ed-7048-43b0-95f8-8843586e206f	|	79411ac9-2bee-443b-970a-47197751c777	|
|	391ead57-b984-44b2-949c-9388032c5f28	|	15f4cb28-ede1-422c-a2d6-efbd43682c61	|
|	c51cfe39-a614-4b93-a477-2bc069d854c7	|	45d3bec7-9f30-480a-b935-44693d1dd86c	|
|	fe49d7cb-bee4-4c0f-af0b-abd55ed22bc5	|	f3a651ab-4ed4-4d7d-bc7c-94a4728a39a2	|
|	98b2a764-3d5f-478b-886d-663af4aec33a	|	43a2cf52-50a6-446c-a5b5-3c779f5c20c4	|
|	791058aa-6fbc-4204-a3e3-6cf2845a37d8	|	b0b2f281-7575-42de-b730-6dd364754062	|
|	70db7ba5-cf2d-4ceb-a4ff-94b46c0b87ac	|	a74431ec-9954-411a-801e-2acdb14caf93	|
|	da75248e-80c7-41e3-9a8c-e6f3b589b6ed	|	cc2cbf14-b5b0-414a-8f7f-7648e9e1bb2f	|
|	1984915f-ad90-4324-bd00-8f9656f9718e	|	27957fd4-1293-4907-be38-8578baca8368	|
|	e1b798dd-777f-47b3-801e-d8eec069044e	|	d30a4943-1366-49eb-b781-9429528d5929	|
|	efd55192-66d0-442c-bcd5-f47fbd0149d3	|	fea6b5c8-64bc-4fb9-8c36-bb4088f99e37	|
|	971467d5-9a24-4bd3-9dde-43023757897a	|	dca8f64a-9e26-417c-b08b-c08644ab28f2	|
|	500b0073-25c8-4d66-b15d-7e2bfd2c0995	|	f20127d1-663b-4a06-9c68-dc11c5af307e	|
|	58f4f964-f429-47c8-a9f5-5e599e6a9704	|	d29a09f7-a402-4664-821c-fa0adf825dcf	|
|	4c046ce3-06c0-4021-a5a4-d7589a5e2911	|	9fdb7f3f-f307-4e0c-ad70-4a7fa9015388	|
|	5e2b6355-5100-429d-9fdc-bd9a59557ad0	|	e246c57f-4f47-40ff-917d-573a42f8bc26	|
|	ff92fce4-83c4-4d15-9200-17f3c1633f9f	|	dcb19e1f-ab7a-47af-a031-2ff3b9ccebb7	|
|	9da25030-6ce7-4d40-bd07-990214829e09	|	31b10f4d-944b-44cd-ae88-4ce5a68c4ee8	|
|	3e2334bf-06ca-45a7-b4a2-b9036716dd6a	|	8260db39-8776-4ad6-bd80-46e4e1168bf7	|
|	7e004437-22e2-46ee-8a61-90f502385c67	|	b3e96cd3-bb16-49d9-b49e-0c30c49f156d	|
|	178ee620-8b79-41e0-8f8a-10f126cf9d82	|	2aab0548-a9f9-4df2-9faf-ef90d2de7369	|
|	8a42cc7e-1ca1-40e3-8e88-9a5537534e2a	|	d5a08d01-4ac6-435e-8056-eb7e82a498b3	|
|	560d5829-0486-43e0-aacd-50ce05c325b6	|	0eef4aa0-c618-4f61-9844-1824ce24d29a	|
|	a40be991-192d-4425-9108-16be994e3dfb	|	bf35f7fe-b65f-4b95-b495-ea6eefb240bd	|
|	2f273802-694c-41c5-ac29-8f823e57a906	|	caaa6bf4-c6a1-4960-8b40-c817be0caaf0	|
|	9319f36b-a596-4644-a6e1-05a89bcb6895	|	e3f27685-1974-4cb9-9fb4-0b1f8e9430c4	|
|	e1749fd2-2625-4e4c-a785-2fbde73844c9	|	646dac25-158c-4b60-9410-df03b00d61cd	|
|	9a2af7f2-bf86-418c-9b87-1914824b0567	|	a6316c3b-6635-4404-aa6f-f300ebd70212	|



    


Author: trobertson@gbif.org
Created: 2015-07-20 11:34:26.979
Updated: 2015-07-20 14:42:57.68
        
Executed the following, reindexed all checklist datasets, and then triggered a dataset deletion in the occurrence store for the occurrence datasets and marked datasets as deleted

{code}
UPDATE DATASET SET duplicate_dataset_key='c0306ec4-6f34-44a5-8fef-687ed876468c' WHERE key='57523568-4931-402a-a490-e9514bbfb54e';
UPDATE DATASET SET duplicate_dataset_key='4ad58f82-6f64-4c95-9471-6ed136668cb6' WHERE key='4bde5856-6d9f-41cd-880a-2d64eac05b0d';
UPDATE DATASET SET duplicate_dataset_key='d314a5d4-ef46-465b-a008-00337afcd1f0' WHERE key='0cf17b49-d15b-468b-be52-a092c12ae7ad';
UPDATE DATASET SET duplicate_dataset_key='0aee2de1-e151-42ff-91ee-4bc66b4e3cbb' WHERE key='51ef1487-eed4-467e-9029-69c99ecd7123';
UPDATE DATASET SET duplicate_dataset_key='21a4ef4f-d25f-428e-be15-03c3ef839942' WHERE key='bbf2e576-f7bc-4092-a14a-e99e308e2810';
UPDATE DATASET SET duplicate_dataset_key='271fbd67-c524-4ffd-aefa-3a9188a63c60' WHERE key='c61fe2ab-980b-49eb-b701-f3eaebf05e1e';
UPDATE DATASET SET duplicate_dataset_key='ec60eeee-3fbe-425e-b10a-cbe54a05279f' WHERE key='6248b578-0e9d-4f15-b646-c9698fdc7558';
UPDATE DATASET SET duplicate_dataset_key='1fb89c2a-2c5c-4084-ae73-28cc753fe206' WHERE key='ae90522a-a302-468f-b64c-3ea5c3ba994a';
UPDATE DATASET SET duplicate_dataset_key='530feb0e-61cd-4058-bb50-328e2230ea82' WHERE key='2a3c4bec-d3f6-4906-9999-f5b0a265d5de';
UPDATE DATASET SET duplicate_dataset_key='afd142ab-4a12-4ff9-b41f-abb59603f350' WHERE key='96b04524-65c4-4bbf-8e81-d6bb8d986d17';
UPDATE DATASET SET duplicate_dataset_key='b83909b4-2562-41c4-a67e-1e191786ea0a' WHERE key='ac701e9a-df0a-4114-b702-9976ddec37c8';
UPDATE DATASET SET duplicate_dataset_key='f3a1e772-2b73-4375-9dd6-2ec4805856f2' WHERE key='8f506017-9c2f-48b2-ab51-c53bd194cac0';
UPDATE DATASET SET duplicate_dataset_key='de4ddd94-937b-4acc-9009-3d9e348c9ea1' WHERE key='e1ad3abd-9570-418f-9d8d-ecd8bd7436a2';
UPDATE DATASET SET duplicate_dataset_key='d67cb7c8-9c55-4034-a3b9-5973efa445b3' WHERE key='2e864ccb-74ab-4b09-9f40-d2d7d16dc254';
UPDATE DATASET SET duplicate_dataset_key='036ec3ff-7852-41ae-86ce-5abe097a6943' WHERE key='de355078-b3b7-4344-b5a2-8f3999b8c4a0';
UPDATE DATASET SET duplicate_dataset_key='54bcd51c-1807-4ea9-9d73-4c04019a8282' WHERE key='a28823ca-50a6-4716-adf8-adbf9a2e58e3';
UPDATE DATASET SET duplicate_dataset_key='d3210a10-1449-4e51-a9c0-0cff2fafdd6e' WHERE key='e861ff23-01ec-4664-b635-adba4e5eb626';
UPDATE DATASET SET duplicate_dataset_key='58744932-8838-4eae-adda-2b82dec3b264' WHERE key='99ae7b99-dd10-48f2-8102-c3f8683b3c6e';
UPDATE DATASET SET duplicate_dataset_key='8c48aedb-a93b-4a6e-acfe-8c0e75758f64' WHERE key='d46ac697-0181-4d7f-ab0b-766fa5176ab5';
UPDATE DATASET SET duplicate_dataset_key='b1a45d42-f677-473b-93d1-f93b117efe1e' WHERE key='ffce9ad0-87dd-48a1-8d43-e2b3f1fafc3e';
UPDATE DATASET SET duplicate_dataset_key='3a8a3458-675f-46f1-abbc-6e089059e5e8' WHERE key='47ce9ad5-19ad-4166-ac0a-dbb02b5f1aa2';
UPDATE DATASET SET duplicate_dataset_key='e756296a-275f-4c05-af4c-3f244b78cfd1' WHERE key='a41be56f-a195-41fc-baf5-abd2018b94a8';
UPDATE DATASET SET duplicate_dataset_key='cd19892b-3d23-4af3-8ef6-b30e5dc41a7b' WHERE key='60df8aae-3e33-4dae-8a42-126683e09e59';
UPDATE DATASET SET duplicate_dataset_key='0f791b93-f49e-4500-b803-b97709e03fe2' WHERE key='d3cae837-f8fd-4147-989f-738c8ca747ab';
UPDATE DATASET SET duplicate_dataset_key='d9000678-9f65-48a9-891b-dd8e00b138ca' WHERE key='a9e3239b-6226-4d26-9240-e6c20c9bd383';
UPDATE DATASET SET duplicate_dataset_key='5750f6b5-ffbe-4bb2-a943-86c5a7870f0d' WHERE key='26a71adb-5f5a-443a-9e6f-5d8eef0d5745';
UPDATE DATASET SET duplicate_dataset_key='1e343fa3-d1cc-435b-b40b-ccbd7cfaa2cb' WHERE key='7f8b1b4e-32c9-46fe-8520-4399bdb6e4b6';
UPDATE DATASET SET duplicate_dataset_key='312ddc7c-1f8e-4975-bf0b-833356ba0041' WHERE key='d8f69e3e-6271-4871-9207-9ad10933841c';
UPDATE DATASET SET duplicate_dataset_key='8fafef67-c923-435d-b74f-b5c4d5b4d7d5' WHERE key='2e8b8a16-6c14-4821-9634-cc6cdd5b7c77';
UPDATE DATASET SET duplicate_dataset_key='38b7571b-5011-49ed-a157-d07330a84836' WHERE key='b2ae8929-4b97-4356-b3c9-c25e01218bb3';
UPDATE DATASET SET duplicate_dataset_key='a015770c-a808-4211-a6ba-4d29b6176976' WHERE key='5ed5f820-2391-495a-bf8b-706ddf4fb052';
UPDATE DATASET SET duplicate_dataset_key='80365675-8ac8-4f77-8969-f5cddc6a7400' WHERE key='25a9ede2-5a97-4a80-b44c-ae9d21e01bb2';
UPDATE DATASET SET duplicate_dataset_key='abc084cd-d0b4-420a-98f9-4df66c867326' WHERE key='56c3dc3d-dd4c-4b22-b5eb-4c1a8ed82322';
UPDATE DATASET SET duplicate_dataset_key='314ffb47-7e25-4f72-bf98-5f8cc7195f76' WHERE key='8c3a6513-1b3c-4a79-9d96-460a0a57f329';
UPDATE DATASET SET duplicate_dataset_key='0f83e46d-1a5a-4d3b-97a4-6156b615f297' WHERE key='99ae7e90-b185-451c-bdc8-42fcc9ad6767';
UPDATE DATASET SET duplicate_dataset_key='aa5192d3-8c98-42aa-8ea6-c25b83ded118' WHERE key='60538813-4292-4eb2-b35c-e1b0c6be11d0';
UPDATE DATASET SET duplicate_dataset_key='41e719e4-15f2-4e25-9d97-647811680e08' WHERE key='5ce5ad1f-e7c6-41a7-9d32-cbbca7866426';
UPDATE DATASET SET duplicate_dataset_key='bb6113e0-9d52-4828-b9a8-4a37c2d6e95d' WHERE key='41cb1252-f524-402c-be18-9b6b2f4e1dc5';
UPDATE DATASET SET duplicate_dataset_key='1bb01740-9d11-42b4-9536-9de9a87c8c5c' WHERE key='0b87ed0f-05ee-468f-a63f-74b940278103';
UPDATE DATASET SET duplicate_dataset_key='2ab222f2-2293-4398-9bdf-0223462d9399' WHERE key='06bc2650-bea2-4d37-be2d-3c7b9e313b38';
UPDATE DATASET SET duplicate_dataset_key='88ce1fb7-0566-4486-bd63-9c1fbc422b30' WHERE key='12b52c47-8d72-4515-a755-721f2908d343';
UPDATE DATASET SET duplicate_dataset_key='8743becd-77f2-4982-a115-02f167f52cae' WHERE key='cbf608fc-58f6-45e1-ad71-116827d3dddf';
UPDATE DATASET SET duplicate_dataset_key='580f0e0f-f68f-40a5-969c-d4881f9d7105' WHERE key='31b4021b-4b7f-410f-9aa3-3f61e8f97a90';
UPDATE DATASET SET duplicate_dataset_key='0ee9877b-755d-4527-923e-5b848ea41eb6' WHERE key='f9bb5b38-4c68-4a0a-9f91-54f1ea73efa9';
UPDATE DATASET SET duplicate_dataset_key='78f68965-9110-4c4c-bae8-cff085ac6b15' WHERE key='2d11a934-b721-47f4-b97a-6f83b18f04d6';
UPDATE DATASET SET duplicate_dataset_key='5d2cdc99-e29f-473b-a71c-9f3a211c5fed' WHERE key='b32a1423-e25d-455e-a83e-ef0781864460';
UPDATE DATASET SET duplicate_dataset_key='4fbe8c40-8690-4b7e-99b1-60d5d90cab60' WHERE key='6a771467-656b-44c2-b48e-53e27681f9de';
UPDATE DATASET SET duplicate_dataset_key='651c1377-8d3d-401f-a09d-03b834a989fb' WHERE key='c96a046b-5628-4149-929b-24e471497e52';
UPDATE DATASET SET duplicate_dataset_key='0cda423c-7e01-45ee-927b-565794631cbe' WHERE key='05f5ac1a-857b-4c97-83b0-ead2ba741d13';
UPDATE DATASET SET duplicate_dataset_key='af26be01-b563-49a2-b71e-8adac2b83560' WHERE key='6f2078e5-e24f-4c83-9efa-c889c7ee16f5';
UPDATE DATASET SET duplicate_dataset_key='0c5beccc-2e5d-4095-9a6a-92095ecd09d2' WHERE key='579196d1-e614-4545-9d37-a9bd363f9d90';
UPDATE DATASET SET duplicate_dataset_key='3d115034-84b5-47d0-a0c4-78722640684c' WHERE key='12047331-df95-4ba2-8579-afad850cc321';
UPDATE DATASET SET duplicate_dataset_key='c21fb84e-d228-46ec-a3a0-d90beedd3ea3' WHERE key='20274f22-5218-4c1f-b0cb-f9fd123454a4';
UPDATE DATASET SET duplicate_dataset_key='2fad476b-71d3-4743-9ab5-b782693974f8' WHERE key='dea824ab-e751-41aa-9244-b296a04cabdd';
UPDATE DATASET SET duplicate_dataset_key='914d133e-5cd4-4e3a-91a7-82c0da6c37c6' WHERE key='d6bbe9e9-5001-4dd0-919a-2d3bb1d946bf';
UPDATE DATASET SET duplicate_dataset_key='c847dc2a-049b-442c-85ac-20c27cb4f634' WHERE key='54dfe2b8-fe8a-44fb-8814-4be9ac39cbd3';
UPDATE DATASET SET duplicate_dataset_key='a5262686-e9bc-45b4-8b4f-ec2d2321bb3b' WHERE key='6f5078d7-9d5c-4b3d-bfb9-b5f1d152d2c5';
UPDATE DATASET SET duplicate_dataset_key='0f7e074d-c7da-40c9-89a3-b9eef2007698' WHERE key='50127eb8-8191-41b0-bd64-cff773065b1b';
UPDATE DATASET SET duplicate_dataset_key='1372b1bf-9c86-401e-ae32-d37d5a019652' WHERE key='70fd2fd1-b2a7-49e0-b585-e519f38c88f4';
UPDATE DATASET SET duplicate_dataset_key='da38edde-3b90-4d0e-8b46-e733c0ba1fe2' WHERE key='dee7feb2-6d52-498c-aaee-2dc5e54a9a7c';
UPDATE DATASET SET duplicate_dataset_key='e0971ffe-6108-4a29-9007-d68a8eaa5b26' WHERE key='26079e48-a6cc-4c81-a595-d503bc1cde39';
UPDATE DATASET SET duplicate_dataset_key='8047c58c-c53a-4c05-b1a0-6d36f7dd1886' WHERE key='53cced00-bcc4-4155-a11e-b6299bd35b0d';
UPDATE DATASET SET duplicate_dataset_key='3b6eb0c3-6695-4869-80b8-910ac0fd6537' WHERE key='68d9d71a-c5d8-4b54-b0f4-02ef9ffa2e58';
UPDATE DATASET SET duplicate_dataset_key='88bcfa1b-e4d5-4d52-9feb-2231e8f03ff7' WHERE key='1e9159f5-6376-48e0-879b-22e207316a50';
UPDATE DATASET SET duplicate_dataset_key='79411ac9-2bee-443b-970a-47197751c777' WHERE key='f43a10ed-7048-43b0-95f8-8843586e206f';
UPDATE DATASET SET duplicate_dataset_key='15f4cb28-ede1-422c-a2d6-efbd43682c61' WHERE key='391ead57-b984-44b2-949c-9388032c5f28';
UPDATE DATASET SET duplicate_dataset_key='45d3bec7-9f30-480a-b935-44693d1dd86c' WHERE key='c51cfe39-a614-4b93-a477-2bc069d854c7';
UPDATE DATASET SET duplicate_dataset_key='f3a651ab-4ed4-4d7d-bc7c-94a4728a39a2' WHERE key='fe49d7cb-bee4-4c0f-af0b-abd55ed22bc5';
UPDATE DATASET SET duplicate_dataset_key='43a2cf52-50a6-446c-a5b5-3c779f5c20c4' WHERE key='98b2a764-3d5f-478b-886d-663af4aec33a';
UPDATE DATASET SET duplicate_dataset_key='b0b2f281-7575-42de-b730-6dd364754062' WHERE key='791058aa-6fbc-4204-a3e3-6cf2845a37d8';
UPDATE DATASET SET duplicate_dataset_key='a74431ec-9954-411a-801e-2acdb14caf93' WHERE key='70db7ba5-cf2d-4ceb-a4ff-94b46c0b87ac';
UPDATE DATASET SET duplicate_dataset_key='cc2cbf14-b5b0-414a-8f7f-7648e9e1bb2f' WHERE key='da75248e-80c7-41e3-9a8c-e6f3b589b6ed';
UPDATE DATASET SET duplicate_dataset_key='27957fd4-1293-4907-be38-8578baca8368' WHERE key='1984915f-ad90-4324-bd00-8f9656f9718e';
UPDATE DATASET SET duplicate_dataset_key='d30a4943-1366-49eb-b781-9429528d5929' WHERE key='e1b798dd-777f-47b3-801e-d8eec069044e';
UPDATE DATASET SET duplicate_dataset_key='fea6b5c8-64bc-4fb9-8c36-bb4088f99e37' WHERE key='efd55192-66d0-442c-bcd5-f47fbd0149d3';
UPDATE DATASET SET duplicate_dataset_key='dca8f64a-9e26-417c-b08b-c08644ab28f2' WHERE key='971467d5-9a24-4bd3-9dde-43023757897a';
UPDATE DATASET SET duplicate_dataset_key='f20127d1-663b-4a06-9c68-dc11c5af307e' WHERE key='500b0073-25c8-4d66-b15d-7e2bfd2c0995';
UPDATE DATASET SET duplicate_dataset_key='d29a09f7-a402-4664-821c-fa0adf825dcf' WHERE key='58f4f964-f429-47c8-a9f5-5e599e6a9704';
UPDATE DATASET SET duplicate_dataset_key='9fdb7f3f-f307-4e0c-ad70-4a7fa9015388' WHERE key='4c046ce3-06c0-4021-a5a4-d7589a5e2911';
UPDATE DATASET SET duplicate_dataset_key='e246c57f-4f47-40ff-917d-573a42f8bc26' WHERE key='5e2b6355-5100-429d-9fdc-bd9a59557ad0';
UPDATE DATASET SET duplicate_dataset_key='dcb19e1f-ab7a-47af-a031-2ff3b9ccebb7' WHERE key='ff92fce4-83c4-4d15-9200-17f3c1633f9f';
UPDATE DATASET SET duplicate_dataset_key='31b10f4d-944b-44cd-ae88-4ce5a68c4ee8' WHERE key='9da25030-6ce7-4d40-bd07-990214829e09';
UPDATE DATASET SET duplicate_dataset_key='8260db39-8776-4ad6-bd80-46e4e1168bf7' WHERE key='3e2334bf-06ca-45a7-b4a2-b9036716dd6a';
UPDATE DATASET SET duplicate_dataset_key='b3e96cd3-bb16-49d9-b49e-0c30c49f156d' WHERE key='7e004437-22e2-46ee-8a61-90f502385c67';
UPDATE DATASET SET duplicate_dataset_key='2aab0548-a9f9-4df2-9faf-ef90d2de7369' WHERE key='178ee620-8b79-41e0-8f8a-10f126cf9d82';
UPDATE DATASET SET duplicate_dataset_key='d5a08d01-4ac6-435e-8056-eb7e82a498b3' WHERE key='8a42cc7e-1ca1-40e3-8e88-9a5537534e2a';
UPDATE DATASET SET duplicate_dataset_key='0eef4aa0-c618-4f61-9844-1824ce24d29a' WHERE key='560d5829-0486-43e0-aacd-50ce05c325b6';
UPDATE DATASET SET duplicate_dataset_key='bf35f7fe-b65f-4b95-b495-ea6eefb240bd' WHERE key='a40be991-192d-4425-9108-16be994e3dfb';
UPDATE DATASET SET duplicate_dataset_key='caaa6bf4-c6a1-4960-8b40-c817be0caaf0' WHERE key='2f273802-694c-41c5-ac29-8f823e57a906';
UPDATE DATASET SET duplicate_dataset_key='e3f27685-1974-4cb9-9fb4-0b1f8e9430c4' WHERE key='9319f36b-a596-4644-a6e1-05a89bcb6895';
UPDATE DATASET SET duplicate_dataset_key='646dac25-158c-4b60-9410-df03b00d61cd' WHERE key='e1749fd2-2625-4e4c-a785-2fbde73844c9';
UPDATE DATASET SET duplicate_dataset_key='a6316c3b-6635-4404-aa6f-f300ebd70212' WHERE key='9a2af7f2-bf86-418c-9b87-1914824b0567';
{code}