Feature #13508

Integrate AtoM's CSV Validator into the Web UI

Added by Steve Breker 3 months ago. Updated about 1 month ago.

Status:QA/ReviewStart date:02/19/2021
Priority:MediumDue date:
Assignee:-% Done:

0%

Category:Import/Export
Target version:Release 2.7.0
Google Code Legacy ID: Tested version:
Sponsored:No Requires documentation:Yes

Description

AtoM's CSV Validator currently has an interface allowing it to be run from the CLI. Integrate the CSV Validator tool into AtoM's Web UI.

  • Add a new settings page in AtoM to set CSV Validation behaviour during import - can be OFF, Permissive, or strict.
  • New feature: allow user to trigger just the CSV Validation. This is a new BG task.
  • New feature: trigger CSV Validator during CSV import (depending on setting above).
  • Modify jobs result page to include CSV Validator results.

Supporting docs here:
https://drive.google.com/drive/u/1/folders/1VbvL4nJLAE7-KPFut11bIkN-XoGAjdjr

Permissive setting will allow import of CSVs that trigger CSV Validator warnings. Strict setting will prevent import of CSVs that trigger warnings. ERRORS always prevent CSV import via the web ui.


Related issues

Copied from Access to Memory (AtoM) - Feature #13475: Enhance AtoM's csv:check-import task to support pre-impor... QA/Review 02/19/2021

History

#1 Updated by Steve Breker 3 months ago

  • Copied from Feature #13475: Enhance AtoM's csv:check-import task to support pre-import validation added

#2 Updated by Steve Breker 2 months ago

  • Status changed from New to In progress

#3 Updated by Steve Breker about 1 month ago

  • Status changed from In progress to Code Review

Add logic to CSV import background job to run the validator prior to import if configured. Also adds a dedicated 'Validate CSV' task that can be run from the WebUI. Depending on 'permissive' or 'strict' setting, the validator results will prevent the import from proceeding. The verbose validator report will be zipped and linked as a download from the import and validate job results.

Ready for CR.

https://github.com/artefactual/atom/pull/1317

#4 Updated by Steve Breker about 1 month ago

  • Status changed from Code Review to QA/Review

Merged ready for QA.

Also available in: Atom PDF