Feature #8764

Create meaningful order from DIP objects

Added by Sarah Romkey almost 7 years ago. Updated almost 6 years ago.

Status:VerifiedStart date:07/31/2015
Priority:MediumDue date:
Assignee:Sara Allain% Done:

0%

Category:Archivematica integration
Target version:Release 2.3.0
Google Code Legacy ID: Tested version:2.3
Sponsored:No Requires documentation:No

Description

This feature would alter the AtoM worker configuration so that DIP objects are uploaded in a meaningful order. It will not have any effect on trees that are sorted by Identifier or Title, but for manually sorted trees it will ensure the order of the digital objects is not random. At the moment, it is based on alphabetical order of the preservation objects including the prepended UUID... which is another way of saying "random".

In this order, DIP objects should be ordered:

1. Based on a logical structMap, if it exists.

2. If a logical structMap does not exist, the objects should be ordered based on the div Label, alphabetically.

The div label, unless altered manually, is the filename of the original. This allows users to control the sort order by naming their files using an alpha-numeric convention.

Note that there may be objects in the structMap that do not have an equivalent in the DIP (if for example, the transfer included an access folder). The atom-worker should ignore those objects and only look for filename equivalents, minus the extension, of the objects in the DIP. The user will need to ensure that every access object has a single preservation equivalent.

logicalStructMap.tar.gz (21.4 KB) Sara Allain, 06/14/2016 07:16 PM

History

#1 Updated by Sarah Romkey over 6 years ago

  • Project changed from AtoM Wishlist to Access to Memory (AtoM)
  • Category set to Archivematica integration
  • Assignee set to José Raddaoui Marín
  • Target version set to Release 2.3.0
  • Requires documentation set to No

#3 Updated by José Raddaoui Marín over 6 years ago

  • Status changed from New to Code Review

#4 Updated by José Raddaoui Marín over 6 years ago

  • Status changed from Code Review to QA/Review
  • Assignee changed from José Raddaoui Marín to Nick Wilkinson

Merged in qa/2.3.x. Commit 994056b

#5 Updated by Nick Wilkinson over 6 years ago

  • Assignee changed from Nick Wilkinson to Sarah Romkey

#7 Updated by Sarah Romkey about 6 years ago

  • Status changed from QA/Review to Feedback
  • Assignee changed from Sarah Romkey to José Raddaoui Marín

Hi Radda- I notice it's alphabetical now, but does ASCII sort order (numbers, capital letters, then lower case). This is ok but more ideally the capital and lower case would be mixed. Is this very complex to do? If so, that's fine, we can document the behaviour as it is.

#8 Updated by José Raddaoui Marín about 6 years ago

Sure Sarah, we can make that.

#9 Updated by José Raddaoui Marín about 6 years ago

  • Status changed from Feedback to Code Review
  • Assignee changed from José Raddaoui Marín to Jesús García Crespo

It looks like Github is not working very well now, I've made the changes over 'dev/issue-8764" but it doesn't appear in Github to create the PR. The only change is in the following line:

https://github.com/artefactual/atom/blob/qa/2.3.x/plugins/qtSwordPlugin/lib/qtPackageExtractorMETSArchivematicaDIP.class.php#L207

Using strcasecmp instead of strcmp.

Please, let me know if you think I should merge.

#10 Updated by Jesús García Crespo about 6 years ago

  • Status changed from Code Review to In progress
  • Assignee changed from Jesús García Crespo to José Raddaoui Marín

Go for it, please!

#11 Updated by José Raddaoui Marín about 6 years ago

  • Status changed from In progress to Deploy
  • Assignee changed from José Raddaoui Marín to Nick Wilkinson

Merged in qa/2.3.x. The AtoM worker needs to be restarted.

#12 Updated by Jesús García Crespo almost 6 years ago

  • Status changed from Deploy to QA/Review
  • Assignee changed from Nick Wilkinson to Sarah Romkey

#13 Updated by Sara Allain almost 6 years ago

  • Assignee changed from Sarah Romkey to Sara Allain

#14 Updated by Sara Allain almost 6 years ago

Everything looks good! Ran two tests on Archivematica 1.5/AtoM 2.3:

Standard DIP upload (SampleTransfers/Multimedia)
  • Expected order: alphabetical
  • Result: alphabetical
DIP upload with logical structmap (TestTransfers/logicalStructMap, also attached)
  • Expected order: as laid out in the mets_structmap.xml
  • Result: correct!

#15 Updated by Sara Allain almost 6 years ago

  • Status changed from QA/Review to Verified

Also available in: Atom PDF