Bug #11534

CSV exports not working

Added by Mike Cantelon almost 2 years ago. Updated over 1 year ago.

Status:VerifiedStart date:09/19/2017
Priority:HighDue date:
Assignee:Dan Gillean% Done:

0%

Category:CSV export
Target version:Release 2.5.0
Google Code Legacy ID: Tested version:
Sponsored:No Requires documentation:No

Description

Likely due to our upgrade of Elasticsearch, the authority record CSV export is failing. This line in lib/job/arActorCsvExportJob.class.php generates an error:

$this->search = new arElasticSearchPluginQuery(1000000000);

If 1000000000 is reduced to 10000 then it'll work, but we'll likely have to add logic to deal with exporting greater than 10000 results.


Related issues

Related to Access to Memory (AtoM) - Task #11567: Update Elasticsearch deps to v5.3.0 Verified 09/29/2017

History

#1 Updated by Dan Gillean almost 2 years ago

  • Subject changed from Authority record CSV export not working to CSV exports not working

Just saw this on repository export as well via the user interface. I had 7 repositories added to the export via the clipboard in the UI. Failure message from the job details page:

[info] [2017-09-22 14:50:31] Job 2003034 "CSV export": Job started.
[info] [2017-09-22 14:50:31] Job 2003034 "CSV export": Starting export to downloads/jobs/d8d82be683cbe28869dacd1a3eee1edf.csv
[info] [2017-09-22 14:50:31] Job 2003034 "CSV export": Exception: Result window is too large, from + size must be less than or equal to: [10000] but was [1000000000]. See
 the scroll api for a more efficient way to request large data sets. This limit can be set by changing the [index.max_result_window] index level setting. [reason: all shards
 failed]

#2 Updated by Mike Cantelon almost 2 years ago

  • Related to Task #11567: Update Elasticsearch deps to v5.3.0 added

#3 Updated by Mike Cantelon almost 2 years ago

  • Assignee set to Nick Wilkinson

#4 Updated by Mike Cantelon almost 2 years ago

  • Requires documentation set to No

#5 Updated by Mike Cantelon almost 2 years ago

  • Status changed from New to In progress
  • Assignee changed from Nick Wilkinson to Mike Cantelon

Actually I think I'll fix a few other jobs affected by the same issue as part of the pull request.

#6 Updated by Mike Cantelon almost 2 years ago

  • Status changed from In progress to Code Review
  • Assignee changed from Mike Cantelon to Nick Wilkinson

#7 Updated by Nick Wilkinson almost 2 years ago

  • Assignee changed from Nick Wilkinson to Steve Breker

Hi Steve, assigning this to you for CR.

#8 Updated by Nick Wilkinson almost 2 years ago

  • Assignee changed from Steve Breker to Mike Gale

Sorry, reassigning to Mike G since he's already got #11567.

#9 Updated by Nick Wilkinson almost 2 years ago

  • Assignee changed from Mike Gale to José Raddaoui Marín

#10 Updated by José Raddaoui Marín almost 2 years ago

  • Status changed from Code Review to Feedback
  • Assignee changed from José Raddaoui Marín to Mike Cantelon

#11 Updated by Mike Cantelon almost 2 years ago

  • Status changed from Feedback to Code Review
  • Assignee changed from Mike Cantelon to José Raddaoui Marín

Hi Radda. I've incorporated your feedback and revised the branch.

#12 Updated by José Raddaoui Marín almost 2 years ago

  • Status changed from Code Review to Feedback
  • Assignee changed from José Raddaoui Marín to Mike Cantelon

#13 Updated by Mike Cantelon almost 2 years ago

  • Status changed from Feedback to QA/Review
  • Assignee changed from Mike Cantelon to Dan Gillean

Thanks Radda! This should fix all the export jobs (actor CSV, actor XML, description CSV, description XML, and repository CSV).

#14 Updated by Dan Gillean over 1 year ago

  • Status changed from QA/Review to Verified

Also available in: Atom PDF