Bug #3004

Fatal error in Zend_Search_Lucene - too many files open

Added by David Juhasz over 12 years ago. Updated almost 6 years ago.

Status:NewStart date:
Priority:LowDue date:
Assignee:-% Done:

0%

Category:-
Target version:-
Google Code Legacy ID:atom-1054 Tested version:
Sponsored: Requires documentation:

Description

To Reproduce:
1) Import the attached demo.xml EAD file
2) Click "view information objects"
3) "Delete" the top-level fonds archival description
4) Confirm the delete

Expected behaviour:
  • Top-level fonds and all children are deleted
Current behaviour:
  • see attached "Too_many_open_files_error.htm" error report

This is probably due to the following Zend_Search_Lucene bug:
http://framework.zend.com/issues/browse/ZF-6530

[g] Legacy categories: Search / browse

demo.xml Magnifier (26.6 KB) David Juhasz, 12/01/2012 01:26 AM

Too_many_open_files_error.htm Magnifier (1.15 KB) David Juhasz, 12/01/2012 01:26 AM

History

#1 Updated by David Juhasz over 12 years ago

  • Priority changed from High to Critical

Tested on Mac OSX 10.5.8 with MAMP.

[g] Labels added: Priority-Critical
[g] Labels removed: Priority-High

#2 Updated by David Juhasz over 12 years ago

  • Subject set to Fatal error in Zend_Search_Lucene trying to delete fonds - Mac OS X only
  • Priority changed from Critical to Medium

This works fine in Ubuntu 8.04 (Hardy Heron), and it sounds like the file limit is
system specific (see http://httpd.apache.org/docs/1.3/misc/descriptors.html) and
notoriously low in Mac OS X.

See http://forums.macosxhints.com/archive/index.php/t-28500.html for how to increase
ulimit for Mac OS X.

[g] Labels added: Priority-Medium
[g] Labels removed: Priority-Critical

#3 Updated by David Juhasz over 12 years ago

  • Target version set to Release 1.1

Bumped to Release 1.1

[g] Labels added: Milestone-Release-1.1

#4 Updated by David Juhasz over 12 years ago

  • Subject set to Fatal error in Zend_Search_Lucene - too many files open

Error occurs on data-load as well.

#5 Updated by David Juhasz over 12 years ago

  • Priority changed from Medium to High

Increase priority to "High"

[g] Labels added: Priority-High
[g] Labels removed: Priority-Medium

#7 Updated by Jesús García Crespo over 12 years ago

I am trying to import a big "migrated_data_v108.yml" file now. Its size is ~33MB.

propel:data-load have being running for a while (~30 minutes) and data/index directory contents more than
4500 files. "lsof -p PHP_PID" returns more than 20.000 opened files. Most of them are in data/index.

To handle this, as root user, I had to increase these limits as root:
sysctl -w kern.maxfiles = 225280
sysctl -w kern.maxfilesperproc = 204800

But check that your shell is not under lower limits. With bash:
ulimit -n (gets the value, 256 in my OSX system by default)
ulimit -n NEW_VALUE (<= kern.maxfiles)

#8 Updated by Jesús García Crespo over 12 years ago

I forgot to say that I am running OSX (Leopard).

#9 Updated by Anonymous almost 12 years ago

  • Priority set to Medium

[g] Labels added: Priority-Medium

#10 Updated by Evelyn McLellan over 11 years ago

  • Target version set to Release 1.2

Moved to 1.2.

[g] Labels added: Milestone-Release-1.2

#11 Updated by David Juhasz almost 11 years ago

  • Priority set to Low

[g] Labels added: Priority-Low

#12 Updated by David Juhasz over 10 years ago

  • Target version set to Release 1.3

Roll over to Release 1.3

[g] Labels added: Milestone-Release-1.3

#13 Updated by David Juhasz almost 10 years ago

Reassign to David's new account.

[g] New owner: David Juhasz

#14 Updated by David Juhasz almost 6 years ago

  • Assignee deleted (David Juhasz)

Also available in: Atom PDF