Java Errors since upgrading to 5.7 Rev 2

[Roger Reeves]

We have been getting quite a few of these errors in the client.  I really notice them when I’m doing alot of debuging in the testing tool.

Any idea what is happening?

Cannot run program “hcisitectl” (in directory “/quovadx/qdx5.7/integrator”): java.io.IOException: error=24, Too many open files

com.hie.util.process.ProcessExecException: Cannot run program “hcisitectl” (in directory “/quovadx/qdx5.7/integrator”): java.io.IOException: error=24, Too many open files

   at com.hie.util.process.BasicProcessMonitor.runProcess(Unknown Source)

   at com.hie.cloverleaf.configserver.LocalProcessMonitor.runProcess(Unknown Source)

   at com.hie.util.process.BasicProcessMonitor.runProcessAndWait(Unknown Source)

   at com.hie.cloverleaf.configserver.LocalProcessMonitor.runProcessAndWait(Unknown Source)

   at com.hie.cloverleaf.remoteserver.RemoteProcessMonitor.runProcessAndWait(Unknown Source)

   at sun.reflect.GeneratedMethodAccessor1826.invoke(Unknown Source)

   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

   at java.lang.reflect.Method.invoke(Method.java:597)

   at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)

   at sun.rmi.transport.Transport$1.run(Transport.java:159)

   at java.security.AccessController.doPrivileged(Native Method)

   at sun.rmi.transport.Transport.serviceCall(Transport.java:155)

   at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)

   at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)

   at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)

   at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)

   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

   at java.lang.Thread.run(Thread.java:619)

   at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:255)

   at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:233)

   at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:142)

   at com.hie.cloverleaf.remoteserver.RemoteProcessMonitor_Stub.runProcessAndWait(Unknown Source)

   at com.hie.cloverleaf.gui.netmon.LockMgrStatus.startDaemonServer(Unknown Source)

   at com.hie.cloverleaf.gui.netmon.LockMgrControl.startDaemonServer(Unknown Source)

   at com.hie.cloverleaf.gui.netmon.DaemonServerControl.actionPerformed(Unknown Source)

   at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:1995)

   at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2318)

   at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)

   at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)

   at javax.swing.AbstractButton.doClick(AbstractButton.java:357)

   at javax.swing.plaf.basic.BasicMenuItemUI.doClick(BasicMenuItemUI.java:1220)

   at javax.swing.plaf.basic.BasicMenuItemUI$Handler.mouseReleased(BasicMenuItemUI.java:1261)

   at java.awt.Component.processMouseEvent(Component.java:6041)

   at javax.swing.JComponent.processMouseEvent(JComponent.java:3265)

   at java.awt.Component.processEvent(Component.java:5806)

   at java.awt.Container.processEvent(Container.java:2058)

   at java.awt.Component.dispatchEventImpl(Component.java:4413)

   at java.awt.Container.dispatchEventImpl(Container.java:2116)

   at java.awt.Component.dispatchEvent(Component.java:4243)

   at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4322)

   at java.awt.LightweightDispatcher.processMouseEvent(Container.java:3986)

   at java.awt.LightweightDispatcher.dispatchEvent(Container.java:3916)

   at java.awt.Container.dispatchEventImpl(Container.java:2102)

   at java.awt.Window.dispatchEventImpl(Window.java:2440)

   at java.awt.Component.dispatchEvent(Component.java:4243)

   at java.awt.EventQueue.dispatchEvent(EventQueue.java:599)

   at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:273)

   at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:183)

   at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:173)

   at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:168)

   at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:160)

   at java.awt.EventDispatchThread.run(EventDispatchThread.java:121)

Topic

[David Barr]

I’d check to make sure that your host server is running as hci.

[Roger Reeves]

Its running as hci

[DJ Skalsky]

We ran into this problem on 5.7 rev2 on linux red had enterprise. While I can’t definitively say which fix really was the solution here are some of the things we did:

1. Increased max file size: fs.file-max=262144 in /etc/sysctl.conf

2. Increased semaphoresL kernel.sem=1000 128000 400 1024 in /etc/sysctl.conf

3. We have a multi-server configuration with global monitor. One of the upgrades (adding rev 2 onto 5.7) was corrupted. We reinstalled. This was more likely associated to our Java problems but could have been associated to the too many open files issue too.

[Roger Reeves]

Still seems to be occurring 🙁

[Jared Parish]

I’m also have received this error on multiple occasions.  Did you find a resolution?

Redhat 5.3

CL: 5.7Rev1

- Jared Parish

[Kannan Varadharajan]

Try upgrading to CIS 5.7 Rev 2.

[Author]

Replies