Process just stops sending messages.

[Mike Campbell]

We are on 5.7, on AIX.  We have an ADT input thread sending messages to 2 outbound threads.  It seems a couple times a week, the messages just stop processing.  I have alerts set up to monitor the last receive and last sent, but still working on those.  

I have to stop the ADT processes, then when I restart they don’t come back ‘on’.  I have to go to the /exec/processes/ADT folder and remove the wpid file.  Then when I do the restart all is good.  

The Cloverleaf Tech Support person mentioned that if the SMAT files got to large that could cause this issue.  Has anyone else run into this same issue?  

I’ve attached the log of the ‘PANIC’ messages.  Not really sure what all those message mean.  

Thanks, and I hope everyone has a great New Year.

Mike Campbell.

mike.campbell@nmhs.org

Topic

[Gary Atkinson]

Sounds like your process is not shutting down cleanly.  Normally when the process is shutdown the pid is also removed.  But, I have had cases where for example we lost power and the shutdown was not clean.  I would try running a site clean-up and see if that works.

[Ron Archambault]

Looks like you’re getting a sig 4, illegal instruction. Do you have the 20 or so lines of the log before the panic?

Also, have you check the shutdown blocks of any tcl procs you may be using on threads in this process?

[Mike Campbell]

I’ll attached additional log info. here.  Our process does a ‘cycle save’ and archiving of SMAT files around midnight.  The additional log info starts just before that, until the panic is thrown.

[Gary Atkinson]

Did you try the site cleanup?

[Mike Campbell]

Haven’t tried a site cleanup yet, and frankly not sure how to do that!  

Also, where can you reset the ftp_keepidle time?  I’m thinking that might reduce the engine idle messages in the log.

Thanks.

[Gary Atkinson]

Not sure about reducing the idle times in the log, but attached is the cleanup steps I use on 5.5.

[Mike Campbell]

Thanks Gary.  We are still fairly new on Cloverleaf and haven’t had all the ‘fun’ yet!

[Gary Atkinson]

I am still a noob too.  I have only been using CL for 2 years.  You will learn to love this forum!

[Author]

Replies