Log files will not cycle, Too big to open with Smat.

Why don’t you have Cloverleaf cycle them?

In the Network Configurator, choose Proces/Configure… from the menu. Now you can enable ‘Automatic Log Cycling’ per process and configure how large you want the specified log file to get.

If you do run into a smat file you can’t load. There is a script in the contrib directory that will take a smat file and convert it to a nl file.  “smat_to_nl” if I recall correctly.

So you can get to it that way, if needed. You will of course not have access to them to search or display in the SMAT tool.  But at least you can get to the message by using some other utilities that was giving you issues.

Thank You.

Hi Mike,

Good to hear that your problem is solved.

And I hadn’t noticed that you were talking about the SMAT files (msg and idx); thought you were trying to cycle the log files (log and err). So my advice concerned the log files, not the SMAT files.

Sorry for the confusion.

If you do run into a smat file you can’t load. There is a script in the contrib directory that will take a smat file and convert it to a nl file.

There are a number of unix editors ported to Windows that will load very large files.  Vim and Emacs will both open large files.  JEdit (you need a java runtime, but some versions come with it) will handle big files, and if you can find a PFE (Programmer’s File Editor) binary and your version of Windows is lower than Vista, that is a good option.

A Q&D script for just viewing .msg files (pick your language) reads in a few kilobytes, replaces xyzMSH| with xyznMSH|, and spits out all of the buffer up to the final “n”, then reloads the buffer with the un-spit-out stuff moved to the front.  If it weren’t big files you could just suck the whole thing in as a string (I routinely do this with 15M files, to make them easier to grep, but the machine I do it on has 6G RAM) and do the substitution all at once.

You really need the full smat_to_nl script for serious processessing, though.

Mike,

  If you want to keep your large file in a smat format for archiving but still readable, I wrote a script that will split a large smat file into multiple smat files.  Note that this was a quick and dirty script so all variables are hard coded but it’s pretty simple.

Hope it’s of use,

Hi Mike,

Good to hear that your problem is solved.

And I hadn’t noticed that you were talking about the SMAT files (msg and idx); thought you were trying to cycle the log files (log and err). So my advice concerned the log files, not the SMAT files.

Sorry for the confusion.

Is there a way within Cloverleaf to have the SMAT files automatically cycled?  Thanks.

Hi Mike,

Good to hear that your problem is solved.

And I hadn’t noticed that you were talking about the SMAT files (msg and idx); thought you were trying to cycle the log files (log and err). So my advice concerned the log files, not the SMAT files.

Sorry for the confusion.

Is there a way within Cloverleaf to have the SMAT files automatically cycled?  Thanks.

I don’t know of a way to automatically cycle them in cloverleaf except by size.  

At our site (AIX 5.2  CL 5.3r1) we use unix shell scripts and cron to cycle all our sites/threads and log files every 3 hours.  Then the .old files are moved to files with a time/date stamp in the name and then loaded into a mysql database.  I have a web tool that allows analysts to query the database and view or resend (testing only) the messages as desired.

I find that this keeps the smat files small and the database has the file name that the message is in so that it can be found quickly should it be needed.

I have to ask this.

Are you talking about Smat files.  ❓

Or are you talking about Engine output log files.

These are two different things. I see answers to both here. I can tell you with output log files go into netconfig at the top there is a tab called processes-> configure. You can set a size limit on the process log to that will automatically cycle them.

For SMAT in the contrib directory there is a perl script ( I don’t recall the name) that you can use to cycle smat files. Use it in conjunction with Cron and it will cycle smat files at that time.