Cloverleaf 6 SMAT files forced .old rename

Clovertech Forums Read Only Archives Cloverleaf Cloverleaf Cloverleaf 6 SMAT files forced .old rename

  • Creator
    Topic
  • #53732
    Peter Heggie
    Participant

      We converted to Cloverleaf 6 about 6 weeks ago.

      We are encountering a problem several times a day where a smat file is open in the gui, and clicking on any command button at the bottom, or the file menu option, causes the smat files to be renamed to .old..

      A message box pops up that says “The SMAT index file is inconsistent with messages.” It lists three possible causes, however none of these causes has occured. It gives you the Yes or No option of re-opening the SMAT file. The renaming has already occured, so you have no control over the renaming. No one else had the file open. It is likely that new messages were written to the SMAT file while I had the file open in the gui, but that should not be a cause for this behavior.

      You must immediately go to the file system and rename the .old files to something else, because if it happens again to the same file, the previous .old files are overwritten and lost.

      We have in our Site Preferences the SMAT History option disabled. We run the cycle save script which works fine.

      Does anyone else have this problem and how did you overcome it?

      Peter Heggie

    Viewing 35 reply threads
    • Author
      Replies
      • #78745
        Mike Campbell
        Participant

          We are experience the exact same issue.  We haven’t found the cause or fix yet either.

          Mike C.

        • #78746
          Christopher Wells
          Participant

            Peter,

            Have you opened up a ticket with Infor support on this yet?  We’re planning to upgrade to 6.0 soon and are VERY interested to avoid this issue ourselves.  

            Also, for both of you, what platform/OS version are you running on?

            Thanks for the information,

            Christopher Wells

          • #78747
            Peter Heggie
            Participant

              I have not opened a ticket, but I will today or tomorrow. We are running on AIX 6.1 TL7.

              Peter Heggie

            • #78748
              Peter Heggie
              Participant

                I opened incident 6794724.

                Peter Heggie

              • #78749
                Peter Heggie
                Participant

                  This morning a set of smat files recycled to .old after one of our administrators performed a resend of messages. It appears that during this operation, or just after the operation, but before the smat file was closed, a new message came into the thread and was saved to the smat file. This may or may not have triggered the cycle save.

                  Also, I was asked to provide the settings in the Process Configuration gui. For this particular site, all processes do not have any functions selected or enabled, such as Automatic Smat Cycling.

                  I remember during the Inforum session in 2012 where enhancements and suggestions were discussed, mention was made about changing the accessibility of smat files, with attention focused on how multiple users or multiple updaters to the file were managed.

                  I have been told that in previous Cloverleaf versions, when a user has a smat file open and has edited a message, the updated message was saved in a .tmp file in the  integrator/temp directory. I am not seeing this so far in a small test I just tried. Did this mode exist for 5.8.4? If so, has it changed for 6.0?

                  That would imply that the user has their own copy of the smat file in a temp file, and a smat file is never locked by a user and only Cloverleaf processes update the file. Is this how it worked?

                  One possible conclusion is that this new automatic cycle save is the result of trying to protect the integrity of the smat file from multiple updates, by carving off the existing smat file into a .old and writing new incoming messages to the new smat file. This is just a theory.

                  Can someone shed light on how multiple user access is managed?

                  Peter Heggie

                • #78750
                  Mike Campbell
                  Participant

                    Peter, I was wondering if you heard anything back from Infor support on the SMAT file issue?  We would like to proceed with upgrading our Prod sites but would like to get this resolved first.

                    Thanks.  Mike C.

                  • #78751
                    Peter Heggie
                    Participant

                      yes we did hear back – we were asked to try setting the Process Configuration to enable Automatic Smat Cycling. I have enabled this today in our test environment for one of our processes; I should probably do it for all of them because we have not had a hit on the problem yet.

                      My guess is that the same underlying condition will still exist, that particular updates to a smat file while it is being used will cause an automatic cycle. With this option enabled, the cycle will result in the old smat file being written to the new smat sub-directory with a timestamp. This should resolve the lost data issue but may still be annoying in some ways.

                      I will wait until I see the behavior before posting more.

                      Peter Heggie

                    • #78752

                      Peter, do you have SmatHistory turned on in the Site Settings?

                      -- Max Drown (Infor)

                    • #78753
                      Peter Heggie
                      Participant

                        no we never have, but I have enabled it now in Test.

                        Peter Heggie

                      • #78754
                        Alice Kazin
                        Participant

                          I’ve seen this issue “cycle save”  occurring on Cloverleaf 5.8.5 on Linux.

                        • #78755
                          Bill Marsch
                          Participant

                            This issue first came about in 5.8.5 when there was an attempt to lock the smat file to a single user where before it was opened as read only to multiple uses.  You could toggle and edit the message and resend it with the only evidence of the edit was in the /hci/cis5.8/integrator/temp directory in a file named with a random name beginning with tmp.  It did not save the message you edited in smat as it does with this change.  You never know when the cycle happens. You can be in it perform various tasks get out back in then out again and back in an hour later and all of a sudden it cycles with out notification/error or any mention of it you only notice that it has 0 records or that it has 1 record.  Between the last time you got out and getting back in you do not know what happened to any and all messages between that time.  If they are lost that is critical, there is no way of knowing.

                          • #78756

                            Peter, R&D has been unable to reproduce this issue in-house. Would you be willing to do a webex issue with them so you can demonstrate the problem?

                            -- Max Drown (Infor)

                          • #78757
                            Peter Heggie
                            Participant

                              yes I’d be glad to; I’m on vacation, back on Wednesday.. maybe Thursday or Friday?

                              Peter Heggie

                            • #78758

                              From Cloverleaf R&D, This is a bug where the engine inconsistently uses upper- and lower-case in the encoding in the .ecd file while using a case-sensitive comparator.

                              They are working on a fix for a future patch.

                              -- Max Drown (Infor)

                            • #78759
                              Peter Heggie
                              Participant

                                Glad to hear they found something. I guess for now we will immediately copy the .old files to the ./Outboundsave directory with an appropriate suffix like ‘to_premise_ob.226.2.1.idx’.

                                Peter Heggie

                              • #78760
                                Donna Bailey
                                Participant

                                  Just started seeing this happen on a Windows server 2003 SP2 CL5.8.5.  Will there be a fix for 5.8?

                                  Donna

                                  Donna Bailey
                                  Tele: 315-729-3805
                                  dbailey@microstar.health
                                  Micro Star Inc.

                                • #78761
                                  Alice Kazin
                                  Participant

                                    Does Cloverleaf 6.0.1 include a patch for this SMAT cycle save issue?

                                  • #78762

                                    No, not in 6.0.1. Maybe in 6.1.

                                    -- Max Drown (Infor)

                                  • #78763
                                    Suzy Hoffman
                                    Participant

                                      What is the workaround for this bug?  We will not be able to upgrade to 6.1 so will need to manage this in 6.0 (on Windows OS).

                                      Thanks in advance.

                                    • #78764
                                      herm ernst
                                      Participant

                                        Also is there a work around for AIX 6.1?

                                        We are also contemplating an upgrade to v6 and are hoping a patch will be made available soon.

                                      • #78765

                                        According to R&D, this fix is scheduled for CIS 6.2 (AR 10093).

                                        -- Max Drown (Infor)

                                      • #78766

                                        R&D is trying to get this into CIS 6.1.1.

                                        -- Max Drown (Infor)

                                      • #78767
                                        Bob Richardson
                                        Participant

                                          Greetings,

                                          Max, the post history does not include exactly WHAT the bug is here.

                                          Please post what SMAT cycle bug is being discussed in this forum.

                                          Thank you.

                                        • #78768
                                          David Ma
                                          Participant

                                            Is there a patch for this SMAT cycle save issue now? we are using version 6.0.

                                          • #78769
                                            Jeff Dinsmore
                                            Participant

                                              Max:

                                              I have seen some anomalies with SMAT when multiple people are viewing saved messages for a thread.  Messages that should be there do not appear immediately in the SMAT.  I don’t *think* we’re losing any messages, but it’s making me nervous.

                                              Please confirm if this patch has been included in 6.1.1.  We are about 4 weeks from a big go-live and don’t want to be having problems with SMAT data disappearing.

                                              Jeff Dinsmore
                                              Chesapeake Regional Healthcare

                                            • #78770

                                              Checking with R&D …

                                              -- Max Drown (Infor)

                                            • #78771
                                              Alice Kazin
                                              Participant

                                                If you use the SMAT database instead of SMAT files, then you don’t have this issue.

                                              • #78772

                                                From R&D,

                                                This is expected and done to not degrade engine writes to smat. We use SQLite

                                                -- Max Drown (Infor)

                                              • #78773
                                                Jim Kosloskey
                                                Participant

                                                  Max,

                                                  That reply from R&D seems to be referencing SMATdb not traditional SMAT.

                                                  So is that in response to the originally reported issue involving traditional SMAT?

                                                  email: jim.kosloskey@jim-kosloskey.com 29+ years Cloverleaf, 59 years IT - old fart.

                                                • #78774

                                                  Yes, this response was for SMAT DB only.

                                                  -- Max Drown (Infor)

                                                • #78775
                                                  Jeff Dinsmore
                                                  Participant

                                                    I understand the WAL function of SQLite – and that all makes sense.

                                                    The issue I’m having is with SMAT files.

                                                    Let’s say I’m doing some testing.  I send a message from system X bound for System Y and I’m saving outbound messages on the thread to “Y”.  

                                                    I’m not always seeing a message in the SMAT file after I know it’s been sent to “Y”.  It may show up a minute later, maybe right away – it’s not entirely predictable.  There seems to be more frequent (apparent) write delays if more than one user is viewing data in a given SMAT.

                                                    This behavior is different than my experience with our current CL5.6 engines.

                                                    Our new engines are 6.1.1

                                                    Is CL 6.x not flushing the file handle(s) it’s has open to write to SMAT?  That might give a nominal improvement in speed, but would reduce usability dramatically – and could also expose the SMAT files to data loss if there’s a power failure or if an engine process is killed forcibly.

                                                    Thanks!

                                                    Jeff Dinsmore
                                                    Chesapeake Regional Healthcare

                                                  • #78776
                                                    Jim Kosloskey
                                                    Participant

                                                      This started out as a discussion about SMAT files (traditional) getting cycled when other actions are being selected in the SMAT GUI.

                                                      It appears this has been identified as a bug and the correction to exist in 6.1 or 6.2.

                                                      But then the discussion morphed to SMATdb.

                                                      So the question still remains (at least in my mind) wass the original bug fixed and in what release?

                                                      email: jim.kosloskey@jim-kosloskey.com 29+ years Cloverleaf, 59 years IT - old fart.

                                                    • #78777
                                                      aaron kaufman-moore
                                                      Participant

                                                        We experience some of that same strange SMAT behavior in our production system that is running 6.0.2 with the classic SMAT files.

                                                      • #78778
                                                        Peter Heggie
                                                        Participant

                                                          We still experience this issue from time to time in our production 6.0.2.1 environment.

                                                          Peter Heggie

                                                        • #78779
                                                          Ben Ware
                                                          Participant

                                                            We are seeing the random cycling in our new 6.1.2.0 (AIX7.1) test environment. It has happened to 7 smatdb files in the last 3 days.  Seeing other weird behavior that seems to be related to this too.  One of the smatdb files randomly cycled on Tuesday.  The new file had messages in it for Wednesday and no messages for today(Thursday) even though the thread statistics showed it should have 22 messages.  The file timestamp showed last activity from Wednesday.  I turned up the engine logging and bounced the process and voila, all of today’s messages wrote to the smatdb with the correct time saved timestamp from when the messages actually passed through the thread.

                                                          • #78780
                                                            Donna Bailey
                                                            Participant

                                                              So is there still a bug in CL6.1.2..I thought is we were using smatdb it was fixed???

                                                              Donna Bailey
                                                              Tele: 315-729-3805
                                                              dbailey@microstar.health
                                                              Micro Star Inc.

                                                          Viewing 35 reply threads
                                                          • The forum ‘Cloverleaf’ is closed to new topics and replies.