Inbound FTP thread getting duplicates

[Tom Rioux]

We have an inbound FTP thread that is creating duplicate messages on the inbound transfer.  We are picking this up from an FTP server.  We have other threads that connect to this server but this thread seems to be the only one that is having an issue.   Here is a portion of the log file where it is creating the dups. It appears that the connection is getting terminated before the DELE command:

[fset:read:INFO/0:impac1_chg_in] Found EOF in impac1_chg_in-FTP-temp

[msg :Msg :DBUG/0:impac1_chg_in] [0.0.18357932] msgFree 0x30002628

[diag:leak:DBUG/0:impac1_chg_in] diag fd (IB)  free -1

[dbi :elog:DBUG/3:impac1_chg_in] [0.0.18357933] Looking for mid in error db

[dbi :rlog:DBUG/3:impac1_chg_in] [0.0.18357933] Looking for mid in recovery db

[msg :Mid :DBUG/3:impac1_chg_in] Assigned mid [0.0.18357933] to msg 30002628

[msg :Msg :DBUG/0:impac1_chg_in] [0.0.18357933] MSG alloc 0x30002628

[msg :Msg :DBUG/0:impac1_chg_in] [0.0.18357933] msgFree 0x30002628

[pd  :pdtd:INFO/1:impac1_chg_in] Set driver status to PD_STATUS_OPENING

[fset:open:INFO/1:impac1_chg_in] Opening control connection to vftp/ftp

[diag:leak:DBUG/0:impac1_chg_in] diag sock (FTP control) alloc 27

[fset:open:INFO/0:impac1_chg_in] Connected to vftp/ftp

[fset:cont:INFO/1:impac1_chg_in] Processing FTP ‘Response read setup’ control st

ate

[fset:cont:INFO/1:impac1_chg_in] Processing FTP ‘Read response’ control state

[fset:cont:DBUG/1:impac1_chg_in] Parsing ‘421 Terminating connection.

***Here is a portion of the log file once it finally does receive the DELE command:

[fset:read:INFO/0:impac1_chg_in] Found EOF in impac1_chg_in-FTP-temp

[msg :Msg :DBUG/0:impac1_chg_in] [0.0.18361716] msgFree 0x30003928

[diag:leak:DBUG/0:impac1_chg_in] diag fd (IB)  free -1

[dbi :elog:DBUG/3:impac1_chg_in] [0.0.18361717] Looking for mid in error db

[dbi :rlog:DBUG/3:impac1_chg_in] [0.0.18361717] Looking for mid in recovery db

[msg :Mid :DBUG/3:impac1_chg_in] Assigned mid [0.0.18361717] to msg 30003928

[msg :Msg :DBUG/0:impac1_chg_in] [0.0.18361717] MSG alloc 0x30003928

[msg :Msg :DBUG/0:impac1_chg_in] [0.0.18361717] msgFree 0x30003928

[fset:cont:INFO/1:impac1_chg_in] Processing FTP ‘Logged in’ control state

[fset:cont:INFO/1:impac1_chg_in] Processing FTP ‘Send CWD command’ control state

[fset:cont:INFO/1:impac1_chg_in] Processing FTP ‘Send DELE command’ control stat

e

[fset:cont:DBUG/1:impac1_chg_in] Setting up to send ‘DELE IMPAC_PROD_CHGS

‘

[fset:cont:INFO/1:impac1_chg_in] Processing FTP ‘Write command’ control state

[fset:cont:INFO/3:impac1_chg_in] Wrote 22 of 22 command characters

[fset:cont:INFO/1:impac1_chg_in] Processing FTP ‘Response read setup’ control st

ate

[fset:cont:INFO/1:impac1_chg_in] Processing FTP ‘Read response’ control state

[fset:cont:INFO/2:impac1_chg_in] 5 second select() awaiting response

[fset:cont:DBUG/1:impac1_chg_in] Parsing ‘250 DELE command successful.

If anyone has seen this before or have any idea what may be causing this, please contact me…Thanks…

Tom Rioux

Memorial Hermann Health Systems

713-448-5747

Topic

[Jim Kosloskey]

Tom,

My guess is the server disconnected the service (I seem to recall the 421 return code means this).

I think the service will need to look at their logs (or turn them on) in order to tell why.

The strange thing is it appears the service may have restarted. Maybe Cloverleaf(R) attempts to restart FTP under certain circumstances such as it can do with the real time protocols.

In any case, if the service restarted I guess it is possible it was restarted at the incorrect place.

Remember, the Fileset/FTP protocol has a file it uses to keep track of where it was in case it has a problem.

Thanks,

Jim Kosloskey

email: jim.kosloskey@jim-kosloskey.com 30+ years Cloverleaf, 60 years IT – old fart.

[Michael Hertel]

Just curious…

What version and platform of Cloverleaf are you using for this?

[Tom Rioux]

We are on Platform 5.2

[Tom Rioux]

What appears to be happening is that the thread is going into error status when it gets the disconnect.   The operators see this and bounce the thread.  Well, since the DELE command never completed successfully the previous time, when the thread is restarted, it picks up the file again.  

I will check with our network guys to see if there is any logging that can be turned on for that server.

[Tom Rioux]

The network admin guys checked the ftp server and it seems that the directory as well as the login had a timeout on it.   We have asked them to take that off and it appears to be working correctly now.

[Jim Kosloskey]

Tom,

Good news!

Jim Kosloskey

email: jim.kosloskey@jim-kosloskey.com 30+ years Cloverleaf, 60 years IT – old fart.

[Author]

Replies