Define continually updated.
Once per day, once an hour, indeterminate.
Will the extract build a true Cloverleaf lookup table with prologue, etc. or rather something like a CSV type file?
If a true Cloverleaf Lookup Table is being created, then you could schedule via your system scheduling tool a purge caches command for the thread(s) affected as often as you like. Otherwise you would need to schedule something that converts to a true Cloverleaf lookup table and purges the caches.
Take into consideration the impact on your system, etc. to have these caches continually purged.
Another option would be to investigate something like SqlLite.
You have probably already addressed this but yet another optin would be if the source system (where you are extracting from anyway) could provide the information you seek in the inbound message. Then you would only need a filtering proc.
Is the source of the information you need in an accessible DB – assuming it cannot be in the message. If so, another option could be to do an ODBC query of the DB as each message arrives to fill out the provided information.
I am sure there are other ways to handle this.
email: jim.kosloskey@jim-kosloskey.com 29+ years Cloverleaf, 59 years IT - old fart.