Mason.
Jim has identified the issues you face.
As an alternative to Cloverleaf tables, we use TCL functions with arrays to load tables.
While we have not used this (we have used a similar approach for other issues) it is possible for a thread to detect the existence of a file and then perform an action.
The table code could be in a TCL translation and every time a test file exists, the table is loaded from a flat file (rather than a DB) and the test file is then removed.
A separate thread/process can create the table data and then create the test file when the table file is complete.