Encrypted SQLite SMAT DB query performance

[Jeff Dinsmore]

I’m re-working some scripts that index SMAT files to use SMAT DB instead.

All preliminary work was done on a test, unencrypted SMAT DB and all worked fine.

Now that I have a pilot build that uses encrypted SMAT DB, it’s showing numbers that are 6-8 times slower.  That won’t get the job done.

Is anyone doing similar things with SMAT DB?

Are you seeing a substantial hit for queries into encrypted SQLite DBs?

Thanks,
Jeff.

Jeff Dinsmore
Chesapeake Regional Healthcare

Topic

[Max Drown (Infor)]

What is it you’re doing that is slower?

Are you using PRAGMA KEY to decrypt?

-- Max Drown (Infor)

[Jeff Dinsmore]

In a Tcl script – decrypting using the sqlite3 “-key” option when opening a SMAT DB file.

The script is doing simple queries.

such as:

select MIN(Time),MAX(Time) from smat_msgs

select MidDomain,MidHub,MidNum,Time,rowid from smat_msgs

These examples are regularly taking 300-500 milliseconds.

Combined processing time for indexing a SMAT DB file is in the neighborhood of a full second.

The prior code working with SMAT files runs in about a tenth of that time.

Thanks,
Jeff.

Jeff Dinsmore
Chesapeake Regional Healthcare

[Max Drown (Infor)]

How many records are in the db?

-- Max Drown (Infor)

[Author]

Replies