For one employer I wrote a ton of tools that used sqlite as an memory datastore for manipulating data. All of the tools were written in perl and I found that if the data had any complexity then you needed an expert perl coder to deal with the in-memory representation. However, if you simplified it down to a few SQL queries that updated/queried an sqlite database then even the most novice perl coder could use/maintain/enhance the tools. For really large datasets you could back the table with a file and get really good results - a lot of programmers can't deal with a dataset larger than core memory, sqlite handles it with ease.