[Prophet] Indexing and facet retrieval

[Simon Wistow]

Having picked some low hanging fruit with config file aliases and 
caching upstream repository names I'm casting around furtively for 
bigger projects.

One thing Jesse talked about was better retrieval of Record, potentially 
using some sort of inverted index.

The advantage of this is that you can have a generic object store yet 
still have fast retrieval from arbitary 'columns'

Funnily enough the Lucene mailing list has been talking about this too 
over the last couple of days.

http://www.nabble.com/Using-lucene-as-a-database...-good-idea-or-bad-idea--to18703473.html

I think possibly you don't strictly *need* some of the stuff from more 
normal search engines - you need to tokenise some fields but you don't 
necessarily need to stem. Scoring isn't necessarily a big deal - for 
most of the time it's just "Give me all records with all these words". 
That said - more traditional searching like FTS2 in SQLite would be 
interesting too.

Thoughts?

Simon