I Just Bought Storage at $500/GB and Other Musings
marklogic.blogspot.com
marklogic.blogspot.com
Reminds me of a local company that was developing something similar, an "XML acceleration appliance" or something like that. The most notable fact about that company was that every single employee had a different version of what their product was actually doing. It was really bizarre. They had substantial funding, they had a brand, they were marketing the product and even managed to sell it, but every time they tried to explain the technical side of things it came out trivial. Don't know if they are still in business, but I wouldn't be surprised if they are.
At the very least, it's significantly less stupid than "XML acceleration". :-P
I'm thinking it's kinda a specialized object database for XML documents? Considering a lot of documents these days are ODF and MSOOXML, that might actually be an interesting technology.
MarkMail is indeed built on top of the MarkLogic native XML database and it works very well.
If anyone is interested, I already wrote up a bunch of my reactions to the article (good and bad) in tweets.
Storage-wise, it's often the case that the MLS DB for a project is actually the same size or smaller than the original data even after you add all of the indexes, etc.
Performance-wise, the MarkMail.org site is running a 4 node cluster. The cluster is totally managed by the ML server and is fully transactional across the cluster.
Feature-wise, the ML server provides all of the underlying goodies for doing not only the various text searches but also the slick faceted search.
http://en.wikipedia.org/wiki/DataPower
I suspect that Google Protocol Buffers, Thrift, etc. are sufficient workarounds for anyone who has a current need for one of these things. If you are using XML as your payload and worried about shaving off milliseconds of latency, then you've done the wrong thing. Perhaps large IT organizations are forced to suffer the consequences of vendor-provided interoperability schemes and buy products like this to make the best of a bad situation.
32,000 megabytes...document is less than one megabyte...it can fit at least 32,000 times.
Did I miss something?
I think the author missed reading his own writing :)
It's about 39000 times, not counting overhead for meta data and end-of-file slack.
It is amazing though, the speed with which the price of storage has come down. 10GHz processors are probably not going to happen, but I really won't be surprised if someone will offer a multiple terabyte solid state drive within a decade.
Not all that long ago I bought a 500 MB conner peripherals hard drive for about 1500$ and I wondered how we would ever fill that thing up...
I'll guess we will see them earlier. I already bought a 4 GB stick just a few months ago for less than ten Euro.