webvet

> 150GB and 100M records is not huge, not even close.

Close to what, if I may ask?

>Database optimization needs to generally take into account YOUR data and usage patterns.

I'd say this is quite true.

>I've found that an unfortunate number of people aren't aware of "EXPLAIN" and its use to help figure out query issues. Learn and use it.

Yes, we discovered this some years ago.

Thanks for you input.

1) Yes, and no 2) Both (3 servers) 3) We've analyzed/optimized this to the max (of our abilities)

I believe we did tune and tweak the heck out of my.cfg, but will investigate thread_dcache_size all the same.

I also believe we're archiving at least some logs (and such) to flat files already, but will re-visit this soon too.

Thanks for all your input.

Thanks for your input - and no, we're not webvet.com

Hey, I'll have to check with the others here, but I think we have not been aware of 1. !!! Will certainly investigate this ASAP - thanks.

2. and 3. - already implemented to the max (of our abilities :)).

We did use a tool (perl script) called mysqltuner.pl on this sometime last year and it did give us some useful/actionable insight. Will check out what you've suggested too.

Thanks. :)

Development froze almost 2 years ago :) Since then, just the data volume keeps growing.

Will get the book and check out the blog soon. Thanks. :)

[1] Been doing already and [2] Will re-visit soon

Thanks :)

Thanks. 1) and 2) - we've done to the max. 4) already in place, with some differences.

Thanks - 4) has been on the cards, I just forgot to mention it.

Yes, we enable slow query logs from time to time, look at those and try to optimize for those. MyISAM tables.

We've been cycling frequently (and painfully) through (2) (and less frequently through (1)) for the best part of three years now, so please don't accuse us at least of looking for a quick fix :)

Please let me know what more info would be helpful and I'll be happy to provide the same.

Hey, thanks :) We are actually considering this, but it skipped my mind while making the post.

Let me try to answer: Slow - as in average Top loads (on CentOS) staying between 1 and 2 pretty much throughout the day; closer to 2 rather than to 1, peaking ALL the way up to 10 and even beyond several times a day, for periods as long as 15 to 30 minutes.

Storage engine: MyISAM

We don't have Memcache (or anything similar) presently, though I do believe we looked at it sometime last year. Will get a re-check done on this - thanks. :)

The primary reason we didn't use them was the lack of several features we needed.

We're not really concerned about the existing services adding the missing features - what we really wish to find out is whether or not there exist (at least a decent sized) market for such a service.

Nothing that we'd really know of, because we never actually used any. :)

Having said that, I must admit that we did study the specs of some of those and found a few gaps here and there (at least so far as our requirement was concerned).

To list a few off the top of my head:

1) Returning of http response codes 2) Following 300 class redirects 3) Control over exact pixel size of the images etc.

Nice idea - nice project. IMO, it could really thrive once it gets good traction - congrats.

One (small) suggestion: Change your tag line from: 'Build a Shyahi profile to showcase your developer contributions and social activity.' to: 'Showcase your developer contributions and social activity' and make it visible somewhere in the first screen-fold. HTH

Here is one that is almost 'Ready to Go'... HTH

http://openoffice.apache.org/get-involved.html

Yes, I'd be interested to hear about this too.

FWIW, here is a somewhat related, recent experience we've had:

During May/June this year we created a freeware app (for Win), made it available for download via our website and then used an auto-submitter to submit it (the PAD file) to a few hundred shareware/freeware download sites (in the hope of both - getting downloads and some link-love for SEO).

The App got listed on a good number of sites (with many linking to our site) and we've been receiving a decent number of downloads, but all those links appear to have done nothing as far as Google rankings are concerned.