HNHacker News
TopNewBestAskShowJobs

forkqueue

341 karma · joined February 4, 2009

Owner of Bashton Ltd, a firm specialising in Linux consultancy, with a particular emphasis on clustering.

If you've got a site you're struggling to scale, we can help. http://bashton.com/

submissionscomments
forkqueue··on Mammatus: Use DNS NS failover to create HA Web Service.
Two examples I've seen recently are Road Runner in the US and Virgin Media in the UK. There are many, many more.
forkqueue··on Mammatus: Use DNS NS failover to create HA Web Service.
The main issue with using DNS for failover is that the name servers of many major ISPs don't respect TTL values, particularly those under 3600 seconds.

As such, when a failover occurs a site will be unavailable for many viewers for several hours and possibly even days, making the solution anything but highly available.

forkqueue··on Facebook's DKIM RSA key should be crackable
Part of the reason small size keys like this are in common use is that bind (and possibly other name daemons) doesn't allow records larger than 255 characters. DKIM requires one to put the public key in DNS.

Earlier this week I set up DKIM, and initially tried and failed to use a 2048-bit key, because of this issue.

forkqueue··on If you were going to design a paywall, is this how you’d do it?
I hear it's solved all their scaling problems at one fell swoop ;)
forkqueue··on My Gmail is fast again
I think they swapped my account onto the old servers Gabe was on, because whilst mine was fast when I read the article, suddenly it's very slow (as in, 30 seconds to send an email slow).

I'd love to use Google Apps for my business, all employees already have Android phones so from that point of view it's a great idea. Things like this are what is stopping me from actually doing it.

That and I don't know if I could stand to be parted from mutt.

forkqueue··on Clustrix (YC W06) Builds the Webscale Holy Grail: A Database That Scales
I'm not sure the hardware is so custom - the pictures on the Clustrix site look very much like generic Supermicro x86 servers with a Clustrix logo stuck on them.
forkqueue··on Mozilla contains unidentified root certificates
That's not quite what it says - the one that wasn't covered by the most recent audit isn't a candidate for removal until 1/1/2012 at the earliest. The other certificate is completely unknown.

This thread gives more context:

http://groups.google.com/group/mozilla.dev.security.policy/b...

forkqueue··on VaultPress: WordPress backup service from Automattic
There's a good chance $30 pricing will be at least half as popular as $10.
forkqueue··on Solaris is no longer free
SystemTap is great for general system issues, but isn't nearly as good when trying to look at issues that occur inside the JVM.
forkqueue··on Solaris is no longer free
Solaris zones are awful, and a good example of where Linux is far superior to Solaris. The creators of Zones seemed to have user-mode-Linux as their model, and it shares most of the annoyances of that too. It's not virtualization, and it's not a jail - it's a middle ground which is good for neither.

Agree with you to some extent on stability - I've seen Solaris boxes with a load of 300+ still up and running although unusably slow, where Linux would almost certainly have died from resource starvation. In general use, both Linux and Solaris are pretty damn reliable though.

forkqueue··on Solaris is no longer free
Yup, DTrace and ZFS are pretty much the only things Solaris brings to the table above what Linux offers.

Interestingly I've never come across any pure Solaris shops that run ZFS, I suppose because if you're conservative enough only to use Solaris, you're too conservative to trust ZFS.

forkqueue··on Scaling MySQL to 700 million inserts per day
A couple of points for those thinking about doing something similar:

"Since InnoDB stores the table in the primary key, I decided that rather than use an auto_increment column, I'd cover several columns with the primary key to guarantee uniqueness. This had the added advantage that if the same record was inserted more than once, it would not result in duplicates."

The 'correct' way to deal with this in MySQL is using the auto_increment_increment.

http://dev.mysql.com/doc/refman/5.0/en/server-system-variabl...

Of course, the real difficulty with mutli-master setups split across data centres isn't ensuring uniqueness of primary keys, it's ensuring data-integrity under a split-brain scenario, i.e. where one server can't reach the other, but users can reach one or the other. UPDATEs and DELETEs to rows can then become extremely difficult to merge back together. This wasn't a problem for this application, but as others have commented, this use case probably wasn't best suited for an RDBMS anyway.

forkqueue··on Ask HN: how do you backup your servers?
duplicity is great for off-site backups - full encryption, supports a wide variety of destinations (amazon s3, FTP etc)
forkqueue··on StickyBits: Add a bar code based history to any physical object
Shame the Android app is Android 2.0+ only, which means I'm unable to try it with my Hero, at least for the moment.
forkqueue··on Eike Batista: Rich Man. Richest Man? - BusinessWeek
Is he related to Fulgencio Batista, former dictator of Cuba?

Wikipedia for once failed to enlighten me.

forkqueue··on Ask HN: How do I accept all major credit cards when not based in the US?
We're in the UK, so I don't know how applicable this is to Jamaica, but for http://kutoken.com/ we use HSBC Merchant processing to accept transactions in GBP, USD and Euro.

HSBC give us the option of having the funds deposited into HSBC accounts in those currencies, or converting to GBP (at our expense, not the customer's).

I'm very happy with this arrangement - it stops many customers from being put off by not knowing how much the service is going to cost them month to month, with the minimum of hassle for us.

forkqueue··on Virgin Media: 100Mbps access across entire network next year
Not true, 802.11n is widely available here.
forkqueue··on Open-Sourcing Traffic Server: 700k lines of code, 9 months
Will be interesting to see how this compare to the current king-of-caches, Varnish.

The plugin architecture looks like it'll make it pretty flexible, but it'll have to be pretty special to beat Varnish in terms of performance.

forkqueue··on Mnot/redbot @ GitHub
I get spurious error messages about the clock being incorrect on some sites - it will say it's in the future, but the time reported looks correct to me.
forkqueue··on Ksplice launches rebootless Linux update service - $4/server/mo
My first thoughts on reading this were that it was super-cool. Then I thought about customers who could benefit from it (we provide Linux consultancy to a number of medium-large enterprises), and I pretty much drew a blank.

If you're large enough for the downtime associated with a reboot to be a big issue then you've presumably already got a minimum of two machines performing the same function. That being the case, it's no problem to remove each node from the cluster in turn, upgrade the kernel, reboot, test and add it back in.

That rather makes the service more of a convenience. For example, for active/passive setups where a failover produces an undesirable amount of downtime (say 30 seconds whilst services migrate), or single server setups where uptime isn't critical, but downtime is still a pain.

Cool technology, but perhaps an example of a solution looking for a problem. I think at $4/month the convenience aspect can probably justify the cost in many cases.

forkqueue··on Going for a trot on the Django pony
Split database support is in Django 1.2 (currently in beta), so that's one con to scratch off the list.
forkqueue··on Verified by Visa and MasterCard SecureCode: or, How Not to Design Authentication
If you want to accept Maestro payments you have to implement 3DS or face a £25000 fine - at least in the UK.
forkqueue··on Don’t Hit It Big Unless You’re Ready For It…
Apachebench ships with Apache and can be used for simple testing.

http://httpd.apache.org/docs/2.0/programs/ab.html

For more realistic mutli-page tests Selenium works well - spin up a few EC2 or similar machines, run Selenium Grid and you can get a decent idea of how your site will cope.

For a simple Wordpress blog Apachebench should suffice though.

forkqueue··on Deploy your site without downtime using a web proxy written in node.js
If you're using Varnish for caching then it's also possible to serve 'stale' cache entries whilst the upgrade is being done.

I have a few customers that use this when doing schema changes. Obviously, this relies on cached data being useful for your site, but for many applications a stale cache is massively preferable to an error message.

http://varnish-cache.org/wiki/VCLExampleGrace

forkqueue··on Ask HN: I've built a product - how do I take payments in the UK?
I'm based in the UK, and we use HSBC for payment processing on http://kutoken.com/

The API documentation is a bit frustrating, but the service itself is good and gives you the option of recurring payments. We can also accept payments in multiple currencies, which a lot of customers appreciate - if you bill people in GBP but they have a dollar card, how much they actually pay is an unknown.

forkqueue··on Amazon S3: Versioning Beta Design
I use duplicity: http://www.nongnu.org/duplicity/
forkqueue··on Ask HN: What do you use for bookkeeping?
Another vote for xero.com

Used GnuCash for 5 years, and whilst it was OK, Xero is a hell of a lot nicer to deal with.

forkqueue··on Default HTTPS access for Gmail
Actually, not all email passes in plain text - a decent chunk (although doubtless a minority) uses SMTP over TLS.

Many servers have it configured, and if it's available on the destination almost all MTAs will use it to send mail to other servers, even if they don't support receipt of mail in this way.

forkqueue··on Ask HN: Found a smart competitor with a 3y headstart. What to do?
You already have a couple of clients prepared to pay for your software. If the 'three years ahead' competitor is so great, why aren't they using the competitor's product rather than yours?

It sounds to me like your competitor is targeting a different market to you, and picking up some of your target market as a happy accident. If you focus on the needs of your market, it becomes less and less likely that those sort of people will use your competitor's product.

I suspect the competitor is unlikely to care too much about your product - they'll see it as a 'low end' solution that only has the potential to take away customers they don't make much from anyway.

forkqueue··on VOIP + Cloud = Better Political Campaigns
Last time I tried using Asterisk on Amazon EC2 the call quality was pretty bad - presumably because Asterisk's timing was being messed up by the virtualisation.
← PreviousPage 2 of 4Next →