Totally. One of my pet peeves is people who insist that "good design" has to have an emphasis on being pretty. Design is as much about function as it is form, and in the case of government sites, having easy navigation, accessibility and relevant content is far far more important than being pretty.
Sadly, most UK government sites are both ugly and horrible to navigate. Or at least that was the trend until recently, thankfully it seems some of those organisations are starting to re-fit their site.