An approach I really like is to run your blog software of choice locally, then rsync the generated flat files to a server. If you want comments, you'll need to maintain some dynamic component on the server, but it still massively reduces your exposure.
I've started using Jekyll + Disqus for simple things (see http://narwhaljs.org for an example).
Much less hassle than setting up a database, installing Wordpress (as easy as it is) and most of all remembering to update Wordpress every few weeks, as long as you don't need in-browser editing and such.