When I lost my previous server, I recreated my websites from a backup on a virtual machine running on an old laptop at home. After ironing out issues with the different software versions that worked well, but obviously this is not a great solution.
So as a permanent solution, I got a virtual private server over at transip. They're cheap and highly automated, so setting up and managing virtual server is really easy. I guess the fact that everything runs of off SSDs helps a lot, because my websites have never been faster.