The machine I was running this website on wasn't handling the load too well. Had to rebuild. I had a server sitting around here, so I loaded it with freebsd, and put www.joelesler.net on it.
Now it works much better. Had to place it in the basement of the house though, it was kinda loud with all those fans running. Had to drill a hole in the floor of my office to get the Cat 6 cable through the floor, but all is well now.