I'm going to agree with MesaManBoogie on this one.
People are going to say **** like "Use protools, no use Logic, no use Cubase, no use Audition" until the cows come home. Despite my advice in another thread saying "use audition!!" lol... i would tell you to go for the Boss BR-900CD. You can plug your guitar straight into it and record with the COSM effects. Its not great, but its a very good start. All you do is set the drum machine (heaps of pre-programmed loops), hit record, and play along.
Once you get used to that go and buy a GOOD microphone, stand and lead. I seriously suggest an SM57. It is the greatest value for money you will ever buy. You could go with a condenser mic, but unless you are in a studio environment, the condenser is going to pick up someone mowing their lawn 10 houses down the road. Then you can mic up your guitar, and start to learn about mic placement and the effect that that has on your sound. It will teach you about the room acoustics a bit more too. However for heavy guitars, the best thing to do here is turn your amp up as loud as possible (without having the police pay you a visit) and turn the mic down as low as possible (whilst still getting a really strong signal). This will eliminate background noise and you'll get the best sound providing you have good mic placement.
Then if you want to get into editing, you can then go and download plenty of free programs. The reason why I like Audition (if you cant find audition, look for Cool Edit Pro) is because there is some really good stock standard effects in the program. Its really easy to use. You can burn a CD (i've never used a BR-900cd) and whack it into your computer. I have no idea if the tracks can be burnt individually?? Anyone???
If you want to advance further from there, then you can sell the Boss and buy a Presonus Firewire input and record directly into your computer. This is getting a little more complicated, but once you're more experienced, that's not a problem.
Its better not to jump straight into a fully fledged PC set-up because you'll be overwhelmed by it all. Just take it slow and grow your home recording set-up