How do I make the background transparent?

The easiest, non-destructive way to do it would be with a layer mask. I'm trying to think of an easy way to make your mask, but I'm at work and don't have a copy of GIMP in front of me.

Maybe use the magic wand to select the background color, bucket fill that selection black on the mask and then touch up the edges by hand?