Punch out the plastic bottom of the socket. You might be able to pry some of the old brass socket out of the bronze housing, but its probably fused in there. Have to grind it out.
I found some grinding attachments at the Dollar Store to use in a drill.
Or else they might have a dremel attachment of the right size, maybe something like this