Taking the magnets out does make it a little bouncy. Some tourney series are turning a blind eye to this at the mo, and some still don't like it.
I think the stock magnet is too heavy (by some way), and the magnets in the VP Scythe trigger are FAR better - well, the wholoe trigger is. I have a magnet spare if you want it, you could replace the stock one with one of a lighter pull weight.
Or you could take the magnet out and buy the Blackheart board to dial out all the bounce