A short term solution is to go to a fabric store and buy a few yards of velcro. Simply put the loops on the exposed hooks, and away you go, you should be safe from snagging.
In the long term, you can swap packs. Or go find cotton jerseys that won't snag on velcro. But, they fade when you wash 'em, so it's a trade.
-Tyger