It's illegal to fire a marker within 150 ft of a public highway........ so never mind your garden, some sites are illegal.....that's the law (just because it doesn't get enforced doesn't make it legal).
So if you fire it and your neighbours are peed off........expect a visit from the local constabulary.