If you have a safe backstop and there is no noise ordinance in the area you are within the law. But nowadays with so many anti-gun idiots on the loose you can expect this kind of thing to happen more often. When I was in Kodiak there was a rifle range (used by private citizens, the Coast Guard, and U.S. Navy SEALS) distant more than two miles as the crow flies from a small unincorporated community (lots of hippies, Greenies and potheads) outside the city limits--and people there were complaining about the noise!
Thank God no one has been complaining about my shooting crows from the window with a 12 gauge, here.