Dorset Police says officers discovered the suspected device at an address in Suffolk Avenue, Christchurch, shortly after 9.30am.
An Explosive Ordnance Disposal team has been called and a cordon remains in place as a precaution.
A number of nearby homes have been evacuated and the road has been closed.
A man has been arrested on suspicion of firearms offences and remains in police custody.
