Coupling of low-frequency electrostatic and electromagnetic modes in the presence of stationary dust in an electron-ion plasma is investigated. In the nonlinear case, dipolar vortex structures associated with these perturbations are studied. Comparisons with previous research are presented in several limiting cases, and it is pointed out that dipolar vortex structures seem to be a very common phenomenon in dusty plasmas. Relevance of this work to space and astrophysical plasmas is discussed.