The mantle plume hypothesis provides explanations for several major observations of surface volcanism. The dynamics of plumes with purely thermal origin has been well established, but our understanding of the role of compositional variations in the Earth's mantle on plume formation is still incomplete. In this study we explore the structures of plumes originating from a thermochemical boundary layer at the base of the mantle in an attempt to complement fluid dynamical studies of purely thermal plumes. Our numerical experiments reveal diverse characteristics of thermochemical plumes that frequently deviate from the classic features of plumes. In addition, owing to the interplay between the thermal and compositional buoyancy forces, the morphology, temperature, and flow fields in both the plume head and plume conduit are strongly time-dependent. The entrainment of the dense layer and secondary instabilities developed in the boundary layer contribute to lateral heterogeneities and enhance stirring processes in the plume head. Our models show that substantial topography of the compositional layer can develop simultaneously with the plumes. In addition, plumes may be present in the lower mantle for more than 70 million years. These features may contribute to the large low seismic velocity provinces beneath the south central Pacific, the southern Atlantic Ocean, and Africa. Our model results support the idea that the dynamics of mantle plumes is much more complicated than conventional thinking based on studies of purely thermal plumes. The widely used criteria for mapping mantle plumes, such as a vertically continuous low seismic velocity signature and strong surface topography swell, may not be universally applicable. We propose that the intrinsic density contrast of the distinct composition may reduce the associated topography of some large igneous provinces such as Ontong Java.