Capillarity can be used to direct anisotropic colloidal particles to precise locations and to orient them by using interface curvature as an applied field. Weshow this in experiments in which the shape of the interface is molded by pinning to vertical pillars of different cross-sections. These interfaces present well-defined curvature fields that orient and steer particles along complex trajectories. Trajectories and orientations are predicted by a theoretical model in which capillary forces and torques are related to Gaussian curvature gradients and angular deviations from principal directions of curvature. Interface curvature diverges near sharp boundaries, similar to an electric field near a pointed conductor.We exploit this feature to induce migration and assembly at preferred locations, and to create complex structures. We also report a repulsive interaction, in which microparticles move away from planar bounding walls along curvature gradient contours. These phenomena should be widely useful in the directed assembly of micro- and nanoparticles with potential application in the fabrication of materials with tunable mechanical or electronic properties, in emulsion production, and in encapsulation.