On the structure, thermodynamics and kinetics of phase stability: A microscopic theory