Oral production is an important part in English learning. Lack of a language environment with efficient instruction and feedback is a big issue for non-native speakers’ English spoken skill improvement. A computer-assisted language learning system can provide many potential benefits to language learners. It allows adequate instructions and instant feedback to the student, thus it facilitates self-study and encourages interactive use of the language. In this paper, we analyse Chinese college students’ speaking requirements first, and then based on these requirements and usability criteria, a detailed description of an oral skills development system is provided. In this system, supported by Automatic Speech Recognition technology, special interactive activities and feedback forms were designed and a prototype was set up and tested to verify the effectiveness of this proposal.