Identifying a medical department based on unstructured data: A big data application in healthcare

Abstract

Health is an individual's most precious asset and healthcare is one of the vehicles for preserving it. The Indian government's spend on healthcare system is relatively low (1.2% of GDP). Consequently, Secondary and Tertiary government healthcare centers in India (that are presumed to be of above average ratings) are always crowded. In Tertiary healthcare centers, like AIIMS, patients are often unable to articulate correctly their problems to the healthcare center's Reception staff for these patients to be directed to the correct healthcare department. In this paper, we propose a system based on Big Data and Machine Learning to direct the patient to the most relevant department .We have implemented and tested parts of this system wherein a patient enters his symptoms and/or provisional diagnosis; the system suggests a department based on this user input. Our system suggests the correct department 68.05% of the time. Our system presently makes its suggestions using gradient boosting algorithm that has been trained using two information repositories-symptoms and disease data, functional description of each medical department. It is our informed assumption that, once we have incorporated medicine information and diagnostics imaging data to train the system and the complete medical history of the patient, performance of the system will improve significantly.