Classification of medical data is one of the most challenging pattern recognition problems. As stated in literature a single classifier is unable to solve all medical image classification problems due to high sensitivity to noise and other imperfections like data imbalance. So, several individual classifiers have been studied to solve the different types of classification problems arising in medical datasets but all have proven to be useful on some specific datasets. Hence, in this paper, we propose a generic multi-level classification approach for medical datasets using sparsity based dictionary learning and support vector machine approaches. The proposed technique demonstrates the following advantages: 1) gives better performance of classification accuracy over all datasets 2) solves imbalanced data problems 3) needs no fusion and ensemble methods in multi-level classification. The results presented on the 5 standard UCI medical datasets demonstrate that the efficacy of the proposed multi-level classification technique. © 2015 IEEE.