Pneumonia is a lung condition that is rather prevalent and has the potential to be lethal. The early diagnosis of this disease is absolutely necessary to cut down on the number of fatalities. The aim of this research is to provide a decision-support tool that can help professionals in the field identify cases of pneumonia. The experimental studies used two publicly available datasets in the Kaggle repository. First, experiments were conducted with the pre-trained models. Then, hard and soft voting ensemble learning approaches were implemented using the five most successful deep learning models. According to the results, the soft voting approach outperformed others, with accuracies of 98.55% and 97.26% in two- and three-class datasets, respectively. With this result, a software included this approach has been developed to assist field experts in their decision-making.