The most problem when applying deep learning algorithms to motor fault diagnosis and prediction is outlier data. In the previous studies, it is assumed that all states data for target motor exist in the big data set. However, this is data that is difficult to collect. This assumption for convenience of experimentation reduces the versatility of the system. To solve this problem, a CNN-based motor fault diagnosis and prediction system considering outlier data is proposed. In the proposed system, a diagnosis model using DT-CNN, an open set recognition technique capable of classifying outlier data, is used. Also, a prediction model that learns the RMSE pattern is used. The prediction model examines the similarity based on the outlier data classified in the diagnosis model. In order to develop the proposed system, a measurement environment based on LABVIEW is constructed. The possibility of using the CNN-based algorithm model is confirmed. Hyper-parameter optimization using genetic algorithms that help system learning and virtual data generation techniques using GAN algorithms are studied. The proposed system is constructed through the above studies. The robustness of the proposed system against transient disturbances is confirmed. In addition, the performance of motor aging diagnosis and failure prediction is evaluated. The proposed system is expected to help more general-purpose motor fault diagnosis and prediction.