This study aims to classify rest and upper limb movements execution and intention using electroencephalogram (EEG) signals by developing machine-learning (ML) algorithms. Five different MLs are implemented, including k-Nearest Neighbor (KNN), Linear Discriminant Analysis (LDA), Naïve Bayes (NB), Support Vector Machine (SVM), and Random Forest (RF). The EEG data from fifteen healthy subjects during motor execution (ME) and motor imagination (MI) are preprocessed with Independent Component Analysis (ICA) to reduce eye-blinking associated artifacts. A sliding window technique varying from 1 s to 2 s is used to segment the signals. The majority voting (MV) strategy is employed during the post-processing stage. The results show that the application of ICA increases the accuracy of MI up to 6%, which is improved further by 1-2% using the MV (p<0.05). However, the improvement in the accuracies is more significant in MI (>5%) than in ME (<1%), indicating a more significant influence of eye-blinking artifacts in the EEG signals during MI than ME. Among the MLs, both RF and SVM consistently produced better accuracies in both ME and MI. Using RF, the 2 s window size produced the highest accuracies in both ME and MI than the smaller window sizes.