Textile sensors for physiological signals bear the potential of unobtrusive and continuous application in daily life. Recently, textile electrocardiography (ECG) sensors became available which are of particular interest for physical activity monitoring due to the high effect of exercise on the heart rate. In this work, we evaluate the effectiveness of a single-lead ECG signal acquired using a non-medical-grade ECG shirt for human activity recognition (HAR). Healthy volunteers (N=10) wore the shirt during four different activities (sleeping, sitting, walking, running) in an uncontrolled environment and ECG data (256 Hz, 12 Bit) was stored, manually checked, and unusable segments (e.g. no sensor contact) were removed, resulting in a total of 228 hours of recording. Signals were split in short segments of different duration (10, 30, 60s), transformed using the Short-time Fourier Transform (STFT) to a spectrogram image and fed into a state-of-the-art convolutional neural network (CNN). The best configuration results in an F'l-Score of 73% and an accuracy of 77% on the test set. Results with leave-one-subject-out cross-validation show F'l-Scores ranging from 41 % to 80%. Thus, a single-lead, wearable-generated ECG has an informative value for HAR to a certain extent. In future work, we aim at using more sensors of the smart shirt and sensor fusion.