In a hospital, accurate and rapid mortality prediction of Length of Stay (LOS) is essential since it is one of the essential measures in treating patients with severe diseases. When predictions of patient mortality and readmission are combined, these models gain a new level of significance. Therefore, the most expensive components of patient care are LOS and readmission rates. Several studies have assessed readmission to the hospital as a single-task issue. The performance, robustness, and stability of the model increase when many correlated tasks are optimized. This study develops multimodal multitasking Long Short-Term Memory (LSTM) Deep Learning (DL) model that can predict both LOS and readmission for patients using multi-sensory data from 47 patients. Continuous sensory data is divided into eight sections, each of which is recorded for an hour. The time steps are constructed using a dual 10-second window-based technique, resulting in six steps per hour. The 30 statistical features are computed by transforming the sensory input into the resulting vector. The proposed multitasking model predicts 30-day readmission as a binary classification problem and LOS as a regression task by constructing discrete time-step data based on the length of physical activity during a hospital stay. The proposed model is compared to a random forest for a single-task problem (classification or regression) because typical machine learning algorithms are unable to handle the multitasking challenge. In addition, sensory data combined with other cost-effective modalities such as demographics, laboratory tests, and comorbidities to construct reliable models for personalized, cost-effective, and medically acceptable prediction. With a high accuracy of 94.84%, the proposed multitask multimodal DL model classifies the patient's readmission status and determines the patient's LOS in hospital with a minimal Mean Square Error (MSE) of 0.025 and Root Mean Square Error (RMSE) of 0.077, which is promising, effective, and trustworthy.