Diffuse liver disease is common, primarily driven by high prevalence of non-alcoholic fatty liver disease (NAFLD). It is currently assessed by liver biopsy to determine fibrosis, often staged as F0 (normal) - F4 (cirrhosis). A noninvasive assessment method will allow a broader population to be monitored longitudinally, facilitating risk stratification and treatment efficacy assessment. Ultrasound shear wave elastography (SWE) is a promising noninvasive technique for measuring tissue stiffness that has been shown to correlate with fibrosis stage. However, this approach has been limited by variability in stiffness measurements. In this work, we developed and evaluated an automated framework, called SWE-Assist, that checks SWE image quality, selects a region of interest (ROI), and classifies the ROI to determine whether the fibrosis stage is at or exceeds F2, which is important for clinical decisionmaking. Our database consists of 3,392 images from 328 cases. Several classifiers, including random forest, support vector machine, and convolutional neural network (CNN)) were evaluated. The best approach utilized a CNN and yielded an area under the receiver operating curve (AUROC) of 0.89, compared to the conventional stiffness only based AUROC of 0.74. Moreover, the new method is based on single image per decision, vs. 10 images per decision for the baseline. A larger dataset is needed to further validate this approach, which has the potential to improve the accuracy and efficiency of non-invasive liver fibrosis staging.