A Novel Method for Quantitative Analysis of C-Reactive Protein Lateral Flow Immunoassays Images via CMOS Sensor and Recurrent Neural Networks

IEEE J Transl Eng Health Med. 2021 Nov 23:9:1900415. doi: 10.1109/JTEHM.2021.3130494. eCollection 2021.

Abstract

Objective: To design and implement an easy-to-use, Point-of-Care (PoC) lateral flow immunoassays (LFA) reader and data analysis system, which provides a more in-depth quantitative analysis for LFA images than conventional approaches thereby supporting efficient decision making for potential early risk assessment of cardiovascular disease (CVD). Methods and procedures: A novel end-to-end system was developed including a portable device with CMOS camera integrated with optimized illumination and optics to capture the LFA images produced using high-sensitivity C-Reactive Protein (hsCRP) (concentration level < 5 mg/L). The images were transmitted via WiFi to a back-end server system for image analysis and classification. Unlike common image classification approaches which are based on averaging image intensity from a region-of-interest (ROI), a novel approach was developed which considered the signal along the sample's flow direction as a time series and, consequently, no need for ROI detection. Long Short-Term Memory (LSTM) networks were deployed for multilevel classification. The features based on Dynamic Time Warping (DTW) and histogram bin counts (HBC) were explored for classification. Results: For the classification of hsCRP, the LSTM outperformed the traditional machine learning classifiers with or without DTW and HBC features performed the best (with mean accuracy of 94%) compared to other features. Application of the proposed method to human plasma also suggests that HBC features from LFA time series performed better than the mean from ROI and raw LFA data. Conclusion: As a proof of concept, the results demonstrate the capability of the proposed framework for quantitative analysis of LFA images and suggest the potential for early risk assessment of CVD. Clinical impact: The hsCRP levels < 5 mg/L were aligned with clinically actionable categories for early risk assessment of CVD. The outcomes demonstrated the real-world applicability of the proposed system for quantitative analysis of LFA images, which is potentially useful for more LFA applications beyond presented in this study.

Keywords: CMOS image sensor; Lateral flow immunoassays (LFA); dynamic time warping; high-sensitivity C-Reactive Protein; long short-term memory (LSTM).

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • C-Reactive Protein*
  • Cardiovascular Diseases* / diagnosis
  • Humans
  • Immunoassay
  • Machine Learning
  • Neural Networks, Computer

Substances

  • C-Reactive Protein

Grants and funding

This work is part of the Eastern Corridor Medical Engineering Centre (ECME) project and funded by the European Union (EU) European Territorial Cooperation (INTERREG VA) Cross-border Programme (2014-2020), managed by the Special EU Programmes Body (SEUPB) (Grant ID: IVA5034).