Inference Time of a CamemBERT Deep Learning Model for Sentiment Analysis of COVID Vaccines on Twitter

Stud Health Technol Inform. 2022 Jun 29:295:269-270. doi: 10.3233/SHTI220714.

Abstract

In previous work, we implemented a deep learning model with CamemBERT and PyTorch, and built a microservices architecture using the TorchServe serving library. Without TorchServe, inference time was three times faster when the model was loaded once in memory compared when the model was loaded each time. The preloaded model without TorchServe presented comparable inference time with the TorchServe instance. However, using a PyTorch preloaded model in a web application without TorchServe would necessitate to implement functionalities already present in TorchServe.

Keywords: Artificial Intelligence; COVID-19; MLOps; Social Media; Vaccines.

MeSH terms

  • COVID-19 Vaccines
  • COVID-19* / prevention & control
  • Deep Learning*
  • Humans
  • Sentiment Analysis
  • Social Media*
  • Vaccines*

Substances

  • COVID-19 Vaccines
  • Vaccines