PyFin-sentiment: Towards a machine-learning-based model for deriving sentiment from financial tweets

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Responding to the poor performance of generic automated sentiment analysis solutions on domain-specific texts, we collect a dataset of 10,000 tweets discussing the topics of finance and investing. We manually assign each tweet its market sentiment, i.e., the investor's anticipation of a stock's future return. Using this data, we show that all existing sentiment models trained on adjacent domains struggle with accurate market sentiment analysis due to the task's specialized vocabulary. Consequently, we design, train, and deploy our own sentiment model. It outperforms all previous models (VADER, NTUSD-Fin, FinBERT, TwitterRoBERTa) when evaluated on Twitter posts. On posts from a different platform, our model performs on par with BERT-based large language models. We achieve this result at a fraction of the training and inference costs due to the model's simple design. We publish the artifact as a python library to facilitate its use by future researchers and practitioners.

Original languageEnglish
Article number100171
JournalInternational Journal of Information Management Data Insights
Volume3
Issue number1
Number of pages10
DOIs
Publication statusPublished - 01.04.2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2023 The Author(s)