BERT for stock market sentiment analysis

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

  • Matheus Gomes Sousa
  • Kenzo Sakiyama
  • Lucas De Souza Rodrigues
  • Pedro Henrique Moraes
  • Eraldo Fernandes
  • Edson Takashi Matsubara

When breaking news occurs, stock quotes can change abruptly in a matter of seconds. The human analysis of breaking news can take several minutes, and investors in the financial markets need to make quick decisions. Such challenging scenarios require faster ways to support investors. In this work, we propose the use of bidirectional encoder representations from transformers BERT to perform sentiment analysis of news articles and provide relevant information for decision making in the stock market. This model is pre-trained on a large amount of general-domain documents by means of a self-learning task. To fine-tune this powerful model on sentiment analysis for the stock market, we manually labeled stock news articles as positive, neutral or negative. This dataset is freely available and amounts to 582 documents from several financial news sources. We fine-tune a BERT model on this dataset and achieve 72.5% of F-score. Then, we perform some experiments highlighting how the output of the obtained model can provide valuable information to predict the subsequent movements of the Dow Jones Industrial (DJI) Index.

Original languageEnglish
Title of host publicationIEEE 31st International Conference on Tools with Artificial Intelligence : ICTAI 2019 : proceedings : 4-6 November 2019, Portland, Oregon
Number of pages5
Place of PublicationPiscataway
PublisherIEEE - Institute of Electrical and Electronics Engineers Inc.
Publication date11.2019
Pages1589-1593
ISBN (print)978-1-7281-3799-5
ISBN (electronic)978-1-7281-3798-8
DOIs
Publication statusPublished - 11.2019
Externally publishedYes
EventIEEE International Conference on Tools with Artificial Intelligence - Portland, United States
Duration: 04.11.201906.11.2019
Conference number: 13
https://ictai.computer.org/

DOI