Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".
Deep-learning model presented in "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".
This repository contains the source code for the models used for DataStories team's submission for SemEval-2017 Task 4 “Sentiment Analysis in Twitter”. The model is described in the paper "DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis".
Citation:
@InProceedings{baziotis-pelekis-doulkeridis:2017:SemEval2,
author = {Baziotis, Christos and Pelekis, Nikos and Doulkeridis, Christos},
title = {DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis},
booktitle = {Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017)},
month = {August},
year = {2017},
address = {Vancouver, Canada},
publisher = {Association for Computational Linguistics},
pages = {747--754}
}The message-level sentiment analysis model, for SubTask A.
The target-based sentiment analysis model, for SubTasks B,C,D,E.
Notes
pip install -r /datastories-semeval2017-task4/requirements.txtUbuntu:
sudo apt-get install graphvizWindows: Install graphiz from here:http://www.graphviz.org/Download_windows.php
The models were trained on top of word embeddings pre-trained on a big collection of Twitter messages. We collected a big dataset of 330M English Twitter messages posted from 12/2012 to 07/2016. For training the word embeddings we used GloVe. For preprocessing the tweets we used ekphrasis, which is also one of the requirements of this project.
You can download one of the following word embeddings:
Place the file(s) in /embeddings folder, for the program to find it.
In order to specify which word embeddings file you want to use,
you have to set the values of WV_CORPUS and WV_WV_DIM in model_message.py and model_target.py respectively.
The default values are:
WV_CORPUS = "datastories.twitter"
WV_DIM = 300The convention we use to identify each file is:
{corpus}.{dimensions}d.txtThis means that if you want to use another file, for instance GloVe Twitter word embeddings with 200 dimensions,
you have to place a file like glove.200d.txt inside /embeddings folder and set:
WV_CORPUS = "glove"
WV_DIM = 200You will find the programs for training the Keras models, in /models folder.
models/neural/keras_models
│ keras_models.py : contains the Keras models
│ model_message.py : script for training the model for Subtask A
│ model_target.py : script for training the models for Subtask B and DNo open issues yet, or sync has not completed.