Are You a Racist or Am I Seeing Things? Annotator Influence on Hate Speech Detection on Twitter

Hate speech in the form of racism and sexism is commonplace on the internet For this reason, there has been both an academic and an industry interest in detection of hate speech. The volume of data to be reviewed for creating data sets encourages a use of crowd sourcing for the annotation efforts.