Bots in the Election

4:15:00 PM
by Anonymous

In the Kno.e.sis Center at Wright State University, we continue to refine our Twitris technology (Licensed by Cognovi Labs LLC) for collective social intelligence to analyze social media (esp. Twitter) in real time. Kno.e.sis and Cognovi Labs teamed up with the Applied Policy Research Institute (APRI) early in the year and created some tools to monitor the debates. See press coverage on TechCrunch. From the time that we first began following the nominees on Twitter, one thing became clear: Donald Trump was considerably more popular than his competition during the primaries as well as the general election. To be honest, I had never considered the possibility that social bots may have been playing a role in this popularity.


After the conclusion of the first debate all parties who had watched our "Debate Dashboard" were shocked not just by the volume of tweets but by the sentiment and emotion that appeared more positive for Trump than Clinton. When we investigated news from major media outlets, we became more and more concerned that our tool had some serious flaws. Due to articles we had seen discussing the large support Trump had on Twitter, we decided to focus on sentiment. Up until a few days before the election, we continued to update and improve our sentiment analysis algorithm.   


Notwithstanding the improvements in precision to our sentiment classifier, we continued to see Trump as the clear leader. As the debates came and went, our data remained consistent. We began an urgent quest for reason. We added gender analysis because media outlets were telling us that women were down on Trump and would be a major force in the election. Our analysis did not show this, despite having 96% precision in determining female and male users. We developed a proprietary process to separate users into left-leaning and right-leaning users. We could even say whether a user was strongly or loosely associated with a particular political party. Unfortunately, analyzing the data based on political association didn't help either. Surprisingly many strongly left leaning users were anti-Hillary, just a bit behind the right-leaning users.


After the second debate, we began to see many articles pop up about social bots. Once we began to look more into the issue, we found many articles from early in the year talking about Trump's "Bot Army" (Trumps' Biggest Lie? The Size of His Twitter Following). We had our aha moment. In that article, there is a reference to The Atlantic's use of a tool called BotOrNot. We decided to attempt to use this or some similar tool during the last debate to remove users with bot accounts and analyze the remaining data.


BotOrNot is a tool developed at the University of Indiana, Bloomington with collaboration from the University of Southern California, Marina Del Rey. Their tool creates over one thousand metrics by looking at the user account and analyzing retweets, hashtags, metadata, etc. The tool performed extremely well in the DARPA Twitter Bot Challenge, having correctly identifying all of the known bots (though it did incorrectly mark some additional users as bots). We were excited to learn that they had made their tool available through an API endpoint and decided to run our tweets through the system to test the speed at which we could process users. Twitris at this point was processing nearly 35 tweets per second for the election analysis alone, and it was clear very quickly that their service would not be able to handle the volume of data we would be consuming.


Though the final presidential debate was only several days away, we still had hope that we would find an answer. We saw Prof. Philip Howard, from the University of Oxford, mention in The Washington Post that they considered any user that tweets more than 50 times in one day a bot. It would be relatively simple to create an index of users and simply increment the count per tweet and then check the index quickly as the tweets roll through. We may have done this if our team had been free at the time. Some were working on bug fixes, others on improving sentiment, and still others were working to fix some infrastructure issues that we were experiencing at the time. Our corpus of tweets for the election campaign was on its way to exceeding 60 million tweets. A robust implementation would have required more time than anyone had to offer.


I suppose that now is a better time than never to define what a "bot" is. Phil Howard says, in that Washington Post article mentioned above, that "A Twitter bot is nothing more than a program that automatically posts messages to Twitter and/or auto-retweets the messages of others". I personally like this definition, but it leaves a little wiggle room where tools like BotOrNot, which focus primarily on the user accounts, are considered. A Twitter user can be a real, living, breathing, human being and still exhibit bot-like tweeting habits. I think that this is the reason that Howard's group settled on the 50-tweets-per-day stat instead of relying on a classifier. A user can tweet for themselves part of the time, but still have some automation process that tweets certain things on their behalf. There are many reasons that someone would do this, to increase their Klout score (imagine a LuLaRoe seller, YouTuber, or Blogger), for example. There are many companies that you can pay to automate this kind of activity for you. Some, like Linkis' "Convey" (more on this later) work by finding influential tweets and tweeting them on your behalf. These tweets are fairly easy to spot because they attach "via @c0nvey" to the end of the original tweet.


In the end, what we did was to develop a system that is able to quickly and accurately weed out tweets that were not authored by humans, even if the user account is owned by an actual human. Let's see how well our system stacks up to the BotOrNot service. We collected all of the bots found over one fifteen minute period and ran them through BotOrNot. 67.16% of the accounts from the tweets we labeled were determined by BotOrNot to be “bot” owned accounts. I was a little disappointed by this, so I took a look at the users that BotOrNot dismissed as human. In the first pass, I decided to apply Howard's 50-tweets-per-day rule. Doing this increased the percentage of accurately labeled bot tweets to 73.88%. One of the screen names found among this group actually contained the word "bot" in it. The most important thing for us at this point was to make sure that we weren’t getting a lot of false positives. We looked at each account one by one; we looked at each tweet in our system, both those classified as "likely bot" and "likely human".


 
Figure: Real-time labeling of bot and human tweets in Twitris




Many of the users with a low tweet-per-day usage had a combination of the two, and looking at the tweets that were labeled "likely bot", nearly all of them contained "via @c0nvey". Digging a bit further, I found that the Convey service has been accused of tweeting on behalf of unwitting users in the past. Here's a thread from one Twitter user talking about his experience:
   c0nvey.jpg


So, our system is able to accurately detect automated (bot) tweets despite the fact that the user is not a bot. Our average detection rate also looks reasonable compared to other services. We experience bot traffic at a rate of about a 5% per day in our election campaign, though there are days that get to nearly 8%.


Moving Forward (oh, and Fake News)


Elections come and go. Once they are gone, we seek to apply our findings to future work. Being able to detect bots is great; but, what else can we do with that? Well, post-election we have learned the term “fake news” (with content that was entirely made up, not grounded in truth or reality), something that not too many people were concerned about before: see the Google Trend.
fakenews.jpg
Where does all of this fake news come from? There have been troves of news reports blaming Facebook and Twitter for altering the outcome of the election. Obviously, Facebook and Twitter themselves weren’t creating pro-Trump news (Facebook in particular was accused of killing pro-Trump trends); however, some blame these companies for not alerting people that the news that they were “allowing” to spread was fake. I don’t think that that is fair. These companies are reliant on the fact that they don’t publish news (for more, read this article on Facebook, the “News Feed”, and the Communications Decency Act 230) to avoid lawsuits.


During the evaluation of our bot detection system, we noticed something interesting. A large majority of the bot-labeled tweets contained links to dubious looking news stories. Because of our ability to identify these bot tweets, we can exclude them from analysis when considering a brand-centered campaign (like Samsung during the Note 7 battery “situation”). I think that it is important to note that, despite the elimination of “fake news” and “bot tweets” from our analysis, Trump was always winning. We saw the same thing with the Brexit referendum earlier this year, where Twitris helped us to correctly predict the Brexit outcome before the polls closed. There is clear evidence to support the fact that high tweet volume translates to success (except Bernie Sanders, but there may be, uh-hum, other reasons for that). It seems to me that for bots and “fake news” to have swayed the election, they would have needed to be ready to go as soon as Trump announced that he was running, but what we have seen is that he was always ahead.


We will continue to find new ways to leverage everything that we learned from the 2016 Election. If you want to stay up to date on our analysis, please sign up to receive CognoviLabs’ newsletter at www.CognoviLabs.com or join Kno.e.sis on FB, and while you are there check the other post-election analysis.

You Might Also Like

40 comments

  1. M88 Casino Review 2021 | Up to C$100 Welcome Bonus - thakasino
    M88 casino welcome bonus | 100% first deposit bonus up to C$100 | 100% first deposit bonus up to C$100 | m88 ทางเข้า 100% 우리카지노 first 188bet deposit bonus up to C$100 | 100% first deposit bonus up

    ReplyDelete
  2. Hello, nice to read your all blogs and learned a ot of new knowledge. Thank you! 토토사이트

    ReplyDelete
  3. You’re doing a great job, keep it up doing a great work like this one. 파워볼사이트닷컴

    ReplyDelete
  4. I am always searching online for articles that can help me. I think you made some good points. Keep working, great job ! 바카라

    ReplyDelete
  5. I'm happy to see your website for valuable information.Why didn't this accident happen earlier? I was surprised!For me, it's bookmarked.

    온라인카지노
    메이저토토사이트
    토토사이트

    ReplyDelete
  6. I just want to say that your article is amazing. The clarity of your pretense is truly wonderful, and I can guess you are an expert on this subject. If you don't mind, I'll get an RSS feed and update you on future posts. Thank you very much.Please continue to enjoy your work.

    스포츠토토
    토토
    바카라사이트

    ReplyDelete
  7. Excellent information on your blog, thank you for taking the time to share with us. 슬롯머신

    ReplyDelete
  8. I blog often ɑnd I sеriously apⲣreciate yօur c᧐ntent.
    Yߋur article һaѕ truly peaked my іnterest. I am ցoing to book mark
    your site and keep checking ffor neѡ details аbout once a wеek.
    I subscribed to ʏоur RSS feed tοo.

    My webpage :: https://www.casinoholic.info 바카라사이트

    ReplyDelete
  9. Everything is very open with a very clear explanation. sportstoto It was definitely informative. Your site is very useful.
    Thank you for sharing!

    스포츠토토
    파워볼게임
    안전놀이터

    ReplyDelete
  10. All together, they make up for 21% of casino table game action. Poker is one of the|is among 카지노사이트 the|is doubtless one of the} most regularly played card video games, and it is probably the most famous of all of them, from a mediatic viewpoint, and in addition typically speaking. There are dozens of various variations of this game, probably the most famous of which are Texas hold 'em and the classic five-card draw poker.

    ReplyDelete
  11. I LOVE THIS POST THAT YOU CREATED.
    THANK YOU!****

    ReplyDelete
  12. ~~~THIS IS A GREAT INFORMATION, THANKS FOR THIS BLOG!

    ReplyDelete
  13. ****THIS IS GREAT BLOG FOR TODAY THAT I READ, THANKS FOR THIS!

    ReplyDelete
  14. THANKS FOR THIS EXCELLENT INFORMATION THAT YOU CREATED.----

    ReplyDelete
  15. Thank you for sharing blog comments on this website.We offer a variety of research and educational programs that are designed to help students and professionals develop the skills and knowledge they need to succeed in the digital age. Our research centers are focused on addressing some of the most pressing challenges facing organizations today.keep updates more.
    contract dispute lawyers
    contract dispute attorney

    ReplyDelete
  16. This comment has been removed by the author.

    ReplyDelete
  17. Bots, short for "robots" or automated software programs, have become a topic of concern and discussion in the context of elections and political campaigns. Bots can be used for various purposes during an election, and their impact can vary depending on how they are employed. Here are some key points to consider regarding bots in elections: DUI Lawyer Lunenburg VA

    ReplyDelete
  18. Bots, an acronym for "robots" or automated software programs, have gained attention and generated debate in relation to political campaigns and elections. During an election, bots can be used for a variety of things, and the results will depend on how they are used. The following are important things to think about when it comes to election bots:protective orders in virginia

    ReplyDelete
  19. This comment has been removed by the author.

    ReplyDelete
  20. The Kno.e.sis Center at Wright State University, in collaboration with Cognovi Labs and the Applied Policy Research Institute, analyzed social media during the 2016 U.S. presidential election to detect the influence of social bots on Twitter. Despite improving sentiment analysis algorithms, the researchers consistently showed positive sentiment for Donald Trump. They discovered the potential influence of social bots on Twitter and developed a system to quickly and accurately identify automated tweets. The researchers found that bot traffic was about 5-8% per day during the election campaign. They plan to apply their findings to future work, particularly in detecting and mitigating the impact of fake news. The researchers also found that high tweet volume seemed to correlate with electoral success, raising questions about the influence of social media dynamics on political outcomes. abogado de nueva jersey flsa

    ReplyDelete
  21. The use of bots can skew public discourse, influence voter perceptions, and even undermine the trust in electoral systems. Addressing this issue requires a multifaceted approach, encompassing technological solutions, regulatory measures, and heightened public awareness.
    lawyer for motorcycle accident
    virginia personal injury lawyer

    ReplyDelete
  22. Bots can create the illusion of widespread support for a candidate or a cause by generating fake likes, shares, comments, or followers. Their ability to rapidly disseminate information allows them to influence the political discourse, potentially swaying voter opinions and election outcomes.
    lawyer for contract dispute
    truck accident law

    ReplyDelete
  23. Bots in the Election" is likely an insightful and timely exploration of the increasingly significant role that automated bots play in modern electoral processes. This piece probably delves into how bots are used to shape public opinion, disseminate information, and potentially spread misinformation on various digital platforms. It likely raises critical questions about the impact of these bots on the integrity and fairness of elections, highlighting both the technological sophistication of these tools and the challenges they pose to democratic processes.
    lawyer for motorcycle accident

    ReplyDelete
  24. Bots in the Election" provides a chilling exposé on the growing influence of automated accounts in shaping political discourse and election outcomes. Through meticulous research and expert analysis, this documentary sheds light on the clandestine tactics employed by bots to manipulate public opinion, spread disinformation, and sway electoral results. With real-world examples and firsthand accounts, the film underscores the urgent need for greater awareness and regulation to safeguard the integrity of democratic processes. "Bots in the Election" serves as a wake-up call to the pervasive threat posed by artificial intelligence in modern politics, urging viewers to remain vigilant and discerning in the face of digital deception.
    Fairfax Divorce Lawyer

    ReplyDelete
  25. The blog post on "blog.knoesis.org/2016/12/bots-in-election.html" delves into the intriguing topic of bots' role in elections, offering valuable insights into their impact on the electoral process. It explores the phenomenon of automated bots and their potential influence on voter behavior and public opinion. With in-depth analysis and compelling examples, the post sheds light on the complexities of modern-day election campaigns and the challenges posed by technological advancements. It prompts readers to contemplate the implications of bots in shaping political discourse and decision-making. Overall, it's an informative and thought-provoking read for anyone interested in the intersection of technology and democracy.
    divorce center new york ny





    ReplyDelete
  26. Navigating the legal system while dealing with traffic violations can be likened to travelling through a convoluted maze. Traffic violations in Manassas, Virginia, can have serious repercussions, such as heavy fines, points on your license, or even the suspension of your ability to drive. A knowledgeable Manassas traffic attorney can assist people navigate these difficult legal waters by providing advice, support, and experience.manassas traffic lawyer

    ReplyDelete
  27. ¿Estás planeando tu próxima aventura? ¡Utiliza el servicio telefónico de Avianca Medellín para reservar sin problemas! Nuestro soporte telefónico brinda asistencia rápida y conveniente para reservar vuelos, administrar itinerarios y responder preguntas sobre viajes. Con el servicio avianca telefono medellin obtienes ayuda de expertos justo cuando la necesitas. Evite los problemas de reserva en línea y llame a la línea telefónica de Avianca Medellín para organizar su viaje de manera rápida y confiable. ¡Tu próximo viaje comienza con una llamada a Avianca Medellín!

    ReplyDelete

  28. Bots are making waves in the election landscape, influencing public opinion and spreading information. Stay vigilant Essex County reckless driving lawyer||Verified Complaint New York Divorce and informed about their impact on democratic processes.

    ReplyDelete
  29. The "Folha Informativa da Rede de Informação" is a valuable resource for staying updated with the latest news and insights. It offers comprehensive coverage, clear writing, and regular updates. However, the layout could benefit from a modern design and more interactive features like polls or comment sections. Overall, the platform is a solid choice for staying informed. driving without a license in fairfax va Championing justice one case at a time. With a relentless pursuit of truth and unwavering dedication, I’m here to protect your rights and navigate the legal maze for you.

    ReplyDelete
  30. This is an important issue that needs more attention! The influence of bots in elections can seriously undermine the democratic process by spreading misinformation and manipulating public opinion. It's crucial that we develop stronger regulations and technology to detect and counteract bot activity, especially during critical election periods. Transparency from social media platforms is key, but educating the public on how to identify and question fake accounts is just as vital. Looking forward to seeing how this challenge is addressed in the coming years. Keep share more article like this. how much does a reckless driving ticket cost in va

    ReplyDelete
  31. Fundraising with Bravelets is a rewarding way to support a cause while empowering others. To start, choose a cause or organization, such as health awareness or environmental issues. Set up your Bravelets campaign by visiting their website and creating a campaign with details about your cause, mission, goals, and funds usage. Choose products that align with your cause to encourage supporters to purchase. Promote your campaign on social media, email newsletters, and community boards using engaging visuals and personal stories. Create a unique hashtag to track campaign reach. Engage your supporters by sharing your campaign with their networks and hosting events or challenges. Monitor progress by sharing updates with supporters to keep them engaged and motivated. Show appreciation for contributions by sending thank-you notes or shout-outs on social media. Once your campaign concludes, evaluate and share the results with your supporters. By following these steps, you can effectively fundraise with Bravelets and make a meaningful impact for your chosen cause.https://duilawyersris.com/dui-lawyer-rockland-ny/

    ReplyDelete
  32. "A timely and thought-provoking analysis!" The debate over the role of bots in elections raises a crucial and frequently neglected question. I admire how you explain how bots can alter information and influence public opinion. It would be useful to see more real-world examples or case studies to demonstrate the impact bots have had on previous elections. Furthermore, investigating alternative solutions or precautions against this expanding problem could improve the article. Overall, a well-researched and timely examination of a crucial issue!"
    credit card fraud lawyer

    ReplyDelete
  33. An excellent examination of how bots affect political discourse and election results can be found on the KNO.E.SIS Research Blog on Bots in the Election. It is a useful tool for comprehending the effects of digital meddling in contemporary elections because of its data-driven methodology and critical viewpoint. henry county dui lawyer Henry County DUI lawyers are known for their expertise in defending DUI cases, providing tailored legal strategies to minimize penalties. Their local knowledge and commitment to protecting clients' rights make them a dependable choice for those facing DUI charges.

    ReplyDelete
  34. Election-related bots have become a major worry, swaying public opinion and disseminating false information on social media. By oversaturating platforms with biased content, these automated accounts have the ability to magnify particular narratives, control conversations, and maybe influence voter behavior. The use of bots emphasizes the continued difficulties in guaranteeing free and transparent elections in the digital era, calling for stricter regulations and heightened awareness.arlington dui lawyer An Arlington DUI attorney is essential in defending people accused of driving under the influence because they provide specialized legal techniques to help them deal with the intricacies of the judicial system. In order to promote lighter sentences or other sentencing alternatives, they evaluate the particulars of each case, including the available evidence and possible defenses. Their knowledge helps clients safeguard their rights and future by offering advice at each step of the procedure.

    ReplyDelete
  35. Fantastic blog! The role of bots in elections is a huge issue, especially with the potential for misinformation and influence on voters. It’s a reminder of how important it is for social media platforms to improve their detection and removal of fake accounts. Also, educating voters about how to spot bots and avoid being misled seems more essential than ever. Thanks for sharing insights! fairfax Weapons Offense Lawyer

    ReplyDelete
  36. Interesting read! It’s clear that bots are becoming more influential in elections. While they can help spread information quickly, they also create risks by amplifying misinformation. It’s important that we stay vigilant and critically assess the sources of what we see online. Thanks for sharing this insights! sex crime law firm new jersey

    ReplyDelete
  37. By influencing public opinion and voter involvement on social media, bots have become more and more important during elections. Although they can quickly disseminate information, their use also raises questions about disinformation and political discourse manipulation. The use of bots in election procedures underscores the necessity for increased oversight and regulation as technology advances in order to guarantee free and fair elections.loudoun county reckless driving lawyer For anyone facing reckless driving charges in Loudoun County, a lawyer is essential because the penalties can be harsh and include fines, license suspension, and even jail time. These lawyers can create a compelling defense to uphold their clients' rights since they are knowledgeable about the nuances of local traffic legislation. With their knowledge, people can more successfully negotiate the legal system and strive toward lowering fines or getting good results.

    ReplyDelete
  38. CapCut is a free, all-in-one video editing tool.
    Download Capcut Pro mod apk for android
    download capcut mod apk
    APKClub

    ReplyDelete