Patrick Buckley The Hologram Concert – How AI is helping to keep music alive When Whitney Houston passed away in 2012, the world was shocked by the sudden and tragic news of her death. Fans gathered around the Beverly Hills hotel in Los...
Patrick Buckley Robot Waiters – The future or just a gimmick? As we continue to battle the COVID-19 pandemic, the hospitality industry is looking to technology as a way to keep workers safe. Could robot waiters be the answer? In...
Olivia Brookhouse Artificial Intelligence, doing more than humanly possible since the Greeks Many of those working in the world of Artificial Intelligence acknowledge the 1950’s as the birth of concepts such as Machine Intelligence and Artificial Intelligence with the creation of...
LUCA Did you miss LUCA Talk: Using mobile data in the transport sector? LUCA Talk 7, held on Tuesday 3rd October, gave us an invaluable insight into the transport sector. There was a focus on mobile data and the way it can...
LUCA Deep Learning and satellite images to estimate the impact of COVID19 Motivated by the fact that the Coronavirus Disease (COVID-19) pandemic has caused worldwide turmoil in a short period of time since December 2019, we estimate the negative impact of...
LUCA Success Story: LUCA Transit and Highways England The transport industry is very receptive to the application of Big Data and Artificial Intelligence strategies, as there are clear use cases that can maximize a companies’ efficiency and...
LUCA Can Big Data reshape the Outdoor Media sector? Out-of-home (OOH) adspend in the UK rose to £1 billion 2014, and is predicted to grow by 4.8% in 2016 according to a recent report. To ensure they benefit...
LUCA LUCA to power data-driven decisions in Brazil’s tourism sector Brazil’s tourism industry had a huge boost in 2016 with more than half a million tourists descending upon Rio de Janeiro for the Olympics – making it a record year with...
Big Data and Elections: We shine a light on Trump and ClintonRichard Benjamins. 9 November, 2016 Twitter is widely used as a tool to understand and predict phenomena in the real world. Today on our blog, we have been using Twitter to understand the US Presidential Elections of November 8th 2016. There are no conclusive research results on whether it is possible to predict the outcomes of elections using tweets but we decided to investigate. Figure 1: Shine a light on Trump or Clinton In 2010, an article was published as part of the Fourth International AAAI Conference on Weblogs and Social Media entitled “Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment- concludes that it indeed is possible“. This research used tweets from the German Federal elections in Sept 2009 and concluded that the mere number of messages mentioning a party can reflect the election result. Furthermore, joint mentions of two parties are in line with real world political ties and coalitions. The research also went on to show that an analysis of the tweets’ political sentiment demonstrates close correspondence to the parties’ and politicians’ political positions indicating that the content of Twitter messages “plausibly reflects the offline political landscape.” However, another article published one year later in the same Artificial Intelligence conference -“Limits of Electoral Predictions Using Twitter” stated that “unfortunately, they found no correlation between the analysis results and the electoral outcomes, contradicting previous reports,”, basing their investigation on tweets of the US 2010 Congressional elections. A search in Google will show much more research on the feasibility of using Twitter and other social media networks for election predictions. Additionally, a Google Trends query to check which candidate generates more search activity provides some insight on the matter: Figure 2: Google Trends candidates’ search activity Whatever the conclusion is, there is no doubt that Twitter reflects to some extent what is going on in a country just before important elections. During the two days running up to the elections on the 8th of November 2016, we established a real-time feed from Twitter filtering relevant hashtags, handles names and keywords. As technology, we have used Sinfonier, an ElevenPaths cybersecurity product to detect cyberthreats based on real-time information processing. In this case, Sinfonier automates the capture of tweets in real-time (see Figure 3). Sinfonier encapsulates real-time capabilities of Apache Storm in a very elegant way, so we can build a “digest Twitter-to-MongoDB” within a few minutes and with almost zero code writing. Figure 3: Sinfonier Topology (data extraction pipeline) designed to capture real-time data from Twitter. We then also used real-time capabilities using Elastic Search and Kibana. Apart from visualizing the tweets in real-time in a dashboard (see Figure 4), we wanted to try out something more fun so we also got some Philips Hue lamps involved. Figure 4: Real-time tweets on Clinton (blue) vs. Trump (red). Trump tweets almost double those of Clinton. Trump is slightly more active in replying and both re-tweet equally all tweets they are mentioned in. Actually, in the Big Data era, where taking data-driven decisions is the ultimate goal, in a variety of situations it will be unfeasible to use traditional dashboards to convey the status of real-time KPIs. Imagine the case of factories, call center open floors and large retail centers. It could be very cool to have “realtime transparent dashboards”, so that lights (visual perception) adapt to the (big) data produced in the real world in a fast, intelligent and pervasive way. The applications are limitless! In such cases, using dynamic lights could be a good alternative to convey the main insights of dashboards. For instance, in a call center, the light intensity and color could change according to the number and type of calls (complaints, information, products, etc.) from customers. By connecting lamps to the Internet, we enter the world of the Internet of Things. Hue lamps can be instructed to react to phenomena on the Internet using the “If This Then That” framework. Using IFTTT, you can use the lamps to turn the light on when it is raining in Amsterdam, or when your plane lands safely in another city around the world. So how have we connected the lamps to the tweets related to the US elections? On this occasion, we haven’t performed a complex analysis nor a prediction of the winner as for this purpose, we would need to ask ourselves first if Twitter is the best data stream to use. Our first step was to design two query sets, in the first query, we count all the tweets related to common words used to refer to Hillary Clinton (e.g. Hillary, Clinton, HillaryClinton) or Donald Trump (e.g. Donald, Trump, DonaldTrump). The results of which are displayed in Figure 5: Figure 5: Twitter shows much more activityrelated with Donald Trump but tweet count include both positive andnegative references so direct interpretation could be misleading. The second query (Figure 6) is much more specific as we compare tweets containing their handles, @RealDonaldTrump vs @HillaryClinton: Figure 6. The second query reveals a much more balanced pattern with no clear winner. Additionally, we set rules for the lights as follows: Lamp 1 is connected to a twitter feed on query 1 (Figure 5), blinking the color of the candidate who had more tweets in the last 2 seconds and showing a stable color of the candidate who had more tweets in the last hour. Lamp 2 has the same behaviour of Lamp 1 but this time it is connected to the second query stream (figure 6). On the day of the elections, we used the lamps in our office to engage with Election Day. We observed that the lamps were mostly red, reflecting the fact that Trump has many more mentions than Clinton. However, we saw that many tweets mentioning Trump are actually against him, showing negative sentimient whilst Hillary Clinton attracted less negative tweets. Video: Pedro Antonio de Alarcon explains the technology used (video in Spanish). Now, the votes have been cast and the United States of America has decided – but in the midst of global frenzied reaction to Donald Trump’s election, our lamps keep on flickering. Can Big Data and IOT prevent motorcycle crashes?Chatbots? New? You haven’t met ELIZA
Patrick Buckley The Hologram Concert – How AI is helping to keep music alive When Whitney Houston passed away in 2012, the world was shocked by the sudden and tragic news of her death. Fans gathered around the Beverly Hills hotel in Los...
Patrick Buckley Robot Waiters – The future or just a gimmick? As we continue to battle the COVID-19 pandemic, the hospitality industry is looking to technology as a way to keep workers safe. Could robot waiters be the answer? In...
Patrick Buckley How will AI change the labour market for the better? From the way we shop, to the way we learn, the digital world in which we live is unrecognisable from the reality of a decade ago. One area which...
Patrick Buckley How AI is helping fashion retailers stay afloat With an estimated current global market value surpassing 406 billion USD, the fashion industry is one of the most significant yet vulnerable industries out there. In an ever-worsening socio-economic...
LUCA La transformación digital en la gestión del agua, ahora más que nunca Hoy en día mantenemos la incertidumbre de cuándo dispondremos de una vacuna o cuál será el impacto real en la sociedad y en la economía que nos deja esta...
Patrick Buckley Thanks to AI, the future of video-conferencing is in sight. Throughout the COVID-19 pandemic, video-conferencing has become the backbone of both our work and social lives. Today, on #WorldHugDay, we take a look at some of the ways in which...