We've been eating our own dog food lately.  By that we mean using our demonstration tool located here --> http://www.bigdatalens.com/demo/ where you can search over a broad (but limited set) of internet based news and have the search results further processed to discover connections.  So we've been using this to monitor developments in the Ebola outbreak in West Africa.  Below are just a couple of the ways you see how Natural Language Processing (NLP) of internet content helps find ties inside and between documents. 

While looking at these think about your the connections you might discover for your area of interest.  Think about the connections you might discover between internal AND external documents.  Think about the connections you might discover between English based documents and documents in another language.  And so on. 

Big Data is about getting up, across and around massive amounts of information, to see and know the patterns that make our world work where these things may have been hidden before.  We think our statement about the power of Big Data and Predictive Analytics says it best "Big Data Predictive Analytics Algorithms tell you what consumers will do, where markets will be or how technology will develop. The outcome boosts sales, improves operations, reduces risk and forms better plans."  Use it to your advantage.

Here are the ties between all 7936 documents processed in < 9 seconds. 

Here are the ties between all 7936 documents processed in < 9 seconds. 

Holding your cursor over one entity clears the graph to show what else it is tied to.  Here the connection is between the CDC (Centers for Disease Control) in Atlanta and African Countries.  This makes sense given the search for Ebola that started the process.

Holding your cursor over one entity clears the graph to show what else it is tied to.  Here the connection is between the CDC (Centers for Disease Control) in Atlanta and African Countries.  This makes sense given the search for Ebola that started the process.

Here we can see connections between how to combat the disease with ethical treatment (meaning professional medical and scientifically proven treatment), the administration of drugs and the President of Liberia (Ellen Johnson-Sirleaf).  The interpretation is that the highest government official in at least one Ebola effected country is promoting the correct health treatment to combat the outbreak.

Here we can see connections between how to combat the disease with ethical treatment (meaning professional medical and scientifically proven treatment), the administration of drugs and the President of Liberia (Ellen Johnson-Sirleaf).  The interpretation is that the highest government official in at least one Ebola effected country is promoting the correct health treatment to combat the outbreak.

And here is a surprise.  What is the connection between Morocco and the Seychelles - other than they are both African countries, though many thousands of miles apart and not yet affected by Ebola?  Digging deeper you discover they have banned travel for their sports teams because of the Ebola outbreak.  So while the outbreak is tragic in the lives it destroys there are also economic, cultural and entertainment costs not typically accounted for.  A connection worth exploring further.

And here is a surprise.  What is the connection between Morocco and the Seychelles - other than they are both African countries, though many thousands of miles apart and not yet affected by Ebola?  Digging deeper you discover they have banned travel for their sports teams because of the Ebola outbreak.  So while the outbreak is tragic in the lives it destroys there are also economic, cultural and entertainment costs not typically accounted for.  A connection worth exploring further.


Comment