Guest post by Katherine Pomfret, Chief Organiser Big Data Week Leeds, originally published on LinkedIn. We all grew up with stories. We loved them as children, when the world was a large and confusing place, because they offered certainty. They delivered powerful messages to our minds, and we learned about the world without realising we were learning, and without having to put in effort. Because images were clear and consistent (all witches are wicked, all princes are handsome, all forests are dangerous), and because of the relentless cause and effect movement of the narrative, we felt confident in drawing conclusions on the basis of stories, and felt confident also in our judgement as to the rightness, or otherwise, of a given course […] Continue Reading
Remote DBA Experts Explain the Impact of Big Data on Database Management by Sujain Thomas from Remotedba Data management has always been part of organizational management. However, with the advent of new data collection and retrieval technologies over the last two decades, the amount of data being generated is in greater volumes and much more diverse. Systems such as RDBMS which had dominated the landscape for decades are now falling by the wayside to give way to NewSQL and NoSQL among others. Data generation today is in virtually every aspect of life from banking, healthcare and education to social life. As an organization with an online presence, data management is no longer a competency but a differentiator that determines winners […] Continue Reading
Are you worried that you haven’t yet mastered all of the ins and outs, ups and downs, and quirky oddities of big data? Don’t fret. Nobody has it mastered 100 percent just yet. But you will need to get on board and begin a data initiative pretty soon so you won’t be left behind. Here are all the ways that big data is changing advertising, so you can be sure your data plans are on the right track. 1. Understanding the Difference in the Right Data, Not Just Big Data The first thing to know is that not all data is even worth your while. You’ll need to assess what data is useful to collect and analyze, and what data […] Continue Reading
What is machine learning? Machine learning (often shortened within the industry as ML) is a kind of artificial intelligence (AI), which is an offshoot of big data. AI, and by extension, ML, utilize big data in a different way than typical analysis. These practices are capable of taking in data, building assumptions based on the data, testing hypotheses about those assumptions, and drawing conclusions from the results. Though not nearly as complex and sophisticated as human learning, AI and ML can do rudimentary logic by themselves. Yes, it sounds a little creepy (and potentially even 2001 Space Odyessy-ish), but there are numerous practical uses for AI and ML. What can ML do for retailers?
As most organizational data sets grow beyond the capabilities of the traditional data warehouse, a lot of businesses are taking a look at the option of building a data warehouse. But scanning the tech news headlines and IT blogs, you’ll find two camps: the one saying that the data lake is the salvation of your data architecture and data plans, and the camp that maintains a data lake is nothing but a data swamp — the place where good data goes to die without a decent burial.
The past couple of years haven’t been easy ones for cyber security specialists, especially those charged with protecting the growing reservoirs of Big Data. The headlines featured more stories about data breaches than about most any other aspect of Big Data and related technologies — even though that time period marked some impressive improvements in terms of open source software, database technology, and the growing importance of the data scientist.
If you read the industry rags, you’ll start to believe that data scientists are rarer than diamonds, and more expensive, too. While they certainly aren’t in abundance, you can get a good data scientist if you’re willing to look, willing to pay for one, and a data scientist is actually what you need. Here’s everything you need to know before launching your next head-hunting campaign. Be Sure Your Organization is Ready for a Data Scientist
The most obvious reason to choose open source software is that it’s free. But for most businesses, especially enterprises, that isn’t as big a point as you might think. After all, most companies think little of dropping $50,000 to $100,000 (often more) on a great software package. Yet open source software dominates the realm of big data solutions, and, in fact, is making quite an impact across the arena of business and enterprise software. Why?
As data becomes more important to doing business, companies are finding themselves in need of various data-related workers. Sometimes, the titles aren’t clear, and it’s difficult to determine whether you need a data scientist, a data engineer, or perhaps both. Here are the descriptions of each one, as well as where the two jobs overlap. Data Scientist