Big Data News & Articles


Big Data Product Watch 2/5/16: App Monitoring, Data Preparation, IoT Hub, More

Here's recent news from OpsClarity, Microsoft, Trillium and others, featuring data-driven app monitoring, data preparation/data quality, a Big Data appliance, an Internet of Things hub and more.

After Spark-Based Revamp, IBM Launches New Data Services

IBM last summer made big news by going all in on Apache Spark for Big Data analytics, with a massive developer investment that resulted in redesigned data products and today's launch of a bevy of new services running on its cloud.

Syncfusion Puts Windows Big Data Platform into Production

Syncfusion moved its Windows-based Big Data platform out of preview and into production with new support for Apache Spark, Apache HBase and Scientific Python. The enterprise software development company claims it's the singular Apache Hadoop-based distribution designed for Windows.

Spark Features Added to Redis NoSQL Database

Redis Labs today announced the integration of its namesake NoSQL database with Spark SQL, along with a new Spark-Redis connector said to speed up certain Big Data analytics tasks by 100 times or more.

Q&A: On Hadoop's 10th Birthday, 10 Questions for One Who Was There

10 years ago today the first Hadoop cluster was put into production at Yahoo. We asked Raymie Stata, who actually hired Hadoop co-creator Doug Cutting into Yahoo, to look back at the history of the game-changing Big Data technology, forecast where it's going and provide advice for developers looking to master it.

Big Data Product Watch 1/28/16: Top Hadoop Distros, Free Training, Cloud Deployment and More

Here's a roundup of recent news from Cloudera, MapR, VoltDB and others, including an analyst's rankings of the top Hadoop distributions, expanded free Hadoop training, new products and more.

Open Source Tech Dominates Top Paying Skills

Cloud and Big Data tech skills still pay off the most, according to the latest salary survey from careers site Dice.com, with open source technologies dominating the 2015 list.

So You Want To Become a Data Scientist?

So you want to become a data scientist? And why wouldn't you? Careers site Glassdoor just named it the "best job in America" for 2016. So we decided to talk to a real-life data scientist to find out what the job's all about and how to become one.

Google's First Apache Contribution? Dataflow, for Big Data Analytics

Google has teamed up with several other companies to submit its open sourced Dataflow technology to the Apache Software Foundation as an incubator project, a first for the search giant.

Hadoop Survey Shows Spark Coming of Age in 2016

Apache Spark, which has been shaking up the Apache Hadoop ecosystem for a couple years now, will come of age this year, moving from a talking point into enterprise deployment, according to a new Hadoop survey from Syncsort.

MapR Offers Free Big Data Test Drives on Amazon Cloud

Test drives of various Big Data technologies are now available on the Amazon cloud in a new program launched by MapR Technologies to help enterprises test the analytics waters with integrated third-party solutions.

Microsoft Revamps R for Big Data Analytics, Offers Free Developer Edition

Microsoft -- the new commercial steward of the open source R programming language -- yesterday announced a revamp of its R-based offerings, including a free developer edition of its rebranded Microsoft R Server.

AtScale Weds 'BI on Hadoop' with Tableau Big Data Visualization

AtScale announced what it claims to be the industry's first 'BI on Hadoop' accelerator to work with Big Data analytics products from Tableau Software, which specializes in data visualization.

Big Data Has Arrived, Execs Say

"Big Data has reached a point of mainstream adoption within Fortune 1000 firms," concludes a new survey from NewVantage Partners, attempting to capture the voice of executive decision-makers guiding data-related enterprise initiatives.

What Are the Most-Wanted Data Science Skills for 2016?

Data science crowdsourcing specialist CrowdFlower Inc. set out to determine what skills are most coveted by employers seeking to hire data scientists, finding an exceptionally strong demand for SQL.

What's in Store for Big Data in 2016?

In a time-honored New Year's tradition, industry players weigh in with their predictions for the Big Data landscape in 2016.

New Surveys Show Big Data Skills Shortage, Low Adoption Rate

Two separate studies recently confirmed that the much-publicized and long-lasting Big Data skills shortage is still hampering enterprises, most of which have yet to put the technology to use.

Confluent Updates Open Source, Kafka-Based Platform for Big Data Streaming

The Big Data streaming project Apache Kafka is all over the news lately, highlighted by Confluent Inc.'s new update of its Kafka-based Confluent Platform 2.0.

Apache Advances Open Source Kylin for OLAP-on-Hadoop

Just more than a year after being open sourced by creator eBay Inc., the Kylin project -- a Big Data distributed analytics engine -- has been advanced by the Apache Software Foundation (ASF) to top-level status.

MapR Adds Streaming for New Converged Big Data Platform

MapR Technologies today announced the upcoming addition of an event streaming system to its Apache Hadoop-based Big Data distribution, improving real-time analytics capabilities in a new rebranded, integrated and converged solution.