Apache Spark integration and real-time big data processing headline the new features in Talend 6, the latest release of the open source big data platform, which is out this week.

Christopher Tozzi, Contributing Editor

October 1, 2015

1 Min Read
Spark vs. Hadoop: Talend 6 Offers Real-Time Big Data Analytics

Apache Spark integration and real-time big data processing headline the new features in Talend 6, the latest release of the open source big data platform, which is out this week.

Talend says the newest version of its platform, which comes in both a free, open source edition as well as a commercial, subscription-based one, is "the industry’s first and only data integration platform with native support for Apache Spark and Spark Streaming." Spark is a big data platform that focuses on in-memory computing, delivering much faster processing speeds than Hadoop-based big data tools in certain situations.

According to Talend, the Spark integration allows Talend 6 to support real-time big data analytics. "Now, for the first time, all the ingredients are coming together to form an integrated real-time big data supply chain that will transform how we do business," Talend CMO Ashley Stirrup said in a blog post announcing the Talend 6 release.

While the big feature in Talend 6 is extended Spark support, the company remains eager to work with customers accustomed to Hadoop-based big data jobs by converting them to Spark. Talend 6 can convert MapReduce workloads—the kind that usually involve Hadoop—to Spark jobs, "resulting in an immediate 5x performance increase," according to the company.

Talend also says that interface enhancements in the new release will speed work for big data engineers. Talend 6 "will improve developer productivity 10x as compared to hand-coding thanks to its intuitive design interface and prebuilt Spark components with automated 'no coding required' Spark code generation," the company said in a product announcement.

From the channel perspective, Talend's position is clear: It's betting that Spark is the future of big data, and Hadoop's day has come and gone.

Read more about:

AgentsMSPsVARs/SIs

About the Author(s)

Christopher Tozzi

Contributing Editor

Christopher Tozzi started covering the channel for The VAR Guy on a freelance basis in 2008, with an emphasis on open source, Linux, virtualization, SDN, containers, data storage and related topics. He also teaches history at a major university in Washington, D.C. He occasionally combines these interests by writing about the history of software. His book on this topic, “For Fun and Profit: A History of the Free and Open Source Software Revolution,” is forthcoming with MIT Press.

Free Newsletters for the Channel
Register for Your Free Newsletter Now

You May Also Like