With Talend Integration Suite MPX, Talend Introduces Extremely Scalable Data Integration for Large Data Volumes

* Reuters is not responsible for the content in this press release.

Tue May 19, 2009 8:01am EDT

Benchmark on New Sun Blade Server Proves Talend`s Latest Solution Has Risen
Above All Performance and Scalability Standards in a Complex Data Processing
Environment
LOS ALTOS, Calif.--(Business Wire)--
Talend, the recognized market leader in open source data integration software,
today announced the availability of Talend Integration Suite MPX, a new
enterprise data integration platform specially designed to help organizations
attain the highest levels of performance and shatter the limits typically
associated with traditional data integration processes. 

Based on Talend`s award winning, enterprise-grade data integration platform
Talend Integration Suite, the new solution introduces the company`s FileScale
technology. The latest breakthrough technology, FileScale, allows organizations
to conduct highly parallelized processing. FileScale enables enterprises to
process large volumes of data in even less time, while also eliminating the
limitations inherent in traditional data integration architectures. 

"Even as data volumes grow exponentially and processing windows shrink,
organizations are under pressure to process and load data even faster to support
time-sensitive, data-driven business methods, like operational business
intelligence, performance management, just-in-time inventory, one-to-one
marketing, and so on," said Philip Russom, a research manager at The Data
Warehousing Institute (TDWI). "Delivering large data volumes in a short period
of time demands a data integration infrastructure that seamlessly processes data
in parallel at every step of the way." 

Fully compatible with projects developed with Talend Integration Suite, MPX
leverages two key sets of features to attain extreme scalability:

* FileScale -- Talend's latest technology is based on the MapReduce architecture
originally developed by Google for highly distributed processing of data in a
data set mode. The FileScale components in Talend Integration Suite MPX allows
integration processes to sort, filter and merge data, perform aggregation and
arithmetic functions and transform and ensure the compliance of data. FileScale
components are especially optimized for each supported platform, ensuring the
highest possible performance.

* Massive Parallelization -- Talend Integration Suite MPX also features multiple
levels of massive parallelization, allowing the execution of separate
sub-processes in parallel, break down of data sets into many parallel streams
and the ability to leverage parallel database loaders.

With Talend Integration Suite MPX, IT organizations are able to process high
volumes of data very quickly, providing the most up to date insight into the
enterprise`s operations. Data warehouses and analytic applications can be
refreshed more often and can include more granular data for more accurate
analysis--all in efforts to equip the enterprise to make more informed and
accurate business decisions. 

"More customers are realizing their data is an untapped resource and looking for
an effective solution to leverage their data. Talend Integration Suite MPX
addresses the true needs of the enterprise by providing high volume data
processing," said Fabrice Bonan, co-founder and COO of Talend. "This new
solution, which has outperformed all benchmarks, introduces a new implementation
of ground-breaking technology and algorithms and takes data processing to the
next level." 

A benchmark was performed with Sun Microsystems on a Sun Blade X6270 server,
featuring two Xeon 5520 quadcore processors at 2,26GHz and 24 GB of RAM, and
running Solaris 10 update 6. In this benchmark, Talend Integration Suite MPX
reached levels of scalability in sorting and calculation tests that have never
been met before. The benchmark was performed with industry-standard TPC-H data
sets, ranging in size from six million to 3.3 billion records. 

Results of the benchmark highlighted the following performance metrics:

* In-memory sorting of data reaching up to one million records per second with
linear scalability. 
* Record-breaking sorting of large data sets (3.3 billion records) at a speed of
200,000 to 400,000 records per second. 
* Average calculation on large data sets (3.3 billion records) reaching 220,000
records per second.

Full results of the benchmark, analyzed and noted by Sun's performance expert,
Amir Javanshir, can be obtained here:
http://blogs.sun.com/aja/entry/talend_s_new_data_processing. 

Talend Integration Suite MPX is available immediately and has been optimized on
the following platforms: Windows 32 & 64 bit, Solaris & OpenSolaris (SPARC &
Intel x86), IBM AIX, HP-UX and Linux 32 & 64 bit. For more information, please
visit http://www.talend.com. 

About Talend

Talend is the recognized market leader in open source data integration. More
than 500 paying customers around the globe, including Yahoo!, Virgin Mobile,
Sony and Swiss Life, use the Talend Integration Suite of products and services
to optimize the costs of data integration, ETL and data quality. With more than
four million lifetime downloads and 900,000 core product downloads, Talend`s
solutions are the most widely used and deployed data integration solutions in
the world. The company has major offices in North America, Europe and Asia, and
a global network of technical and services partners. For more information,
please visit http://www.talend.com. 





Talend
Yves de Montcheuil
press@talend.com
or
Schwartz Communications
Payal Cudia, 781-684-0770
talend@schwartz-pr.com

Copyright Business Wire 2009

Comments (0)
This discussion is now closed. We welcome comments on our articles for a limited period after their publication.