In-Memory Hadoop—use it when speed matters.

GG Logo 1 300x152 In Memory Hadoop—use it when speed matters.It is always interesting when two hot technologies come together. The CA based software house, GridGain, has brought together In-Memory and Hadoop by offering a high-performance in-memory file system. It is even 100% compatible with HDFS. GridGain File System (GGFS) is a plug-and-play alternative to the disk-based Hadoop HDFS. Enabling up to 10x faster performance for IO and network intensive Hadoop MapReduce jobs running on 10s and 100s of computers in any Hadoop cluster.

Unlike any other file system, GGFS can work as either a standalone file system in Hadoop cluster or work in tandem with HDFS, providing a primary caching layer for the secondary HDFS. As a caching layer it provides highly configurable read-through and write-through behavior. In either case GGFS can be used as a drop-in alternative for, or an extension of, standard HDFS providing an instant performance boost.

Interestingly GridGain’s In-Memory Hadoop isn’t yet another proprietary Hadoop distribution, rather, it is a Hadoop accelerator that works with any choice of Hadoop distribution (including the highly reliable, 100% open source CDH from Cloudera). The architecture behind In-Memory Hadoop gives you the freedom to not only chose any Hadoop distribution but to also use any of the dozens of Hadoop-based tools that you currently utilize. Whether you use the standard tools such as HBase, Hive, Mahout, Oozie, Flume, Scoop, Pig, or any of the commercial BI, data visualization, or data analytics platforms – you can continue to use them without any change while enjoying an instant performance boost.

Another hot feature with In-Memory Hadoop is the GUI-based management and monitoring tool called Visor. It provides deep development and operational capabilities including an operations & telemetry dashboard, data grid and compute grid management, as well as GGFS monitoring and file management between HDFS, local and GGFS file systems.

If you want to read more or need faster Hadoop, see GridGain.com.

 In Memory Hadoop—use it when speed matters.

CTOvision Pro Special Technology Assessments

We produce special technology reviews continuously updated for CTOvision Pro members. Categories we cover include:

  • Analytical Tools - With a special focus on technologies that can make dramatic positive improvements for enterprise analysts.
  • Big Data - We cover the technologies that help organizations deal with massive quantities of data.
  • Cloud Computing - We curate information on the technologies enabling enterprise use of the cloud.
  • Communications - Advances in communications are revolutionizing how data gets moved.
  • GreenIT - A great and virtuous reason to modernize!
  • Infrastructure  - Modernizing Infrastructure can have dramatic benefits on functionality while reducing operating costs.
  • Mobile - This revolution is empowering the workforce in ways few of us ever dreamed of.
  • Security  -  There are real needs for enhancements to security systems.
  • Visualization  - Connecting computers with humans.
  • Hot Technologies - Firms we believe warrant special attention.

 

solid
About Kimberly Kelly

Kimberly Kelly has been involved in entrepreneurial activities on the Internet since she was 8 years old when she created an organization raising over $2000.00 for charities. Since that time she has continued to immerse herself in technology for positive change. She writes at CTOvision.com and DelphiBrief.com and the new analysis focused Analyst One.

Comments

  1. I find it encouraging to see more organizations utilizing data analytics as a whole, and especially encouraging when progressive firms empower their user base to access tools from mobile environments. The convergence of cloud, big data and mobility is just beginning and should bring about a host of new opportunities for businesses to achieve what T-Systems calls zero distance.

    Peter Fretty, IDG blogger