In-Memory Hadoop—use it when speed matters.

GG-Logo-1It is always interesting when two hot technologies come together. The CA based software house, GridGain, has brought together In-Memory and Hadoop by offering a high-performance in-memory file system. It is even 100% compatible with HDFS. GridGain File System (GGFS) is a plug-and-play alternative to the disk-based Hadoop HDFS. Enabling up to 10x faster performance for IO and network intensive Hadoop MapReduce jobs running on 10s and 100s of computers in any Hadoop cluster.

Unlike any other file system, GGFS can work as either a standalone file system in Hadoop cluster or work in tandem with HDFS, providing a primary caching layer for the secondary HDFS. As a caching layer it provides highly configurable read-through and write-through behavior. In either case GGFS can be used as a drop-in alternative for, or an extension of, standard HDFS providing an instant performance boost.

Interestingly GridGain’s In-Memory Hadoop isn’t yet another proprietary Hadoop distribution, rather, it is a Hadoop accelerator that works with any choice of Hadoop distribution (including the highly reliable, 100% open source CDH from Cloudera). The architecture behind In-Memory Hadoop gives you the freedom to not only chose any Hadoop distribution but to also use any of the dozens of Hadoop-based tools that you currently utilize. Whether you use the standard tools such as HBase, Hive, Mahout, Oozie, Flume, Scoop, Pig, or any of the commercial BI, data visualization, or data analytics platforms – you can continue to use them without any change while enjoying an instant performance boost.

Another hot feature with In-Memory Hadoop is the GUI-based management and monitoring tool called Visor. It provides deep development and operational capabilities including an operations & telemetry dashboard, data grid and compute grid management, as well as GGFS monitoring and file management between HDFS, local and GGFS file systems.

If you want to read more or need faster Hadoop, see

CTOvision Pro Special Technology Assessments

We produce special technology reviews continuously updated for CTOvision Pro members. Categories we cover include:

  • Analytical Tools - With a special focus on technologies that can make dramatic positive improvements for enterprise analysts.
  • Big Data - We cover the technologies that help organizations deal with massive quantities of data.
  • Cloud Computing - We curate information on the technologies enabling enterprise use of the cloud.
  • Communications - Advances in communications are revolutionizing how data gets moved.
  • GreenIT - A great and virtuous reason to modernize!
  • Infrastructure  - Modernizing Infrastructure can have dramatic benefits on functionality while reducing operating costs.
  • Mobile - This revolution is empowering the workforce in ways few of us ever dreamed of.
  • Security  -  There are real needs for enhancements to security systems.
  • Visualization  - Connecting computers with humans.
  • Hot Technologies - Firms we believe warrant special attention.


Recent Research

Tech Firms Seeking To Serve Federal Missions: Here is how to follow the money

Creating The New Cyber Warrior: Eight South Carolina Universities Compete

Mobile Gamers: Fun-Seeking but Fickle

Update from DIA CTO, CIO and Chief Engineer on ICITE and Enterprise Apps

Pew Report: Increasing Technology Use among Seniors

Finding The Elusive Data Scientist In The Federal Space

DoD Public And Private Cloud Mandates: And insights from a deployed communications professional on why it matters

Intel CEO Brian Krzanich and Cloudera CSO Mike Olson on Intel and Cloudera’s Technology Collaboration

Watch For More Product Feature Enhancements for Actifio Following $100M Funding Round

Navy Information Dominance Corps: IT still searching for the right governance model

DISA Provides A milCloud Overview: Looks like progress, but watch for two big risks

Innovators, Integrators and Tech Vendors: Here is what the government hopes they will buy from you in 2015

About Kimberly Kelly

Kimberly Kelly has been involved in entrepreneurial activities on the Internet since she was 8 years old when she created an organization raising over $2000.00 for charities. Since that time she has continued to immerse herself in technology for positive change. She writes at and and the new analysis focused Analyst One.

  • Peter Fretty

    I find it encouraging to see more organizations utilizing data analytics as a whole, and especially encouraging when progressive firms empower their user base to access tools from mobile environments. The convergence of cloud, big data and mobility is just beginning and should bring about a host of new opportunities for businesses to achieve what T-Systems calls zero distance.

    Peter Fretty, IDG blogger