News, analysis and context on enterprise technology for the CTO
Like my colleague Alex Olesker, I too attended Cloudera Day 2012. While there were many panels of interest, perhaps one of the most important was Amr Awadallah's talk about big data applications to business intelligence. Many CTOVision readers with backgrounds in the intelligence community may think of corporate espionage when the phrase "business intelligence" is uttered, but I assure you that this is definitely not the case. Business intelligence is … [Read more...]
At Cloudera Day, Cloudera software engineed Todd Lipcon Delivered a Deep Dive on the Core of Cloudera's Distribution including Apache Hadoop (CDH), detailing tweaks and planned improvements to the Hadoop core. Just a few days later, some of these planned improvements were implemented when Cloudera released CDH3, Update 3, and more will be made for the upcoming CDH4. Many tweaks need to be configured by the user, so if you want your cluster running … [Read more...]
In January, the CTOvision team covered many exciting developments in disruptive technology. As always, we focused on the most important trends for CTOs and the federal government such as Big Data, cloud computing, and mobile. We also looked at success stories and predicted future technology developments. For the first time this month provided a way to consume CTOvision on your mobile device through Google Currents by clicking this link in your mobile … [Read more...]
Carahsoft hosted a Cloudera Day in the DC area on 26 January 2012. Cloudera executives speaking at the event included their CEO Mike Olson, CTO Amr Awadallah, VP of Product Charles Zedlewski, VP of Customer Solutions Omer Trajman, and Cloudera's Architect Doug Cutting. Doug is known as the founder of many successful open source projects including Lucene, Nutch, and Hadoop. The event was heavily attended by government and private sector … [Read more...]
We have previously provided a Quickstart guide to standing up Rackspace cloud servers (and have one for Amazon servers as well). These are very low cost ways of building reliable, production ready capabilities for enterprise use (commercial and government). And Bryan Halfpap has provided a Quickstart guide which shows you how to build a Hadoop Cluster (leveraging Cloudera's CDH3). Using Bryan's guide you can have a Hadoop Cluster up and running in … [Read more...]
Two years ago, the Department of Energy's Office of Advanced Scientific Computing Research launched the Magellan project, a research and development effort aimed at harnessing cloud computing for the most demanding information processing of the national labs. A distributed testbed infrastructure was deployed at the Argonne Leadership Computing Facility and the National Energy Research Scienti cComputingCenter, then benchmarked for some of the most … [Read more...]
The Federal Data Center Consolidation Initiative (FDCCI) is an important initiative in the federal space that seeks to enhance how the government delivers IT services in agencies and in some cases to citizens. Consolidating data centers offers opportunities for CIOs and CTOs to change IT strategy and implementations. The FDCCI should lead to improved federal capabilities while lessening the financial brunt on the taxpayers. Join Carahsoft, Doug … [Read more...]
On January 19, Carahsoft hosted a webinar on Big Data success in government with Bob Gourley and Omer Trajman of Cloudera. Bob began by explaining the current state of Big Data in the government. There are 4 areas of significant activity in Big Data. Federal integrators are making large investments in research and development of solutions. Large firms like Lockhead Martin, Boeing, Northrop Grumman, QinetiQ, SAIC as well as smaller "boutique" … [Read more...]
Thursday January 19, 2012 Carahsoft and Cloudera are presenting a webinar on Big Data in the federal space. The following is from their announcement site: Join us as we describe big data technologies including Apache Hadoop and how government organizations have been successfully deploying these technologies. We will discuss the fundamentals of Hadoop and how it fits into government initiatives. In this live webcast, Bob Gourley, Editor of … [Read more...]
Digital Reasoning defines Big Data as too large, accumulating too fast, and too diverse in format and location to handle with conventional software and infrastructure. Big Data leads to information overload in government and industry, such as when logs and audits gather information that a business can't track, when an influx of human, signals, satellite, and drone video intelligence cause an analyst in the IC to lose or miss important security … [Read more...]