Hadoop and Business Intelligence

BusinessIntelCTO

Like my colleague Alex Olesker, I too attended Cloudera Day 2012.  While there were many panels of interest, perhaps one of the most important was Amr Awadallah's talk about big data applications to business intelligence. Many CTOVision readers with backgrounds in the intelligence community may think of corporate espionage when the phrase "business intelligence" is uttered, but I assure you that this is definitely not the case. Business intelligence is … [Read more...]

Registration now open for Government Big Data Forum: 6 March 2012, DC

Registration is now open for the next full meeting of the Government Big Data Forum.  This event will very likely be booked full in a very short time so please check your calendar now and if you can make it register right away. The event will be heavy on lessons learned and use cases from industry. Learn from folks who have lots of lessons to share. Visit this link: http://events.carahsoft.com/event-detail/1378/ The following is from the … [Read more...]

A Swarm of Nano Quadrotors: The flying robot video you absolutely must watch

nanoquadrotors-2

As you watch the video below you can form your own conclusions about this natural evolution of robotics.  But I'll give you some of my opinions below the video: http://youtu.be/YQIMGV5vtd4 Now some context: As a technologist I would like to remind you all that every future use case for incredibly capable systems like this will involve IT with moving parts, and all IT with moving parts requires IT guys to fix them when they break. So guess … [Read more...]

FDCCI Preparation with Virtual Instruments and Carahsoft

Team up with Carahsoft and Virtual Instruments to prepare for the FDCCI

Last week I attended a Carahsoft webinar with Virtual Instruments' Doug Norton and our very own Bob Gourley. The topic was the Federal Data Center Consolidation Initiative, and what Virtual Instruments can do to help prepare your agency for consolidation. The key capability that Virtual Instruments brings to the table is the ability to identify and create real metrics for your data center and across the SAN. VI uses fibre channel technologies to copy … [Read more...]

Improving Hadoop Performance with Optimization, CDH3 Update 3, and CDH4

mahout

At Cloudera Day, Cloudera software engineed Todd Lipcon Delivered a Deep Dive on the Core of Cloudera's Distribution including Apache Hadoop (CDH), detailing tweaks and planned improvements to the Hadoop core. Just a few days later, some of these planned improvements were implemented when Cloudera released CDH3, Update 3, and more will be made for the upcoming CDH4. Many tweaks need to be configured by the user, so if you want your cluster running … [Read more...]

Cloudera Day in DC

hadoop

Carahsoft hosted a Cloudera Day in the DC area on 26 January 2012. Cloudera executives speaking at the event included their CEO Mike Olson, CTO Amr Awadallah, VP of Product Charles Zedlewski, VP of Customer Solutions Omer Trajman, and Cloudera's Architect Doug Cutting. Doug is known as the founder of many successful open source projects including Lucene, Nutch, and Hadoop. The event was heavily attended by government and private sector … [Read more...]

Hadoop Quickstart: Use Whirr to automate standup of your distributed cluster on Rackspace

whirr-logo

We have previously provided a Quickstart guide to standing up Rackspace cloud servers (and have one for Amazon servers as well). These are very low cost ways of building reliable, production ready capabilities for enterprise use (commercial and government).  And Bryan Halfpap has provided a Quickstart guide which shows you how to build a Hadoop Cluster (leveraging Cloudera's CDH3).  Using Bryan's guide you can have a Hadoop Cluster up and running in … [Read more...]

An Update on Liquid Robotics

Wave Glider

    Liquid Robotics, a company led by CEO Bill Vass, is making huge inroads in sensor deployments in some of the most difficult to monitor parts of our planet.  That is, the vast, open ocean.  Liquid Robotics has developed a maritime robot that can travel thousands of miles, carry different payloads, energize itself from ocean wave movement, and transmit large amounts of data in real time to its users.  This surfboard looking robot … [Read more...]

Big Data Success in Government

hadoop

On January 19, Carahsoft hosted a webinar on Big Data success in government with Bob Gourley and Omer Trajman of Cloudera.  Bob began by explaining the current state of Big Data in the government.  There are 4 areas of significant activity in Big Data. Federal integrators are making large investments in research and development of solutions.  Large firms like Lockhead Martin, Boeing, Northrop Grumman, QinetiQ, SAIC as well as smaller "boutique" … [Read more...]

Digital Reasoning’s Synthesys

Digital

Digital Reasoning defines Big Data as too large, accumulating too fast, and too diverse in format and location to handle with conventional software and infrastructure. Big Data leads to information overload in government and industry, such as when logs and audits gather information that a business can't track, when an influx of human, signals, satellite, and drone video intelligence cause an analyst in the IC to lose or miss important security … [Read more...]