Welcome!

Weblogic Authors: Yeshim Deniz, Elizabeth White, Michael Meiner, Michael Bushong, Avi Rosenthal

Related Topics: @BigDataExpo, @CloudExpo, @ThingsExpo

@BigDataExpo: Blog Feed Post

Identifying Where and How to Start the Big Data Journey | @BigDataExpo #BigData #DataLake #Analytics

Organizations are eager to realize the business benefits of Big Data that they don’t take the time to do the little things first

Decisions Exercise: Identifying Where and How to Start the Big Data Journey

The recent deluge of rains in Northern California have flooded streets, brought down trees and plugged storm sewers.  As I was trying to make my way around the neighborhood, I thought of a classroom exercise to help my MBA students to identify the use cases upon which they could focus data and analytics.  In this exercise, I’m going to ask my students to pretend that they have been hired by the city to “Optimize Street Maintenance” after these rainstorms. In particular, the students need to address the following questions:

  • Where and how do you start to address this initiative?
  • What data might you need to support this initiative?

These are classic questions that I hear all the time when I meet with clients about their big data journeys.  Let’s walk through how I’ll teach my students to address this challenge.

Step 1:  Identify and Brainstorm the Decisions
“Where and how to start?” is such an open ended question.  How does one even begin to think about that question?  We recommend that organizations start by identifying the decisions that need to be made to support the targeted business initiative, which is “Optimize Street Maintenance” in this exercise.

I will break up the students into small groups (3 to 5 students) and ask them to brainstorm the decisions that need to be made with respect to the “Optimize Street Maintenance” initiative.  Those decisions could include:

  • What streets and intersections need maintenance?
  • What storm sewers are blocked?
  • What is blocking those storm sewers?
  • What sort of maintenance is needed?
  • What is the impact of street cleaning and debris removal on flooding?
  • What streets and intersections should we fix first?
  • How busy are the streets and intersections?
  • What worker skills are needed to fix the street?
  • What equipment and materials are needed to fix the street?
  • What time of the day / day of the week is ideal for doing that maintenance work?
  • How many workers are available?
  • Do I have access to temporary workers?
  • How much overtime can I afford?
  • How do I warn residents that a road is flooded?
  • What options do I give residents when the major arteries are flooded?

This brainstorming is much more effective when you have brought together the different business stakeholders who either impact or are impacted by the “Accelerate Street Maintenance” initiative (see Figure 1).

Figure 1: Brainstorm Decisions Across Different Stakeholders

Some key process points about Step 1:

  • Allow individuals to brainstorm on their own at first. When it is entirely a group exercise, some folks go quiet and we potentially lose some good ideas.
  • Be sure to capture each decision on a separate Post-It note for later usage.
  • Place the decisions/Post-it Notes on a flip chart (or two).
  • You don’t need to group decisions by business function. I just did it here to demonstrate the process.

Finally, “all ideas are worthy of consideration.”  This is the key to any brainstorming session; to create an environment where everyone feels comfortable to contribute without someone passing judgment about his or her thoughts or ideas.

Step 2:  Group Decisions Into Use Cases
Next, we want to group the decisions into common subject areas or use cases (which is much easier to do if each decision is captured on a separate Post-It note).  I will bring all the students together around the decisions on Post-it Notes, and have them look for logical groupings.

Looking over the decisions captured above, we can start to see some natural “Accelerate Street Maintenance” use cases emerging, such as:

Prioritize Streets and Intersections

  • What streets and intersections should we fix first?
  • What streets and intersections are busiest at what times of the day?
  • What are the alternative route options during maintenance?
  • What are the alternative transportation options during maintenance?
  • What business parks or malls will be disrupted by the maintenance work?
  • Which streets and intersections raise safety concerns for bikers and pedestrians?

Estimate Maintenance Effort

  • What streets and intersections need maintenance?
  • What storm sewers need maintenance?
  • How much maintenance is needed?
  • What type of maintenance is needed?
  • What worker maintenance skills are needed?
  • What types of equipment and materials are needed?

Optimize Maintenance Effort

  • What worker skills are needed to fix the street?
  • How many workers with those skills are available?
  • What equipment is available to fix the street?
  • What tools are needed to fix the street?
  • What materials (concrete, asphalt) are needed to fix the street?
  • How effective is street cleaning and debris removal in preventing flooding?

Minimize Traffic Disruptions

  • Which streets are bottlenecks for schools and at what times of the day?
  • Which streets are bottlenecks for shopping malls and at what times of the day?
  • Which streets are bottlenecks for business parks and at what times of the day?
  • What are the alternative route options?
  • What are the public transportation options?

Minimize Maintenance Costs

  • How many workers are available?
  • To what temporary workers do we have access?
  • How much overtime can I afford?
  • How much maintenance budget is available?

Improve Resident Communications

  • What streets need maintenance?
  • What streets and intersections are likely to need maintenance?
  • What are alternative travel routes?
  • What are alternative transportation options?

Increase Resident Satisfaction

  • How many residents did the flooding impact?
  • How long were those residents impacted?
  • What comments or feedback are most important and/or relevant?
  • What phone calls are most important and/or relevant?
  • What social media postings are important and/or relevant?

See Figure 2 for an example of how the end point of Step 2 might look.

A key process point about Step 2:

  • Ideally you will end up with 7 to 12 use cases. If you have fewer than 7, then look for ways to break up some of the groupings.  If you have more than 12, then look for ways to aggregate similar use cases.  Not sure why, but 7 to 12 use cases always seems to work out to the right level of granularity in the use cases.

Step 3:  Prioritize Use Cases
Not all use cases are equal, and some use cases are dependent upon other use cases.  The prioritization matrix takes the different business stakeholders through a facilitated process to prioritize each use case vis-à-vis its business value and implementation feasibility (see Figure 3).

Figure 3: Prioritization Matrix

For more details on the prioritization process, check out these blogs:

Summary
The news really surprised no one:  “MD Anderson Benches IBM Watson In Setback For Artificial Intelligence In Medicine.”  From the press release:

“The partnership between IBM and one of the world’s top cancer research institutions is falling apart. The project is on hold, MD Anderson confirms, and has been since late last year. MD Anderson is actively requesting bids from other contractors who might replace IBM in future efforts.  And a scathing report from auditors at the University of Texas says the project cost MD Anderson more than $62 million and yet did not meet its goals.”

If big data were only about buying and installing technology, then it would be easy.  Unfortunately, companies are learning the hard way that the “big bang” approach for implementing big data is fraught with misguided expectations and outright failures.

Organizations are so eager to realize the business benefits of big data, that they don’t take the time to do the little things first, like identifying and prioritizing those use cases that offer the optimal mix of business value and implementation feasibility. While I applaud all efforts to cure cancer (my mom died from cancer, so I have a vested interest like so many others), sometimes “curing cancer” might not be the best place to start.  Identifying and prioritizing those use cases that move the organization towards that “cure cancer” aspiration is the best way to achieve that goal.

The post Decisions Exercise: Identifying Where and How To Start the Big Data Journey appeared first on InFocus Blog | Dell EMC Services.

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business”, is responsible for setting the strategy and defining the Big Data service line offerings and capabilities for the EMC Global Services organization. As part of Bill’s CTO charter, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He’s written several white papers, avid blogger and is a frequent speaker on the use of Big Data and advanced analytics to power organization’s key business initiatives. He also teaches the “Big Data MBA” at the University of San Francisco School of Management.

Bill has nearly three decades of experience in data warehousing, BI and analytics. Bill authored EMC’s Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements, and co-authored with Ralph Kimball a series of articles on analytic applications. Bill has served on The Data Warehouse Institute’s faculty as the head of the analytic applications curriculum.

Previously, Bill was the Vice President of Advertiser Analytics at Yahoo and the Vice President of Analytic Applications at Business Objects.

@ThingsExpo Stories
SYS-CON Events announced today that Enzu will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY, and the 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enzu’s mission is to be the leading provider of enterprise cloud solutions worldwide. Enzu enables online businesses to use its IT infrastructure to their competitive ad...
The 21st International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Machine Learning and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding busin...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm.
SYS-CON Events announced today that delaPlex will exhibit at SYS-CON's @CloudExpo, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. delaPlex pioneered Software Development as a Service (SDaaS), which provides scalable resources to build, test, and deploy software. It’s a fast and more reliable way to develop a new product or expand your in-house team.
SYS-CON Events announced today that T-Mobile will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. As America's Un-carrier, T-Mobile US, Inc., is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The Company's advanced nationwide 4G LTE network delivers outstanding wireless experiences to 67.4 million customers who are unwilling to compromise on ...
Five years ago development was seen as a dead-end career, now it’s anything but – with an explosion in mobile and IoT initiatives increasing the demand for skilled engineers. But apart from having a ready supply of great coders, what constitutes true ‘DevOps Royalty’? It’ll be the ability to craft resilient architectures, supportability, security everywhere across the software lifecycle. In his keynote at @DevOpsSummit at 20th Cloud Expo, Jeffrey Scheaffer, GM and SVP, Continuous Delivery Busine...
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
SYS-CON Events announced today that Peak 10, Inc., a national IT infrastructure and cloud services provider, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Peak 10 provides reliable, tailored data center and network services, cloud and managed services. Its solutions are designed to scale and adapt to customers’ changing business needs, enabling them to lower costs, improve performance and focus intern...
SYS-CON Events announced today that Progress, a global leader in application development, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Enterprises today are rapidly adopting the cloud, while continuing to retain business-critical/sensitive data inside the firewall. This is creating two separate data silos – one inside the firewall and the other outside the firewall. Cloud ISVs ofte...
DevOps at Cloud Expo – being held October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real r...
SYS-CON Events announced today that Linux Academy, the foremost online Linux and cloud training platform and community, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Linux Academy was founded on the belief that providing high-quality, in-depth training should be available at an affordable price. Industry leaders in quality training, provided services, and student certification passes, its goal is to c...
SYS-CON Events announced today that Hitachi Data Systems, a wholly owned subsidiary of Hitachi LTD., will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City. Hitachi Data Systems (HDS) will be featuring the Hitachi Content Platform (HCP) portfolio. This is the industry’s only offering that allows organizations to bring together object storage, file sync and share, cloud storage gateways, and sophisticated search and...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 21st International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. @ThingsExpo Silicon Valley Call for Papers is now open.
SYS-CON Events announced today that DivvyCloud will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. DivvyCloud software enables organizations to achieve their cloud computing goals by simplifying and automating security, compliance and cost optimization of public and private cloud infrastructure. Using DivvyCloud, customers can leverage programmatic Bots to identify and remediate common cloud problems in rea...
SYS-CON Events announced today that Tintri, Inc, a leading provider of enterprise cloud infrastructure, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Tintri offers an enterprise cloud platform built with public cloud-like web services and RESTful APIs. Organizations use Tintri all-flash storage with scale-out and automation as a foundation for their own clouds – to build agile development environments...
SYS-CON Events announced today that Fusion, a leading provider of cloud services, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Fusion, a leading provider of integrated cloud solutions to small, medium and large businesses, is the industry’s single source for the cloud. Fusion’s advanced, proprietary cloud service platform enables the integration of leading edge solutions in the cloud, including cloud...
SYS-CON Events announced today that Systena America will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Systena Group has been in business for various software development and verification in Japan, US, ASEAN, and China by utilizing the knowledge we gained from all types of device development for various industries including smartphones (Android/iOS), wireless communication, security technology and IoT serv...
SYS-CON Events announced today that Technologic Systems Inc., an embedded systems solutions company, will exhibit at SYS-CON's @ThingsExpo, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Technologic Systems is an embedded systems company with headquarters in Fountain Hills, Arizona. They have been in business for 32 years, helping more than 8,000 OEM customers and building over a hundred COTS products that have never been discontinued. Technologic Systems’ pr...
SYS-CON Events announced today that Carbonite will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Carbonite protects your entire IT footprint with the right level of protection for each workload, ensuring lower costs and dependable solutions with DoubleTake and Evault.
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists will examine how DevOps helps to meet th...