Welcome!

Weblogic Authors: Yeshim Deniz, Elizabeth White, Michael Meiner, Michael Bushong, Avi Rosenthal

Related Topics: @CloudExpo

@CloudExpo: Blog Post

Will Database.com Handle Big Data?

Salesforce.com's New Database-as-a-Service

I'm really looking forward to next week's sneak peek webinar of Salesforce's new DaaS (database-as-a-service) appropriately named Database.com. Salesforce is touting the new service as the premiere cloud database for enterprises "that is designed for the next generation of collaborative, mobile and real-time apps." The question I have is will Database.com give any real or affordable options for handling big data?

What is Big Data? To simplify, big data refers to datasets that are so large they become unmanageable using traditional database management tools (think hundreds of terabytes or event petabytes of data). Big Data datasets can also be highly unstructured, meaning that the data in them doesn't fit neatly into a traditional relational database. Handling this type of data requires new sets of tools and frameworks that are designed for capturing, storing, searching, and analyzing such large amounts of data.

But Who Needs to Worry About Processing This Much Data? In the past, the problems associated with handling datasets of this size might have been limited to only the largest research institutions like NASA, CDC, National Weather Service, etc. However, with the explosion of new social and mobile applications and the ubiquity of mobile devices it's no longer unthinkable to amass such large datasets. For example, there are more than 30 billion (yes, billion) pieces of content shared on Facebook each month. All of these data points have to get stored in a database, right? Yep. And when you login to your Facebook account the system has to query all of your friends, then query all of your friends' shared content, and then display it in your news feed - all in a matter of milliseconds. Now multiply that by 600 million users.

Database.com is for the Enterprise, Not Wannabe Facebook Startups, Right? Right. Well... wait. Actually...well, I'm not sure. This is a good question. Although I follow Salesforce pretty closely and stay on top of what's happening in the community I'm still uncertain as to Database.com's ultimate business model and who it's mainly geared toward. With Database.com's pre-built toolkits for Ruby, iOS, Android, PHP, and it's recent acquisition of Heroku it would seem as though Salesforce is targeting web application developers in general who need a scalable database. I could also see existing Salesforce CRM or Platform customers building Business-to-Consumer web applications that are integrated with their existing Salesforce database. But as your active user base increases, and if you provide social and mobile aspects to your application, then your content storage, search, analysis, and computational needs are going to increase as well. And if there's one thing I know about Salesforce it's that additional storage capacity gets quite expensive.

What's Out There for Managing Big Data? This is an enormous topic and well beyond exploration in the scope of this post. However, there are a number of technologies that have emerged in the last several years, primarily from Google and Yahoo, since internet search engines were among the first companies to encounter the challenges with big data. Open Source technologies such as Hadoop, MapReduce, and BigTable are among the core of big data management. It essentially requires spreading out the storage and transactional computations among a distributed network of servers. Companies like CloudEra have emerged to offer services and proprietary software that help companies more easily implement and maintain these data management systems. Here are some additional resources on Big Data:

Here's a great video of Robert Scoble interviewing Mike Olson, CloudEra's CEO, on the evolution from conventional relational databases to systems more conducive to processing big data.

Is This the Future of Data Management? Things were simpler in an era when most data in enterprise databases was human-created and consisted of structured data made up of nice, neat rows and columns. It was hard to amass gigabytes of data, much less terabytes... and petabytes? Forget it. But now, with the ability and desire of companies to store and analyze information from so many data-producing devices, and with the seeming necessity to create social applications in a world where mobile devices can lead to a constant stream of pictures, text, files, videos, and other content being saved and queried - finding yourself in a world of big data might soon be the new norm.

More Stories By Clint Lee

Clint is a Principal and Founder of The Flywheel Group, a premier provider of innovative solutions to the franchise industry. The FranchiseFlywheel™ application was developed out of the industry's need for a cutting-edge and affordable franchise management tool for franchisors. Spending several years in the franchise industry directing daily activities related to franchise and business development processes, marketing, lead-generation, and contract administration, and an understanding of the needs of peers and colleagues, led to the development of the application. The Flywheel Group is focused on improving best practices and driving change in the franchise industry by introducing industry-leading solutions and working with its clients to re-engineer business processes that will ultimately enhance revenue and improve bottom line efficiency. Clint actively writes and shares his thoughts on the Flywheel Blog.

IoT & Smart Cities Stories
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
SYS-CON Events announced today that Silicon India has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Published in Silicon Valley, Silicon India magazine is the premiere platform for CIOs to discuss their innovative enterprise solutions and allows IT vendors to learn about new solutions that can help grow their business.
DXWorldEXPO LLC announced today that "IoT Now" was named media sponsor of CloudEXPO | DXWorldEXPO 2018 New York, which will take place on November 11-13, 2018 in New York City, NY. IoT Now explores the evolving opportunities and challenges facing CSPs, and it passes on some lessons learned from those who have taken the first steps in next-gen IoT services.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
Founded in 2000, Chetu Inc. is a global provider of customized software development solutions and IT staff augmentation services for software technology providers. By providing clients with unparalleled niche technology expertise and industry experience, Chetu has become the premiere long-term, back-end software development partner for start-ups, SMBs, and Fortune 500 companies. Chetu is headquartered in Plantation, Florida, with thirteen offices throughout the U.S. and abroad.
SYS-CON Events announced today that DatacenterDynamics has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY. DatacenterDynamics is a brand of DCD Group, a global B2B media and publishing company that develops products to help senior professionals in the world's most ICT dependent organizations make risk-based infrastructure and capacity decisions.
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
Nicolas Fierro is CEO of MIMIR Blockchain Solutions. He is a programmer, technologist, and operations dev who has worked with Ethereum and blockchain since 2014. His knowledge in blockchain dates to when he performed dev ops services to the Ethereum Foundation as one the privileged few developers to work with the original core team in Switzerland.
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
DXWorldEXPO LLC announced today that ICOHOLDER named "Media Sponsor" of Miami Blockchain Event by FinTechEXPO. ICOHOLDER gives detailed information and help the community to invest in the trusty projects. Miami Blockchain Event by FinTechEXPO has opened its Call for Papers. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Miami Blockchain Event by FinTechEXPOalso offers sp...