Cloudera is building a new open-source storage engine called Kudu, sources say

Cloudera CeBIT Flickr

EXCLUSIVE:

Big data company Cloudera is preparing to launch major new open-source software for storing and serving lots of different kinds of unstructured data, with an eye toward challenging heavyweights in the database business, VentureBeat has learned.

The storage engine, Kudu, is meant as an alternative to the widely used Hadoop Distributed File System and the Hadoop-oriented HBase NoSQL database, borrowing characteristics from both, according to a copy of a slide deck on Kudu’s design goals that VentureBeat has obtained. The technology will be released as Apache-licensed open-source software, the slides show.

Cloudera has had one of its early employees leading a small team to work on Kudu for the past two years, and the company has begun pitching the software to customers before an open-source release at the end of this month, a source familiar with the matter told VentureBeat.

From VentureBeat

Get faster turnaround on creative, more testing, smarter improvements and better results. Learn how to apply agile marketing at our roadshow in SF.

That source and others believe Kudu could present a new threat to data warehouses from Teradata and IBM’s PureData (formerly Netezza), and other vendors. It may also be used as a highly scalable in-memory database that can handle massively parallel processing (MPP) workloads, not unlike HP’s Vertica and VoltDB, the sources say. And one day Kudu — which works across multiple data centers with RAM and fast solid-state drives (SSDs) — could even play a part in backup and disaster recovery.

Cloudera declined to comment.

However Cloudera chooses to market Kudu, it’s clear that the software is a big step forward for the company, not only in the company’s efforts to outdo other Hadoop vendors, but also in its quest to become a prominent player in enterprise software.

Not that Cloudera is a nobody. It’s worth almost $ 5 billion, according to one recent estimate, it has considerable backing from Intel, and it’s been positioning itself as a competitor to much larger database companies, like IBM and Oracle. But the fact is, fellow Hadoop vendor Hortonworks has gained credibility after it went public last year, and Hadoop company MapR is still around, too.

Cloudera recently doubled down on the rising Apache Spark open-source big data processing framework, but Spark is something Cloudera has been working on for years. And a few months ago, Cloudera brought new Python capability to Hadoop, following its acquisition of DataPad last year. Those are important efforts, but Kudu is something entirely new, something that can give the company freshness as it grows toward an initial public offering.

So what is Kudu, then?

It’s “nearly as fast as raw HDFS for scans” and, at the same time, “nearly as fast as HBase for random access,” according to one slide from a presentation on Kudu’s design goals. But Kudu is not meant to be a drop-in substitute for HDFS or HBase. “There are still places where these systems will be optimal, and Cloudera will continue to support and invest in them,” a slide said.

Kudu could be used for time-series data, or real-time reporting, or model building, according to another slide.

And it’s important to note that Kudu isn’t a SQL query engine for pulling up specific data. Cloudera has Impala for that, and others have Hive for that. Kudu has an “early integration” with Impala, and Spark support is coming, according to a slide.

The Kudu application programming interface (API) works with Java — the common language of Hadoop — as well as C++. Kudu’s architecture allows for operation across sites, according to one slide. That makes it comparable to Google’s Spanner and the Spanner-inspired CockroachDB. That could make Kudu a great choice for big companies looking to store their big data around the world.

Is Kudu well adopted, though? No, not yet.

“Looking for beta customers,” a slide said.

More information:

Powered by VBProfiles



RSS-4

Ubuntu Make Now Lets Users Install the Unity 3D Editor in Ubuntu Linux

Ubuntu Make Now Lets Users Install the Unity 3D Editor in Ubuntu Linux
Didier Roche, the creator of the Ubuntu Make command-line utility that lets users of the Ubuntu Linux operating system install various useful third-party projects, has announced the release of a new maintenance version. Ubuntu Make 15.09 is now …
Read more on Softpedia News

ownCloud Announces Ubuntu-Based Appliance with ownCloud Proxy
Being based on the long-term supported Ubuntu 14.04 (Trusty Tahr) operating system, the ownCloud Appliance comes fully pre-configured and includes the ownCloud Proxy app, which was introduced during the ownCloud Contributor Conference event that …
Read more on Softpedia News


RSS-4

Get the most out of your marketing stack by unifying data sources

puzzle pieces

GUEST:

When it comes to getting the most value out of data, successful companies take a practical approach, first defining their own data strategy and then determining the tools needed to get it done. A good example of this is Airbnb, which set their own data strategy and tools to help users more accurately price their home listings. Too often, however, companies fail to lay out a clear strategy, instead relying on the available tools to show them where they need to go. Unfortunately, these tools usually serve up packaged metrics with data that is too detailed and lacks cohesion.

The mobile marketing data landscape

marketing data landscape mobile

In VentureBeat’s The State of Marketing Analytics: Insights in the age of the customer, author Jon Cifuentes writes:

“Enterprises are stuck between fragmented data silos…There’s customer data, inventory data, log data, search data, reporting, analytics, CRM, session data, et. al – with different vendors supporting each. While “real-time” customer data sounds nice in theory, the actual process of broadcasting this information through the organization is time-consuming, expensive, fragmented, and frustrating.”

These cobbled-together sources and tools provide directional insight but don’t align with initial expectations, particularly as companies start requiring custom insights and metrics.  In fact, most companies quickly find themselves in exactly the situation they had hoped to avoid – working in increasingly complex systems with considerably higher non-value added workloads.

data silo

The challenge for companies is: how do you align your data vision with your unique acquisition, engagement and monetization strategies?

Purpose-built tools like app analytics, A/B testing, marketing automation, etc. have done a great job in recent years of allowing non-technical people to analyze data, run tests and engage users. However, since these tools were built for single-use cases and by separate companies with proprietary data stores, they have failed to address a core issue: the need to access the same user data in order to truly provide a personalized experience to each user.

Data-capture tools and user engagement tools also need to be integrated in order to provide a full picture of how changes impact the product downstream.  For instance, teams need to be able to apply user actions from app analytics to run A/B tests, which will in turn impact the user experience.

The path forward

The solution exists at the platform level: unifying data sources before applications are built on top of them, with a flexible 2-way structure that enables real-time integration between event and user data, at all levels in the stack, and not just based on basic pre-determined rules with segmentations on top.

data silo2

This type of structure makes it possible for events to be enriched by boundless user attributes (user state) and enables contextual analytics.  This, in turn, produces a robust targeting framework, because now the user state can be updated in any manner, in real-time.  For example, Glassdoor utilizes this methodology to deliver real-time dynamic notifications of job alerts to users based on their prior behavior when browsing the Glassdoor website.

While many marketing vendors are fighting to define themselves as integrated or unified marketing platforms, most still need to reach deeper down the stack and unify product and marketing tools with data tools at a platform level.   Because they refer to the same data source, there will be no discrepancies between insights and actions.  For example, segments defined for analytics will maintain the same properties in A/B testing or content delivery.  Applications developed on top of unified data platforms will be inherently more flexible and manageable.

From VentureBeat

VB just released The State of Marketing Analytics: Insights in the age of the customer. $ 499 on VB Insight, or free with your martech subscription.

Omniata is coming out of beta on September 24th!  You can reach us at [email protected] to learn more. Though just coming out of beta, we’re already tracking 300 million monthly active users, 2 billion events per day, and handling over 17,000 requests per second!

Alex Arias is the CEO and cofounder of Omniata, a unified data, analytics and user engagement platform.  For more than 10 years, Alex has been an entrepreneur and driver of innovation in digital services, working previously at Digital Chocolate and EA.  He’s been helping companies define their own Data Value Journey since cofounding Omniata two and a half years ago.



RSS-5

Be Your Own NSA: How To Keep Some Dirtbag From Renting Out Your Crib While You’re Away on Vacay

While “John and Ed” were at Burning Man earlier this month, their paid house sitter (from TrustedHousesitters.com no less) listed their San Francisco pad on Airbnb. , this naturally prompts the question: what can I, as a person who leaves my home from time to time, do to prevent something similar, or worse, from happening to me? Here’s the answer.


Cloud Computing

Robotics tipping point: What business leaders and entrepreneurs need to know NOW (webinar)

robots

VB WEBINAR:

Join us for this live webinar on Friday, September 25 at 10 a.m. Pacific, 1 p.m. Eastern. Register here for free. 

Silicon Valley is at the center of the perfect storm of robotics.

It’s at the center of the talent, the investment and the research, the center of the software and hardware industries — all key ecosystem components to build the robotics companies that need to rise to serve the world’s future.

But the event horizon to make that happen is something that needs to be considered in terms of decades, not the typical start-up timelines of a few months to a few years, according to Andra Keay. Keay is managing director of Silicon Valley Robotics, and one of the panelists in this upcoming webinar that will be shedding light on what businesses need to know now to take advantage of the evolution that’s reaching a tipping point.

“Robotics moves slowly but it’s been around a long time,” she says. “The industry has done a great job over the last 50 years of helping us to envision what uses we could make of robots and what that could mean to the quality of our life and our economy. Yet, few of those promises have yet been met.”

The problem, according to Keay is that our expectation of robotics has been inflated.

“We did it wrong. We’ve created this situation where we look at robots as humanoid,” Keay says. “There’s no way that robots have anything like the capability of a person. It’s just absolutely impossible in this century for a robot to replace a human in anything.”

That’s not to say that robotics technology isn’t already very much a part of our lives, or that now isn’t the right time for the industry to become more established and scale.

“Five years ago in the industry we said, OK, the time is right,” Keay says. “It’s clear that robotics is at a point where it’s time to move into new areas. Out of industry, out of research labs, into the service industry and into the home.”

Robotics technologies are well engrained in certain industries, like automotive. It’s just that, for the average person, it doesn’t feel like something that’s particularly close to home. For this reason, it’s easy for people to dismiss robotics as science fiction because it seems so far away and the tipping point moments so elusive.

Understanding what that future may actually look like comes back to understanding the technological and economic drivers that are making robotics peek right now.

Don’t miss out!  Learn more about Andra Keay’s vision for the future of robotics by tuning-in for the webinar “How robotics will change everything, including your business.”

Register here for free.

“In many cases it will be taking this ubiquitous connectivity that mobility computing delivers and making a gradual transition to products that are just that much more powerful and versatile,” Keay says. “It’s not going to be a disruption, but once in a while one of those devices will change in how we use it and that will lead to other changes. I think that, with time, robotics will account for the same kind of seismic shift that the internet and computers had in the 20th century.”

One popular belief is that the growth of robotic technology will inevitably equate to the loss of human jobs. But Keay says there is good reason to believe that the opposite will be true.

“Everywhere I look there are industries that have increased the number of robots that they employ. They’ve also increased the number of people that they employ,” she says. “An exciting vision of the future is that of the skilled mobile tradesperson. They’ll still drive a pickup or an SUV but instead of a leaf blower, or a power tool, they’re working with smarter tools that are used in applications to take care of robots.”

Keay sees a correlation between this future of robot builders and technicians and the opportunity to create small, regional pockets of highly-specialized, entrepreneurial manufacturers and service providers of a variety of stripes to support niche industrial and commercial requirements for robotic technology. “Robots increase the number of jobs that are needed and they also increase the productivity of a company that allow it to expand and create even more jobs,” she says. “That will create opportunities for a new class of entrepreneurs.”

Ultimately, the future of robotic technology means creating machines that augment, not replace, humans and socializing the idea that people can work with robots in an integrated fashion.

“Some of those fences are starting to come down as computing power and intelligent algorithms lead us to a better understanding of how people can work alongside robots,” Keay says. “To make a significant impact on our economy, we need to build a lot of robots because there are not that many out there today.”

“People need to build them and people need to maintain them and the only way we can do that is to create opportunities for the industry to grow in Silicon Valley and elsewhere.”

What you’ll learn:

  • The key consumer and commercial applications of robots and drones
  • The role robots will play in societies and economies
  • How smartphone technologies will pave the way to robotics’ future
  • How cognitive technologies will transform our lives and business
  • The foundation of many IoT applications in shaping the way to robotics

Speakers:

Jim McGregor, Principal Analyst, Tirias Research
Andra Keay, Managing Director of Silicon Valley Robotics
Anthony Lewis, Senior Director of Technology, Qualcomm
Maged Zaki, Director of Technical Marketing, Qualcomm Technologies, Inc.

This webinar is sponsored by Qualcomm.



RSS-5

Get ready to watch all your favorite TV shows in virtual reality

Netflix-living-room

Feed-twFeed-fb

Hulu and Netflix are jumping on the virtual reality train. All aboard, early adopters.

Both streaming video services will soon offer virtual reality apps that let users explore content and watch what they want in 3D virtual spaces. Netflix is up first, with an app launching in the Gear VR store on Thursday, just hours after it was announced on stage at Oculus Connect.

While the video itself plays inside the headset on a virtual screen — banish all hopes of stepping into your favorite TV show or movie, at least for now — the app’s browsing interface is an interactive “Netflix Living Room.” This is a valuable feather in Netflix’s cap, marking the “first” subscription video app for VR and yet another platform for the ubiquitous service. Read more…

More about Entertainment, Gaming, Netflix, Hulu, and Television


RSS-3


RSS-3

Real Advice for Real Money