What is open metadata and why should we care?
Metadata Management

What is open metadata and why should we care?

It was a blatant plug. Mandy Chessell, IBM’s chief data officer had just delivered a keynote talk on open metadata and she was petitioning the audience to join her, or at least the ODPi, saying that “adoption is key to standards.” She has a point. For open metadata to become the de facto standard for the big data industry, it will need volume support and where better to get it than at a big data conference?

Dataworks 2018, held at the Estrel in Berlin, a large hotel and congress center on the edge of the Neukolln district in the south of the city should have been fertile ground for Chessell. The room was full of data geeks. How Erich Mielke, the head of the East German Stasi would have loved to mine their collective knowledge on handling large amounts of data. The irony is not lost, given the Berlin wall ran just a stone’s throw from the Estrel and the last person to be killed at the wall, Chris Geuffroy was shot scaling a fence between Treptow Park and Neukolln.

That’s history of course but managing big data remains a constant problem for businesses and organizations, especially as it moves between devices, datacenters and the public cloud. As organizations evolve, their adoption of cloud strategies varies widely. Interestingly, a quick interactive poll of the Dataworks audience revealed that 35 percent had no interest in moving data to the cloud. It wasn’t expected but then there is a lot of uncertainty about security and how to manage it if it is in the cloud.

It’s something the event’s main sponsor Hortonworks has clearly tried to solve with its DataPlane Service, a management system that can give visibility of all data regardless of its location. Chessell’s push for open metadata dovetails neatly with this idea, offering a sort of filing cabinet, like in a library, which helps users find what they are looking for quickly. The metadata is a catalogue of all available data but not all filing cabinets are created equal. That’s Chessell’s point. If it’s not open, it just slows everything down.

“Organizations will either be locked into single vendor deployments or spend time creating their own integrations to shift and transform metadata between repositories from different vendors - this is what is happening today and what we are trying to change,” she says when asked what happens if the open standard is not widely taken-up. “The effect is increased cost in managing data and less effective use of data, since it is harder to find and control it.”

You’re viewing IDG Connect Insider content. Please enter your email to continue.


PREVIOUS ARTICLE

«Should companies #DeleteFacebook?

NEXT ARTICLE

The rise of the robots (as a service)»
Marc Ambasna-Jones

Marc Ambasna-Jones is a UK-based freelance writer and media consultant and has been writing about business and technology since 1989.

Our Case Studies

IDG Connect delivers full creative solutions to meet all your demand generatlon needs. These cover the full scope of options, from customized content and lead delivery through to fully integrated campaigns.

images

Our Marketing Research

Our in-house analyst and editorial team create a range of insights for the global marketing community. These look at IT buying preferences, the latest soclal media trends and other zeitgeist topics.

images

Poll

Is your organization fully GDPR compliant?