Launching an Inner Information Market with Atlan
The Energetic Metadata Pioneers sequence options Atlan clients who’ve lately accomplished an intensive analysis of the Energetic Metadata Administration market. Paying ahead what you’ve discovered to the following knowledge chief is the true spirit of the Atlan group! So, they’re right here to share their hard-earned perspective on an evolving market, what makes up their fashionable knowledge stack, modern use circumstances for metadata, and extra.
On this installment of the sequence, we meet Cristina Perez Martinez, Information Engineer and Architect, and Ezequiel Barbero, Market & Enterprise Intelligence Supervisor at Telefónica Tech, who share how a contemporary knowledge cataloging expertise and column-level lineage will help a broad imaginative and prescient for knowledge democratization.
This interview has been edited for brevity and readability.
May you inform us a bit about your self, your background, and what drew you to Information & Analytics?
Ezequiel Barbero:
I’ve bought a Masters in Large Information and have labored in Information & Analytics since 2002. I began at Telefónica in Argentina with the BI Information Crew engaged on ETLs primarily based in SQL. Then I labored in Information Engineering serving to with Information Science, working with the pinnacle of that group in Argentina.
In 2019, I got here to Spain to work with their Information Science group on Advertising and marketing Intelligence, and in 2021 I joined Telefónica Tech to start out the BI Crew.
Cristina Perez Martinez:
I began working at Telefónica in 2019 as a Python developer, and I moved to Telefónica Tech in 2021. My group has primarily been working as Information Engineers and Information Architects for the BI group.
Would you thoughts describing Telefónica, and the way your knowledge group helps the group?
Cristina:
Telefónica is split into fairly a couple of completely different corporations, however as a complete, it’s a Telecommunications Enterprise. Right here, in Telefónica Tech, the digital enterprise unit, we’ve been centered on digital applied sciences akin to AI & BD, connectivity and IoT, Cybersecurity, Cloud, and Blockchain.
Our group is split into two, with a part of the group centered on structure and engineering, getting uncooked knowledge, then standardizing and remodeling it till it goes into Snowflake, our Information Warehouse. The remainder of the group is targeted on Information Evaluation, primarily based in Snowflake and coding in SQL. From there, they develop dashboards in PowerBI.
Ezequiel:
Telefónica Tech has a group engaged on IoT and Large Information for exterior use circumstances, however our group is chargeable for inside use circumstances, supporting the corporate. We help infrastructure, transformation, and for nearly a 12 months now, Information Governance.
What does your knowledge stack appear to be?
Ezequiel:
Our stack relies on Microsoft Azure, and we use Information Manufacturing unit for Orchestration. We use Databricks’ ETL device, blob storage, and knowledge lake. Snowflake is Telefónica’s knowledge warehouse.
Why seek for an Energetic Metadata Administration answer? What was lacking?
Ezequiel:
Our firm has over 6,200 folks, however our group is small relative to the whole group. So if it’s necessary to enhance knowledge democratization, then that wouldn’t be doable with out self-service, and with out Information Governance.
Why was Atlan an excellent match? Did something stand out throughout your analysis course of?
Ezequiel:
We have been first on the lookout for a cloud-based SaaS answer that was simple to deploy and straightforward to arrange.
Cristina:
Our aim was to have a spot the place we may create a catalog of information that was accessible sufficient to the remainder of the corporate. It was additionally necessary to grasp the lineage between Snowflake and PowerBI. Our major aim was to grasp the influence that modifying a supply would have on our knowledge warehouse, so column-level lineage ensures end-to-end visibility and traceability. Moreover, we acknowledge the necessity for a strong device to strengthen safety of our knowledge platform, permitting us to assign roles and permissions to make sure that solely approved folks have entry to particular data, in addition to the flexibility to carry out audits which is important to take care of the integrity and compliance of our knowledge operations.
What do you propose on creating with Atlan? Do you’ve got an concept of what use circumstances you’ll construct, and the worth you’ll drive?
Cristina:
One of many necessities we had is to create considerably of a market for our knowledge, with the whole lot primarily based on Atlan belongings, and we’re engaged on launching that to start with of this 12 months. From there, we’re wanting ahead to populating much more metadata in Atlan and Snowflake.
Sooner or later, we’re enthusiastic about the opportunity of utilizing Atlan AI. Our aim is to make accessing knowledge even simpler for folks, and with the ability to chat with Atlan about knowledge would make it simple for folks to seek out what they want.
Photograph by Mario Caruso on Unsplash
