Skip to content

Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.

License

Notifications You must be signed in to change notification settings

manifoldai/OpenMetadata

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

OpenMetadata

Build Status Quality Gate Status Release GitHub commit activity Twitter Follow Join us on Slack License openmetadata

What is OpenMetadata?

OpenMetadata is an all-in-one platform for data discovery, data lineage, data quality, observability, governance, and team collaboration. It is one of the fastest growing open-source projects with a vibrant community and adoption by a diverse set of companies in a variety of industry verticals. Powered by a centralized metadata store based on Open Metadata Standards/APIs, supporting connectors to a wide range of data services, OpenMetadata enables end-to-end metadata management, giving you the freedom to unlock the value of your data assets.

OpenMetadata includes the following:

  • Metadata Schemas - Defines core abstractions and vocabulary for metadata with schemas for Types, Entities, and Relationships between entities. This is the foundation of the Open Metadata Standard. Also supports the extensibility of entities and types with custom properties.

  • Metadata Store - Stores metadata graph that connects data assets, user, and tool-generated metadata.

  • Metadata APIs - For producing and consuming metadata built on schemas for User Interfaces and Integration of tools, systems, and services.

  • Ingestion Framework - A pluggable framework for integrating tools and ingesting metadata to the metadata store, supporting about 55 connectors. The ingestion framework supports well know data warehouses like Google BigQuery, Snowflake, Amazon Redshift, and Apache Hive; databases like MySQL, Postgres, Oracle, and MSSQL; dashboard services like Tableau, Superset, and Metabase; messaging services like Kafka, Redpanda; and pipeline services like Airflow, Glue, Fivetran, Dagster, and many more.

  • OpenMetadata User Interface - A single place for users to discover and collaborate on all data.

Features

Here are some of the supported features in a nutshell:

  • Data Collaboration - Get event notifications with Activity feeds. Send alerts & notifications using webhooks. Add Announcements to notify the team of upcoming changes. Add Tasks to request descriptions or glossary term approval workflows. Add user mentions and collaborate using conversation threads.

  • Data Quality and Profiler - Standardized tests and data quality metadata. Groups related tests as Test Suites. Supports custom SQL data quality tests. Has an interactive dashboard to drill down to the details.

  • Data Lineage - Supports rich column-level lineage. Effectively filters queries to extract lineage. Edit lineage manually as required and connect the entities with a no-code editor.

  • Comprehensive Roles and Policies - Handles complex access control use cases and hierarchical teams.

  • Webhooks - Supports webhook integrations. Integrate with Slack, Microsoft Teams and Google Chat.

  • Connectors - Supports 55 connectors to various databases, dashboards, pipelines, and messaging services.

  • Glossary - Add a Controlled Vocabulary to describe important concepts and terminologies within your organization. Add Glossaries, Terms, Tags, Descriptions, and Reviewers.

  • Data Security - Supports Google, Okta, custom OIDC, Auth0, Azure, Amazon Cognito, and OneLogin as identity providers for SSO. Also, supports SAML-based authentication for AWS SSO and Google.

  • Secrets Manager Interface - Communicates with any key management store.

  • And lots more...

Check out for more here

Try our Sandbox

Take a look and play with sample data at http://sandbox.open-metadata.org

Install and Run OpenMetadata

Get up and running in a few minutes. See the OpenMetadata documentation for installation instructions.

Documentation and Support

Check out OpenMetadata documentation for a complete description of OpenMetadata's features.

Join our Slack Community to get in touch with us, want to chat, need help, or want to discuss about a new feature requirement.

Or join the group at https://groups.google.com/g/openmetadata-users

We're here to help and make OpenMetadata even better!

Contributors

We ❤️ all contributions, big and small! Check out our CONTRIBUTING guide to get started and let us know how we can help.

Don't want to miss anything? Give the project a ⭐ 🚀

A HUGE THANK YOU to all our supporters!

Stargazers repo roster for @open-metadata/OpenMetadata

License

OpenMetadata is released under Apache License, Version 2.0

About

Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • TypeScript 38.6%
  • Java 28.4%
  • Python 26.4%
  • JavaScript 3.7%
  • Less 1.4%
  • FreeMarker 0.5%
  • Other 1.0%