DataHub Integrations

Open-source data integration platform for syncing data from APIs, databases, and files to warehouses and lakes.

Airflow is an open-source data orchestration tool used for scheduling, monitoring, and managing complex data pipelines.

Fully managed Apache Kafka service available across major cloud providers with built-in monitoring and security.

Fully managed PostgreSQL-compatible database service on Google Cloud designed for demanding enterprise workloads.

Self-service data analytics platform for data preparation, blending, and advanced analytics workflows.

AWS real-time data streaming service for collecting, processing, and analyzing data streams at any scale.

Fully managed Apache Kafka service on AWS for building and running streaming data applications.

AWS serverless business intelligence service for creating interactive dashboards and visualizations.

Cloud-based enterprise planning platform for financial planning, supply chain, and workforce planning.

Unified programming model for defining and executing both batch and streaming data processing pipelines.

High-performance real-time analytical database based on MPP architecture for large-scale data analytics.

Real-time stream processing framework for stateful computations over bounded and unbounded data streams.

Apache Hudi is an open-source data lake framework that provides ACID transactions, efficient upserts, time travel queries, and incremental data processing for large-scale datasets.

Open-source massively parallel processing SQL query engine for data stored in Apache Hadoop.

Athena is a serverless interactive query service that enables users to analyze data in Amazon S3 using standard SQL.

Azure AD is a cloud-based identity and access management tool that provides secure authentication and authorization for users and applications.

Azure Blob Storage is a cloud-based object storage service that allows users to store and manage large amounts of unstructured data.

Globally distributed, multi-model NoSQL database service on Azure for mission-critical applications.

Cloud-based data integration service for creating, scheduling, and orchestrating data pipelines at scale.

Cloud-native data streaming service on Azure with native Apache Kafka support for real-time event ingestion.

Fast and scalable data exploration service optimized for log and telemetry data analytics.

Fully managed relational cloud database service built on SQL Server for modern application development.

Integrated analytics service on Azure that combines enterprise data warehousing with big data analytics.

BigQuery is a cloud-based data warehousing and analytics tool that allows users to store, query, and analyze large datasets quickly and efficiently.

A source provided by DataHub for ingesting glossary metadata that provides a comprehensive list of business terms and definitions used within an organization.

Apache Cassandra is a distributed NoSQL database designed to handle large amounts of data across many commodity servers.

ClickHouse is an open-source column-oriented database management system designed for high-performance data processing and analytics.

CockroachDB is a distributed SQL database that provides strong consistency, high availability, and horizontal scalability.

Atlassian's team workspace for creating, organizing, and collaborating on documentation and knowledge bases.

Enterprise-grade data streaming platform built on Apache Kafka with schema registry, governance, and managed cloud service.

Distributed NoSQL cloud database for enterprise applications with built-in full-text search and analytics.

Distributed SQL database built on a shared-nothing architecture for machine data and IoT workloads.

An ingestion source for enriching metadata provided in CSV format provided by DataHub

Dagster is a next-generation open source orchestration platform for the development, production, and observation of data assets.

Databricks is a cloud-based data processing and analytics platform that enables data scientists and engineers to collaborate and build data-driven applications.

Integrate your open source DataHub instance with DataHub Cloud or other on-prem DataHub instances

DataHub utility for applying metadata changes and configurations to your DataHub instance.

DataHub utility for debugging and diagnosing metadata issues in your DataHub instance.

DataHub utility for managing and ingesting documentation assets.

DataHub garbage collection utility for cleaning up stale metadata and soft-deleted entities.

Google Cloud's intelligent data fabric for unified data management, governance, and analytics across data lakes and warehouses.

IBM's enterprise relational database management system for transactional and analytical workloads.

dbt is a data transformation tool that enables analysts and engineers to transform data in their warehouses through a modular, SQL-based approach.

Delta Lake is an open-source data lake storage layer that provides ACID transactions, schema enforcement, and data versioning for big data workloads.

Demo Data is a data tool that provides sample data sets for demonstration and testing purposes.

Cloud-based business intelligence platform with data integration, visualization, and collaboration capabilities.

Dremio is a data lake engine that provides fast, direct access to data lake storage with enterprise-grade security and governance.

Druid is an open-source data store designed for real-time analytics on large datasets.

DynamoDB is a fully managed NoSQL database service that provides fast and predictable performance with seamless scalability.

Elasticsearch is a distributed, open-source search and analytics engine designed for handling large volumes of data.

High-performance in-memory analytics database optimized for data warehousing and analytics workloads.

Microsoft Excel spreadsheet integration for importing metadata definitions and enrichment data.

Microsoft Fabric's unified data lake for storing and managing all organizational data in one place.

Feast is an open-source feature store that enables teams to manage, store, and discover features for machine learning applications.

An ingestion source for single files provided by DataHub

File Based Lineage is a data tool that tracks the lineage of data files and their dependencies.

Fivetran is a cloud-based data integration platform that provides automated data pipelines for analytics and business intelligence.

Glue is a data integration service that allows users to extract, transform, and load data from various sources into a data warehouse.

Fully managed, scalable NoSQL database service for large analytical and operational workloads on Google Cloud.

Google Cloud Storage is a unified object storage service that provides industry-leading durability and availability for data.

Grafana is an open-source analytics and monitoring platform that allows users to query, visualize, and alert on metrics and logs.

Great Expectations is an open-source data validation and testing tool that helps data teams maintain data quality and integrity.

Open-source massively parallel processing data warehouse based on PostgreSQL for large-scale analytics.

Hex is a collaborative data workspace that allows teams to explore, analyze, and share data insights through interactive notebooks.

Reverse ETL platform that syncs data from your warehouse to business tools like CRMs, ad platforms, and SaaS apps.

Hive is a data warehousing tool that facilitates querying and managing large datasets stored in Hadoop Distributed File System (HDFS).

Hive Metastore (HMS) is a service that stores metadata that is related to Hive, Presto, Trino and other services in a backend Relational Database Management System (RDBMS).

Enterprise business intelligence suite for interactive dashboards, reports, and AI-powered data exploration.

Iceberg is a data tool that allows users to manage and query large-scale data sets using a distributed architecture.

Enterprise data integration and management platform for ETL, data quality, and master data management.

JSON Schemas is a data tool used to define the structure, format, and validation rules for JSON data.

Kafka is a distributed streaming platform that allows for the processing and storage of large amounts of data in real-time.

Kafka Connect is an open-source data integration tool that enables the transfer of data between Apache Kafka and other data systems.

LDAP (Lightweight Directory Access Protocol) is a data tool used for accessing and managing distributed directory information services over an IP network.

Open-source BI tool that connects to your dbt project to provide self-serve analytics and exploration.

Looker is a business intelligence and data analytics platform that allows users to explore, analyze, and share data insights in real-time.

MariaDB is an open-source relational database management system that is a fork of MySQL.

Cloud-native data integration platform for building ELT pipelines into cloud data warehouses.

Metabase is an open-source business intelligence and data visualization tool that allows users to easily query and visualize their data.

Unified analytics platform from Microsoft that integrates data engineering, data science, warehousing, and real-time analytics.

Enterprise analytics and mobility platform for business intelligence, dashboards, and reporting.

MLflow is an open-source platform for managing the end-to-end machine learning lifecycle.

Mode is a cloud-based data analysis and visualization platform that enables businesses to explore, analyze, and share data in a collaborative environment.

MongoDB is a NoSQL database that stores data in flexible, JSON-like documents, making it easy to store and retrieve data for modern applications.

Data observability platform that detects, resolves, and prevents data quality issues across your data stack.

MySQL is an open-source relational database management system that allows users to store, organize, and retrieve data efficiently.

Neo4j is a graph database management system that stores data in nodes and relationships, enabling complex graph queries and analytics.

NiFi is a data integration tool that allows users to automate the flow of data between systems and applications.

All-in-one workspace for notes, docs, project management, and collaboration.

Okta is a cloud-based identity and access management tool that enables secure and seamless access to applications and data across multiple devices and platforms.

OpenAPI is a specification for building and documenting RESTful APIs.

Open standard for data lineage collection and analysis. DataHub supports OpenLineage via a native REST endpoint and Spark event listener plugin.

Oracle is a relational database management system that provides a comprehensive and integrated platform for managing and analyzing large amounts of data.

Real-time distributed OLAP datastore designed for low-latency analytics on large-scale datasets.

Postgres is an open-source relational database management system that provides a powerful tool for storing, managing, and analyzing large amounts of data.

PowerBI is a business analytics service by Microsoft that provides interactive visualizations and business intelligence capabilities with an interface simple enough for end users to create their own reports and dashboards.

On-premises report server for hosting and managing Power BI reports, paginated reports, and KPIs.

Prefect is a modern workflow orchestration for data and ML engineers.

Preset is a cloud-native business intelligence platform that provides self-service analytics and data visualization capabilities.

Presto is an open-source distributed SQL query engine designed for fast and interactive analytics on large-scale data sets.

Protobuf Schemas is a data tool used for defining and serializing structured data in a compact and efficient manner.

Pulsar is a real-time data processing and messaging platform that enables high-performance data streaming and processing.

Qlik Sense is a business intelligence and data analytics platform that enables users to create interactive visualizations and dashboards.

RDF (Resource Description Framework) is a standard model for data interchange on the web, enabling ingestion of ontologies and knowledge graphs as DataHub glossary terms.

Redash is a data visualization and collaboration platform that allows users to connect and query multiple data sources and create interactive dashboards and visualizations.

Kafka-compatible streaming data platform built for mission-critical workloads without ZooKeeper.

Redshift is a cloud-based data warehousing tool that allows users to store and analyze large amounts of data in a scalable and cost-effective manner.

S3 Data Lake is a cloud-based data storage and management tool that allows users to store, manage, and analyze large amounts of data in a scalable and cost-effective manner.

SAP Analytics Cloud (SAC) is a cloud-based business intelligence and planning platform that provides analytics and planning capabilities.

SageMaker is a data tool that provides a fully-managed platform for building, training, and deploying machine learning models at scale.

Salesforce is a cloud-based customer relationship management (CRM) platform that helps businesses manage their sales, marketing, and customer service activities.

SAP HANA is an in-memory data platform that enables businesses to process large volumes of data in real-time.

Sigma is a cloud-native analytics and business intelligence platform that provides spreadsheet-like interface for data analysis.

Distributed SQL database designed for real-time analytics and transactional workloads in a single unified engine.

Embedded analytics platform for building and integrating data-driven insights into products and workflows.

Send notifications to Slack channels on updates to entities in DataHub.

SnapLogic is an enterprise integration platform as a service (iPaaS) that enables organizations to connect applications, data sources, and APIs across cloud and on-premises environments through a low-code drag-and-drop interface with hundreds of pre-built connectors, simplifying and accelerating data and application integration.

Snowflake is a cloud-based data warehousing platform that allows users to store, manage, and analyze large amounts of structured and semi-structured data.

Open-source behavioral data platform for collecting, processing, and modeling event-level data.

Data quality platform for testing, monitoring, and profiling data with checks defined as code.

Spark is a data processing tool that enables fast and efficient processing of large-scale data sets using distributed computing.

Open-source data lineage tracking and visualization tool for Apache Spark pipelines.

DataHub utility for ingesting SQL query metadata and lineage from query logs.

Microsoft SQL Server is a relational database management system designed to store, manage, and retrieve data efficiently and securely.

SQLAlchemy is a Python-based data tool that provides a set of high-level API for connecting to relational databases and performing SQL operations.

SQL Server Integration Services — Microsoft's enterprise ETL platform for data migration, transformation, and workflow automation.

High-performance analytical database for real-time, multi-dimensional analytics at scale.

Superset is an open-source data exploration and visualization platform that allows users to create interactive dashboards and perform ad-hoc analysis on various data sources.

Tableau is a data visualization and business intelligence tool that helps users analyze and present data in a visually appealing and interactive way.

Open-source and enterprise data integration platform for ETL, data quality, and cloud data management.

Teradata is a data warehousing and analytics tool that allows users to store, manage, and analyze large amounts of data in a scalable and cost-effective manner.

AI-powered analytics platform with natural language search for self-service business intelligence.

Open-source time-series database built on PostgreSQL for fast analytics on time-series data.

Trino is an open-source distributed SQL query engine designed to query large-scale data processing systems, including Hadoop, Cassandra, and relational databases.

Vertex AI is Google Cloud's machine learning platform that provides tools for building, training, and deploying ML models at scale.

Vertica is a high-performance, column-oriented, relational database management system designed for large-scale data warehousing and analytics.