Skip to content

How Data Warehouses Work

Jaren Brownlee edited this page May 22, 2023 · 6 revisions

An important thing to understand when working with DeepLynx is how a data warehouse functions. Here is a brief diagram illustrating how most data warehouses are organized. Note: Source systems refer to outside systems such as P6 and Aveva Everything 3D.

image

The DeepLynx program performs all operations illustrated above.

Where DeepLynx is unique is that as part of our ETL pipeline we map the data coming in to a user defined ontology. That ontology allows us to unify all data from all sources under a single schema - which is then stored in a graph like manner.

DeepLynx Wiki

Sections marked with ! are in progress.

Building DeepLynx

DeepLynx Overview

Getting Started

Building From Source

Admin Web App


Deploying DeepLynx


Integrating with DeepLynx


Using DeepLynx

Ontology

Data Ingestion

Timeseries Data

Manual Path
Automated Path
File/Blob Storage

Data Querying

Event System

Data Targets


Developing DeepLynx

Developer Overview

Project Structure and Patterns

Data Access Layer

Development Process

Current Proposals

Clone this wiki locally