Metadata-Version: 2.1
Name: piperider-nightly
Version: 0.2.0.20220622a1
Summary: PiperRider CLI
Home-page: https://github.com/InfuseAI/piperider
Author: InfuseAI Dev Team
Author-email: dev@infuseai.io
Project-URL: Bug Tracker, https://github.com/InfuseAI/piperider/issues
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Development Status :: 4 - Beta
Requires-Python: >=3.7
Description-Content-Type: text/markdown
Provides-Extra: snowflake
Provides-Extra: postgres
Provides-Extra: dev
License-File: LICENSE


<p align="center">
  <a href="https://piperider.io">
    <img  src=".github/images/logo.svg"
      width="284" border="0" alt="PipeRider">
  </a>
</p>

# PipeRider: Data Reliability Automated

# What is PipeRider?

PipeRider is an open-source toolkit for detecting data issues across pipelines that works with CI systems for continuous data quality assessment. PipeRider makes it easy for teams to have visibility about how data are being tested, and ensure errors are caught before they cause outages of downstream data applications like business intelligence dashboards or ML systems.
# Why PipeRider?

Ensuring consistent quality of data used to be difficult. Missing values, schema changes, data drift (to name just a few), could be introduced to your data at any time. Without effective data quality tools these errors will affect downstream operations and result in countless lost hours to debugging and missed revenue opportunities from unexpected downtime.
PipeRider allows you to define the shape of your data once, and then use the data checking functionality to alert you to changes in your data quality.

[![ci-tests](https://github.com/infuseai/piperider-cli/actions/workflows/tests.yaml/badge.svg)](https://github.com/infuseai/piperider-cli/actions/workflows/tests.yaml/badge.svg)
[![release](https://img.shields.io/github/release/infuseAI/piperider-cli/all.svg?style=flat-square)](https://github.com/infuseAI/piperider-cli/releases)
[![pipy](https://img.shields.io/pypi/v/piperider?style=flat-square)](https://pypi.org/project/piperider/)
[![python](https://img.shields.io/pypi/pyversions/piperider?style=flat-square)](https://pypi.org/project/piperider/)
[![downloads](https://img.shields.io/pypi/dw/piperider?style=flat-square)](https://pypi.org/project/piperider/#files)
[![license](https://img.shields.io/github/license/infuseai/piperider?style=flat-square)](https://github.com/InfuseAI/piperider/blob/main/LICENSE)
[![InfuseAI Discord Invite](https://img.shields.io/discord/664381609771925514?color=%237289DA&label=chat&logo=discord&logoColor=white&style=flat-square)](https://discord.com/invite/5zb2aK9KBV)


# Learn More

| PipeRider Resources | Description |
| -------------------- | ----------- |
| [Documentation] | PipeRider Main Doc Site |
| [Sample_Project] | Sample Project with with sqlite |
| [dbt_Sample_Project] | Sample Project with dbt |
| [Roadmap] | PipeRider Roadmap |

[Documentation]: https://docs.piperider.io/
[Sample_Project]: https://github.com/InfuseAI/infuse-finance
[dbt_Sample_Project]: https://github.com/InfuseAI/dbt-infuse-finance
[Roadmap]: https://github.com/orgs/InfuseAI/projects/1/views/1


# Key Features

## Instant quality assessment in html report

Example of [single run report](https://piperider-github-readme.s3.ap-northeast-1.amazonaws.com/single-run/global_mobility_report.html)

## Report Comparison

Example of [comparison report](https://piperider-github-readme.s3.ap-northeast-1.amazonaws.com/compare-report/index.html)

## Extensible custom assertions

Refer
to [custom assertions](https://docs.piperider.io/data-quality-assertions/custom-assertions)
## Works with existing dbt projects

## Automatic Test Recommendations (Coming Soon)

# Getting started

## Install PipeRider

```bash
$ pip install piperider
```

By default, PipeRider supports built-in sqlite connector, extra connectors are available:

| connectors  | install  |
|---|---|
| snowflake | pip install 'piperider[snowflake]'  |
| postgres  | pip install 'piperider[postgres]'  |

Use comma to install multiple connectors in one line:

```
$ pip install 'piperider[postgres,snowflake]'
```

## Attach piperider to a dbt project

![piperider_init](images/init_pipe.gif)

This command creates `/.piperider` under a dbt project root and generates necessary configurations.

## Scan data quality from models

![piperider_run](images/run_pipe.gif)

This command scans the models from datasource and creates assessment results in `/.piperider/output`

## Generate reports

![piperider_report](images/report_pipe.gif)

generate a static html report under current path.

## Generate comparison view

![piperider_compare](images/compare_pipe.gif)

The generated report in html will be placed in the path shown in console

# Get involved
## Contributions

We welcome contributions. See the [Set up dev environment](DEVELOP.md) and the [Contributing guildline](CONTRIBUTING.md) to get started.
