This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

Database and Data Lake Connections

Database and Data Lake connections vary by service. Each connector will have specific security and access requirements in order for PlaidCloud to connect.

PlaidCloud enables connection directly to databases, data lakes, query engines, and lakehouses. Connections can also utilize a PlaidLink agent if services are behind a firewall.

Since the terms of database, lakehouse, query engine, and potentially others are used to refer to data that can be queried using a connection, we generally treat all of these as "Databases" despite a wide variety of underlying technology that performs the underlying query.

1 - Amazon Athena

Connecting to Amazon Athena Database

Upstream Documentation

Amazon Athena documentation is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

2 - Amazon Redshift

Connecting to Amazon Redshift Database

Upstream Documentation

Amazon Redshift has several guides related to use located here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

3 - Apache Doris

Connecting to Apache Doris Database

Upstream Documentation

Apache Doris documentation is here.

The Apache project homepage for Apache Doris is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

4 - Apache Hive

Connecting to Apache Hive Data Lake

Upstream Documentation

Apache Hive documentation is located here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Data Lake Connector

Documentation under development

5 - Apache Spark

Connecting to Apache Spark Database

Upstream Documentation

The Apache Spark documentation is here.

The Apache project is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

6 - Azure Databricks

Connecting to Azure Databricks Database

Upstream Documentation

Azure Databricks documentation is here.

Security Requirements

Documentation under development

Obtain Credentials

In order to obtain the connection credentials necessary for PlaidCloud to communicate with a Databricks warehouse, follow the steps below:

  1. Open the Databricks console
  2. Under the User Settings in the upper right, select "Settings"
  3. Navigate to the "Developers" section
  4. Generate an Access Token with a sufficient lifespan specified
  5. Navigate to the "SQL Warehouses" area
  6. Select the warehouse required for connecting
  7. Capture the connection details including host, and http path
  8. Navigate to the warehouse data area
  9. Capture the initial catalog and initial schema information

With the information above, the connection form can be completed and tested with the Databricks warehouse

Create Database Connector

Documentation under development

7 - Databend

Connecting to Databend Database

Upstream Documentation

Databend documentation is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

8 - Exasol

Connecting to Exasol Database

Upstream Documentation

Exasol documentation is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

9 - Greenplum

Connecting to Greenplum Database

Upstream Documentation

The Greenplum documentation is located here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

10 - IBM DB2

Connecting to IBM DB2 Database

Upstream Documentation

The IBM DB2 documentation is located here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

11 - IBM Informix

Connecting to IBM Informix Database

Upstream Documentation

IBM Informix documentation is located here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

12 - Microsoft Fabric

Connecting to Microsoft Fabric Database

Upstream Documentation

The Microsoft Fabric documentation is located here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

13 - Microsoft SQL Server

Connecting to Microsoft SQL Server Database

Upstream Documentation

Microsoft SQL Server documentation is located here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

14 - MySQL

Connecting to MySQL Database

Upstream Documentation

MySQL documentation is located here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

15 - ODBC

Connecting to a Database using ODBC

Upstream Documentation

Using the ODBC connector will require configuration specific to the database. While ODBC is a generic connection type, each database may implement some specific configurations. Please refer to the ODBC documentation for the target database.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

16 - Oracle

Connecting to Oracle Database

Upstream Documentation

The Oracle database documentation is located here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

17 - PlaidCloud Lakehouse

Connecting to PlaidCloud Lakehouse

Upstream Documentation

There is very little configuration necessary for using the built-in PlaidCloud Lakehouse. The documentation for the service is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Lakehouse Connector

Documentation under development

18 - PostgreSQL

Connecting to PostgreSQL (Postgres) Database

Upstream Documentation

PostreSQL documentation is located here

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

19 - Presto

Connecting to Presto Database

Upstream Documentation

The Presto documentation is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

20 - SAP HANA

Connecting to SAP HANA Database

Upstream Documentation

The SAP HANA documentation is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

21 - Snowflake

Connecting to Snowflake Database

Upstream Documentation

The Snowflake documentation is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

22 - StarRocks

Connecting to StarRocks Database

Upstream Documentation

StarRocks documentation is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development

23 - Trino

Connecting to Trino Query Engine

Upstream Documentation

The Trino documentation is here.

Security Requirements

Documentation under development

Obtain Credentials

Documentation under development

Create Database Connector

Documentation under development