Database and Data Lake Connections
Database and Data Lake connections vary by service. Each connector will have specific security and access requirements in order for PlaidCloud to connect.
PlaidCloud enables connection directly to databases, data lakes, query engines, and lakehouses. Connections can also utilize a PlaidLink agent if services are behind a firewall.
Since the terms of database, lakehouse, query engine, and potentially others are used to refer to data that can be queried using a connection, we generally treat all of these as "Databases" despite a wide variety of underlying technology that performs the underlying query.
1 - Amazon Athena
Connecting to Amazon Athena Database
Upstream Documentation
Amazon Athena documentation is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
2 - Amazon Redshift
Connecting to Amazon Redshift Database
Upstream Documentation
Amazon Redshift has several guides related to use located here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
3 - Apache Doris
Connecting to Apache Doris Database
Upstream Documentation
Apache Doris documentation is here.
The Apache project homepage for Apache Doris is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
4 - Apache Hive
Connecting to Apache Hive Data Lake
Upstream Documentation
Apache Hive documentation is located here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Data Lake Connector
Documentation under development
5 - Apache Spark
Connecting to Apache Spark Database
Upstream Documentation
The Apache Spark documentation is here.
The Apache project is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
6 - Azure Databricks
Connecting to Azure Databricks Database
Upstream Documentation
Azure Databricks documentation is here.
Security Requirements
Documentation under development
Obtain Credentials
In order to obtain the connection credentials necessary for PlaidCloud to communicate with a Databricks warehouse, follow the steps below:
- Open the Databricks console
- Under the User Settings in the upper right, select "Settings"
- Navigate to the "Developers" section
- Generate an Access Token with a sufficient lifespan specified
- Navigate to the "SQL Warehouses" area
- Select the warehouse required for connecting
- Capture the connection details including host, and http path
- Navigate to the warehouse data area
- Capture the initial catalog and initial schema information
With the information above, the connection form can be completed and tested with the Databricks warehouse
Create Database Connector
Documentation under development
7 - Databend
Connecting to Databend Database
Upstream Documentation
Databend documentation is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
8 - Exasol
Connecting to Exasol Database
Upstream Documentation
Exasol documentation is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
9 - Greenplum
Connecting to Greenplum Database
Upstream Documentation
The Greenplum documentation is located here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
10 - IBM DB2
Connecting to IBM DB2 Database
Upstream Documentation
The IBM DB2 documentation is located here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
11 - IBM Informix
Connecting to IBM Informix Database
Upstream Documentation
IBM Informix documentation is located here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
12 - Microsoft Fabric
Connecting to Microsoft Fabric Database
Upstream Documentation
The Microsoft Fabric documentation is located here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
13 - Microsoft SQL Server
Connecting to Microsoft SQL Server Database
Upstream Documentation
Microsoft SQL Server documentation is located here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
14 - MySQL
Connecting to MySQL Database
Upstream Documentation
MySQL documentation is located here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
15 - ODBC
Connecting to a Database using ODBC
Upstream Documentation
Using the ODBC connector will require configuration specific to the database. While ODBC is a generic connection type, each database may implement some specific configurations. Please refer to the ODBC documentation for the target database.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
16 - Oracle
Connecting to Oracle Database
Upstream Documentation
The Oracle database documentation is located here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
17 - PlaidCloud Lakehouse
Connecting to PlaidCloud Lakehouse
Upstream Documentation
There is very little configuration necessary for using the built-in PlaidCloud Lakehouse. The documentation for the service is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Lakehouse Connector
Documentation under development
18 - PostgreSQL
Connecting to PostgreSQL (Postgres) Database
Upstream Documentation
PostreSQL documentation is located here
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
19 - Presto
Connecting to Presto Database
Upstream Documentation
The Presto documentation is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
20 - SAP HANA
Connecting to SAP HANA Database
Upstream Documentation
The SAP HANA documentation is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
21 - Snowflake
Connecting to Snowflake Database
Upstream Documentation
The Snowflake documentation is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
22 - StarRocks
Connecting to StarRocks Database
Upstream Documentation
StarRocks documentation is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development
23 - Trino
Connecting to Trino Query Engine
Upstream Documentation
The Trino documentation is here.
Security Requirements
Documentation under development
Obtain Credentials
Documentation under development
Create Database Connector
Documentation under development