PostgreSQL
Last updated
Last updated
PostgreSQL is an advanced, enterprise class open source relational database management (RDBMS) that supports both SQL (relational) and JSON (non-relational) querying. PostgreSQL is the primary data store or warehouse for many web, mobile, geospatial, and analytics applications.
1. Click Add Data Source
2. In the menu, select PostgreSQL
3. Config information of Data Source
Display name: name of your PostgreSQL source
Host: the IP address where your database is hosted
Port: you need to check with your system administrator to choose the port opening for connecting
Username: username of the PostgreSQL user you created
Password: password of the PostgreSQL user you created
4. Test Connection
After inputting the Config information, click Test Connection to check whether your PostgreSQL source connects successfully.
5. Click Add to add Data Source
Your PostgreSQL will be displayed in the Data Sources (e.g. sample postgres) with the information of the Owner, Type, Date Modified, and Action.
1. Click the Jobs tab then click Add Job
2. Config information for Job
Job name: name of your job
From Data Source: select your data source to add the job
From database: select one database suggested in the data source. If the database you need doesn’t appear on the list, please type exactly the database you want.
From table: select one table suggested in the database. If the table you need doesn’t appear on the list, please type exactly the table you want. Or you can choose to sync all tables.
Sync to data warehouse: toggle this to turn syncing to the Data warehouse on or off. You can create a new database or pick up the existing database on the Data warehouse to sync.
Create new database: choose one database suggested in the data source or you can create a new one
Create new table: choose one table suggested in the database or you can create a new one (also when you create a new database)
Sync to data lake: toggle this to turn to sync to Data lake on or off
Sync Mode: you choose between Full Sync and Incremental sync:
Full sync: sync everything in the data source with the designated destination, data lake, data warehouse, or both
Incremental sync: transfers changed all record and catalog data since the last synchronization (full or incremental)
Scheduler type: choose the type you want to sync
Run only once: only runs one time at a designated Date and Time
Recurring: set up the repeated sync using the time scheduler
Frequency: select the time interval between the data sync
3. Click Add Job
4. Check your synced job: Synced Jobs will be displayed in Jobs with the information of their mode, status, date synced, and action. You can click Force Sync to sync manually to ensure you access the up-to-date data.
5. Click the Jobs History to see what jobs have been done in the system so far. You can track all the activities of the jobs, including the time, the number of occurrences, and how many columns each job has generated.
This is a demo of the entire process of adding PostgreSQL Data Source.
We hope that the above instructions will be useful to you. Let's have a look at our other articles to learn more about adding other databases with Data Insider.
