Overview

With Dropbase, you can easily load data to your databases. Loading data to database is typically used after you have imported some data and applied some cleaning/transformation steps. Dropbase automatically creates a Database for you when you create you Workspace. We also give you have access to the database so that you can easily connect it to your favorite tools, in any way you want.

Loading Data in Dropbase always means loading data to your Dropbase Database. Note that "Import" and "Load Data" mean different things. "Import" means importing data to be processed by Dropbase, and "Load Data" means move it to the Database. If you import data but do not load, the data won't actually be loaded to your database.

Loading Data from Database Manager

The easiest way to load a CSV or Excel file to the database is through the Database Manager. Simply drag and drop your file to the desired folder, select the columns in your file that you want to load to the database, and click on the "Create Table & Load Data" button.

To append more data to an existing table, simply drag and drop a new file to the desired table, map the columns in the incoming file to those required by the destination table, and click on the "Load to Database" button.

Loading Data Using a Worksheet

By default, a Load to Database Step is added to the Dataflow (right Sidebar) of any Worksheet. To load data to a database table, you first need to import data into a Worksheet and optionally apply Processing Steps. If any Processing Steps have been applied, they must be run before loading your data.

Select the Load to Database Step and specify if you want to load data to a new table in your Database or to an existing table.

To load data to a new database table, choose the "New Table" option. Enter the table name and click on the "Load to Database" button.

To load data to an existing database table, choose the "Existing Table" option. Choose additional options such as Overwrite, Append, or Merge and the table which you want to load your data to. Once you're ready click on the "Load to Database" button.

After you load data to your database using a Worksheet, you will receive a status message. If you successfully loaded data, you will be able to view your loaded data immediately by clicking on the "View Loaded Data" button.

Loading Data Using a Pipeline

A Pipeline can have only one Database destination, and it must be specified at the time of deploying the Pipeline. After the Pipeline is deployed, importing data to the Pipeline or approving incoming data from Dropzone Data Requests will trigger a Pipeline run, and subsequently, load data to your Database. For more details on Pipelines, please consult the Pipelines doc.

Loading Data Options

When loading data, you have the option to load to new or existing tables. If you choose to upload data to an existing table, you can decide if you want to overwrite the data in the table, append the new data to it, or merge incoming data to the destination table.

New Table vs Existing Table

Loading data to a new table creates a new table in your managed Dropbase Database.

Loading data to an existing table loads data to a table that you have already created in your managed Dropbase Database. If you load data to an existing table, you need to specify if you want to append, overwrite, or merge data. When loading data to an existing table, the new data must match the schema of the existing table.