Processing Steps

Processing Steps are used to clean and transform imported data into the desired form that you want. There are multiple types of pre-built Processing Steps as well as custom Processing Steps.

Adding Processing Steps

There are 2 ways to add Processing Steps to your data.

From the Dataflow (right Sidebar): You can add Steps directly from the Dataflow by clicking on the '+' button. Doing so will bring up a component that lets you search and choose which Step you want to apply to your data.

From the Spreadsheet View: You can also click on any of the column headers for the columns you want to process or transform. You will see a dropdown with a categorized list of some of the Processing Steps that you can apply on that column. When you click on any of those, a Step will be added to the Dataflow.

Removing Steps

Removing Steps can be done from the Dataflow in the sidebar. You can simply click on the trash icon on a Step to remove it. You may have to re-run the last Step to refresh the data in the Spreadsheet View.

Running Steps

You can Run Steps by clicking on the "Run" button on a Step. Running Steps will apply all Processing Steps to your imported data in a sequential manner.

Note that clicking on the "Run" button on an individual Step will run that Step along with all the Steps before it in the Dataflow. This ensures that you get the most accurate view of your processed data up to the Step you run.

To make this point clear, if there is only one Step in the Dataflow, then clicking "Run" will only run that one Step. If you run the last Step in the Dataflow, it will run all steps. However, if you run a Step that's anywhere in the middle of a Dataflow (i.e. neither the only Step nor the last Step), then Dropbase will run all Steps up to and including the Step you clicked on. Any Step after th done you ran will remain un-processed.

After a Step has been run, you can click on the Step to view a Snapshot of your data after that Step has been applied.

Pre-built Processing Steps

Dropbase has a number of powerful and convenient pre-built processing steps.

Change Column Type

What it does: The change column type function converts the data type of a column from a source type to a target type. Supported types are text, integer, decimal, Boolean, DateTime, and duration.

How to perform: There are two ways of accessing the function. The first is by selecting the header of the column you wish to alter from the Spreadsheet view, which will open a dropdown menu. From this menu, you will see an option for "Field Type", with the current field type populated. Hover over that field type to see a list of other column types, and select the type you wish to change it to. This selection will then appear in the Sidebar as a Step, which you can now run or alter.