Top Excel Data cleansing

Data cleansing is an important activity within Excel and one that we find ourselves doing day in day out, sometimes without even knowing it.

So what is data cleansing?

In the words of Oz du Soleil, Excel MVP, it is like “Hercules being sent out to capture the three-headed dog that guards the entrance to hell!”

So you can see that Oz sees that data cleansing is hard work but one that needs to be done in order to succeed in Excel.

We get thrown data at us from external accounting systems, ERPs or downloads from the company server and most of the time it is not imported in an Excel friendly way.  This is where you and I come in to clean the data!
​You can listen to our podcast episode which was highly entertaining and full of golden nuggets by clicking on below’s image and further down I will show you the My Top Data Cleansing Techniques, which include the ones that Oz uses:

Top Excel Data cleansing

1. Unpivot Data

Power Query is a free add-in created by Microsoft for Excel 2010 (or later) and you can download and install it for Excel 2010 and 2013 here:

Download Power Query here 

How to Install Power Query 2010 here

How to Install Power Query 2013 here

In Excel 2016 it comes built in the Ribbon menu under the Data tab and within the Get & Transform group.

Power Query allows you to extract data from any source, clean and transform the data and then load it to another sheet within Excel, Power Pivot or the Power BI Designer canvas.

One of the best features is to Unpivot Columns.

What that does is transforms columns with similar characteristics (e.g. Jan, Feb, March…) and puts them in a unique column or tabular format (e.g. Month), which then allows you to do further analysis using Pivot Tables which was not possible before unpivoting.

Here is how this is done:

Top Excel Data cleansing

2. Find & Replace

The Find & Replace feature or CTRL+H shortcut allows you to amend your data in seconds.  Imagine you had thousands of rows of data that was downloaded from an external system with the wrong date.  A simple CTRL+H will save you heaps of time!  See how below.

Top Excel Data cleansing

3. Find Errors with Go to Special Constants

Say you have a data set and want to make sure that each column contains what it is supposed to.

For example, say you have a column which contains Dates and you want to check that there are no cells which contain Text.

You can easily check this by highlighting that column and pressing CTRL+G to bring up the Go To dialogue box (or by choosing from the menu Home > Find & Select > Go To…)

Then you need to choose Special > Constants and select the constant that you want to find in your column.

In our example you will need to only select the Text box and de-select the other boxes and press OK.  This will highlight the cells that contain text and you can begin to format these cells.

Top Excel Data cleansing

4. Find Blank Cells In Excel With A Color

In Excel you can have a data set that comes from an external source which isn’t always formatted to your liking.

One of the most common things you may encounter are blank cells in your Excel data which can hinder your analysis, especially if you are using a Pivot Table to analyze the data.

To find these annoying blank cells in Excel you will need to highlight all your data set (CTRL+*) and bring up the Go To shortcut:  CTRL+G > Special > Blanks.

Then you can fill in the blank cells with a color red and filter by that same color to drill down to these blank cells and take some formatting action.

Top Excel Data cleansing

 

Top Excel Data cleansing

5. Remove Duplicates in an Excel Table

When you have duplicates values within your Excel Table there is a quick and easy way to remove those values.

The duplicate values could be all over your Excel Table and sometimes it takes valuable time trying to locate those duplicates and then deleting them.

Not to worry, Remove Duplicates to the rescue!

STEP 1: Click inside your Excel Table and select Table Tools > Design > Remove Duplicates

STEP 2: This will bring up the Remove Duplicates dialogue box.  Select only the Column box that contains the duplicates that you want to remove and press OK

Top Excel Data cleansing

6. Text To Columns: Dates

Whenever you download data from an external ERP system like Oracle, SAP, etc, you can have data that is not formatted the way you and Excel likes.

Sometimes “Date” values are downloaded as “Text”, so you cannot sort in the periodic date format.

No worries!  Text to Columns to the rescue!

Below I show you how to convert this “Text” data into “Excel friendly” data.  Download the workbook to practice this cool trick!

NB: If the dates are not converting properly after you do the Text to Columns, it may be that your computer’s Region formats need changing.

Go to the Region settings in your Control Panel and make sure that the Short Date is in this format: dd/MM/yyyy

Top Excel Data cleansing

7. Using Formulas To Clean Data

There are several formulas that you can use to clean up dirty, inconsistent and wayward data.  Below are some of the best formulas that you can use:

Download Workbook

Top Excel Data cleansing

Top Excel Data cleansing

Top Excel Data cleansing

Top Excel Data cleansing

Top Excel Data cleansing

Top Excel Data cleansing

8. Excel Add-Ins

Here are some great Excel Add-Ins that will help you clean up your messed up data with a press of a button, so no need to write any formulas:

Power Query for Excel

Ablebits

Asap-Utilities

So there you are, these are just a few data cleansing techniques that you can apply to your data today.  Join me and Oz in this Free Power Query & Data Cleansing Webinar to learn some more techniques now:
Top Excel Data cleansing
What is your favorite data cleansing technique?  Let me know by commenting below 🙂
Cheers,
John

If you like this Excel tip, please share itEmail this to someone

email

Pin on Pinterest

Pinterest

Share on Facebook

Facebook

Tweet about this on Twitter

Twitter

Share on LinkedIn

Linkedin

Share on Google+

Google+

Related Posts

Show The Percent of Difference From Previous Years...   I am sure that your boss has asked you to come up with a Year on Year variance report at some stage.  There are a couple of ways to get him/her an answer. One is using Formulas, but that will take time to set up and you are exposed to errors! The other method is t...
Rank Largest to Smallest With Excel Pivot Tables Excel Pivot Tables have a lot of useful calculations under the SHOW VALUES AS option and one that can help you a lot is the RANK LARGEST TO SMALLEST calculation. This option will immediately calculate the rankings (1 being the LARGEST value) for your values, allowing you to pi...
Drop Down List with Data Validation One of the coolest features of Excel is to create a drop down list with your data.  It is one of the first things that I learned and use on a daily basis. You can create a drop down list to eliminate manual entry and re-entry of data, as well as reduce data entry mistakes if y...
Summarize Data With Dynamic Subtotals What does it do? It returns a Subtotal in a list or database Formula breakdown: =SUBTOTAL(function_num, ref1) What it means: =SUBTOTAL(function number 1-11 includes manually-hidden rows & 101-111 excludes them, your list or range of data) ***Go to the bottom...