How to Remove Duplicates in Tableau

Nothing throws off an analysis faster than duplicate data. One accidental copy-paste or a messy data source can instantly inflate your sales numbers, skew your averages, and lead to decisions based on faulty information. This article will walk you through several practical methods to find and remove duplicates directly within Tableau, so you can trust your dashboards and reports.

Graphed

Build AI Agents for Marketing

Build virtual employees that run your go to market. Connect your data sources, deploy autonomous agents, and grow your company.

Build Your First Agent

Why Does Duplicate Data Matter?

Before we get into the fixes, it's helpful to understand exactly why duplicates are such a problem. Imagine you're analyzing customer orders, and a single order for $50 accidentally appears twice in your data. Here’s how that small error can snowball:

• Inflated Metrics: Simple calculations like counting orders or summing up revenue will be wrong. Your total revenue will appear to be $100 instead of $50, and your order count will be two instead of one.
• Inaccurate Averages: If you calculate average order value, it might seem correct ($100 across 2 orders is still $50/order), but if that duplicate order becomes just one of many, it can subtly throw off the entire average.
• Skewed Visualizations: Charts and graphs will display these inflated numbers, giving you a misleading visual of your business performance. A bar chart showing sales by region, for example, might falsely highlight one region as a top performer due to duplicate entries.

Cleaning up duplicates isn't just a technical exercise, it's a fundamental step in ensuring the integrity of your entire analysis. Getting it right builds trust in your dashboards from stakeholders and your team.

The Quick Fix: Using COUNTD for Aggregation

Sometimes, you don't need to physically remove duplicate rows from your dataset. You just need to make sure you're counting things correctly in your visualization. This is where Count (Distinct), or COUNTD(), is incredibly useful.

Let’s say you have a list of orders and you want to know how many unique customers made a purchase. Your data might look something like this:

Order ID, Customer ID, Sale Amount 101, C-123, $50 102, C-456, $75 103, C-123, $30 104, C-789, $120 105, C-123, $65

If you drag Customer ID to your sheet and use a standard COUNT() aggregation, Tableau will tell you that you have 5 customers. But a quick look shows that customer C-123 made three separate purchases. We only have three unique customers.

The fix is simple:

1. Drag the dimension you want to count (in this case, Customer ID) onto your canvas or into the "Text" box on the Marks card.
2. Right-click the blue Customer ID pill.
3. Go to Measure > Count (Distinct).

Tableau will now show the correct number: 3. This approach is perfect for high-level KPIs and dashboards where you need accurate unique counts without altering the underlying data structure.

AI Agents for Marketing

Crash Course

Graphed

Free PDF · the crash course

AI Agents for Marketing Crash Course

Learn how to deploy AI marketing agents across your go-to-market — the best tools, prompts, and workflows to turn your data into autonomous execution without writing code.

Download the PDF

Method 1: Filtering Duplicates with a Table Calculation

When you need to truly filter out duplicate rows from a view, one of the most common methods is by using an INDEX() table calculation. The idea is to assign a sequential number to each row within a partition (a group of identical rows) and then filter to keep only the first instance of each.

This sounds complex, but it's a straightforward, step-by-step process.

Step 1: Build Your View

First, bring all the columns that define a "unique" row into your view. If a unique record is defined by an Order ID and a Product ID, drag both of those dimensions onto the Rows shelf.

Step 2: Create a Calculated Field for INDEX()

Next, we’ll create the calculation that "numbers" the rows.

• Go to Analysis > Create Calculated Field.
• Name the field something descriptive, like "Duplicate Filter".
• In the formula box, simply type:

INDEX()

Click "OK". The INDEX() function simply returns the index (or row number) of the current row in the partition.

Step 3: Add the Calculation to Your View

Now, drag your new "Duplicate Filter" calculated field from the data pane to the Rows shelf. Right-click on it and make sure it is set to Discrete. At this point, you'll see a number next to each row, likely starting at 1 and counting up.

Step 4: Configure the Table Calculation

This is the most important step. We need to tell Tableau how to apply the INDEX() calculation. We want it to restart its count for every unique combination of our identifying fields.

• Right-click the "Duplicate Filter" pill on the Rows shelf.
• Select Edit Table Calculation.
• Under "Compute Using," choose Specific Dimensions.
• Check the boxes for all the dimensions that you use to identify a unique record (e.g., Order ID, Customer ID, Product ID, etc.).

After you configure this, you will see a "1" next to the first instance of each record Group, and a "2", "3", etc., next to any subsequent duplicates.

Graphed

Build AI Agents for Marketing

Build virtual employees that run your go to market. Connect your data sources, deploy autonomous agents, and grow your company.

Build Your First Agent

Step 5: Filter the Duplicates Out

Finally, all we need to do is tell Tableau to only show the rows where our calculated field is equal to 1.

• Drag the "Duplicate Filter" pill from the Rows shelf to the Filters card.
• A dialog box will appear. Type 1 in the box and click OK, or select 1 from the list and hit "OK."

All duplicate rows will disappear from your view, leaving you with a clean, unique dataset for that specific worksheet.

Method 2: Use a FIXED Level of Detail (LOD) Expression

Level of Detail (LOD) expressions offer another powerful way to identify and filter duplicates. A FIXED LOD allows you to compute an aggregation at a specific level of granularity, regardless of what dimensions are in your view. We can use this to count how many times each unique record appears.

Step 1: Decide What Makes a Row Unique

Just like with the table calculation method, you first need to identify the combination of fields that should be unique. For an e-commerce dataset, this might be [Order ID] and [Product ID].

Step 2: Create the Main LOD Calculation

Create a calculated field to count the number of records for each unique combination you identified in step 1.

• Open the calculated field editor.
• Name it something like "Row Count per Record."
• Enter the following formula, replacing the dimensions with your own:

{ FIXED [Order ID], [Product ID] : COUNT([Orders]) }

This calculation tells Tableau: "For every unique combination of Order ID and Product ID, count up the total number of rows and display that count." If there are no duplicates, this field will always show 1.

Step 3: Filter Based on the LOD

Now that you have a new measure that equals 1 for unique records and >1 for duplicates, you can filter on it.

• Drag your "Row Count per Record" field to the Filters shelf.
• Select "All values" and click "OK."
• In the next window, choose At Most and type 1 in the box.

This filter configuration will ensure that only rows with a count of 1 are included in the visualization. As a benefit, this method is often more flexible than table calculations, as it isn't dependent on the structure of your worksheet.

AI Agents for Marketing

Crash Course

Graphed

Free PDF · the crash course

AI Agents for Marketing Crash Course

Learn how to deploy AI marketing agents across your go-to-market — the best tools, prompts, and workflows to turn your data into autonomous execution without writing code.

Download the PDF

Best Practice: Handle Duplicates in Your Data Source

While the methods above are great for managing duplicates within Tableau Desktop, the most robust and efficient solution is often to clean your data before it ever reaches your workbook. Cleaning data at the source ensures that all of your analyses are consistent and you don't have to rebuild duplicate filters for every new worksheet. A great option for this is using Tableau's companion tool: Tableau Prep.

Tableau Prep is designed for cleaning, shaping, and combining data before analysis. Removing duplicates is one of its core strengths.

The Tableau Prep Workflow

1. Connect to Data: Open Tableau Prep and connect to your data source.
2. Add an Aggregate Step: Click the plus icon on your workflow and choose "Aggregate."
3. Group by Unique Fields: In the Aggregate tool pane, drag the fields that define a unique row (e.g., Order ID, Customer ID) into the "Grouped Fields" area.
4. Aggregate Other Fields (Optional): If you have numeric fields like Sales, drag them to the "Aggregated Fields" area and choose an aggregation like Sum or Average.
5. Output the Clean Data: Add an "Output" step to save the cleaned data as a .hyper file or publish it directly to Tableau Server. You can then connect to this new, clean data source from Tableau Desktop.

So, Which Method is Right For You?

Choosing the best approach depends on your specific needs:

• For a quick, one-off visualization check where you need to report on unique counts (like the number of unique customers), use COUNT(Distinct).
• For filtering within a single worksheet without changing your underlying data, table calculations (INDEX) or LOD expressions (FIXED) are both excellent choices.
• For a permanent, reliable solution that ensures data quality across your entire workbook and for your team, cleaning the data upstream with a tool like Tableau Prep is the best practice.

Final Thoughts

Handling duplicate data is an essential skill for anyone working in Tableau. By using methods like aggregations with COUNTD, filtering with table calculations or LOD expressions, or cleaning your data from the start with Tableau Prep, you can create accurate, reliable analyses that drive better business decisions.

We built Graphed because we know wrestling with data in tools like Tableau can be time-consuming and complex. Manually configuring LOD expressions or setting up Tableau Prep flows takes valuable time away from actual analysis. With our platform, you just connect your data sources directly - like Google Analytics, Shopify, or Salesforce - and use plain English to build real-time dashboards. Ask, “show me my sales compared to ad spend,” and our AI handles all the underlying data work, giving you clean, accurate charts in seconds.