How to Set Up On-Premises Data Gateway in Power BI

If you're trying to use Power BI with data that isn't in the cloud - like a SQL Server database sitting on your company’s local server or Excel files on a shared network drive - you’ll quickly hit a wall. Power BI is a cloud service, and it needs a secure way to reach into your private network and grab that data. This article explains exactly how to build that bridge by setting up and configuring an on-premises data gateway.

Graphed

Still Building Reports Manually?

Watch how growth teams are getting answers in seconds — not days.

Watch the Demo

What Exactly Is an On-Premises Data Gateway?

Think of the on-premises data gateway as a secure messenger that runs on a computer inside your company's network. Its only job is to receive data requests from the Power BI service in the cloud, securely fetch the requested data from your local sources, and then send it back up to Power BI for your reports and dashboards.

Without it, Power BI has no way of knowing your internal servers even exist. The gateway acts as a bouncer at the door, authenticating Power BI's requests, ensuring they have the right permissions, and managing the flow of information without exposing your entire network to the internet.

You need a gateway when your data lives in places like:

• SQL Server, Oracle, or other databases running on local servers.
• Files like Excel workbooks, CSVs, or text files stored on company network shares.
• An on-premises SharePoint site.
• Any other data source that isn't publicly accessible via the web.

Graphed

Still Building Reports Manually?

Watch how growth teams are getting answers in seconds — not days.

Watch the Demo

Two Gateway Modes: Standard vs. Personal

Microsoft offers two versions of the gateway, and it’s important to pick the right one for your situation.

Standard Mode: This is the one you should almost always use. It's intended for central use by multiple users and can be used by Power BI, Power Automate, and other Microsoft cloud services. An IT administrator typically sets it up on a server that is always running. Multiple report creators can connect to data sources through a single, professionally managed gateway.

Personal Mode: This version is designed for a single user (usually a data analyst) to connect to sources. It only works with Power BI and runs as an application on your own computer. The major catch is that it only works when your computer is on and you are logged in. If you shut down your laptop for the weekend, your reports stop refreshing. For any serious or collaborative work, standard mode is the way to go.

This tutorial will focus on installing and configuring the Standard Mode gateway, as it's the professional standard.

Before You Begin: System Requirements

Before you jump into the installation, make sure the computer you're planning to use as the gateway server meets some basic requirements. You can’t just install it on any old spare machine and expect smooth performance.

Here are the fundamentals:

• Operating System: Windows Server 2012 R2 or newer, or Windows 8 (64-bit) or newer.
• .NET Framework: Version 4.7.2 or later is required. The installer typically handles this, but it’s good to be aware of.
• Hardware: Microsoft recommends a minimum of an 8-core CPU, 8 GB of RAM, and sufficient disk space - especially if you're dealing with very large datasets.
• An "Always-On" Machine: Don't install the gateway on your personal laptop. It needs to be installed on a server or a dedicated desktop computer that will remain on and connected to the network 24/7. If the machine restarts or loses its connection, your data refreshes will fail.
• Power BI Account: You'll need credentials for a Power BI account (a Pro or Premium license is needed to publish and share reports that use a gateway).

Step-by-Step Guide: Installing the Gateway

Alright, with the requirements out of the way, let’s get this gateway installed. The process is straightforward if you follow the steps carefully.

Step 1: Download the Gateway Installer

First, you need to download the installer from the Microsoft Power BI site. You can usually find it by navigating to the "Downloads" section in the Power BI service or by heading directly to the gateway download page. Make sure you grab the standard mode installer.

Graphed

Still Building Reports Manually?

Watch how growth teams are getting answers in seconds — not days.

Watch the Demo

Step 2: Start the Installation

Run the downloaded installer file. You'll be greeted with a setup wizard.

• Acknowledge the warning that it shouldn’t be installed on a domain controller.
• Accept the terms of use and privacy statement.
• Choose an installation path (the default is usually fine) and click Install.

The installer will copy all the necessary files to your machine. This might take a few minutes.

Step 3: Sign In and Register the Gateway

Once the files are installed, the configuration wizard will open. This is where you connect the gateway application to your Power BI account.

1. Enter the email address associated with your Power BI Pro or Premium account and click "Sign in." Authenticate your account just like you would on the website.
2. After signing in, select "Register a new gateway on this computer" and click Next.

Step 4: Configure Your New Gateway

Now you need to give your gateway a unique name and set up a recovery key. This is a very important step!

• Gateway Name: Give it a descriptive name that your team will recognize, like "Marketing Department SQL Gateway" or "Company HQ File Server." This name will appear in the Power BI service, so clarity helps.
• Recovery Key: You must create a recovery key with at least 8 characters. This key is absolutely critical. If you ever need to restore the gateway to a new machine or migrate your settings, you will need this key. If you lose it, you will have to recreate all of your data source connections from scratch. Save this key somewhere secure, like a password manager.

Once you've entered the name and a new, secure recovery key, click Configure. The application will finalize the setup. If all goes well, you'll see a screen confirming that your gateway is now online and ready to be used.

Managing the Gateway in the Power BI Service

The installer is done, but you're not finished yet. The gateway "bridge" has been built, but now you need to tell Power BI which "roads" - or data sources - it's allowed to access.

Step 1: Locate Your Gateway in Power BI

Head over to https://app.powerbi.com and log in. In the top-right corner, click the settings gear icon, then select "Manage gateways and connections." You should see the gateway you just named listed under the "On-premises data gateways" tab. A green status indicator will let you know it's online and connected.

Graphed

Still Building Reports Manually?

Watch how growth teams are getting answers in seconds — not days.

Watch the Demo

Step 2: Add a Data Source Connection

Now, let's create a connection to an actual on-premises data source, like a SQL Server database.

1. On the "Manage gateways and connections" page, select your gateway name. In the options that appear, select “New” at the top to add a new connection.
2. Connection Name: Give the connection a name, like "Sales Reporting Database."
3. Connection Type: You'll see a massive list of all the data sources Power BI supports. Find and select the right one (e.g., SQL Server).
4. Server and Database information: Enter the server name (e.g., SQL-SRV-01\SQLEXPRESS) and the name of the database (e.g., SalesDB).
5. Authentication Method: This is a key part. You need to provide credentials that the gateway can use to access the database. You'll typically choose between "Basic" (with a username and password) or "Windows" (using a Windows service account). This account needs to have at least read permissions on the database you're connecting to. Ensure the information you enter here is accurate.

Once you’ve filled everything out, click Create. Power BI will test the connection. If the gateway successfully reaches the database with the credentials you provided, you’ll see a "Connection successful" message. Now, anyone you grant access to can use this predefined "Sales Reporting Database" source when building dashboards in Power BI Desktop or the service.

Final Thoughts

Setting up an on-premises data gateway is how you securely connect Power BI's cloud-based analytics to the valuable data living inside your company's private network. By installing the gateway, configuring it with a secure recovery key, and managing data source connections, you build the essential bridge needed for live, refreshable reporting.

Configuring data gateways and managing different data sources is a necessary step in the world of traditional business intelligence. For marketing and sales data, however, the main challenge isn't connecting to on-premise servers but wrangling scattered data from a dozen different cloud platforms. Here at https://www.graphed.com/register we felt this pain, so we built a solution that lets you skip the friction entirely. We connect directly to your cloud data sources like Google Analytics, Shopify, HubSpot, and Facebook Ads, so you can stop wrestling with installations and start asking questions in plain English to build real-time dashboards in seconds.