Skip to content
itsorted.online
AI guide

Shadow AI: How to Find Which AI Tools Your Staff Are Using

Shadow AI is any AI tool staff use for work without the business knowing: a free chatbot account, an AI note-taker joined to client meetings, a browser extension that reads every page, or an app given access to the company mailbox. You can't manage what you can't see. This guide shows the free places to look first (the app consent lists in Microsoft 365 and Google Workspace, and browser extension reports), what paid discovery tools add and which licence they need, and how to turn what you find into an approved-tools list that staff will actually follow, rather than a ban they work around.

By IT Sorted teamReviewed 7 min readHow we write guides
in

Key takeaways

  • OAuth app lists in Microsoft Entra and Google Admin show AI tools connected to work accounts, at no extra cost.
  • Chrome Enterprise Core reports installed browser extensions and is free to use.
  • Defender for Cloud Apps discovery isn't in Business Premium; it comes with the Defender Suite add-on or E5.
  • A short staff survey finds the free chatbot accounts that no admin console shows.
  • Publish approved alternatives before blocking anything, or use moves to personal phones.
In this guide · 8 sections
  1. 01What counts as shadow AI, and why it matters
  2. 02Microsoft 365: check Enterprise applications and user consent
  3. 03Google Workspace: check Accessed apps and API controls
  4. 04Browser extensions: the blind spot
  5. 05Paid discovery tools and what licence they need
  6. 06Turn findings into an approved AI tools list
  7. 07Do it yourself or get help?
  8. 08Frequently asked questions

Short answer

Start with the free sources: Enterprise applications in Microsoft Entra and Accessed apps in the Google Admin console show AI apps connected to work accounts, and Chrome Enterprise Core lists browser extensions. Then ask staff and publish an approved-tools list.

What counts as shadow AI, and why it matters

Most shadow AI isn't malicious. Staff use AI because it saves time. The risk is what goes in and what the tool can reach: client data pasted into a consumer chatbot, a note-taker recording meetings without consent, or an app granted read access to every email and file.

TypeExampleWhere you can see it
Connected app (OAuth)AI email assistant given access to Outlook or GmailEntra Enterprise applications; Google Admin Accessed apps
Meeting botAI note-taker joining Teams or Meet callsOAuth lists, calendar permissions, meeting participant lists
Browser extensionAI writing or summarising extensionChrome Enterprise Core or Edge management reports
Website accountFree chatbot used with a personal emailNot visible in admin consoles; network or endpoint discovery, or ask staff
Desktop or phone appAI app installed on a laptop or personal phoneIntune or MDM app inventory (company devices only)

The PDPA still applies whichever tool staff use. Our ChatGPT at work policy guide covers what data should never go into AI tools.

Google Workspace: check Accessed apps and API controls

Google's equivalent sits in the Admin console under Security, Access and data control, API controls. Google's app access help page explains how to view accessed apps and set each one to trusted, limited or blocked.

  • Open Manage third-party app access and view Accessed apps: every app users signed into with Google and the number of users.
  • Look for AI assistants, note-takers and "chat with your Drive" tools with access to Gmail, Drive or Calendar.
  • Set approved apps to Trusted, and block apps you don't want accessing Workspace data.
  • Consider restricting access to unconfigured third-party apps so new apps need admin approval.
  • Check the OAuth log events in the audit and investigation tool to see when an app was first authorised and by whom.

If staff connect ChatGPT, Claude or Copilot to Drive or SharePoint, read our AI connectors security guide before approving them.

Browser extensions: the blind spot

AI browser extensions can read the pages staff view, including web email, CRM records and banking portals. They don't show up in OAuth lists. Google says Chrome Enterprise Core provides browser management and reporting at no additional cost, including installed extensions, once browsers are enrolled. Microsoft Edge can be managed similarly through Intune.

Browser extension review

Turn findings into an approved AI tools list

Discovery only helps if the result is a clear list staff can follow. Banning everything pushes AI use onto personal phones, where you have no visibility at all.

  1. Ask staff what they use and why

    A five-question anonymous survey finds the free accounts no console shows. Ask which tools, for which tasks, and what data goes in.

  2. Pick approved tools for the common tasks

    Usually one business chatbot with training off (such as Copilot Chat with your work account, ChatGPT Business or Gemini in Workspace), one note-taker and one writing aid.

  3. Check training and retention settings

    Confirm the approved tools don't train on your data. Our AI training opt-out guide lists the settings per tool.

  4. Publish the list with simple rules

    Approved tools, what data may go in, how to request a new tool, and who to ask. One page is enough.

  5. Then restrict the rest

    Require admin consent for new OAuth apps, block high-risk extensions, and revoke tools you've replaced.

  6. Review quarterly

    Re-run the OAuth and extension reports every quarter and update the list.

Do it yourself or get help?

An admin can run the OAuth and extension checks in an afternoon. Help is useful when the lists are long, when you need consent settings and extension policies changed without breaking tools people rely on, or when staff need training on what not to paste into AI.

Our Microsoft 365 / Google Security Lockdown (S$590) reviews connected apps, sets admin consent and extension policies, and documents the result. Security Awareness Training (S$390) covers safe AI use alongside phishing.

Frequently asked questions

Shadow AI is any AI tool used for work without the organisation's knowledge or approval: a personal chatbot account, an AI meeting note-taker, an AI browser extension, or an app given access to company email or files. It is a subset of shadow IT, with the extra risk that staff paste business or customer data into it.

Yes. Microsoft Entra's Enterprise applications list shows apps users have signed into with their work account and the permissions they granted, and the sign-in logs show who uses them. This is available without extra licences. Website-only AI use with personal accounts won't appear there.

Blocking without an alternative usually moves AI use to personal phones and accounts, where you can't see or control it. A better approach is to approve one or two business-grade tools with training turned off, publish simple rules on what data may go in, and then block or restrict the rest.

No. Microsoft's subscription matrix lists Defender for Cloud Apps in Microsoft 365 E5 and in the Defender Suite add-on for Business Premium, but not in Business Premium itself. Business Premium includes Defender for Business for devices, Intune and Entra ID P1, which already help with app consent and device inventory.

It is good practice. Reviewing which apps are connected to company accounts is normal administration, but monitoring web traffic or device activity should be covered in your IT policy and explained to staff. Being open also makes the staff survey more honest. This is general information, not legal advice.

Rather have it done for you?

Fixed price, set up in your own accounts.

Order online, get a written scope, and keep full ownership of everything we set up. Questions first? Ask us in writing.