EU AI Act for Call Centers: AI Agents and Staff Monitoring
TL;DR
Three EU AI Act rules hit call centers. First, using AI to infer your employees' emotions from their voice, such as flagging an agent as angry or stressed, has been banned since 2 February 2025; that exact call center case is one of the European Commission's own examples. Second, from 2 August 2026 every AI voice agent must tell callers it is an AI. Third, AI that monitors and evaluates human agents' performance or behavior is high-risk, with full duties from 2 December 2027, and staff representatives must be told before it is used.
Not legal advice
This is general information about Regulation (EU) 2024/1689 as amended by Regulation (EU) 2026/1744. Every legal point links to its source. All sources were last checked on 11 November 2026. Your own counsel decides how the rules apply to your operation.
What does the EU AI Act change for call centers?
A call center uses AI in two directions. One faces customers: AI voice agents, routing, call summaries. The other faces staff: quality scoring, coaching, monitoring. The AI Act is gentle on the first and strict on the second.
Customer-facing AI mostly needs honesty: callers must be told they are talking to an AI (Article 50). Staff-facing AI is where the ban and the high-risk list sit, because the Act treats the workplace as a place where people cannot easily say no.
Can a call center use AI to track its agents' emotions?
No. Article 5(1)(f) prohibits "the use of AI systems to infer emotions of a natural person in the areas of workplace and education institutions, except where the use of the AI system is intended to be put in place or into the market for medical or safety reasons". It has applied since 2 February 2025.
The European Commission's guidelines on prohibited practices give a call center as one of their examples. Germany's AI Act regulator, the Bundesnetzagentur, lists it in its summary: "The use of webcams and voice recognition systems by call centres to track their employees' emotions, such as anger" (Bundesnetzagentur).
In practice, that rules out features such as agent stress scores, anger alerts on the agent's voice, or "agent mood" dashboards built from voice analysis. A banned practice can cost up to EUR 35 million or 7% of worldwide annual turnover, whichever is higher (Article 99(3)).
Two limits of the ban, according to the Commission's guidelines as summarized by the Future of Privacy Forum: emotions inferred from written text alone are outside it, because the ban needs biometric data such as voice or face; and it covers the employees, not the customers on the line. Text analysis used to score staff can still be high-risk, as the scoring section below shows.
Can a call center analyze customers' emotions?
It is not banned, as long as the same tool does not also track the agent's emotions. But it is regulated. Emotion recognition systems are on the high-risk list in Annex III point 1(c), with full duties from 2 December 2027. And Article 50(3) already requires, from 2 August 2026, that the people exposed to an emotion recognition system are told it is running.
So a real-time "customer sounds frustrated" prompt is possible, but it needs a notice to the caller now and high-risk controls later. Ask the vendor whether their sentiment feature reads the voice or only the text: the answer changes the rules that apply.
Which call center AI tools are banned, high-risk or simply disclosed?
| AI tool | Status under the AI Act | What it triggers | From |
|---|---|---|---|
| AI voice agent answering customers | Transparency only | Tell callers it is an AI (Art. 50(1)) | 2 Aug 2026 |
| AI outbound calls (reminders, follow-ups) | Transparency only | Same disclosure at the start of each call | 2 Aug 2026 |
| Call summaries and transcripts | Not on the Annex III list | GDPR applies to the data | Now |
| Routing by queue, language or availability | Not on the Annex III list | Nothing extra under the Act | Now |
| Emotion or stress detection on the agent’s voice | Prohibited (Art. 5(1)(f)) | Switch it off | Banned since 2 Feb 2025 |
| Emotion detection on the customer’s voice | High-risk (Annex III 1(c)) | Notice to callers (Art. 50(3)), deployer duties | 2 Aug 2026 notice, 2 Dec 2027 duties |
| Text-only sentiment on transcripts | Outside the ban per Commission guidelines | High-risk if used to evaluate staff (4(b)) | See row below |
| AI quality scoring or monitoring of human agents | High-risk (Annex III 4(b)) | Deployer duties, inform staff representatives first | 2 Dec 2027 |
| Assigning work by an agent’s individual behavior or traits | High-risk (Annex III 4(b)) | Deployer duties, inform staff representatives first | 2 Dec 2027 |
What must an AI voice agent tell callers?
Article 50(1) requires AI systems that talk to people to be designed so that people know they are dealing with an AI, unless it is obvious. Article 50(5) says the information must be clear and given at the latest at the first interaction. On the phone, that is the first sentence.
A simple opening: "Hello, this is the AI assistant of [Company]. I can help with your order, or put you through to a colleague." It names what the caller is talking to and how to reach a person. Use the same opening for outbound calls, and answer honestly whenever a caller asks if they are talking to a human.
If you run calls for clients under their brand, agree in writing who sets the greeting, so the disclosure is never dropped when a client edits the script. Breaching Article 50 can cost up to EUR 15 million or 3% of worldwide annual turnover; for SMEs the lower of the two applies (Article 99(4) and (6)).
Is AI quality scoring of human agents high-risk?
Yes. Annex III point 4(b) lists AI used "to allocate tasks based on individual behaviour or personal traits or characteristics or to monitor and evaluate the performance and behaviour of persons" in work relationships. Automated QA scorecards, ranking agents, flagging "low performers" and coaching that grades each agent all fit that description.
There is no easy way out through Article 6(3). It lets some Annex III systems escape the high-risk label when they only do narrow or preparatory tasks, but it also says an Annex III system is always high-risk when it profiles people. Evaluating a named agent's work performance is profiling.
Scoring calls in aggregate, for example "how many calls mention a refund this week", without rating individual staff, is a different use. Keep the two apart in your tools and your documents.
What must a call center do for high-risk AI?
When you use a high-risk system built by a vendor, you are its "deployer". These duties from Article 26 apply from 2 December 2027.
Tell staff representatives and staff first
Before putting a high-risk AI system into use at the workplace, employers must inform workers’ representatives and the affected workers.
Source: AI Act, Art. 26(7)Use it as instructed
Take technical and organizational measures so the system is used according to the provider’s instructions for use.
Source: AI Act, Art. 26(1)Name the people who oversee it
Human oversight must sit with people who have the necessary competence, training and authority, and the support to use it.
Source: AI Act, Art. 26(2)Keep the logs
Keep the logs the system generates for at least six months, unless other EU or national law says otherwise.
Source: AI Act, Art. 26(6)Inform the people decisions are about
Where the system makes or helps make decisions about people, tell them a high-risk AI system is used.
Source: AI Act, Art. 26(11)Explain decisions on request
An agent affected by a decision based on the system’s output, such as a dismissal or a lost bonus, where it significantly affects them, can ask for a clear explanation of the AI’s role and the main elements of the decision.
Source: AI Act, Art. 86What are the key dates for call centers?
| Date | What applies | Call center impact |
|---|---|---|
| 2 Feb 2025 | Prohibited practices (Art. 5), AI literacy (Art. 4) | Agent emotion tracking must be off; staff using AI get support to understand it |
| 2 Aug 2026 | Transparency (Art. 50) | AI voice agents disclose; customer emotion recognition needs a notice |
| 2 Dec 2027 | Annex III high-risk duties, after the 2026 delay | AI scoring and monitoring of staff, and customer emotion recognition, follow Art. 26 |
The ban did not move: the July 2026 amendment delayed the high-risk duties, not the prohibitions. The AI Act also reaches call centers outside the EU when the output is used in the EU (Article 2), so offshore teams serving EU customers are in scope too.
How does an AI phone agent from AInora fit?
AInora builds AI voice agents that take inbound calls and make outbound ones: first-line answers, bookings, order questions and reminders. It is a customer-facing agent, not a tool for scoring your staff. How it lines up with the rules above:
- The agent says it is an AI assistant in its first sentence, in the words you choose.
- It hands the call to a person when the caller asks, or when your rules say so.
- Every call gets a transcript and a summary your team can review.
- You decide what it may and may not ask or say.
- It speaks many languages, so the same disclosure holds on every line.
Your counsel decides the rules; the agent follows them. To hear one on your own calls, fill out the short form and we build a demo agent from your website. For the bigger picture, see AI voice agents for European contact centers.
Frequently Asked Questions
Inferring employees’ emotions with AI at the workplace has been banned since 2 February 2025 under Article 5(1)(f), except for medical or safety reasons. The Commission’s own example is a call center using voice recognition to track its employees’ emotions, such as anger. Analyzing customers’ emotions is not banned, but it is high-risk and needs a notice to callers.Source: Bundesnetzagentur, prohibited practices
According to the Commission’s guidelines, inferring emotions from written text alone is outside the workplace ban, because the ban needs biometric data such as voice. But if transcript analysis is used to monitor or evaluate individual agents, it is high-risk under Annex III point 4(b).Source: Future of Privacy Forum
Yes. From 2 August 2026, Article 50 requires that people talking to an AI system are told so, clearly and at the latest at the first interaction. On a phone call that means the opening sentence.Source: AI Act, Art. 50
Yes. Annex III point 4(b) lists AI used to monitor and evaluate the performance and behavior of workers, and to allocate tasks based on individual behavior or traits. Because it profiles named staff, the Article 6(3) exception does not apply. The duties apply from 2 December 2027.Source: AI Act, Annex III 4(b)
Yes, for high-risk AI at the workplace. Article 26(7) requires employers to inform workers’ representatives and the affected workers before putting the system into use.Source: AI Act, Art. 26(7)
Yes. It covers providers and deployers outside the EU when the AI system’s output is used in the EU.Source: AI Act, Art. 2
Up to EUR 35 million or 7% of worldwide annual turnover for a banned practice such as tracking employees’ emotions, and up to EUR 15 million or 3% for breaches of deployer duties or the disclosure duty. For SMEs and start-ups the lower of the two amounts applies.Source: AI Act, Art. 99
Founder & CEO, AInora
Building AI voice agents that let businesses serve more clients with the same team. The agents call back every new lead, re-contact past customers and take the calls the team cannot get to, and the work lands in the client's own CRM.
View all articlesReady to try AI for your business?
Hear how AInora sounds handling a real business call. Try the live voice demo or book a consultation.
Continue reading
Related Articles
Contact Center AI Transformation Guide
Where AI fits in a contact center and how to roll it out in steps.
AI vs Call Center: a Comparison
What an AI voice agent does well, and where people still do better.
EU AI Act for Insurance AI Voice Agents
Claims and renewal calls versus life and health pricing under the AI Act.