powering productive workplaces
Front page
InterviewService & Connectivity46m · 15:01 GMT · 6 min read

When Workplace AI Fails, Who Is Accountable for Fixes?

Workplace AI support is becoming a test of data quality, access controls and shared accountability. FirstDay Foundation’s Nishanth Sirikonda explains why IT teams should investigate the source material, permissions and systems behind an AI response before blaming the tool

When an employee reports that an AI assistant cannot find a company policy or has returned an answer that conflicts with a business system, the problem may not lie with the tool itself.

The cause could be outdated source material, an access restriction, incomplete data or a failed connection between the AI tool and the system holding the information. For service desk teams, an AI-related ticket requires a broader investigation than a conventional application fault.

Nishanth Sirikonda, Cloud Solutions Architect at Texas-based charity FirstDay Foundation, said employees commonly report that an AI assistant cannot find a policy or that its response does not match information available in a business platform.

“That symptom can have several causes: outdated source content, a permission restriction, a connection problem or incorrect interpretation,” Sirikonda told UC Today.

The service desk’s first task is to establish what the employee was trying to do, then compare the AI response with the authoritative source. This is especially important when employees expect an AI assistant to work like a conventional search engine, rather than a tool limited by the information and access rights it has been given.

Direct Access Does Not Guarantee AI Access

Permissions should be among the first areas examined when an employee expects an AI tool to retrieve information from a system such as Workday.

Employees do not all have access to the same company information. Access can depend on job title, role and security settings, while payroll, absence and personal data may be restricted to specific positions.

“It all depends on permissions first, because not everybody will have the same permissions,” Sirikonda said.

The fact that a record exists in a source system does not mean it should be returned to every employee through an AI assistant. Nor does an employee’s ability to view information directly automatically mean that the AI tool has been authorised to retrieve it.

“Direct access does not automatically mean the AI should have access,” he said.

Sirikonda said the investigation should begin with three checks: whether the source information is correct, whether the employee can access it directly, and whether the AI connection is authorised to retrieve it.

Those checks can establish whether the issue lies with the source content, an employee’s access rights or the connection between the AI tool and the underlying business system. They also help teams avoid treating every missing result as an AI failure.

Better Tickets Support Faster Investigations

A ticket stating only that an AI assistant has given the wrong answer gives the service desk little to investigate.

Teams need system logs, login timing information and a clear description of where and when the issue occurred. They also need to determine whether the problem is recurring, limited to one employee or affecting a broader group.

Sirikonda said this context is necessary to establish whether an incident is caused by an individual’s permissions, a problem with a source system or a wider issue with the AI connection.

Analysts should also record what the employee asked, the response the tool provided, the information they expected to find and whether they can retrieve that information in the underlying application.

This matters where sensitive information is involved. An employee may know that a record exists without being entitled to receive it through an AI assistant. In that case, the tool may be operating as intended rather than failing.

The objective is not simply to decide whether the employee received an unsatisfactory answer. It is to determine whether the response was shaped by an access rule, a missing connection, incomplete source material or an unclear request.

Check the Data Before Blaming the AI

Sirikonda said that when an AI assistant produces an inaccurate answer, organisations should first examine the information and systems behind it.

Incomplete, outdated or poorly structured documents can lead to incomplete or inaccurate responses. The same applies when an application connection fails to supply the information the tool needs to answer correctly.

“If you’ve given broken data to your AI, it will say the same thing,” Sirikonda said.

AI assistants work from the content, metadata and access rules made available to them. They do not independently verify company records, correct inaccurate policies or decide which restricted information an employee should receive.

That means an incorrect answer should lead teams to examine the documents, metadata and system connections feeding information into the assistant before raising the matter with a supplier.

“If the AI is giving a wrong answer, just check your metadata or the documents you loaded into the AI,” Sirikonda said.

A second possibility is that the assistant is not receiving enough information through the relevant application connections. In that case, the issue may lie with an integration, an application programming interface or the way the source data has been made available to the AI tool.

For service desk leaders, this makes data governance an operational support issue. Content needs to be current, organised and accessible through properly configured connections. Permissions must also reflect what employees are allowed to see through the assistant, not merely what they may be able to access elsewhere.

Responsibility Is Shared Across the Organisation

AI-related incidents cannot sit solely with the service desk. Resolving them requires coordination between business owners, security teams, technology teams and support functions.

Human resources teams must keep company policies and employee information current. Technology teams are responsible for the integrations that make information available to the assistant. Security teams manage the controls that protect sensitive data, while the service desk gathers the details needed to assess the incident and route it to the appropriate owner.

“Everybody has a different role here,” Sirikonda said.

Suppliers may be responsible for platform uptime, agreed response times and aspects of technical support. However, service-level agreements cannot solve an organisation’s own problems with source data, permissions or internal approvals.

Sirikonda said organisations must understand what information they have authorised an AI supplier or connection to access. They must also be able to identify where information is coming from and whether its use has been approved.

Employee training is part of the same support model. Staff need to understand what information they can provide to an AI tool, what they should avoid sharing and how to use the tool securely.

“The trend is moving towards how you feed information to the AI, what you need to say, what you need not to say and how that information is sent securely,” Sirikonda said.

For service desk leaders, workplace AI is not simply another application to support. It requires a clear process for examining source data, access rules, system connections and ownership across the organisation before responsibility for an incident can be assigned.

rate this story
helps rank stories across uc today
Join the conversation

Does this reflect your experience?

opening the room…