EXAMTOPICS / TECHNOLOGY INSIGHTS

ISACA AAIA: Using AI in Internal Audit

AI can help internal audit analyze larger populations, summarize documents, identify unusual patterns, draft procedures, organize evidence, and accelerate reporting. It can also invent facts, expose confidential data, reproduce bias, hide assumptions, and encourage auditors to accept fluent output without sufficient evidence. The value comes from assigning AI the right work while keeping professional judgment and accountability with the auditor.

The current ISACA AAIA outline explicitly requires practitioners to evaluate AI integration into the audit process and to use AI to enhance planning, execution, and reporting. That does not mean every audit task should be automated. It means audit functions need a controlled way to decide where AI improves coverage or efficiency and where human validation remains essential.

Choose use cases by value and validation difficulty

Start with tasks that are repetitive, data intensive, and easy to validate: classifying documents, extracting structured fields, comparing policy versions, clustering transactions, summarizing interview notes, identifying duplicate findings, or generating first-draft test steps from an approved audit program.

Be more cautious when output is subjective, high impact, difficult to independently verify, or dependent on confidential context. Final audit opinions, rating decisions, fraud allegations, personnel conclusions, and regulatory interpretations should not be delegated to an unvalidated model.

Document the purpose, approved data, model or tool, expected benefit, validation method, prohibited uses, and accountable auditor for each AI use case.

Use AI to strengthen audit planning, not replace risk assessment

AI can search prior findings, incident records, policies, risk registers, project documentation, and external threat information to surface themes for planning. It can help organize large information sets and suggest questions that an auditor might otherwise miss.

The auditor still needs to confirm completeness and relevance. A model may overemphasize the documents it can access while ignoring an unconnected system, recent organizational change, or sensitive issue that was never documented. Planning should combine AI-assisted analysis with interviews, professional skepticism, business context, and independent sources.

Preserve which sources were provided to the model and which statements came from retrieval versus generation. That makes planning conclusions easier to challenge and reproduce.

Expand population testing with analytics and anomaly detection

AI and machine learning can help identify unusual transactions, access patterns, journal entries, claims, tickets, or configuration changes across a population. That can direct auditor attention beyond a small random sample.

Anomaly does not equal error or fraud. Validate why an item is unusual, whether the feature set makes sense, and whether the training or baseline data represents the current process. Rare but legitimate business activity can produce many false positives.

Use models to prioritize investigation, then test underlying evidence. Record the population, model version, features, threshold, results, reviewer decisions, and disposition so the procedure is auditable.

Apply AI carefully to unstructured evidence

Internal audits often involve contracts, policies, emails, tickets, meeting notes, and other unstructured material. AI can extract clauses, compare language, categorize issues, and create searchable summaries that reduce manual review effort.

Validation remains critical. For contract analysis, confirm extracted dates, obligations, renewal terms, audit rights, and security clauses against the original document. For interview summaries, preserve the source notes and let participants correct material errors where appropriate.

Do not allow a summary to become the only retained evidence. Compression can remove qualifiers, conflicting statements, uncertainty, and context that matter to an audit conclusion.

Use AI for workpapers and reporting with traceable sources

AI can draft procedure descriptions, organize evidence references, identify inconsistent terminology, and turn approved findings into clearer report language. This is useful when the model works from a controlled evidence set and the auditor reviews every material statement.

Require citations or source references for factual claims where practical. If a generated paragraph cannot be traced to evidence, treat it as a draft hypothesis rather than an audit fact. Avoid asking the model to “fill in” missing rationale or control details.

Maintain version history so teams can distinguish model-generated draft language from auditor-approved conclusions. Final accountability remains with the audit function and engagement leadership.

Validate hallucinations, calculations, and hidden assumptions

Generative AI can produce plausible but false statements, fabricated citations, incorrect arithmetic, and confident interpretations that exceed the evidence. The broader set of AI risks and challenges should therefore be translated into explicit validation steps for audit use.

Check names, dates, amounts, control descriptions, regulatory references, and numerical results against authoritative sources. Recalculate material figures with deterministic tools. Ask what assumptions the model made and whether omitted evidence could change the conclusion.

High-quality prompting can reduce errors but cannot eliminate the need for verification. The control is the validation process, not confidence in the prompt.

Protect confidentiality and data-use restrictions

Audit evidence can contain privileged investigations, personal data, credentials, security weaknesses, board material, financial information, and third-party confidential data. Know where the AI service processes prompts and attachments, whether the provider retains them, whether customer data is used for training, and which administrators can access logs.

Apply approved data classifications and redaction where necessary. Restrict uploads to services that meet contractual, privacy, security, and residency requirements. If an audit client has placed use restrictions on information, those restrictions should follow the data into the AI workflow.

Review plugins and tool integrations because they can send data beyond the primary model provider. An approved chat service can become an unapproved data-sharing path when connected to external tools.

Preserve independence, skepticism, and human accountability

AI can create automation bias because fluent output feels authoritative. Audit teams should deliberately challenge model results, especially when they confirm an existing expectation. Use independent evidence and alternative explanations rather than treating the model as an expert witness.

Do not let management’s AI system become the sole tool used to audit management. Independent tooling, configurations, datasets, or procedures may be necessary when the audited system could influence the evidence or analytic result.

The broader ISACA CISA discipline still applies: auditors need sufficient, reliable, relevant evidence and must reach their own conclusions. AI can assist the procedure; it does not own the opinion.

Audit functions should distinguish deterministic automation from generative assistance. A scripted reconciliation or SQL query can often be reproduced exactly, while an LLM may produce different wording or reasoning across runs. Use deterministic tools for calculations and rule-based tests when they are sufficient; use generative AI where language understanding or flexible classification creates real value.

Prompt injection can affect audit workflows when models summarize documents, emails, tickets, or web content. Untrusted evidence may contain instructions intended to manipulate the model. Treat source material as data, separate it from system instructions, limit tool permissions, and validate unexpected actions or conclusions rather than assuming the model will ignore malicious content.

Peer review should cover AI-assisted workpapers the same way it covers other audit evidence. Reviewers should know which steps used AI, what data was supplied, how outputs were validated, and which material judgments were made by the auditor. Hidden AI use makes quality review weaker because the reviewer cannot assess the method.

Training needs to include failure modes, not only prompting tips. Auditors should understand hallucination, data leakage, bias, automation bias, context limits, retrieval errors, model change, and the difference between model confidence and evidence. They should also know when an AI tool is outside the approved environment and must not receive client data.

Finally, maintain fallback procedures. An audit methodology should not become dependent on one model provider or on AI availability. Teams should know how to complete critical work when the service is unavailable, produces unreliable output, or cannot be used for a sensitive engagement.

Audit leadership should approve which models and deployment modes are allowed. A locally hosted model, enterprise SaaS tenant, public consumer chatbot, and embedded vendor feature can have very different data-use, retention, security, and auditability characteristics. The same prompt may be acceptable in one environment and prohibited in another.

When AI is used to generate audit procedures, compare the suggested procedure with the engagement objective and control logic. Models can produce polished but generic test steps that miss the actual population, evidence source, or risk condition. The auditor should convert the draft into a precise procedure with defined population, sample or analytic method, expected evidence, and deviation criteria.

Use post-engagement review to improve the method. Track where AI suggestions were rejected, where validation found factual errors, which tasks saved meaningful time, and which uses created rework. This feedback supports evidence-based expansion instead of adopting AI because it appears modern.

Audit functions should also define disclosure expectations. If an AI-generated summary, analytic model, or drafting tool materially influenced a finding, the engagement file should contain enough method detail for quality reviewers to understand and challenge that influence even when the final report does not mention the tool.

Govern audit AI like any other critical audit methodology

Maintain an approved tool inventory, use-case catalog, data restrictions, access controls, model/version records, validation standards, training, change management, incident response, and periodic effectiveness review. Different use cases may require different levels of approval.

Measure whether AI actually improves audit quality. Useful indicators include population coverage, time saved, false-positive rate, missed-error rate in validation samples, reviewer overrides, evidence traceability, and recurring model failure patterns. Efficiency without quality is not success.

Used within the assurance principles shared by ISACA certifications, AI is most useful when it expands what auditors can examine while leaving judgment, evidence evaluation, skepticism, confidentiality, and accountability intact. The goal is not an automated audit opinion; it is a better-informed auditor working with controlled, verifiable assistance.