The Queensland Audit Office (QAO) found that the Department of Transport and Main Roads (TMR) is not adequately identifying or managing ethical risks arising from its use of artificial intelligence (AI) in mobile phone/seatbelt detection cameras and QChat, a staff virtual assistant.
Key Risks Identified
- Privacy and data handling: Concerns over photo storage, access, and use.
- Fairness and oversight: Limited human involvement in AI decision-making, risking unfair outcomes.
- Accuracy issues: Potential for faulty image recognition leading to errors.
- QChat risks: Users might upload sensitive data, receive incorrect responses, or interact inappropriately.
Camera Program Findings
- AI screened 208.4 million images in 2024, issuing about 114,000 fines.
- The system reduced human review work by 98.7%, leaving 2.7 million cases for contractors to check.
- After external review, the Revenue Office assessed 137,000 potential offences.
- While human oversight exists, QAO warned TMR has not confirmed whether all ethical risks and safeguards are “complete and effective.”
Virtual Assistant Concerns
- Staff interactions could breach laws or ethical standards.
- Risk of uploading protected information or spreading misinformation.
- QAO recommended tighter monitoring and structured staff training.
Source abc.net.au
Leave a Reply