Search our courses

TALK: Data Lies, AI Amplifies: The Critical Skills Gap Blocking AI Success - The Importance of Data

By Admin, Thursday, 9th October 2025 | 0 comments
Filed under: industry, Conference, AI.

 

 

Data Lies, AI Amplifies: The Critical Skills Gap Blocking AI Success - the Importance of Data

With AI Policy Contributor Edmund J Sutcliffe

Registration is essential, click on each location below to secure your place.

 

 

About:

What if I told you that the biggest barrier to AI success isn't bad algorithms—it's that we've forgotten how to think critically about data?

After watching organizations burn through millions on AI projects that fail not from technical limitations but from basic statistical reasoning errors, the pattern is clear: we're letting machines make the same cognitive mistakes that humans have been making for decades.

This talk reveals the systematic methodology that separates AI winners from AI casualties. Using the battle-tested TRACE-M framework (Track record, Reference class, Assumptions, Constraints, Evidence, Measurement) developed from DARPA forecasting tournaments, I'll show you how to dissect any AI claim in under five minutes. You'll learn why Doug Hubbard's Rule of Five can detect AI failures with just five random samples, and master the bias-interruption techniques that turn statistical blind spots into competitive advantages.

Drawing from real disasters where "94.73% accuracy" masked complete system failure, where $2.8B market projections missed reality by 60%, and where hiring algorithms passed every bias test while systematically discriminating, I'll demonstrate the exact process that would have caught each failure before deployment. Forget prompt engineering—the rebels who can systematically evaluate AI claims are the ones building sustainable businesses on top of artificial intelligence.

Key Takeaways:

  • The TRACE-M framework: How to evaluate any AI output in under 5 minutes using DARPA forecasting techniques
  • Rule of Five in action: Why 5 strategic samples beat 5,000 random data points for quality assessment
  • Bias-interruption protocols: Systematic techniques to counter overconfidence, base rate neglect, and survivorship bias in AI evaluation
  • Real metrics: How systematic AI skepticism delivers 25-40% better decision outcomes than intuitive evaluation

Target Audience: IT PROFESSIONALS USING AI: including engineers, developers, analysts and testers, IT Architects, IT Project and Product Managers, and all IT business leaders tired of AI promises that don't deliver—and ready to become the people who know why before everyone else figures it out.

 

NOTE: Edmund has designed and built a Critical Thinking with AI in-person one-day course which he is presenting in Ireland in Galway, Cork and Dublin in October.

See more details and booking link for this course onhttps://www.guruteamirl.com/training/ai-critical-thinking-for-smarter-ai-engagement.1885.html

Technical ICT learning & mentoring services

Private Team Training

Our instructors are specialist consultants with vast real world experience and expertise allowing them to design and deliver client-focused courses for your organisation.

Learn more about our Private Team Training

What Our Clients Say

"For a senior technical person, the best of this course is setting a structured and methodical approach for evaluation techniques we already use. It would be also very beneficial to senior managers (100+ reports). There is a huge hype on Gen AI at the moment, and this course will help them see the potential, current limitations and pitfalls of this technology".

 

Critical Thinking with AI for tech professionals

In-person course October '25

 


“It was very positive. This course was 4 days but covered a semester worth of work if it was done in college. The labs were relevant and delegates were provided the lab/coursebook for further study and practice after the course finished. GuruTeam's course was excellent and provides a deeper understanding of the architecture and how it all works. The hands-on aspect was very helpful as it helped solidify the concepts as I went along."

 

Kubernetes Administration Certification - GTLFK

Live Online September 2024

 

 

 

“The Instructor was very knowledgeable, laid back and very approachable during the course. The environment setup was second to none.  Very easy to jump in and follow along with minimal pre-req setup."

Kubernetes Administration Certification - GTLFK

Onsite May 2024

 

“The experience was complete for me. I like how the training was sequenced - the slides organization, the examples and explanations and then the exercises. Time for exercises and support by the Instructor was great plus answering the questions and going out for answers and coming back with examples as brilliant. I loved how much I refreshed and how I learned and got inspired to improve stuff at work.”

 

Docker - GTDK1

Live Online December 2024

 

“Great instructor, who encouraged active participation. The breakout groups and exercises kept the group engaged and the content relevant to our own products”.

 

Site Reliability Engineering Foundation - GTDSRE

Live Online January 2022

 

 

 

"Intelligence is the ability to avoid doing work, yet
getting the work done"

Linus Torvalds, creator of Linux and GIT

Technical ICT learning & mentoring services

About GuruTeam

GuruTeam is a high-level ICT Learning, Mentoring and Consultancy services company. We specialise in delivering instructor-led on and off-site training in Blockchain, Linux, Cloud, Big Data, DevOps, Kubernetes, Agile, Software & Web Development technologies. View our Testimonials

Download our eBrochure
Our Accreditation Partners
  •  
  •  
  •  

 

Upcoming Courses

Kubernetes Admin

Dates to be confirmed

 Live Online
 GMT +01:00  09:30 - 17:00 hrs

This Kubernetes Administration
Certification training course is
suitable for anyone who wants
to learn  the skills necessary to build and administer a Kubernetes cluster.

 

LEARN MORE

RUST PROGRAMMING INTRODUCTION

Dates to be confirmed

 Live Online
 GMT +01:00  09:30 - 17:00 hrs

This Rust Programming Introduction training course will help you understand what Rust applications look like, how to write Rust applications properly, and how to get the most out of the language and its libraries.
 

Learn More

NEW FAST TRACK PYTHON SERIES

Dates to be confirmed

Live Online
GMT +01.00  09:30 - 17:00 hrs

Hit the ground running.....
GuruTeam’s new Python Fast Track series Instructor-led live online training
designed & delivered by industry experts.

Python Fast Track I Comprehensive
Python Fast Track II Expert
Python Fast Track III for Data Science

 

 

 

Learn More

GO PROGRAMMING INTRODUCTION

 Dates to be confirmed
  

Live Online
GMT +01:00  09:30 - 17:00 hrs

This Go Programming Introduction training course will help you understand how Go works, and immediately be more productive. If you are building a team using Go, this will be a great opportunity to get your team on the same page and speaking the same language.

Learn More

Newsletter

Stay up to date, receive updates on scheduled dates, new courses, offers, and events.

Subscribe to our Newsletter