[patrickdavey]

Interesting thought. I feel currently AI is most useful to those who have a decent understanding of the subject material and can critique any output. To wholesale trust the output of AI and remove any human in the loop, well, it needs to be really correct all the time.

Exams are a different beast and really a subset of a range of common problems.

Still, I'm very curious what happens when people who have just cheated their way through college, or these kinds of professional exams, meet the real world? Will they all get fired a few months down the track?

[CamperBob2]

Still, I'm very curious what happens when people who have just cheated their way through college, or these kinds of professional exams, meet the real world? Will they all get fired a few months down the track?

They will continue to use AI to do their jobs. Eventually, the people who pay their salaries will ask themselves why they continue to pay them.

To wholesale trust the output of AI and remove any human in the loop, well, it needs to be really correct all the time.

It's not now, but it will be. Accounting is what you might call an exact science, one where creativity isn't rewarded and where hallucinations by one model can be detected and corrected by others. There is no need for humans to do this type of work.

[Qem]

> Accounting is what you might call an exact science, one where creativity isn't rewarded

Not sure of this. Corporations pull a lot of creative accounting all the time:

https://en.wikipedia.org/wiki/Creative_accounting

[patrickdavey]

well, lets take that as true (no more humans doing accounting). Doesn't that mean that there'll be a knowledge gap there? What happens when new rules come along (laws change all the time which will affect accounting practices). How will an AI (at least the current batch) learn what needs to change when there's no prior art for it to lean on?

I mean sure, if we ever get AGI then all bets are off, but, as far as I know we're not there, and LLMs are unlikely to evolve into AGI. They're not thinking right? It doesn't actually _understand_ anything right? I mean, I'm quite probably wrong here, but, as far as I can tell it's really just very fancy backwards autocomplete.

[ponector]

>> I'm very curious what happens when people who have just cheated their way through college, or these kinds of professional exams, meet the real world

Certification questions, as well as interview questions usually quite far from the real world. The best strategy is to fake everything to pass through and then learn at work.

Basically fake it until you make it. The hardest part of swe job is to land it.

[jimnotgym]

I lot of people who took those exams on paper are no good at actual finance jobs. It is more about gatekeeping than anything else