In Australia, any Federal Government algorithm can be FOI’d by a member of the public.
It’s one of the reasons the Aus Federal Government statisticians tend away from black box AI and towards more traditional methods.
> [...] Government statisticians tend away from black box AI and towards more traditional methods.
I was indeed wondering how constraints on model interpretation forces governments to stay away from NN and more complex approaches.
I have worked for a fraud-prevention company for a few years, and the financial nature of the decisions involved led to reward model interpretation (sometime at accuracy's expense) in order not to create friction with clients. Definitely not the best not being able to explain why your model performs poorly or what actions are needed to solve a problem.
anddt|5 years ago
I was indeed wondering how constraints on model interpretation forces governments to stay away from NN and more complex approaches.
I have worked for a fraud-prevention company for a few years, and the financial nature of the decisions involved led to reward model interpretation (sometime at accuracy's expense) in order not to create friction with clients. Definitely not the best not being able to explain why your model performs poorly or what actions are needed to solve a problem.