They replaced the training data with an evaluator. (which rates the LLMs output for training?) Interesting, thanks.
Edit: this reminds me of the self evolving (virtual) robot problem, a robot which is rated by an external moderator and improves over time. I.e.: https://www.sciencedirect.com/science/article/pii/S0925231221003982
Accountability of a human decision maker is the way to go. Agreed.
I see the danger when the accountant’s job asks for high throughput which enforces fast decision making and the tool (llm) offers fast and easy decisions. What is the accountant going to do, if (s)he just sees cases not people and fates?