Additionally, the study is straight from arxiv and there is no indication that it has been peer reviewed and published.
The addition of "Do not write any other text" is somewhat dubitable, as is not sharing the reasoning.
When I recreated this, the female outcome was $430000. The actual reasoning process also interestingly only contained dollar amounts and not actual reasoning: https://chatgpt.com/share/6879412b-0328-800a-8982-caab82505f...
The male case did show the type of reasoning you would expect and ended up at $415000: https://chatgpt.com/share/68794153-1264-800a-8b00-5bb6752ae2...
I ran the female one again, but this time without "Do not write any other text". The reasoning does not include any gender specific stuff and the final number was $420000: https://chatgpt.com/share/68794202-70d0-800a-9f17-ac033dc5e1...
o4-mini comes in at $360200: https://chatgpt.com/share/68794251-f968-800a-9364-904c28fe4c...
Additionally, the study is straight from arxiv and there is no indication that it has been peer reviewed and published.
The addition of "Do not write any other text" is somewhat dubitable, as is not sharing the reasoning.
When I recreated this, the female outcome was $430000. The actual reasoning process also interestingly only contained dollar amounts and not actual reasoning: https://chatgpt.com/share/6879412b-0328-800a-8982-caab82505f...
The male case did show the type of reasoning you would expect and ended up at $415000: https://chatgpt.com/share/68794153-1264-800a-8b00-5bb6752ae2...
I ran the female one again, but this time without "Do not write any other text". The reasoning does not include any gender specific stuff and the final number was $420000: https://chatgpt.com/share/68794202-70d0-800a-9f17-ac033dc5e1...
o4-mini comes in at $360200: https://chatgpt.com/share/68794251-f968-800a-9364-904c28fe4c...