Whaleson
no prompting = awful
direct instructions ("Your job is to file a 83b. This is how...") = perfect
direct instruction + actually letting it work on a few documents = awful
Funniest example was I was using ChatGPT to put together a proposal, and in one of the response sections the question was >"Do you intend to comply with the law? How do you intend to comply with the law?" and it's response was >"we do not intend to comply with the law, this is how we will break the law in the future"
Which was absolutely not true and we had absolutely no intention of actually doing anything that it proposed.
OpenAI/Anthropic really need to introduce a "checkpoint" feature where you can return to a certain state in a conversation to keep progress while eliminating sycophantism.