Agent, Know Thyself (and bid accordingly)

Agent, Know Thyself! (and bid accordingly)why we need to train models to learn their own capabilities, and how this will help them bid for work!Rohit Krishnan and Andrey FradkinApr 27, 20263273ShareWritten with the wonderful Andrey Fradkin, who does the Justified Posteriors podcast.Attention conservation notice: We developed a new benchmark, MarketBench, and scaffold. Based on our findings, we argue that self-assessment of capabilities and costs is a key capability, and it needs to be a target of training. This is work in progress, and we are looking for collaborators and funding to pursue this research. Paper here. Repo here.Let’s say you have a large-scale project to work on.

…

Excerpt limited to ~120 words for fair-use compliance. The full article is at Strangeloopcanon.