We've got also prepared a demo that you should run the agents yourself undertaking on an arbitrary webpage. An case in point is shown previously mentioned where the agent is tasked to locate the very best Thai cafe in Pittsburgh. making on our atmosphere, we release a set of benchmark website jobs focusing on analyzing the purposeful correctness o

To facilitate Evaluation and evals, We have now also introduced the trajectories from the GPT-4V + SoM agent on the full set of 910 VWA responsibilities here. It is made of .html documents that report the agent's observations and output at each action with the trajectory. We've also ready a demo for you to operate the agents on the have undertakin