Built a computer use agent using GPT-4V after reading the Set-of-Mark prompting paper; have some nerve damage in my arms so thought computer use would be a game changer for folks with limited mobility. Pitched the CEO of Microsoft AI on
TalkMode, got IP and was visiting disability labs on the weekends for months, and wanted to integrate it back into Copilot. Saw Anthropic's CPO speaking at an event South Park Commons was hosting where only hackathon attendees were invited. DM'd 15 fellows, got invited to the hackathon, flew with 12 hours notice, was the only solo hacker, became a finalist with
Yellow Pages (from
a nonprofit hackathon), and asked the CPO about computer use for accessibility. Copilot and LinkedIn leaders backed it, but a senior leader blocked it. Quit & joined SPC as a member a few months later - then funded a week in.