AI Engineer / AI Software Engineer-Task Creator (RL Environments) (Contract)

Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.

We build hard, realistic tasks used to test how well AI agents do real work on a computer. Each task is a small scenario running on a Linux desktop - real files, real applications, real documents - plus a program that automatically checks whatever the agent produced.

You create those tasks end to end. The bar: hard for a top AI agent, straightforward for a competent human.

· Design a realistic multi-step scenario across a few applications.

· Write the instruction the AI agent receives: clear, complete, no giveaways.

· Write Python to set up the environment and to score the result automatically.

· Test it, run it, and hand

• · Put together the files it needs - spreadsheets, documents, emails, data.
• Sometimes supplied to you, sometimes built by you.