Software Engineer, AI Coding Tasks

Our client at BLUUKAZI is looking for experienced software engineers to build AI coding tasks from a codebase they know well. US$1,000 per task, and you can do as many tasks as you want.You turn a real change from a repository you know into a task that today's best AI coding models struggle with: hard for the models, but fair for a skilled engineer. Your tasks are used to measure and train AI coding models.

Remote, any location. US$1,000 per task that passes review. Minimum of one task a week, about 10 hours a week.

• Identify and propose meaningful software engineering challenges based on real-world code changes in eligible repositories.

• Configure and reproduce development environments using Git, Docker, Linux, and relevant development tools.

• Develop clear technical specifications, reference implementations, and automated validation tests for assigned coding tasks.

• Design robust evaluation criteria to assess code correctness, functionality, and adherence to technical requirements.

• Create and test edge cases to identify incomplete, incorrect, or shortcut implementations.

• Evaluate coding tasks against leading AI models to assess their difficulty, reliability, and effectiveness.

• Refine task specifications and automated tests based on evaluation results and reviewer feedback.

• Collaborate with technical reviewers to ensure tasks meet established quality and evaluation standards.

• Maintain accurate technical documentation and deliver high-quality, reproducible engineering tasks.

Compensation & Engagement Terms

• Compensation: USD $1,000 per task successfully accepted through the client's quality review process.

• Engagement Type: Project-based, with opportunities for additional tasks following successful acceptance.

• Availability: Minimum 10 hours per week, starting immediately.

• Contract: Selected candidates must sign and accept the client's contract terms after their proposal qualifies.

• Intellectual Property: Submitted work will be used for AI training. Candidates must own the relevant code changes and solutions and possess the rights required to license the work to the client. Employer-owned or client-owned proprietary code is not eligible.

• Minimum 2 years of professional software engineering experience.

• Demonstrated contributions merged into a public open-source repository. An eligible personally owned private codebase may also be considered.

• Strong proficiency in at least one programming language: Python, TypeScript, Go, Rust, Java, or C++.

• Hands-on experience with Docker, Linux, Git, and automated testing frameworks.

• Practical experience using AI-assisted coding tools in software development workflows.

• Strong understanding of software debugging, test design, code quality, and validation methodologies.

• Ability to design comprehensive test cases and clearly distinguish correct implementations from incomplete or incorrect solutions.

• Strong technical writing skills, with the ability to communicate software requirements and engineering decisions clearly.

• Ability to work independently, incorporate technical feedback, and deliver quality results.

• Access to a secure personal or authorized work computer; public or shared computers are not permitted.

• Advanced expertise in databases, distributed systems, compilers, cybersecurity, cloud infrastructure, or other specialized engineering domains.

• Experience developing AI agent evaluation tasks, coding benchmarks, or reinforcement learning environments.

• Experience creating automated grading systems, evaluation rubrics, or model assessment frameworks.

• Strong open-source contribution history or experience maintaining public software repositories.

• Familiarity with CI/CD pipelines, integration testing, and reproducible development environments.

• Experience evaluating large language models or AI-generated code for correctness, reliability, and performance.

• A direct line to the hiring team. BLUU KAZI presents your profile in person, so your application never disappears into a portal.
• Coaching at every stage. Interview preparation, feedback after each round and support through the offer.
• Room to grow. Access to BLUU KAZI training and certification paths in cybersecurity, cloud and AI.
• A bench that works for you. Join our network of emerging and veteran technologists and hear first about roles that fit.