Data Engineer

About Karya

Karya provides AI-enabled earning and learning opportunities to economically underserved communities, and high-quality, ethically sourced datasets to research labs and technology companies. Digital workers earn at least 20 times the local minimum wage. The platform has delivered over 40 million tasks. About the role This role runs live client projects on the Karya platform. The work is the execution layer above the core product: project workflows, data jobs, checks, reports, and delivery. You will work with Operations and client teams on questions of progress, quality, pay, and files, and with platform engineers when a fix belongs in the product. Worker payouts and client deliverables depend on getting these checks right.

Responsibilities

• Run and monitor data jobs on remote Linux servers, and recover failed jobs from logs and process state.
• Configure project workflows, including the handoff from automated processing to human tasks, and track what

is in progress, held, or ready to deliver.

• Write PostgreSQL and ClickHouse queries for throughput, completion, quality, pay, and delivery status.
• Apply completion and quality rules to access, pay, and delivery decisions, after a sample check.
• Write Python, SQL, or Bash scripts for those checks and decisions, and keep them in the repository.
• Package datasets to client specifications, move them through cloud object storage, and record what has shipped.
• Read the TypeScript / Node.js codebase to follow tasks, assignments, payments, and file storage.
• Reply to Operations and client teams with the finding, the change made, and what is still open.