Senior Kotlin Expert (SME) - AI Benchmarking Consultant

Kotlin Expert (SME) – Consultant Description

Purpose

We are seeking a highly experienced Kotlin Software Engineering professional to serve as a Subject Matter Expert (SME) on advanced software development and AI benchmarking projects. This role is pivotal in designing, documenting, and validating Kotlin-based tasks and functionalities that test and refine the coding capabilities of large language models (LLMs) — particularly within Android development environments.

Your work will define both the technical standard and the functional scaffolding of real-world coding benchmarks, ensuring all tasks meet the highest levels of authenticity, precision, and reproducibility. You will help assemble datasets and functional frameworks that mirror the complexity and reasoning required in professional Android engineering.

Core Components

• Functional Design, Documentation & Benchmark Definition
• Define, document, and validate Kotlin-based Android functionalities used in AI benchmarking and software simulation projects.
• Author comprehensive functional and technical documentation, including feature requirements, system behavior, and expected outcomes.
• Translate open-ended requirements into realistic, well-scoped Android tasks representing genuine engineering challenges.
• Ensure each benchmark task is complete, verifiable, and grounded in authentic developer workflows.
• Maintain structured repositories of Kotlin challenges, categorized by complexity, topic, and functional type.
• Technical Standard Setting, QA & Process Improvement
• Define Kotlin-specific quality metrics, benchmarking criteria, and rubrics aligned with Android production standards.
• Develop SOPs and QA frameworks enforcing stylistic consistency, idiomatic Kotlin use, and functional clarity.
• Conduct rigorous QA passes on deliverables — verifying code correctness, documentation completeness, and benchmark adherence.
• Apply quality principles to maintain dataset and code task evaluation standards.
• Curate gold-standard Kotlin examples representing benchmark-worthy implementations.
• Talent Definition, Vetting & Calibration
• Collaborate with recruitment and project leads to define role competencies for Kotlin contributors.
• Develop technical evaluation frameworks for vetting Kotlin developers, including practical code tasks and debugging exercises.
• Lead calibration sessions with contractors to ensure consistency and quality.
• Create skill matrices and capability documentation for Kotlin engineering talent aligned to benchmarking needs.

Interested in remote work opportunities in Mobile? Discover Mobile Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Provide continuous feedback and training materials for quality improvement.
• Benchmark Dataset Development & Validation
• Collaborate with AI research teams to design and refine Android benchmarking datasets for evaluating LLM coding performance.
• Source, assess, and refine Kotlin-based Android tasks testing comprehension, reasoning, and problem-solving.
• Document evaluation criteria including accuracy, code structure, and maintainability.
• Contribute to post-project analysis, surfacing insights on performance trends and task design improvements.
• Recommend dataset refinements to enhance domain coverage.
• Project Delivery & Stakeholder Support
• Support project setup, scoping, and execution of Kotlin-oriented AI training and evaluation projects.
• Provide expert-level input on tooling, frameworks, and pipeline design (Ktor, Jetpack, Gradle, KSP).
• Collaborate closely with ML engineers, QA specialists, and data annotators to meet research-grade standards.
• Produce summary documentation and retrospective reports detailing lessons learned and recommendations.
  
  

Target Profile

• 5+ years of professional experience in Kotlin software engineering (Android, backend, or multiplatform).
• Mastery of Kotlin idioms, coroutines, Flow, Jetpack Compose, and asynchronous programming.
• Experience in technical documentation, benchmark dataset design, or QA of coding tasks preferred.
• Proven ability to define and enforce technical and stylistic standards across distributed teams.
• Strong collaboration and communication skills with the ability to articulate complex logic clearly.
• Exceptional attention to detail and documentation discipline.
• Fluent in English, with precise writing and communication abilities.
  
  

  Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Example Documentation & Benchmark Task Scope

Domain

Example SME Responsibilities

Android Functionality Design

Define and document functional benchmarks such as ViewModel lifecycle management, asynchronous data fetching, and Compose state handling.

Benchmark Dataset Creation

Source and curate Kotlin tasks that measure model comprehension and code accuracy, ensuring each is verifiable and complete.

Code Review & QA

Apply QA rubrics to assess correctness, structure, and maintainability of Kotlin-based benchmark submissions.

Talent Calibration

Develop and refine role definitions and test exercises for Kotlin annotators or contributors.

Documentation Ownership

Author clear, maintainable task documentation describing functionality, context, and test criteria for model evaluation.

Continuous Improvement

Identify recurring code or comprehension defects and propose updated documentation or templates to address them.

Summary

This Kotlin SME role merges engineering excellence, documentation rigor, and benchmark development expertise. You will help shape the foundation for evaluating AI models in real-world Android engineering, defining how Kotlin is used to measure and guide the next generation of intelligent software systems.

We offer a pay range of $25-to- $65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.

Job title: Kotlin Expert (SME)

Employment type: Contract

Workplace type: Remote

Seniority level: Senior Level