Senior Ruby Software Engineer (LLM Evaluation & Dataset Development) - Remote

About The Company

Quik Hire Staffing is a leading recruitment agency dedicated to connecting talented professionals with innovative organizations across various industries. Our mission is to facilitate seamless employment solutions by leveraging a vast network of industry experts and a deep understanding of market trends. We pride ourselves on our commitment to diversity, inclusion, and delivering personalized staffing services that meet the unique needs of each client and candidate. With a focus on quality and integrity, Quik Hire Staffing has established a reputation for excellence in talent acquisition and workforce management, supporting companies in achieving their strategic objectives through top-tier talent placement.

About The Role

We are currently seeking a highly skilled Software Engineer specializing in Ruby to join our client's innovative team on a remote, full-time basis. In this role, you will focus on evaluating and validating large language models (LLMs) within the context of software engineering tasks. Your primary responsibility will involve building and maintaining datasets for LLM training and evaluation, specifically tailored to address real-world software development challenges. The position offers a unique opportunity to work on cutting-edge AI projects that influence the future of software development tools. As a remote team member, you will collaborate with AI researchers and engineers worldwide, contributing your expertise in Ruby development and code analysis to enhance AI capabilities in understanding and fixing complex codebases.

Qualifications

The ideal candidate will possess at least three years of professional experience in software engineering with a strong command of Ruby and Ruby on Rails frameworks. You should have demonstrated proficiency in using Git for version control, Docker for containerization, and setting up reproducible software pipelines. Experience with Ruby testing frameworks such as RSpec or Minitest, along with gem management tools like Bundler, is essential. Candidates should be comfortable navigating and understanding complex, real-world codebases, and capable of modifying and testing code locally. Prior contributions to open-source projects or experience in evaluating open-source repositories will be considered a significant advantage. Strong analytical skills, attention to detail, and the ability to work independently in a remote environment are also required.

Responsibilities

• Analyze and triage issues reported on GitHub across trending open-source libraries to identify relevant evaluation scenarios for LLM testing.
• Set up and configure code repositories, including containerization using Docker, to ensure reproducible testing environments.
• Assess code quality by evaluating unit test coverage and other metrics to establish baseline performance and robustness of test suites.
• Modify, run, and debug Ruby codebases locally to evaluate the performance of large language models in bug-fixing and code-completion tasks.
• Collaborate closely with AI research teams to select appropriate repositories and issues that challenge LLM capabilities, ensuring comprehensive evaluation coverage.
• Document findings, contribute to dataset creation, and refine evaluation methodologies to improve model assessment accuracy.
  
  

  Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

Benefits

Joining our client's team offers the opportunity to work at the forefront of AI and software engineering innovation. Benefits include flexible remote work arrangements, allowing you to work from anywhere, fostering a healthy work-life balance. You will gain exposure to cutting-edge AI research and contribute to impactful projects that shape the future of software development tools. The role provides continuous learning opportunities, professional growth, and the chance to collaborate with a global team of experts. Competitive compensation packages, health benefits, and support for professional development are also part of the employment package, ensuring a rewarding and enriching work experience.

Equal Opportunity

Quik Hire Staffing is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees and applicants. We hire based on skills, experience, and qualifications without regard to race, color, religion, gender, gender identity, sexual orientation, age, disability, or any other protected characteristic. All qualified candidates are encouraged to apply, and we ensure a fair and unbiased review process for every application received.