B

Senior AI Systems Performance Engineer

Remote
Apply
AI Summary

Optimize AI training and inference workloads for enterprise-scale platforms, focusing on performance, scalability, and cost efficiency. Lead GPU optimization, distributed training, and production AI systems with deep expertise in machine learning frameworks and HPC. Drive technical leadership in AI infrastructure performance engineering for a remote-first tech consulting firm.

Key Highlights
10+ years of experience in AI infrastructure, HPC, and performance engineering required
Full-time, fully remote role with $130K–$180K annual salary (U.S.-based)
Expertise in GPU optimization, distributed training, and LLM inference critical
Key Responsibilities
Optimize AI training and inference pipelines for maximum throughput, low latency, and scalability
Design and implement GPU optimization techniques (e.g., quantization, pruning, mixed precision) for production AI workloads
Profile and analyze AI applications using tools like NVIDIA Nsight, PyTorch Profiler, and TensorBoard to identify bottlenecks
Collaborate with cross-functional teams to improve model performance, reliability, and cost efficiency in enterprise AI systems
Build automated benchmarking frameworks, performance dashboards, and monitoring solutions for AI infrastructure
Technical Skills Required
Python CUDA Distributed Computing Frameworks (e.g., NCCL, PyTorch Distributed)
Benefits & Perks
$130,000–$180,000 annual salary
100% remote work (Continental U.S.)
Equal Opportunity Employer
Nice to Have
Experience with vLLM, TensorRT-LLM, DeepSpeed, or Triton Inference Server
Knowledge of model compression, KV cache optimization, and speculative decoding
Contributions to open-source AI infrastructure projects or technical publications

Job Description


Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title

AI Systems Performance Specialist

Location: 100% Remote (Continental United States)

Position Type: Full-time, Direct W2

Salary Range: $130,000–$180,000 Annually

Experience Required: 10+ Years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary

Bright Vision Technologies is seeking a highly experienced AI Systems Performance Specialist with 10+ years of experience in AI infrastructure, machine learning systems, High-Performance Computing (HPC), and performance engineering. The ideal candidate will optimize AI training and inference workloads for maximum performance, scalability, reliability, and cost efficiency. This role requires deep expertise in GPU optimization, distributed training, Large Language Model (LLM) inference, Python, C++, CUDA, and production AI systems, along with the ability to lead performance optimization initiatives across enterprise-scale AI platforms.

Key Responsibilities

  • Optimize AI training and inference pipelines for maximum throughput, low latency, scalability, and infrastructure efficiency
  • Analyze and improve GPU utilization, memory management, kernel execution, and multi-GPU performance across production AI workloads
  • Design and implement optimization techniques including quantization, pruning, mixed precision, batching, caching, speculative decoding, and model parallelism
  • Profile AI applications using industry-standard performance analysis tools and identify bottlenecks across compute, memory, networking, and storage
  • Optimize distributed training and inference using NCCL, DeepSpeed, PyTorch Distributed, Ray, MPI, or similar distributed computing frameworks
  • Collaborate with AI researchers, ML engineers, platform engineers, and infrastructure teams to improve model performance and production reliability
  • Build automated benchmarking frameworks, performance dashboards, monitoring solutions, and regression testing pipelines
  • Evaluate emerging AI hardware, GPU architectures, inference frameworks, and optimization technologies to improve enterprise AI capabilities
  • Drive AI infrastructure cost optimization through efficient resource utilization, cloud optimization, and FinOps best practices
  • Mentor engineering teams and provide technical leadership on AI systems architecture, GPU optimization, and performance engineering

Required Qualifications

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, Artificial Intelligence, or a related technical discipline
  • 10+ years of professional experience in performance engineering, AI infrastructure, machine learning systems, High-Performance Computing (HPC), or distributed computing
  • Expert-level programming skills in Python and C++
  • Extensive experience optimizing GPU-accelerated AI workloads using CUDA, distributed training frameworks, and modern deep learning libraries
  • Strong knowledge of Large Language Models (LLMs), deep learning frameworks, model serving, and production AI inference
  • Hands-on experience with profiling tools such as NVIDIA Nsight Systems, Nsight Compute, PyTorch Profiler, TensorBoard, or similar performance analysis tools
  • Experience deploying and optimizing AI workloads on AWS, Microsoft Azure, or Google Cloud Platform (GCP)
  • Strong understanding of distributed systems, networking, storage optimization, and AI infrastructure architecture
  • Excellent analytical, troubleshooting, communication, and technical leadership skills

Preferred Qualifications

  • Experience optimizing production-scale LLM inference and serving large foundation models
  • Hands-on experience with vLLM, TensorRT-LLM, DeepSpeed, Triton Inference Server, CUTLASS, FasterTransformer, or similar AI optimization frameworks
  • Knowledge of model compression, KV cache optimization, speculative decoding, and advanced inference optimization techniques
  • Experience implementing FinOps strategies for AI infrastructure cost optimization and resource management
  • Contributions to AI systems research, open-source AI infrastructure projects, patents, or technical publications
  • Familiarity with emerging AI accelerator technologies, including AMD ROCm, Intel oneAPI, or custom AI hardware

Interested in this opportunity? Apply today for immediate consideration!

Email your updated resume: [email protected]

Call or Text: (908) 505-3545

Learn more: www.bvteck.com

Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Powered by JazzHR

aygtziHWiY

Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Bright Vision Technologies

United State

Senior Software Engineer - Golang (Remote)

Programming
1h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

cloudjobs

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Not Applicable

judi health

United State

Subscribe our newsletter

New Things Will Always Update Regularly