[Remote] Software Engineer, Systems ML

Note: The job is a remote job and is open to candidates in USA. Meta is hiring a Software Engineer for its Systems ML Engineering team. The role builds and optimizes large-scale machine learning infrastructure, including training and inference systems, performance-critical components, and reliable ML serving solutions.


Responsibilities

  • Design, build, and optimize large-scale ML training and inference systems, including distributed computing frameworks and hardware-accelerated pipelines
  • Develop and maintain high-performance ML infrastructure components in C++ and Python, ensuring reliability, scalability, and low-latency execution
  • Identify and resolve performance bottlenecks across the ML stack using profiling, instrumentation, and benchmarking tools
  • Architect and evaluate trade-offs in ML system design, including memory bandwidth, compute utilization, and I/O throughput
  • Partner with research and product teams to translate ML model requirements into efficient infrastructure solutions
  • Define and track system-level metrics and service level objectives to maintain production reliability of ML serving systems
  • Lead technical design reviews and contribute to engineering standards for ML systems across the organization
  • Mentor other engineers on ML infrastructure best practices, debugging methodologies, and performance optimization techniques
  • Drive adoption of AI-augmented development workflows to expand engineering productivity and broaden the scope of deliverables
  • Contribute to staged rollout strategies using feature flagging and experimentation frameworks to safely deploy ML system changes

Skills

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 6+ years of experience in software engineering with a focus on machine learning systems, AI infrastructure, or high-performance computing
  • Experience developing and optimizing ML training or inference pipelines using frameworks such as PyTorch, TensorFlow, or equivalent
  • Experience with distributed computing architectures and large-scale systems design for ML workloads
  • Experience programming in C++ and Python for performance-critical systems
  • Experience using profiling and performance analysis tools to identify and resolve bottlenecks in ML or compute-intensive systems
  • Experience optimizing large-scale ranking and recommendation model inference on AI accelerator hardware
  • Experience with hardware-software co-design, including numerics optimization and SIMD or vectorization techniques
  • Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
  • Experience with GPU programming using CUDA, ROCm, or equivalent hardware accelerator kernel development
  • Experience with ML compiler technologies such as MLIR, LLVM, TVM, XLA, or IREE
  • Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
  • Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)

Benefits

  • Bonus
  • Equity

Company Overview

  • Meta is a social technology company that enables people to connect, find communities, and grow businesses. It was founded in 2004, and is headquartered in Menlo Park, California, USA, with a workforce of 10001+ employees. Its website is

  • Company H1B Sponsorship

  • Meta has a track record of offering H1B sponsorships, with 5145 in 2026, 6419 in 2025, 5944 in 2024, 3874 in 2023, 5237 in 2022, 7 in 2021, 10 in 2020. Please note that this does not guarantee sponsorship for this specific role.

  • Back to blog

    Other Jobs To Apply

    Remote Customer Service Representative – TurboTax

    Distribution Warehouse Technician

    Warehouse Associate 2nd Shift

    Night Warehouse Selector

    Work From Home Customer Service Rep

    Communications Dispatcher

    Community Specialist, Channel Retail

    Chat and Email Support Agent

    Customer Happiness Manager - Remote Anywhere

    Amazon Packing Job Openings - Freshers Welcome

    Senior Remote Data Entry Specialist – Precision Data Management Champion, Global Data Quality Leader, and Accuracy Expert – Join brighthush’s Data Excellence Team

    Warehouse Clerk

    Principal Software Engineering - Virtualization

    Seasonal Package Handler - Part Time (Warehouse like)

    Weekend Shift:Warehouse Associate-New York

    Security Officer Full Time - Access Verification

    Amazon Delivery Driver

    [FULL TIME Remote] Walmart Part Time Remote – Work From Home

    Customer Support Specialist - Apple Store (Work From Home)

    Netflix Tagger - Remote Job

    Remote Customer Support Assistant - Coca-Cola

    Remote Product Tester - $25-45 per hour

    Automated Driving Advanced Development Intern, Machine Learning Research (Cambridge)

    Fulfillment Center-Warehouse Packer(Contract)|Houston

    Intern, Internal Audit

    Round Rock Job:DSP Route Driver(Part-Time)

    Warehouse Associate (PT or FT flex schedules)

    Dedicated Entry Level Remote Booking & Reservations Assistant – Client Coordination and Scheduling Specialist at brighthush

    Part-Time Virtual Assistant (Remote – PST Hours)

    Call Center Representative Remote / Telecommute Jobs

    Remote Ticketing & Travel Support Agent - Airlines Industry

    [Remote] GM, Member Programs

    Online Product Tester

    amazon flex $15+/ Hour

    RN Medical Review Nurse

    Equity Actors

    Nursing Assistant - Float (Intermittent) Open Continuous Announcement

    Deltona:Front End Cashier(Full-time,$16-$20/hr) | Hiring

    Interim Support Lead Part Time-7171 Southern Plaza-Indianapolis, IN | Five Below | Handshake

    House Cleaning Job at Ghim Moh

    Amazon Sort Center Associate – Roseville, CA

    Fulfillment Center Order Picker Needed-Fort Wayne Area | Hiring

    Area Manager, Early Career

    Area Manager, Early Career

    Remote Work From Home Market Research. Ideal For Customer Service Representative

    Remote Work From Home Market Research. Ideal For Customer Service Representative

    Apple Support Specialist

    Apple Support Specialist

    data science entry level jobs (remote) highest paying jobs without a degree

    data science entry level jobs (remote) highest paying jobs without a degree