Remote Lead Data Engineer, Databricks (Remote, US)

Description

About V4C

V4C is a pure-play Databricks partner, and in under two years we have earned 850+ Databricks certifications across 325+ customers and been named Databricks' 2026 Partner of the Year (C&SI Emerging).

As a Lead Data Engineer, you will lead the build of production Lakehouse pipelines on customer engagements, working directly with customers and often Databricks' own field teams. Every technical hire here gets a certification roadmap built for them and taught in-house by Databricks-approved trainers, plus a dedicated Employee Success Manager whose only responsibility is your experience at V4C.

The Role

Lead Data Engineers are the technical backbone of V4C delivery. You lead the engineering workstream on an engagement — translating an architecture into working pipelines, setting the patterns the team follows, and owning the quality of what ships. You will work across batch and streaming, on messy enterprise source systems, under real deadlines, and in front of the customer explaining what you built and why. The difference from a Data Engineer is ownership: you are accountable for a workstream and the engineers on it.

Responsibilities

  • Lead engineering on customer engagements, from design through production handover
  • Build and optimize batch and streaming pipelines using PySpark, SQL, and Delta Lake on Databricks
  • Implement Medallion architecture across cloud ecosystems and set the layer conventions the team follows
  • Own performance and cost: benchmark Spark jobs, tune SQL, right-size compute, and explain the trade-offs to the customer
  • Implement data quality and validation as code, including Lakeflow expectations and automated testing in CI
  • Mentor mid-level and junior engineers through code review, pairing, and design feedback
  • Partner with the Data Architect on design decisions, and escalate when implementation reveals the design will not hold



Requirements

  • 7+ years of data engineering plus experience leading projects or teams
  • Strong proficiency in Python, SQL, Apache Spark, and Delta Lake
  • Production experience building both batch and streaming pipelines at enterprise scale
  • Hands-on experience with AWS, Azure, or GCP and its data services
  • Experience with data modeling, Git, and CI/CD for data workloads
  • Demonstrated experience optimizing Spark performance and managing platform cost
  • Strong client communication skills, including the ability to explain technical trade-offs to a non-technical stakeholder

Preferences

  • Healthcare or life sciences experience preferred but not required
  • Existing Databricks Certified Data Engineer Associate or Professional certification
  • Hands-on experience with Unity Catalog, Lakeflow, or Databricks Asset Bundles
  • Experience with dbt, Airflow, or equivalent orchestration and transformation tooling
  • Experience migrating a legacy ETL estate to a modern cloud platform
  • Consulting or client-facing engineering background



Benefits

  • Unlimited PTO
  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k, IRA)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Training & Development
Back to blog

Other Jobs To Apply

Cloud Database Support Engineer

Director, Segment Finance

100% Virtual LISW/LCSW Position – Work from Anywhere! 7 on 7 off schedule

Detection & CorpSec Engineer (Remote)

Lead Funnel Architect / CRO Manager

Remote Opportunity - MicroStrategy (MSTR) Administrator

Customer Support Representative – Remote

Remote Solutions Architect

Pricing & Packaging Director — Remote, AI-Driven Growth

Informatica DPM Senior :: Remote :: 9 Months Contract

Copy and Content Executive - TWITCH LAB - Burson

Dedicated Fleet Support Account Manager

Director, Distribution Center Maintenance & Asset Reliability (Remote Eligible)

Mobile Service Technician, Seattle

Associate, Digital Assets

Owner Connections Representative

Mobile Game Tester - Now Hiring

Geologist II (P.G. license required)

Contract Salesforce Pardot Trainer — In-Person & Online

Performance Director

Clinical Trails Monitor II (Remote)

Collector Inbound - Remote (Metro Orlando, FL area only)

Workday & People Technology Analyst (Remote)

Senior Account Manager - Financial Services

Client Sales Partner-Telecom (US Remote)

Remote Commercial Auto Sales Executive – Bi-lingual

Cleaner

Principal Pricing Strategist (REMOTE EST/CST)

Sr. MicroStrategy Developer | Remote

Licensed Mortgage Loan Officer - Remote

Remote Eligibility Reviewer — Agriculture Relief

Business Analyst (contract)

Part Time Typing Data Entry - Work From Home Customer Service Representative - No Experience Required

reputed company (RN) – Hospital at Home reputed company (reputed company & Per Diem)

Join Our Team: Freelance Bookkeeping Jobs Remote at Virtual Balance Solutions

reputed company Healthcare Careers Jobs | UHC Group Job Vacancies 2023

Urgently Hiring: RN Med Surg / Telemetry - $2,205 per week

Compliance Consultant (Remote/ Part Time)

Dental Billing Specialist-REMOTE

USPS Tier 2 Implementation Support

Part-Time Administrative Coordinator (Hybrid Eligible) (Department of Neurology)

[Remote] 2D Animator (Freelance)

Audio Data Annotation Specialist (Basic JSON Skills) | Remote

amazon work from home $15+/ Hour (Sign on Bonus!)!

Marketing Coordinator (6 Month Contract)

Work From Home Remote Entry Level -Focus Group Position

Remote Customer Experience (CX) Specialist

Remote Sales Representative

Biology AI Problem Designer - Remote, Part-Time

Remote Receptionist - Dallas Front Desk & Admin