AWS Databricks Engineer- Remote-6 Months - Must be authorized to work in the U.S. without sponsorship.

AWS Databrick Data Engineer
Remote
6months Contract/Contract to Hire
 
Must be authorized to work in the U.S. without sponsorship. No EAD''s
 
An AWS Databricks Data Engineer to design, build, and maintains scalable data pipelines and lakehouse architectures using Apache Spark, Python, and SQL. Optimize cloud storage, ensure data quality, and integrate seamlessly with other AWS services

Core Responsibilities

  • Pipeline Development: Design and build batch and streaming data pipelines using PySpark, Delta Lake, Autoloader and Delta Live Tables (DLT) to ingest data sets into Databricks.
  • AWS Integration: Build cloud-native data solutions leveraging AWS services (e.g., S3 for storage, IAM for access management, and AWS Glue or Lambda for serverless tasks
  • Data Governance & Security: Configure and manage access controls using Databricks Unity Catalog to ensure compliance and monitor lineage
  • Orchestration & CI/CD: Automate pipeline deployments using Databricks Workflows, Apache Airflow, and CI/CD tools (e.g., GitHub, GitLab). 
  • Cross-Functional Collaboration: Partner closely with stakeholders to build robust feature stores and prepare datasets for various consumption needs

 

Typical Qualifications & Technical Skills

  • Industry: Healthcare Payer industry experience. Have worked on MMIS data sets – claims, provider, member enrollment and similar data sets
  • Experience: 3-5 years of hands-on data engineering experience, specifically on Databricks.
  • Programming: High proficiency in Python (specifically PySpark) and advanced SQL.
  • Big Data & Cloud: Strong understanding of Apache Spark, Data Lakehouse architecture, and working within a production AWS environment.
  • Databricks Ecosystem: Familiarity with the Databricks platform ecosystem, including notebooks, Delta Lake, and Unity Catalog.
Back to blog

Other Jobs To Apply

( Senior Analyst ) American Express Virtual Jobs, American Express Remote Positions @ Get Dream Job

senior manager, Influencers (New York City or Seattle – U.S.)

( Accountant II ) Starbucks Careers Work From Home, Starbucks Wfh Jobs @ Get Dream Job

Call Center Agent (PT or FT - 100% Work From Home)

Recurring Production Support Content at Walt Disney Company: 100% Remote (US)

[Remote] Associate Proposal Writer, Amer-APAC

Data Entry / Medical Billing Work at Jobs

Amazon Customer Service - Work From Home $16-$24/hr

Tesla Remote Data Entry Jobs (Remote Careers)

Technical YouTube Channel Operations Specialist at TCWGlobal: 100% Remote (US)

Netflix Customer Service Advisor (Remote)

AI Engineer- Python and Databricks- remote

Product Marketing Manager, International

Policy Enforcement Manager, Creativity Standards

Remote eBay or Marketplace Lister

Remote eBay Expert

Principal, Advisory Services (SNAP Policy) - Remote Eligible

Spotify Online Support Advisor with Spanish and English

Design Program Manager [Remote]

Publicist [Remote]

Lead Enterprise Solution Analyst [Remote]

Senior Designer, Gameplay [Remote]

Senior Designer, Virtual Sets - Spectrum News

Remote Customer Success Manager - Growth & Value Realization

Inbound Sales Call Center Representative

Senior Grants and Contracts Specialist

Principal Software Engineer - (Kubernetes - AKS)

[Remote] Client Partner, Enterprise Sales - New England Based

HR Contact Center Representative - REMOTE

HR Contact Center Representative - REMOTE

Manager I, Health and Wellness Benefits

Heavy Duty Fleet Maintenance Trainer

Collections Representative, Bilingual French

[Remote] Director, Marketing (Robinson Managed Solutions)

Sr. Digital Products & Innovation Analyst

Remote Implementation Analyst – Supply Chain & Automation

Strategy Planning Advisor

Strategic Industry Sales Specialist - AI & Data Centers

Field Merchandiser

Account Manager - B2C OEM

Senior Advisor, Federal Government Relations job at ExxonMobil in Washington D.C., DC

Socioeconomic & Human Rights Engineer - Advanced

Senior Analyst, Regional Outbound Logistics

[Work From Home] Nike Data Entry Specialist (Multiple Positions)

Guest Experience Lead

Assistant/Department Manager- From $18 up to 24$ per hour

Coca-Cola Remote Jobs (Data Entry) – No Experience $25/Hr

Field Clinical Trainer

USA - Medical Monitor Contractor - USD (contract)

Dedicated Case Coordinator at Pfizer: 100% Remote (West, TX (Not hiring in FL))