AWS Databricks Engineer- Remote-6 Months - Must be authorized to work in the U.S. without sponsorship.

AWS Databrick Data Engineer
Remote
6months Contract/Contract to Hire
 
Must be authorized to work in the U.S. without sponsorship. No EAD''s
 
An AWS Databricks Data Engineer to design, build, and maintains scalable data pipelines and lakehouse architectures using Apache Spark, Python, and SQL. Optimize cloud storage, ensure data quality, and integrate seamlessly with other AWS services

Core Responsibilities

  • Pipeline Development: Design and build batch and streaming data pipelines using PySpark, Delta Lake, Autoloader and Delta Live Tables (DLT) to ingest data sets into Databricks.
  • AWS Integration: Build cloud-native data solutions leveraging AWS services (e.g., S3 for storage, IAM for access management, and AWS Glue or Lambda for serverless tasks
  • Data Governance & Security: Configure and manage access controls using Databricks Unity Catalog to ensure compliance and monitor lineage
  • Orchestration & CI/CD: Automate pipeline deployments using Databricks Workflows, Apache Airflow, and CI/CD tools (e.g., GitHub, GitLab). 
  • Cross-Functional Collaboration: Partner closely with stakeholders to build robust feature stores and prepare datasets for various consumption needs

 

Typical Qualifications & Technical Skills

  • Industry: Healthcare Payer industry experience. Have worked on MMIS data sets – claims, provider, member enrollment and similar data sets
  • Experience: 3-5 years of hands-on data engineering experience, specifically on Databricks.
  • Programming: High proficiency in Python (specifically PySpark) and advanced SQL.
  • Big Data & Cloud: Strong understanding of Apache Spark, Data Lakehouse architecture, and working within a production AWS environment.
  • Databricks Ecosystem: Familiarity with the Databricks platform ecosystem, including notebooks, Delta Lake, and Unity Catalog.
Back to blog

Other Jobs To Apply

Guest Advocate (Cashier or Front of Store Attendant/Cart Attendant) (T0754)

Amazon Warehouse - Shopper / Order Fulfillment Associate $17-$23/hr

UPS Part-Time Twilight Sort Associate

Hiring in Las Vegas:Dock Worker(Part-Time)

Delivery Driver - Competitive Pay, PTO & Growth

Sortation Warehouse Associate-Mobile,AL | Hiring

Amazon Warehouse

Amazon Warehouse

Amazon Delivery Driver

UHAUL Careers Remote - International Shipping Operations Representative - Customer Service and Logistics

Bilingual French – Remote Roadside Assistance Agent (Part Time)

Warehouse Office Support

Join Amazon in Birmingham as a 3rd Shift Inbound Dock Unloader

Warehouse Team Member

Amazon Delivery Driver

Customer Service Rep (100% Work From Home)

Inbound Retail Sales Rep (Work From Home)

Customer Service Rep (100% Work From Home)

Senior Station Manager

3rd Shift(Contract)-Yuma | Hiring

Area Manager II (Fulfillment & Operations)

Admissions Essay Reviewer/Teacher (Remote)

Teach English online with flexible hours

Package Handler - Part Time (Warehouse like)

Warehouse Associate II (Part-Time)

Amazon Warehouse Operator – Columbus, OH

Amazon Sortation Center Associate

Seasonal Warehouse Associate (Macon, GA)

LPN – 100% Remote

Remote Licensed Practical Nurse | Licensed Vocational Nurse Patient Advocate (Contract/100% Remote)

Amazon Warehouse - Shopper / Order Fulfillment Associate $17-$23/hr

Amazon Delivery Driver

Receiving 1st shift M-Thu 5:00 AM - 3:30 PM

Amazon Warehouse Associate

Bakersfield Job:Full-time Night Shift Warehouse Unloader(Part-Time)

Warehouse Associate•Columbus,OH•Amazon | Hiring

Warehouse Associate - $26/hr +

Warehouse Associate - Nights - $28/hr +

On-Demand: Guest Advocate (Cashier), General Merchandise, Fulfillment, Food and Beverage, Style (T2715)

Distribution Center Associate

Warehouse Associate($19-$22/hr)-Sacramento,CA | Hiring

Sterile Processing Supervisor - Full Time - Bakersfield - Outpatient Surgery

Amazon Delivery Driver

Remote Insurance Verification Specialist, Specialty (Pennsylvania)

Strategy Planning Advisor

Remote Medical Billing & Coding Jobs (No Experience Required)

Call Center Specialist

Call Center Specialist

Call Center Agent (Fully Remote)

Remote Chat & Email Support - No Talking Required | Entry-Level Welcome