AI Engineer- Python and Databricks- remote

Responsibilities

Role Summary

We are seeking a Senior AI Engineer to build and support production-grade decisioning and data processing systems in a highly rules-driven enterprise environment.
This is a hands-on engineering role focused on Python-based decision pipelines, business rule implementation, and CI/CD delivery. Strong experience with Databricks and Azure AI Foundry is essential for building scalable enterprise AI and data solutions. Exposure to enterprise AI or LLM capabilities, including OpenAI models, may occur when required, but the primary emphasis is on reliable, maintainable, production systems rather than experimentation or research.

Core Responsibilities
Design, build, and support scalable Python-based processing and decisioning pipelines using Databricks, PySpark, and Pandas.
Develop and maintain enterprise data processing workflows within the Databricks platform.
Translate complex business rules and domain logic into clean, testable, and maintainable decisioning systems.
Build modular, reusable components suitable for orchestrated, production workflows.
Develop and integrate AI-powered solutions using Azure AI Foundry, including enterprise AI, OpenAI, and other LLM services when required.
Integrate enterprise AI or LLM services (including OpenAI models) when needed, including basic prompt/template configuration and structured output parsing.
Apply standard safety and compliance controls (e.g., PII handling, input/output validation).
Integrate internal and external APIs with robust error handling and retry strategies.
Implement data validation, structured logging, and monitoring to support production observability and troubleshooting.
Participate in Git-based development, including branching, pull requests, code reviews, and conflict resolution.
Build and maintain CI/CD pipelines in Azure DevOps, including release workflows and deployment monitoring.
Support and troubleshoot live production systems.

Required Skills & Experience
Strong, hands-on experience with Python engineering for production systems.
Hands-on experience with Databricks for enterprise data engineering, notebook development, and production data pipelines.
Hands-on experience with Azure AI Foundry for developing, deploying, and integrating enterprise AI solutions.
Advanced proficiency with PySpark and Pandas.
Proven experience implementing business rules, decision logic, or rule-driven systems.
Experience working with OpenAI, Agentic AI systems, or AI-assisted workflows.
Experience integrating and working with OpenAI or other large language models (LLMs) in enterprise applications.
Solid understanding of Git-based delivery models.
Hands-on experience with Azure DevOps, including CI/CD pipelines and deployment monitoring.
Experience supporting enterprise production workloads.

Nice to Have
Experience in utilities, energy, or other rules-heavy domains.
Familiarity with workflow orchestration tools (ADF, Airflow, etc.).
Prior exposure to applied AI systems in enterprise environments.

Back to blog

Other Jobs To Apply

Quantum Computing/Cryptography Engineer - II

Senior Director at General Electric - GE: 100% Remote (CA, MH, India, ENG, United Kingdom)

Boeing Virtual Information Session - Fall 2026 [Remote]

(#R-098370) R&D Co-Op | Johnson & Johnson | Handshake

Drive with DoorDash

Benefits Partner-Remote Eligible

Enterprise Account Executive - Workvivo

Creative Director, Copy (Brand Narratives)

REMOTE - Enterprise Engineer V - Datadog

Remote Front-End Developer (Angular 16+ | UI/UX + TD)

Publicity Coordinator, Theatrical & Awards (Contract)

Customer Service Rep (100% Work From Home)

Mid-Level Shopify Developer (Remote)

Software Engineer, Enterprise Zone (Backend & Full Stack) — Multiple Levels

Senior Gameplay Animator - Remote, World Class Motion Lead Job at Doist in New Y

Part-Time Shopify Data & PO Coordinator (Remote)

Architect Product Security

Remote SLAM & Real-Time 3D CV Engineer

TikTok Social Programming, Bleacher Report at Warner Bros. Discovery: 100% Remote (NY, GA)

Senior Pharmacy Technician - Call Center - Work From Home

Financial Solutions Advisor - Central OC

Key Account Distribution Leader - Grainger at 3M: 100% Remote (GA, SC, NC)

1LMX RMS Global Configuration Management Engineer - FULLTIME TELEWORK

Boeing Virtual Information Session - Fall 2026 [Remote]

Monday.com Administrator-100% Remote

Advisory Consultant - Economics

Advisory Consultant - Economics

Experience Design (XD) I, Product Design - Bank of America Experience Design

Payroll Implementation Germany Full-time $82,000 - $92,000 USD

Technical Leader (Remote)

Smartsheet Expert for Integrated Project Planning

Pinterest collage maker $60 budget

Readiness Program Manager

Readiness Program Manager

Inside Sales Representative (Remote - Central Region)

Webflow Expert Needed to Finish Website and Build Stripe-to-Dropbox Customer Workflow

Creative Director, Partnerships & Collectibles Job at Crocs, Inc. in broomfield

Inside Sales Lead-Lathrop

Environmental Standards Expert - Climate

Conseiller(ère) Online après-vente - Service Preparation Specialist H/F - Aix en Provence

Senior Palantir

SE Region for CDL A Drivers. Top 50% Avg. $81,172

S.V.P. International LFO

S.V.P. International LFO

IT Philippines Full-time $10,000 - $12,000 USD

Intern, Applied Technologies (Summer 2027) [Remote]

Private - Web Site Testing

Global Indirect Tax Manager at Reddit, Inc: 100% Remote (US)

Data Analyst - Report Writer III at PROLIM: 100% Remote (US)

Freelance Senior Reddit Specialist at Orchestra Communications: 100% Remote (New York, NY, Washington, DC, Boston, MA, Miami, FL, Seattle, WA, San Francisco, CA, San Diego, Los Angeles, US)