AI Engineer- Python and Databricks- remote

Responsibilities

Role Summary

We are seeking a Senior AI Engineer to build and support production-grade decisioning and data processing systems in a highly rules-driven enterprise environment.
This is a hands-on engineering role focused on Python-based decision pipelines, business rule implementation, and CI/CD delivery. Strong experience with Databricks and Azure AI Foundry is essential for building scalable enterprise AI and data solutions. Exposure to enterprise AI or LLM capabilities, including OpenAI models, may occur when required, but the primary emphasis is on reliable, maintainable, production systems rather than experimentation or research.

Core Responsibilities
Design, build, and support scalable Python-based processing and decisioning pipelines using Databricks, PySpark, and Pandas.
Develop and maintain enterprise data processing workflows within the Databricks platform.
Translate complex business rules and domain logic into clean, testable, and maintainable decisioning systems.
Build modular, reusable components suitable for orchestrated, production workflows.
Develop and integrate AI-powered solutions using Azure AI Foundry, including enterprise AI, OpenAI, and other LLM services when required.
Integrate enterprise AI or LLM services (including OpenAI models) when needed, including basic prompt/template configuration and structured output parsing.
Apply standard safety and compliance controls (e.g., PII handling, input/output validation).
Integrate internal and external APIs with robust error handling and retry strategies.
Implement data validation, structured logging, and monitoring to support production observability and troubleshooting.
Participate in Git-based development, including branching, pull requests, code reviews, and conflict resolution.
Build and maintain CI/CD pipelines in Azure DevOps, including release workflows and deployment monitoring.
Support and troubleshoot live production systems.

Required Skills & Experience
Strong, hands-on experience with Python engineering for production systems.
Hands-on experience with Databricks for enterprise data engineering, notebook development, and production data pipelines.
Hands-on experience with Azure AI Foundry for developing, deploying, and integrating enterprise AI solutions.
Advanced proficiency with PySpark and Pandas.
Proven experience implementing business rules, decision logic, or rule-driven systems.
Experience working with OpenAI, Agentic AI systems, or AI-assisted workflows.
Experience integrating and working with OpenAI or other large language models (LLMs) in enterprise applications.
Solid understanding of Git-based delivery models.
Hands-on experience with Azure DevOps, including CI/CD pipelines and deployment monitoring.
Experience supporting enterprise production workloads.

Nice to Have
Experience in utilities, energy, or other rules-heavy domains.
Familiarity with workflow orchestration tools (ADF, Airflow, etc.).
Prior exposure to applied AI systems in enterprise environments.

Back to blog

Other Jobs To Apply

Upto $200K/Year | Inpatient 7-On/7-Off | Dual-Certified PMHNP/FNP | Remote

Lead M&A Delivery

CAD Implementer (REMOTE-US)

Scientific Account Manager - Stem Cell Solutions- REMOTE

Regional Safety Leader - Remote Power & Energy

Sr. Program Manager (Healthcare)

Senior/Lead Software Engineer

Hubspot Marketing Consultant (Remote)- CONTRACT

Remote Sales Administrative Assistant

Remote eBay Expert

Electrical or Mechanical Commissioning Agent (Travel Required/Remote)

Senior Big Data Engineer: Snowflake + dbt (Remote)

Remote Senior Bioinformatics Manager, Genomics & Clinical

Business Process Analyst at General Dynamics: 100% Remote (LA)

Solution Architect – Agentic AI

NetSuite ARM Implementation Consultant - Senior Associate

PMT Engineer - Analytics and Automation

Payments & Product Partnerships Counsel, Americas

Financial Consultant I - Principal Connection

Dist Design Project Coord - Sr

Market Commentary Writer and Social Editor at Wealthfront: 100% Remote (San Francisco, CA, New York City, NY)

Global Total Rewards Lead

Remote Payroll Specialist | Flexible Hours & Growth

Entry-Level Auto Technician: Hands-On Tire & Maintenance

Senior Associate, Risk and Structuring Analytics

Services Project Coordinator

Software Developer/Senior Software Developer

Manager, Professional Services- Streaming Media

Varonis Careers - Technical Account Manager

Manager, Accounts Payable

Monday.com Consultant[remote]

Remote Electrical Engineer — Critical Power Systems

Platform Engineering & Reliability Specialist (Azure)

Remote Patient Scheduling Specialist (Part-Time, 20hrs/wk)

Remote Retirement Inside Sales Specialist

Remote SAP MM Consultant – Entry Level

Client Support Specialist - Greater Philadelphia, PA Area (REMOTE)

Customer Service Specialist I at Aon Plc: 100% Remote (Fort Washington, PA, US)

Services Project Coordinator

Appeals Nurse Consultant (Remote)

Servicing Travel Advisor III - Chase Travel (Remote - Tempe, AZ)

Programmatic Solutions Manager, Uber Advertising

Manager, Flight Maintenance - Traveling

Customer Service / Pizza Maker (01068) 28803 Northwestern Hwy, Southfield, MI

Guidewire Architect - PC/CC/BC

Notary Stamp Order Online | West College Corner, IN

Senior Analyst, Program Cost Controls (Remote)

Sr. Tech Business Developer, Just Walk Out Technology by Amazon - AWS Solutions

Medical Consultant

SENIOR DIGITAL SALES EXECUTIVE (REMOTE/USA) - KSLA (GDM - GRAY MEDIA GROUP)