Data Engineer Job at Interactive Resources - iR, Tempe, AZ

ZG94NGR0MzAwU2VwN3dRVDBOLzBoMWhqaHc9PQ==
  • Interactive Resources - iR
  • Tempe, AZ

Job Description

About the Role

We are seeking a highly skilled Databricks Data Engineer with strong expertise in modern data engineering, Azure cloud technologies, and Lakehouse architectures. This role is ideal for someone who thrives in dynamic environments, enjoys solving complex data challenges, and can lead end-to-end delivery of scalable data solutions.

What We're Looking For

  • 8+ years designing and delivering scalable data pipelines in modern data platforms
  • Deep experience in data engineering, data warehousing, and enterprise-grade solution delivery
  • Ability to lead cross-functional initiatives in matrixed teams
  • Advanced skills in SQL, Python , and ETL/ELT development , including performance tuning
  • Hands-on experience with Azure , Snowflake , and Databricks , including system integrations

Key Responsibilities

  • Design, build, and optimize large-scale data pipelines on the Databricks Lakehouse platform
  • Modernize and enhance cloud-based data ecosystems on Azure , contributing to architecture, modeling, security, and CI/CD
  • Use Apache Airflow and similar tools for workflow automation and orchestration
  • Work with financial or regulated datasets while ensuring strong compliance and governance
  • Drive best practices in data quality, lineage, cataloging, and metadata management

Primary Technical Skills

  • Develop and optimize ETL/ELT pipelines using Python, PySpark, Spark SQL , and Databricks Notebooks
  • Design efficient Delta Lake models for reliability and performance
  • Implement and manage Unity Catalog for governance, RBAC, lineage, and secure data sharing
  • Build reusable frameworks using Databricks Workflows, Repos, and Delta Live Tables
  • Create scalable ingestion pipelines for APIs, databases, files, streaming sources , and MDM systems
  • Automate ingestion and workflows using Python and REST APIs
  • Support downstream analytics for BI, data science, and application workloads
  • Write optimized SQL/T-SQL queries, stored procedures, and curated datasets
  • Automate DevOps workflows, testing pipelines, and workspace configurations

Additional Skills

  • Azure: Data Factory, Data Lake, Key Vault, Logic Apps, Functions
  • CI/CD: Azure DevOps
  • Orchestration: Apache Airflow (plus)
  • Streaming: Delta Live Tables
  • MDM: Profisee (nice-to-have)
  • Databases: SQL Server, Cosmos DB

Soft Skills

  • Strong analytical and problem-solving mindset
  • Excellent communication and cross-team collaboration
  • Detail-oriented with a high sense of ownership and accountability

Job Tags

Similar Jobs

Globe Life AIL - Lisa Russel

Customer Service Work From Anywhere Job at Globe Life AIL - Lisa Russel

 ...that gives you the freedom to travel while growing your career? Work from anywhere in the world, set your own schedule, and join a driven team...  .../ Responsibilities / Rewards ~100% Remote: Work from home or anywhere you choose ~ Flexible Schedule: Design your workday... 

ECHO Realty

Senior Financial Analyst Job at ECHO Realty

 ...ECHO Realty is seeking to hire a Senior Financial Analyst who will be responsible for conducting advanced financial and data analysis and developing predictive models to forecast business performance. This role supports quarterly portfolio statistics reporting, financial... 

Nayamode

Design Studio Manager Job at Nayamode

 ...Role Overview We are seeking a highly experienced Design Studio/ Production Manager to lead production operations for a fast-moving creative team delivering a high volume of complex content. This is a hybrid role between a Design Studio Manager and Production Manager... 

Animal Supply Company

Operations Shift Supervisor Job at Animal Supply Company

 ...Operations Shift Supervisor 2nd Shift Location: Plant City, Florida Schedule: Monday Friday, 3:00 PM 12:00 AM About the Role: We are seeking a motivated and experienced Operations Shift Supervisor to join our distribution center team. In this role,... 

Johns Hopkins Health System

Supply Chain Coordinator I Job at Johns Hopkins Health System

 ...Position Summary : Reporting to the Manager/Supervisor, Supply Chain Operations, this role (Picker/Packer) is responsible for the...  ...Knowledge of customer services protocols is required Knowledge of healthcare supplies and materials management operations are preferred...