Data Engineer Job at Interactive Resources - iR, Austin, TX

bUl6QjNKeXovWW5xeWNHbU8zZDB3a1U1VGc9PQ==
  • Interactive Resources - iR
  • Austin, TX

Job Description

About the Role

We are seeking a highly skilled Databricks Data Engineer with strong expertise in modern data engineering, Azure cloud technologies, and Lakehouse architectures. This role is ideal for someone who thrives in dynamic environments, enjoys solving complex data challenges, and can lead end-to-end delivery of scalable data solutions.

What We're Looking For

  • 8+ years designing and delivering scalable data pipelines in modern data platforms
  • Deep experience in data engineering, data warehousing, and enterprise-grade solution delivery
  • Ability to lead cross-functional initiatives in matrixed teams
  • Advanced skills in SQL, Python , and ETL/ELT development , including performance tuning
  • Hands-on experience with Azure , Snowflake , and Databricks , including system integrations

Key Responsibilities

  • Design, build, and optimize large-scale data pipelines on the Databricks Lakehouse platform
  • Modernize and enhance cloud-based data ecosystems on Azure , contributing to architecture, modeling, security, and CI/CD
  • Use Apache Airflow and similar tools for workflow automation and orchestration
  • Work with financial or regulated datasets while ensuring strong compliance and governance
  • Drive best practices in data quality, lineage, cataloging, and metadata management

Primary Technical Skills

  • Develop and optimize ETL/ELT pipelines using Python, PySpark, Spark SQL , and Databricks Notebooks
  • Design efficient Delta Lake models for reliability and performance
  • Implement and manage Unity Catalog for governance, RBAC, lineage, and secure data sharing
  • Build reusable frameworks using Databricks Workflows, Repos, and Delta Live Tables
  • Create scalable ingestion pipelines for APIs, databases, files, streaming sources , and MDM systems
  • Automate ingestion and workflows using Python and REST APIs
  • Support downstream analytics for BI, data science, and application workloads
  • Write optimized SQL/T-SQL queries, stored procedures, and curated datasets
  • Automate DevOps workflows, testing pipelines, and workspace configurations

Additional Skills

  • Azure: Data Factory, Data Lake, Key Vault, Logic Apps, Functions
  • CI/CD: Azure DevOps
  • Orchestration: Apache Airflow (plus)
  • Streaming: Delta Live Tables
  • MDM: Profisee (nice-to-have)
  • Databases: SQL Server, Cosmos DB

Soft Skills

  • Strong analytical and problem-solving mindset
  • Excellent communication and cross-team collaboration
  • Detail-oriented with a high sense of ownership and accountability

Job Tags

Similar Jobs

M3USA

Physician Relations Specialist (Remote) Job at M3USA

 ...PracticeMatch is the industry leader in providing practicing physician and resident/fellow data and services to in-house physician staffing...  ...PracticeMatch , an M3 company. This position is fully remote and you will be able to work permanently from your home. Job... 

Muenster Pet

Supply Chain Logistics Coordinator Job at Muenster Pet

 ...This is a full-time, on-site role for a Supply Chain Logistics Coordinator located in our expanding production facility in Denton, TX. The role involves coordinating daily supply chain operations, ensuring accurate inventory levels, coordinating shipping and delivery... 

ALife Hospitality Group

Line Cook Job at ALife Hospitality Group

About ALife Hospitality Group ALife Hospitality Group is one of Houstons leading and fastest-growing hospitality groups, operating a diverse portfolio of restaurants, lounges, and nightlife concepts. Were passionate about great food, memorable experiences, and building...

Talentoma

Remote Customer Support Specialist Job at Talentoma

 ...connection and a quiet, distraction-free home workspace Team-minded attitudewilling to ask questions and support others No experience required paid training is provided Customer service experience (call center, retail, hospitality) is a plus, not required... 

Faris Machinery Co

Heavy Equipment Mechanic Job at Faris Machinery Co

 ...environment where you can troubleshoot complex problems and keep heavy machinery running smoothly? Faris Machinery Company is searching...  ...technical school education. Strong understanding of diesel and gas engines, hydraulics, and electrical systems. Proficient...