Skip to main contentOpteroAIBeta
Back to listings
This listing is over a month old and likely no longer available.
Agility Partners logo

Senior Data Engineer

Agility Partners
Greater IndianapolisseniorTrending: 108 views

Description

We’re hiring a Senior Data Engineer to modernize and automate data workflows on Azure. This is not a dashboard-only or pure ETL role. You’ll design and operate scalable, distributed data systems that translate complex business processes into clean, durable data foundations. You’ll work closely with product, platform, and business stakeholders to turn messy, real‑world requirements into well-modeled, maintainable data solutions that support analytics, automation, and decision-making. What You’ll Do Data Engineering & Platforms Build scalable data pipelines using PySpark in modern data platforms (Databricks preferred; Synapse acceptable) Apply Spark-style, distributed processing patterns in production environments Design data systems that are reliable, observable, and easy to maintain Data Modeling & Design Translate business logic and application behavior into clean data models Design dimensional and analytics-ready schemas that represent real business concepts Make informed decisions around storage and access patterns (e.g., Synapse Serverless SQL vs Azure SQL) Stakeholder & Architecture Work Partner with business and technical stakeholders to clarify true requirements Operate effectively within large, imperfect data ecosystems Balance speed, pragmatism, and long-term maintainability What We’re Looking For Required Data Engineering Fundamentals Strong PySpark experience in distributed data environments Solid understanding of Parquet, Delta Lake, and distributed compute Clear judgment on when to use Pandas vs PySpark APIs Modeling & Business Acumen Exceptional data modeling skills with a business-first mindset Ability to distinguish between what stakeholders ask for and what they actually need Strong scope discipline and resistance to over-engineering Cloud & Enterprise Experience Working knowledge of Azure concepts (tenancy, networking, service integration) Comfort operating in large enterprise environments with real-world constraints Strong communication skills and stakeholder trust-building ability Preferred Platform & Design Experience Databricks experience in production Dimensional modeling and analytics-centric data design Background in software development (C#, Java, or similar) Enterprise Readiness Experience designing systems consumed by analytics, reporting, and downstream applications Comfort working in regulated or constraint-heavy environments

Required skills

Mid-Senior levelOtherInformation TechnologyIT Services and IT Consulting and Utilities
Posted 4/22/2026Source: LinkedInView original listing

Want to know your chances? OpteroAI predicts your offer probability for this role based on your profile.

See your offer score

Free to start. No credit card.

Glassdoor rating3.5/5

Company Insights

Glassdoor rating
3.5