This listing is over a month old and likely no longer available.
Senior Data Engineer
Agility PartnersGreater IndianapolisseniorTrending: 108 views
Description
We’re hiring a Senior Data Engineer to modernize and automate data workflows on Azure. This is not a dashboard-only or pure ETL role. You’ll design and operate scalable, distributed data systems that translate complex business processes into clean, durable data foundations.
You’ll work closely with product, platform, and business stakeholders to turn messy, real‑world requirements into well-modeled, maintainable data solutions that support analytics, automation, and decision-making.
What You’ll Do
Data Engineering & Platforms
Build scalable data pipelines using PySpark in modern data platforms (Databricks preferred; Synapse acceptable)
Apply Spark-style, distributed processing patterns in production environments
Design data systems that are reliable, observable, and easy to maintain
Data Modeling & Design
Translate business logic and application behavior into clean data models
Design dimensional and analytics-ready schemas that represent real business concepts
Make informed decisions around storage and access patterns (e.g., Synapse Serverless SQL vs Azure SQL)
Stakeholder & Architecture Work
Partner with business and technical stakeholders to clarify true requirements
Operate effectively within large, imperfect data ecosystems
Balance speed, pragmatism, and long-term maintainability
What We’re Looking For
Required
Data Engineering Fundamentals
Strong PySpark experience in distributed data environments
Solid understanding of Parquet, Delta Lake, and distributed compute
Clear judgment on when to use Pandas vs PySpark APIs
Modeling & Business Acumen
Exceptional data modeling skills with a business-first mindset
Ability to distinguish between what stakeholders ask for and what they actually need
Strong scope discipline and resistance to over-engineering
Cloud & Enterprise Experience
Working knowledge of Azure concepts (tenancy, networking, service integration)
Comfort operating in large enterprise environments with real-world constraints
Strong communication skills and stakeholder trust-building ability
Preferred
Platform & Design Experience
Databricks experience in production
Dimensional modeling and analytics-centric data design
Background in software development (C#, Java, or similar)
Enterprise Readiness
Experience designing systems consumed by analytics, reporting, and downstream applications
Comfort working in regulated or constraint-heavy environments
Required skills
Mid-Senior levelOtherInformation TechnologyIT Services and IT Consulting and Utilities
Similar roles
Want to know your chances? OpteroAI predicts your offer probability for this role based on your profile.
See your offer scoreFree to start. No credit card.
Glassdoor rating3.5/5
Company Insights
Glassdoor rating
3.5