Job Summary
Senior Data Engineer – Responsible for designing and operating real‑time and analytical data pipelines that power enterprise reporting and decision‑making, including security and operational telemetry. The role focuses on ingesting, modeling, and optimizing high‑volume streaming and batch data in Azure Data Explorer (ADX) and delivering curated datasets, analytics, and Power BI/Tableau dashboards for internal stakeholders.
Responsibilities- Design, develop, and maintain robust data processes and solutions to ensure efficient movement and transformation of data across multiple systems.
- Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs.
- Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and deliver data solutions that meet organizational needs.
- Monitor work against production schedules, provide progress updates, and report issues or technical difficulties to lead developers.
- Implement and manage data governance practices, ensuring data quality, integrity, and compliance with regulations.
- Design and implement data security measures, including access controls, encryption, and data masking.
- Mentor associate and intermediate data engineers as needed.
- Perform data analysis and provide insights to support decision‑making across departments.
- Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices.
- Other duties as assigned or requested.
- 5 years of experience in design and analysis of algorithms, data structures, and design patterns for scalable, highly available systems.
- 5 years of data engineering, ETL development, or data management experience.
- 5 years of SQL experience and proficiency with database technologies (e.g., MySQL, PostgreSQL, MongoDB).
- 5 years of data warehouse concepts experience and familiarity with data warehouse solutions (e.g., Snowflake, Redshift, BigQuery).
- 7+ years of experience with data pipeline and workflow management tools (e.g., Apache Airflow, AWS Glue, Azure Data Factory).
- 7+ years of experience defining system architectures and trade‑offs for short‑term execution and long‑term capabilities.
- 7+ years of experience designing or developing data solutions in healthcare.
- 7+ years of experience with cloud platforms (AWS, Azure, GCP) and related data services.
- 7+ years of experience in data governance, data quality, and data security best practices.
- 7+ years of experience translating requirements, design mockups, or user stories into technical designs.
- 7+ years of experience producing fault‑tolerant, efficient, and maintainable data‑related code.
- 7+ years of experience structuring and transforming data from multiple source systems.
- 7+ years of experience creating data visualizations and dashboards using Power BI or Tableau for internal and external audiences.
- 7+ years of experience using Cribl as a streaming and transformation solution.
- 7+ years of experience using Azure Data Factory as a transformation solution.
- 5 years of experience using Azure Data Explorer.
- Demonstrated ability to achieve stretch goals in a fast‑paced environment.
- Strong adaptability and willingness to learn new data development technologies.
- Analytical thinking with a focus on detail and accuracy.
- Technical proficiency across a range of data tools and technologies.
- Track record in designing and implementing large‑scale data sources.
- Sense of ownership, urgency, and drive.
- Passion for user experience and usability improvements.
- Team collaboration and cross‑functional teamwork.
- Experience and willingness to mentor junior data engineers.
- Bachelor’s degree in Computer Science, Information Systems, Data Science, Computer Engineering, or related field.
- Master’s degree in Computer Science, Information Systems, Data Science, Computer Engineering, or related field.
0% – 25%
Pay Range$102,700.00 – $164,600.00
Equal Opportunity EmployerHighmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law.
#J-18808-Ljbffr