Principal Data Engineer

:

Job Summary:

Lead the design, development, and optimization of enterprise-scale data pipelines and architectures to drive data-driven decision-making. Architect efficient data tables and schemas to enhance query performance, ensuring seamless integration with cross-functional teams

Key Responsibilities:

Data Pipeline

• Design and implement high-performance data pipelines using ETL processes, batch/streaming frameworks (e.g., Apache Spark, Airflow), and cloud platforms (AWS).
• Optimize data ingestion, transformation, and storage workflows to meet scalability, reliability, and latency requirements.

• Architect database schemas and dimensional models (e.g., star/snowflake) to maximize query performance and reduce latency.
• Implement indexing strategies, partitioning, and materialized views to optimize data retrieval.

• Partner with data scientists, product managers, and engineers to align data infrastructure with business needs.
• Establish data governance frameworks, ensuring compliance with security, privacy, and quality standards.
• Mentor junior engineers and foster best practices in data engineering

• Stay ahead of industry trends (e.g., AI/ML integration, real-time analytics) and advocate for emerging technologies.
• Lead technical strategy for data infrastructure, balancing innovation with operational stability.

• 8+ years of experience in data engineering, with a focus on ETL, data modelling, and cloud-based architectures.
• Proficiency in SQL, Python, and tools like Spark and Snowflake.
• Strong knowledge of database design, dimensional modeling, and query optimization.

• Proven ability to lead teams, mentor engineers, and drive technical initiatives.
• Experience translating business requirements into scalable technical solutions.

• Expertise in machine learning model deployment or real-time analytics.
• Familiarity with DevOps practices (CI/CD, Docker, Kubernetes).

• Data Fanatics: Our edge is always found in the data
• Partner Obsessed: We are obsessed with partner success
• Team of Doers: We have a bias for action
• Game Changers: We encourage innovation

Pattern is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.