Principal Data Engineer

Your key responsibilities will include designing and implementing high-performance data pipelines using ETL processes, batch/streaming frameworks (e.g., Apache Spark, Airflow), and cloud platforms (AWS). You will also be optimizing data ingestion, transformation, and storage workflows to meet scalability, reliability, and latency requirements.

In the realm of data architecture and query efficiency, you will architect database schemas and dimensional models (e.g., star/snowflake) to maximize query performance and reduce latency. Moreover, you will implement indexing strategies, partitioning, and materialized views to optimize data retrieval.

Collaborating with data scientists, product managers, and engineers will be crucial to align data infrastructure with business needs. You will also establish data governance frameworks to ensure compliance with security, privacy, and quality standards, while mentoring junior engineers and promoting best practices in data engineering.

Staying abreast of industry trends such as AI/ML integration and real-time analytics, you will advocate for emerging technologies and lead the technical strategy for data infrastructure, striking a balance between innovation and operational stability.

As a suitable candidate, you should possess at least 8 years of experience in data engineering, focusing on ETL, data modeling, and cloud-based architectures. Proficiency in SQL, Python, and tools like Spark and Snowflake is essential, along with a strong understanding of database design, dimensional modeling, and query optimization.

Demonstrating leadership skills, you should have the ability to lead teams, mentor engineers, and drive technical initiatives. Experience in translating business requirements into scalable technical solutions will be valuable.

Preferred qualifications include expertise in machine learning model deployment or real-time analytics, as well as familiarity with DevOps practices (CI/CD, Docker, Kubernetes).

Pattern is an equal opportunity employer that values diversity and is dedicated to fostering an inclusive environment for all employees.,