Principal Data Engineer

Department Icon Data Science Analytics & Machine Learning
149+ Applicants
Posted: 9 months ago
8-12 years
Maharashtra, Pune
Work from Office

Posted: 9 months ago
|
Applicants: 149+
Job Description
Similar Jobs
Please verify your account first! Send OTP

Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs

Job Description

    You will be responsible for leading the design, development, and optimization of enterprise-scale data pipelines and architectures to facilitate data-driven decision-making. Your role will involve architecting efficient data tables and schemas to enhance query performance and ensure seamless integration with cross-functional teams.
    Your key responsibilities will include designing and implementing high-performance data pipelines using ETL processes, batch/streaming frameworks (e.g., Apache Spark, Airflow), and cloud platforms (AWS). You will also be optimizing data ingestion, transformation, and storage workflows to meet scalability, reliability, and latency requirements.
    In the realm of data architecture and query efficiency, you will architect database schemas and dimensional models (e.g., star/snowflake) to maximize query performance and reduce latency. Moreover, you will implement indexing strategies, partitioning, and materialized views to optimize data retrieval.
    Collaborating with data scientists, product managers, and engineers will be crucial to align data infrastructure with business needs. You will also establish data governance frameworks to ensure compliance with security, privacy, and quality standards, while mentoring junior engineers and promoting best practices in data engineering.
    Staying abreast of industry trends such as AI/ML integration and real-time analytics, you will advocate for emerging technologies and lead the technical strategy for data infrastructure, striking a balance between innovation and operational stability.
    As a suitable candidate, you should possess at least 8 years of experience in data engineering, focusing on ETL, data modeling, and cloud-based architectures. Proficiency in SQL, Python, and tools like Spark and Snowflake is essential, along with a strong understanding of database design, dimensional modeling, and query optimization.

    Looking to get Placed? Try our Placement Guarantee Plan


    Demonstrating leadership skills, you should have the ability to lead teams, mentor engineers, and drive technical initiatives. Experience in translating business requirements into scalable technical solutions will be valuable.
    Preferred qualifications include expertise in machine learning model deployment or real-time analytics, as well as familiarity with DevOps practices (CI/CD, Docker, Kubernetes).
    Pattern is an equal opportunity employer that values diversity and is dedicated to fostering an inclusive environment for all employees.,

Skills

PythonData ArchitectureData GovernanceData ModelingEtlMachine LearningSnowflakeAi/mlAnalyticsAiMlSqlData EngineerDevOpsSQLPythonSnowflakeMachine LearningDimensional ModelingQuery OptimizationSparkDatabase DesignETL

If an employer asks you to pay any kind of fee, please notify us immediately. Jobaaj does not charge any fee from the applicants and we do not allow other companies also to do so.

Important dates & deadlines?

Application Deadline

17 Oct 25, 12:34 PM IST

Similar Jobs

View All
Loading...
Bag Logo
Jobaaj
Don't Miss out any Updates

Subscribe now for the latest job alerts
and never miss an update

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

Principal Data Engineer

Share with