Data Platform Engineer

Department Icon Data Science Analytics & Machine Learning
149+ Applicants
Posted: 4 months ago
0-1 years
Pune, Maharashtra
work from office

Posted: 4 months ago
|
Applicants: 149+
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs

Job Description

Senior Data Platform Engineer
As a Senior Data Platform Engineer, you will drive the architectural execution of the Data platform. You will take ownership of the systems scalability and consistency, ensuring the Operational Data Store functions as a reliable, highly available operational source for all global Master Data. You will act as a technical leader, mentoring the engineering team and collaborating with cross-functional integration teams to ensure seamless data flow.
Expanded Responsibilities
  • Platform Architecture & Management: Architect and maintain mission-critical data lake and warehouse environments on Google Cloud Platform (GCP), utilizing services such as BigQuery, Pub/Sub, and Cloud Storage.
  • Infrastructure & Deployment: Design, deploy, and manage robust, scalable infrastructure using Terraform to ensure environmental consistency across all deployment stages.
  • Data Pipeline Engineering: Engineer high-performance, distributed data pipelines for real-time and batch streaming using technologies like Dataflow and Kafka. Lead workflow orchestration by designing, deploying, and monitoring complex Directed Acyclic Graphs (DAGs) in Apache Airflow (Cloud Composer).
  • Software Development: Develop custom backend tooling, internal APIs, and microservices in Golang and Python to enhance platform capabilities.
  • Data Governance & Modelling: Manage the end-to-end data warehouse lifecycle, employing dbt (Data Build Tool) for clean, documented, and tested data models.
  • DevOps & Reliability: Drive DevOps and Site Reliability Engineering (SRE) practices, owning CI/CD pipelines and utilizing Docker for seamless, highly reliable deployments. Optimize and architect diverse database engines (SQL and NoSQL), focusing on performance tuning, schema design, and security.
  • Database Management: Architect and optimize various database engines (SQL and NoSQL), focusing on performance tuning, schema design, and security.
Technical Profile Additions
  • Programming - Advanced proficiency in Golang (for systems) and Python (for data/automation).
  • Infrastructure as Code (IaC): Terraform
  • CI/CD & Version Control: Jenkins, Gitlab
  • Programming Languages: Python (with expertise in FastAPI and Prefect; well-versed in functional programming and a strong grasp of object-oriented programming)
  • GCP Expertise:
    • Cloud Run (Services, Jobs, Functions)
    • Databases: BigQuery, Cloud SQL for PostgreSQL & , Cloud Spanner
    • Cloud Storage
    • Managed Airflow (Cloud Composer)
    • Pub/Sub, Eventarc
    • IAMs: Ability to construct necessary permissions following the principle of least privilege; capability to analyze permission requests for potential security consequences.
    • Artifact Registry
    • GCP Monitoring and Alerting
    • Secret Manager
    • Vertex AI and Workbench Instances: Setup and permission management.
    • GCP Networking
  • Containerization: Docker
  • Architecture: Advanced skills in architecting data pipelines on Cloud (GCP preferred)
  • Data Architecture Theory: Advanced understanding of Data Mesh Architecture and its comparison to the centralized approach.
Intermediate Level Is Acceptable
  • Looking to get Placed? Try our Placement Guarantee Plan

    Transformations: dbt
  • Frontend Technologies: React.js
Nice To Have
  • Secrets Management: Akeyless
  • Project Management & Documentation: Jira, Confluence, ServiceNow
  • Data Ingestion & Reverse ETL: Fivetran (including Fivetran Activations)
Required Education
Educational Background & Qualifications
  • Masters or Bachelors Degree in Computer Science, Data Engineering, Software Engineering, or a related technical field (e.g., Electromechanical Engineering with a focus on Automation)
  • Specialized Coursework: Strong academic foundation in Distributed Systems, Database Management Systems (DBMS), Algorithm Design, and Real-time Computing.
Preferred Certifications
  • Google Cloud Professional Data Engineer or Google Cloud Professional Cloud Architect.
  • APICS or similar certifications in Logistics/Supply Chain (a significant plus for understanding the why behind the warehouse data).

Skills

PythonData ArchitectureData GovernanceEtlData EngineerAiGoogle CloudSql

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

TVH is a global organization with a passion for quality and service. TVH is an authorized master distributor for many premium brands for parts and accessories for forklifts, aerial work platforms, industrial sweepers and scrubbers and agricultural tractors. TVH also remanufactures and repairs parts. The electronics department specializes in repairing printed circuit boards, joysticks, and displays. From the simplest pallet truck to the heaviest forklift, from the smallest nut and bolt to a complete chassis: you will find it all at TVH. TVH has been serving the material handling, industrial, construction and agricultural industries for over 50 years. TVH is a one-stop-shop offering great service, extensive product knowledge and fast delivery. TVH’s headquarters is located in Waregem, Belgium. There are two regional headquarters: one in Olathe, Kansas, for the Americas and one in Hermalle, Belgium, for Europe. TVH has more than 81 locations worldwide with a team of over 5,000 employees. At TVH, we not only want to be the best at what we do, we also want to create a great place to work. We offer our associates a competitive salary, benefits, and the opportunity to learn and grow. Are you ready to grow with TVH? Join our team!
Read More

Important dates & deadlines?

Application Deadline

29 Jul 26, 02:57 PM IST

Similar Jobs

View All
Loading...
Bag Logo
Jobaaj
Don't Miss out any Updates

Subscribe now for the latest job alerts
and never miss an update

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

Data Platform Engineer

Share with