Data Platform Engineer [T500-28096]

Department Icon Data Science Analytics & Machine Learning
Posted: 1 week ago
2-5 years
Hyderabad, Telangana, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 2 Jan 2027

Posted: 1 week ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

AI Summary
Job Description
Similar Jobs
Please verify your account first! Send OTP

AI summary of this job

Beta Read in 10 seconds

A Data Platform Engineer role at Talent500 in Hyderabad for people with 2–5 years of experience. You'll build and operate data pipelines using Python, SQL, Apache Spark, Kafka, and MongoDB. You will also manage lakehouse systems and deploy infrastructure using Docker, Kubernetes, Apache, and Helm.

  • Hyderabad
  • Work from office
  • 2–5 years

What you'll do

  • Operate Apache Iceberg lakehouse systems
  • Build batch and streaming data pipelines
  • Deploy infrastructure via GitOps and IaC

Good fit if you

  • Have Python and SQL experience
  • Know Apache Spark and Kafka
  • Work with Docker and Kubernetes
Sounds like you? Applying takes under a minute.

AI-generated from the job description. Check the full description before you apply.

Helpful?

Job Description

About the job Talent500 is hiring for one of its clients. About Itineris: Itineris is a leading technology company that specializes in innovative SaaS solutions for water and energy utilities. Its flagship solution, UMAX, is a highly configurable Customer Information System (CIS) and CRM platform built on Microsoft Dynamics 365. UMAX enables utilities to streamline a wide range of operations – including customer service, field services, billing, asset management, and data analytics. Today, Itineris supports over 30 prominent utility providers across 7 countries and 11 U.S. states, serving more than 8 million customer accounts. There’s a saying at Itineris: Together goes a long way. And we live by that. Whether your job is translating our customers’ needs into the best software, selling, coding, or keeping our business running smoothly, we’re united by the same mission: growing our company and delivering innovative software that empowers energy and water utilities to engage better with their customers. UMAX is the brand name of our software solution for water and energy utilities. It automates their business processes and enables them to better engage with their customers. UMAX is a cloud-based solution, built on the powerful Microsoft Dynamics 365 platform. Role Overview: We are building a secure, scalable, and product-oriented data platform, called NEXUS, that becomes the backbone for analytics, operational data services, and AI/ML products. This role accelerates how our teams ingest, govern, activate, and innovate with data, reducing time-to-insight and enabling AI-driven applications responsibly. As a Data Platform Engineer: You’ll work closely be a part of a small, five-person Data & AI platform team, and partner with the AI Practice and UMAX Product / Engineering teams, with an initial focus on: Own our Apache Iceberg lakehouse end to end. REST catalog (Polaris) operations, table maintenance (compaction, snapshot expiry, orphan cleanup, sort clustering etc.), storage layout, and the merge-on-read vs copy-on-write tradeoff per table. Building and operating CDC / replication and batch + streaming ingestion pipelines for analytics, operational, and AI/ML consumers. Tuning the cost and performance of distributed compute and storage (incremental vs full rewrites, spot capacity, autoscaling, file sizing). Provisioning data-specific features (e.g. databases, feature stores, model registries) Deliver version-aware snapshots / SCD publish (cross-window deduplication, deterministic and auditable snapshot assembly, merges / upserts into well-contracted consumer stores). Enforcing data quality, lineage, and access / classification controls across batch & streaming. Orchestrating and operating scheduled, idempotent pipeline runs (failure recovery, retries). Offering well-contracted data stores and access APIs, built for portability across our multi-cloud (SaaS / hybrid / federated) footprint. Ship via GitOps and IaC (declarative deployment (ArgoCD / Helm), infrastructure-as-code (Bicep) — owning the pipeline, not just the code). Qualifications: 5+ years in data infrastructure, platform engineering, or related backend roles. Deep knowledge of: Deep Apache Spark internals: partitioning, skew, file sizing, join strategies, fluency in reading plans Lakehouse / warehouse design (Iceberg / Delta) Efficient storage design (partitioning, Z-ordering, compaction)Data replication & CDC, and batch + streaming ingestion (e.g. Kafka / Event Hubs / IoT Hub) Schema & data contract governance SQL & analytical data modelling (current state, SCD, merges / upserts, dimensional modelling) Proficient in Python, with strong software engineering and containerized application development (e.g. Docker / Kubernetes); comfortable building well-tested, modular, performant code. Infrastructure-as-code familiarity is a plus but secondary. Observability mindset: metrics, tracing, and logging for data systems. Nice to Have: Operationalizing ML data: feature stores, model / feature serving contracts, drift / monitoring data (modeling itself stays with the AI Practice). Building prediction-serving, write-back, and feedback-label pipelines that connect model outputs back into UMAX (the NEXUS integration layer), to support AI/ML initiatives. Document stores (Cosmos DB, MongoDB). Experience with regulated / utility customer data. What we offer: A fast-growing and international environment with offices in Hyderabad (India), Ghent (Belgium), Atlanta (USA), London (UK). Working with future-ready water and energy companies and building valuable utility expertise. Internal mobility, developing your career through various educational programs and growth paths. An entrepreneurial mindset where you have a direct impact on our growth journey. An open environment where we understand the importance of taking a break to recharge and achieve the best results. We make it a priority to celebrate milestones, both big and small. Onboarding, learning and buddy programs to get ready for a smooth start in your new job. A flexible and inclusive working environment – where people can just be who they are, and where we offer flexible options for hybrid working so you can work in a way that suits you best. Competitive perks & benefits, because we want to help you reach your full potential, both at work and in your personal life. A lot of fun moments with an eye for sports, celebration and wellbeing, important for maintaining a healthy work-life balance.

Skills

PythonSQLApache SparkKafkaMongoDBDockerKubernetesApacheHelmMicrosoft DynamicsCRMOnboardingCustomer ServiceTeamsIoT

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Hyderabad.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.