Senior Data Engineer

Department Icon Data Science Analytics & Machine Learning
Posted: 2 months ago
5-10 years
Bengaluru, Karnataka, India
Data Science Analytics & Machine Learning
work from office
Full Time

Posted: 2 months ago
This job's closing date (15 Nov 2026) has passed, so the role may already be filled. See live similar jobs.
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

    • Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
    • Build and optimize distributed data applications using Apache Spark and Python Scala.
    • Develop reliable, high-performance data pipelines for batch and streaming workloads.
    • Design and manage data workflows using Apache Airflow.
    • Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
    • Work with large datasets to ensure data quality, consistency, reliability, and performance.
    • Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
    • Optimize data workflows for scalability, reliability, performance, and cost efficiency.
    • Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.

Requirements

Candidates who demonstrate:

  • 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
  • Strong hands-on experience with Apache Spark and Scala.
  • Experience designing, building, and maintaining large-scale ETL pipelines.
  • Strong hands-on experience with AWS, particularly Amazon S3.
  • Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
  • Strong SQL skills and a solid understanding of distributed data processing concepts.
  • Experience working with batch and/or streaming data pipelines.
  • Excellent debugging, problem-solving, and performance optimization skills.
  • Strong communication and collaboration skills.

Good to Have

  • Experience with Databricks and the broader Databricks data platform.

  • Familiarity with streaming technologies such as Apache Kafka.

  • Experience working on large-scale data platforms handling high-volume data workloads.

  • Exposure to additional AWS data services and cloud-native data architectures.

Benefits

  • Best-in-class salary: We hire strong talent and compensate accordingly.
  • Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
  • Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
  • High-impact work: Build AI-first systems and products used at scale by global clients.

Skills

PythonScalaSQLData EngineeringApache SparkKafkaAirflowDatabricksETLAWSApacheS3ConsultingCommunicationTeams

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media and Entertainment companies in the world! We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore. Since 2019, Proximity has created and grown high-impact, scalable products used by 370 million daily users, with a total net worth of $45.7 billion among our client companies.

We are Proximity — a global team of coders, designers, product managers, geeks, and experts. We solve complex problems and build cutting edge tech, at scale. Our team of Proxonauts is growing quickly, which means your impact on the company’s success will be huge. You’ll have the chance to work with experienced leaders who have built and led multiple tech, product and design teams. Here’s a quick guide to getting to know us better:

Watch our CEO, Hardik Jagda, tell you all about Proximity.

Read about Proximity’s values and meet some of our Proxonauts here.

Explore our website, blog, and the design wing — Studio Proximity.

Get behind-the-scenes with us on Instagram! Follow @ProxWrks and @H.Jagda

Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.