Data Engineer (PySpark)

Department Icon Data Science Analytics & Machine Learning
Posted: 1 year ago
4-7 years
Pune, Maharashtra
Data Science Analytics & Machine Learning
work from office
Full Time

Posted: 1 year ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.

Job Description

Role: Data Engineer

Location: Pune (On-site)

Job Type: Full-Time

Experience: 47 Years

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL workflows.
  • Work with large datasets using PySpark, Python, and SQL to ensure efficient data transformation and integration.
  • Implement data solutions on AWS, leveraging services like S3, Glue, Lambda, and Redshift.
  • Collaborate with cross-functional teams to define data requirements and optimize data flows.
  • Work within Databricks to develop and deploy data engineering solutions.
  • Ensure data quality, reliability, and security across all environments.
  • Monitor and optimize data processes for performance and cost efficiency.

Required Skills

  • Strong experience in Python, PySpark, and SQL.
  • Hands-on experience with AWS data services (Glue, Redshift, Lambda, S3, etc.).
  • Expertise in the Databricks platform and data pipeline orchestration.
  • Solid understanding of data warehousing, data modeling, and ETL design principles.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.

Good to Have

  • Exposure to the Fintech domain and understanding of financial data structures.
  • Experience with CI/CD, Airflow, or other workflow orchestration tools.
  • Familiarity with data governance and compliance best practices.

Skills

PythonData GovernanceData ModelingData WarehousingEtlData EngineerSql

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Suresoft Technologies, Inc. is a leading provider of software reliability testing tools and services. We deliver innovative solutions to help our customers build safe, reliable, and high-performance software. We are headquartered in Seoul, Korea with offices in the US and global partners. Our customers include Samsung, LG, Hyundai, Qualcomm, Mediatek, and many more. Our core product, COVERAGE MASTER, is a comprehensive code coverage measurement tool that supports all levels of coverage including Statement, Branch, MC/DC, and Object Code Coverage. It is proven to be the fastest, most accurate, and easiest to use coverage tool in the market. Suresoft Technologies has also been delivering highly effective software testing services to various industries including automotive, aerospace, defense, and medical devices. Our services include static analysis, dynamic analysis, test case design, and test execution. Our team of experienced software testing experts can help our customers improve the quality of their software and reduce the risk of defects.
Read More

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Pune.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.