PySpark Developer

Department Icon IT / Software Development & Related
Posted: 2 weeks ago
3-8 years
Bengaluru
IT / Software Development & Related
work from office
Full Time
Closes 26 Dec 2026

Posted: 2 weeks ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

PySpark Developer

Experience: 3-7 Years

Location: PAN India

Key Skills
  • Strong experience in PySpark, Apache Spark, Python, and SQL .
  • Expertise in building and optimizing ETL/Data Processing Pipelines .
  • Good understanding of Spark Architecture (RDDs, DataFrames, Spark SQL, DAGs).
  • Experience with Hadoop Ecosystem (Hive, HDFS) and large-scale data processing.
  • Exposure to AWS/Azure/GCP , object storage, and cloud-based data solutions.
  • Knowledge of Data Modeling, Data Engineering, and Pipeline Design .
  • Hands-on experience with Git and Linux/Unix environments.
  • Strong debugging, performance tuning, and problem-solving skills.
Responsibilities
  • Design, develop, and maintain scalable PySpark-based data pipelines .
  • Build ETL workflows for ingesting, transforming, and loading large datasets.
  • Optimize Spark jobs for performance, scalability, and reliability.
  • Process data from multiple sources, including databases, APIs, HDFS, and cloud storage.
  • Ensure data quality, validation, and governance standards.
  • Troubleshoot and tune Spark applications for maximum efficiency.
  • Collaborate with data engineers, analysts, and data scientists to deliver business solutions.
  • Support production deployments and ongoing application maintenance.
  • Follow security and best practices for enterprise data engineering.
Good to Have
  • Spark Streaming / Structured Streaming
  • Kafka or other messaging platforms
  • Databricks, Airflow, or Azure Data Factory
  • Data Warehousing concepts
  • Agile/Scrum experience

Preferred: Candidates with strong hands-on PySpark development experience, cloud exposure, and expertise in building high-performance big data solutions.

Skills

PythonDebuggingLinuxUnixDeveloperCloudSqlLinuxPythonUnix

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Tata Consultancy Services (TCS) is an Indian multinational information technology (IT) services and consulting company with headquarters in Mumbai, Maharashtra, India.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New IT / Software Development & Related roles in Bengaluru.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.