An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.
Job Description
- Job Title: Data Engineer (PySpark)
- Location: [Location] - Pune
- Job Type: Full time
- Job Summary:
- We are looking for a talented and experienced Data Engineer to join our team. The ideal
- candidate will have expertise in Python, PySpark, SQL, Mongo DB, Shell Scripting, Linux, and
- Pandas, and will be responsible for designing, building, and maintaining scalable data
- pipelines and infrastructure.
- Specifically we are looking for immediate joiners and people should be local to Pune.
- Bachelors or Masters degree in Computer Science, Information Technology, or a related
- field.
- 3+ years of experience in data engineering or a similar role.
- Design, develop, and maintain robust and scalable data pipelines using Python, PySpark,
- and SQL for data ingestion, processing, and storage.
- Ability to manage large data sets with tens of millions of records while achieving fast
- performance using Spark
- Knowledge on latest trends in data engineering space such as druid, elastic search, etc
- Knowledge in big data technologies such as Hadoop, Hive, etc
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and various cloud
- services.
- Experience on scheduling/orchestration tools
- Excellent problem-solving skills and attention to detail.
- Strong understanding of ETL processes and tools.
- Experience with shell scripting and Linux for automation and server management.
- Knowledge of data modeling, data architecture, and data warehousing concepts.
- Strong communication and collaboration skills.
- Ability to work independently and as part of a team.
- Experience on AI/ML/LLM is a plus
- Preferred Qualifications:
- Certification in cloud platforms (e.g., AWS Certified Data Analytics, Google Cloud
- Professional Data Engineer).
Skills
Data AnalyticsBig DataPythonData ArchitectureData ModelingData WarehousingData Warehousing ConceptsEtlAi/mlData EngineerAnalyticsAiGoogle CloudMlSqlIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
BMC Software, a global leader in IT solutions, empowers businesses to run and reinvent their operations with innovative software and services, including automation, operations, and service management. Specializing in mainframe, mobile, cloud, and DevOps solutions, BMC Software is at the forefront of the digital enterprise management field. BMC Software careers offer an opportunity to be part of a team that values creativity, collaboration, and the pursuit of excellence. Professionals at BMC are dedicated to solving complex IT challenges, driving digital transformation, and contributing to the success of customers worldwide. Joining BMC Software means embarking on a career where innovation thrives, and where you can make a real impact in the technology industry.
Similar Jobs
View all
New Data Science Analytics & Machine Learning roles in Pune.
One email a day. Unsubscribe any time.
