An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Posted over 15 days ago, so the role may have closed. Confirm on the employer's page when you apply, or see similar jobs.
Job Description
- Must be from data engineering - background with 3+ years of experience
- Experience in advanced Apache Spark processing framework, and spark programming languages such as Scala/Python/Advanced Java with sound knowledge in shell scripting.
- Experience in working with Core Spark, Spark Structured Streaming, Data Frame API, Data set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data. Specifically, this experience must be in writing "Big Data data engineering jobs for large-scale data integration in AWS.
- Experience in writing spark streaming jobs integrating with streaming frameworks such as Apache Kafka or AWS Kinesis.
- Knowledge of using, setting up and tuning resource management frameworks for spark.
- Experience working with external job schedulers such as autosys, aws data pipeline, airflow etc.
- Experience in AWS services such as EMR, Glue, S3 Athena, IAM, Lambda and Cloud watch is required.
Skills
Data IntegrationSqlIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allNew Data Science Analytics & Machine Learning roles in Bengaluru.
One email a day. Unsubscribe any time.

