An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
AI summary of this job
Beta Read in 10 secondsA Big Data Engineer role at Meeden Labs in Hyderabad for people with 6–8 years of experience. You'll build scalable data pipelines and architectures using AWS, Spark, Python, Scala, and Airflow. You'll also collaborate with data scientists and analysts to deliver high-quality datasets.
- Hyderabad
- Work from office
- 6–8 years
What you'll do
- Design and implement robust data pipelines
- Develop and optimize data processing workflows
- Utilize SQL, Hive, and Hadoop
Good fit if you
- Have 6–8 years of experience
- Know AWS, Spark, and Airflow
- Strong in Python and Scala
AI-generated from the job description. Check the full description before you apply.
Job Description
We are seeking a skilled Big Data Engineer to join our dynamic team in Andhra Pradesh. The ideal candidate will have a strong background in big data technologies and a passion for data-driven solutions. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures that support our data analytics and business intelligence initiatives.
Key Responsibilities:
- Design and implement robust data pipelines using technologies such as AWS, Spark, and Airflow.
- Develop and optimize data processing workflows to ensure efficient data ingestion and transformation.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
- Utilize SQL, Hive, and Hadoop for data querying and processing tasks.
- Implement CI/CD practices to streamline the deployment of data solutions.
- Ensure data quality and integrity throughout the data lifecycle.
- Stay updated with the latest trends and technologies in big data engineering and contribute to continuous improvement initiatives.
Required Skills:
- Proficiency in AWS and big data technologies such as Spark and Hadoop.
- Strong programming skills in Python and Scala.
- Experience with data orchestration tools like Airflow.
- Solid understanding of SQL and data warehousing concepts.
- Familiarity with API development and data pipeline orchestration.
- Excellent problem-solving skills and the ability to work collaboratively in a team environment.
If you are a motivated individual with a passion for big data and a desire to make an impact, we encourage you to apply for this exciting opportunity.
Skills
Big DataData EngineerPythonSqlBig Data EngineeringScalaSparkHiveCicdAirflowData Pipeline OrchestrationAwsApi DevelopmentHadoopIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in Hyderabad.
One email a day. Unsubscribe any time.

