Data Engineer

Department Icon Data Science Analytics & Machine Learning
149+ Applicants
Posted: 2 years ago
2-4 years
Tirupati, Andhra Pradesh, India
Work From Office

Posted: 2 years ago
|
Applicants: 149+
Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs

Job Description

Responsibilities
  • Develop, construct, test and maintain optimal data pipeline/ETL architectures
  • Map out data systems/objects and define/design required integration, ETL, BI & AI systems/processes
  • Work closely within the team to prepare data for predictive and prescriptive modeling
  • Optimise AWS and Azure data delivery infrastructure for greater scalability
  • Utilise SQL as well as big data tools and frameworks to optimize data acquisition and preparation from enterprise data lake and data warehouse
  • Work with Cloud Architecture teams to strive for greater functionality in our data systems
  • Develop architecture required to return data to data warehouse for front-end product utilisation
  • Curate data models in the data warehouse to be used by front-end advanced analytics designers
  • Provide production level code reviews for the team
  • design, maintain and implement quality assurance and testing approaches
  • Deploy scripts and architectures to production via Jenkins
Requirements
  • Bachelors Degree in Computer Science, Mathematics, Engineering, Management Information Systems, or related field
  • 5+ years of experience working with enterprise data platforms, building, and managing data lakes and using data technologies
  • 3-5 years of experience designing and implementing data warehouse solutions
  • 2+ years of experience with Spark using Python/Scala.
  • Experience with Spark streaming, building real time data pipelines is preferred
  • 2+ years of experience working with AWS and or Azure platform.
  • Looking to get Placed? Try our Placement Guarantee Plan

  • Experience with solutioning on AWS infrastructure using services like AWS S3 Lambda, EMR, Redshift (or Snowflake)
  • Experience with automating and orchestrating jobs on a big data platform using Oozie, Airflow, Jenkins or something similar
  • Good understanding and experience working with various products in the Big data ecosystem like Hive, HDFS, Presto, NoSQL databases like Cassandra, DynamoDB
  • Experience with setting up and using Kafka for real time streaming is a big plus
  • Prior experience with working in a SQL server-based environment and using SSIS, SSRS, TSQL is a plus.
  • Prior experience with traditional ETL tools like Talend Open Studio, Pentaho, or something similar is a plus
  • Advanced SQL and data design concepts
  • Drive innovation and efficiency through new approaches
  • Ability to work in a team environment that promotes collaboration
This job was posted by Murali Linga from QuaXigma.

Skills

AnalyticsDesigningEtlInnovationPythonQualityQuality AssuranceSqlSsrs

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Quaxigma is a software consulting and product engineering company focused on helping organizations solve complex problems with data-driven insights. They specialize in cloud computing, data engineering, and data science.

Important dates & deadlines?

Application Deadline

14 Dec 23, 10:25 AM IST

Similar Jobs

View All
Loading...
Bag Logo
Jobaaj
Don't Miss out any Updates

Subscribe now for the latest job alerts
and never miss an update

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

Data Engineer

Share with