An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
- As a Data Engineer with 4+ years of experience, your primary responsibility will be to create and maintain an optimal data pipeline architecture. You will be required to assemble large, complex data sets and identify opportunities for internal process improvements such as automating manual processes and optimizing data delivery. Your expertise will be crucial in redesigning infrastructure to enhance scalability using SQL and Azure big data technologies.
In this role, you will build the necessary infrastructure for the extraction, transformation, and loading of data from diverse sources. Additionally, you will develop analytics tools that leverage the data pipeline to generate actionable insights into customer acquisition, operational efficiency, and other key business metrics. Collaborating with stakeholders from Executive, Product, Data, and Design teams, you will address data-related technical issues and support their infrastructure requirements.
Ensuring data security and segregation across different data centers will be a key aspect of your responsibilities. You will also create data tools for the analytics and data science teams to optimize product performance and drive innovation within the industry. Working closely with data and analytics experts, you will aim for enhanced functionality in data systems.
To excel in this role, you should hold a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a related quantitative field. Furthermore, you should possess hands-on experience with big data tools like Hadoop, Spark, Kafka, Power BI, as well as relational SQL and NoSQL databases such as Postgres and Cassandra. Experience with data pipeline management tools, cloud services like Azure, and stream-processing systems is essential. Proficiency in scripting languages like Python, Java, C++, Scala, and strong analytical skills related to unstructured datasets are also required.
Your background should include a successful track record of manipulating and extracting value from large datasets, along with project management and organizational skills. Experience in root cause analysis, data transformation, metadata management, and working collaboratively with cross-functional teams in a dynamic environment will be beneficial for this role.
In terms of educational qualifications, a degree in Tech (CS/IT), M. Tech (CS/IT), or MSc. (CS/IT) from a recognized university will be preferred for this position.,
Skills
Big DataPythonData ScienceRoot Cause AnalysisData EngineerAnalyticsSqlSQLAzure DatabricksStormSparkStreamingSparkAzkabanAzure Data LakeAzurePythonCHadoopAzure SynapseLuigiAzure Data FactoryCassandraAirflowJavaPower BIScalaKafkaPostgresIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
Similar Jobs
View allLooking for something similar?
New Data Science Analytics & Machine Learning roles in All India.
One email a day. Unsubscribe any time.

