Neoware Technology Solutions - Lead Data Engineer - Python/SQL
Data Science Analytics & Machine Learning
149+ Applicants
Posted: 4 months ago
8-10 years
Chennai, Tamil Nadu
work from office
Posted: 4 months ago
|
Applicants: 149+
Job Description
About Company
Similar Jobs
Please verify your account first!
Send OTP
Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs
Job Description
Description
Requirements :
Requirements :
- 8+ years of hands-on experience in delivering data engineering solutions
- Experience leading a team of 5+ team members, responsible for technical project management including stakeholder management, design review, code reviews and mentoring
- Strong hands-on experience in Microsoft Azure platform, with experience in data engineering related services and technologies including Azure Data Factory, Azure Functions, Azure Databricks, Azure Synapse Analytics, Azure Event Hub, Azure Stream Analytics and Azure Data Lake Storage
- Expertise in database concepts, SQL and relational modelling
- Experience establishing reference data management and data quality practices at enterprise scale
- Good understanding and experience working with NoSQL databases
- Strong hands-on experience in implementing data pipelines using Python and PySpark
- Good understanding of data lake and data warehouse concepts, modern data architecture patterns and industry trends in data engineering space
- Hands-on experience in data modelling, with a good understanding of both ER modelling and dimensional modelling
- Good understanding and experience implementing data quality management solutions
- Good understanding of metadata management for data engineering solutions and data platforms
- Good understanding of data governance concepts including data stewardship, data security and data privacy management
- Experience with version control tools like Git for managing version control for source code
- Experience with DevOps processes, including experience implementing CI/CD pipelines for data engineering solution components
- Strong analytical and problem-solving skills
- Excellent communication and collaboration skills
- Lead technical architecture and design efforts for data engineering solution components for delivering business solutions
- Design and implement scalable, secure and resilient data engineering solutions on Microsoft Azure platform, with a good understanding of data architecture patterns
- Evaluate and select appropriate technology stack for data engineering solution components cloud native services, open-source tools, data storage, data processing frameworks etc.
- Lead, mentor and manage a team of dynamic data engineers for development, testing and implementation of data pipelines ensuing quality, performance and on-time delivery
- Responsible for detailed technical design and data mapping specification
- Ensure adherence to industry best practices, coding standards and guidelines driving continuous improvement in code quality and delivery excellence
- Optimize data solutions for performance, cost-efficiency and scalability
- Ensure data quality and integrity for downstream systems and applications
- Plan, prioritize and manage data engineering projects, ensuring timely delivery with quality
- Identify and mitigate risks, troubleshoot issues, handle customer escalations
- Ensure alignment with business requirements and priorities, working closely with stakeholders both internal and customer
- Maintain comprehensive technical documentation, including architecture diagrams, high level / low level data integration design, data mapping specifications, database design etc.
- Working closely with peers, BI engineers and data scientists to enable advanced analytics, machine learning models and reporting solutions
Looking to get Placed? Try our Placement Guarantee Plan
Skills
Advanced AnalyticsBusiness SolutionsPythonData ArchitectureData GovernanceData IntegrationData PrivacyData ProcessingImplementationMachine LearningReference DataQuality ManagementAnalyticsData ManagementSqlData EngineerIf an employer asks you to pay any kind of fee, please notify us immediately. Jobaaj does not charge any fee from the applicants and we do not allow other companies also to do so.
About Company
Neoware Tech Solutions is a premier provider of IT and consulting services with a focus on Blockchain, Metaverse, Artificial Intelligence & Machine Learning.
Important dates & deadlines?
Application Deadline
14 Mar 26, 02:32 PM IST
Similar Jobs
View All
Loading...
Don't Miss out any Updates
Subscribe now for the latest job alerts
and never miss an update
Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago
