Databricks Sr. Developer/Lead/Architect

About Role:

We are seeking a skilled and experienced Databricks Developer / Architect to join our dynamic team. The ideal candidate will have a strong background in data engineering, analytics, and cloud computing. You will be responsible for designing, implementing, and maintaining data pipelines and analytics solutions using Databricks.

Key Responsibilities:

• Data Pipeline Development:Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
• Data Integration:Integrate data from various sources, including databases, APIs, and cloud storage, into Databricks.
• Data Transformation:Perform data cleaning, transformation, and aggregation to prepare data for analysis and reporting.
• Performance Optimization:Optimize data processing workflows for performance and scalability.
• Collaboration:Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions.
• Monitoring and Troubleshooting:Monitor data pipelines and workflows to ensure reliability and troubleshoot issues as they arise.
• Documentation:Create and maintain comprehensive documentation for data pipelines, processes, and best practices.

Qualifications:

• Experience:3-10 years of experience in data engineering, data analytics, or a related field.
• Experience with data visualization tools (e.g., Tableau, Power BI).
• Familiarity with machine learning and data science workflows.

Technical Skills:

• Proficiency in Databricks and Apache Spark.
• Strong programming skills in Python, Scala, or Java.
• Experience with SQL and relational databases.
• Knowledge of cloud platforms (AWS, Azure, GCP) and their data services.
• Familiarity with data warehousing concepts and ETL processes.

Looking to get Placed? Try our Placement Guarantee Plan

Get Hired
• Understanding of big data technologies and frameworks.

Soft Skills:

• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Ability to work independently and as part of a team.
• Attention to detail and a commitment to quality.

Education:

• Bachelors degree in Computer Science, Information Technology, Data Science, or a related field (or equivalent experience).
• Certifications in Databricks or cloud platforms (e.g., Databricks Certified Associate Developer, AWS Certified Big Data Specialty).