Please click on the Apply to verify the status of jobs posted more than 15 days ago, as they may have expired. Similar Jobs
Job Description
- As a GCP Data Engineer, you will play a crucial role in the development, optimization, and maintenance of data pipelines and infrastructure. Your proficiency in SQL and Python will be pivotal in the management and transformation of data. Moreover, your familiarity with cloud technologies will be highly beneficial as we strive to improve our data engineering processes.
You will be responsible for building scalable data pipelines. This involves designing, implementing, and maintaining end-to-end data pipelines to efficiently extract, transform, and load (ETL) data from various sources. It is essential to ensure that these data pipelines are reliable, scalable, and performance-oriented.
Your expertise in SQL will be put to use as you write and optimize complex SQL queries for data extraction, transformation, and reporting purposes. Collaboration with analysts and data scientists will be necessary to provide structured data for analysis.
Experience with cloud platforms, particularly GCP services such as BigQuery, DataFlow, GCS, and Postgres, will be valuable. Leveraging cloud services to enhance data processing and storage capabilities, as well as integrating tools into the data ecosystem, will be part of your responsibilities.
Documenting data pipelines, procedures, and best practices will be essential for knowledge sharing within the team. You will collaborate closely with cross-functional teams to understand data requirements and deliver effective solutions.
The ideal candidate for this role should have at least 3 years of experience with SQL and Python, along with a minimum of 1 year of experience with GCP services like BigQuery, DataFlow, GCS, and Postgres. Additionally, 2+ years of experience in building data pipelines from scratch in a highly distributed and fault-tolerant manner is required. Comfort with a variety of relational and non-relational databases is essential.
Proven experience in building applications in a data-focused role, both in Cloud and Traditional Data Warehouse environments, is preferred. Familiarity with CloudSQL, Cloud Functions, Pub/Sub, Cloud Composer, and a willingness to learn new tools and techniques are desired qualities.
Furthermore, being comfortable with big data and machine learning tools and platforms, including open-source technologies like Apache Spark, Hadoop, and Kafka, will be advantageous. Strong oral, written, and interpersonal communication skills are crucial for effective collaboration in a dynamic environment with undefined problems.
If you are an inquisitive, proactive individual with a passion for data engineering and a desire to continuously learn and grow, we invite you to join our team in Chennai, Tamil Nadu, India.,
Skills
Big DataPythonEtlData ExtractionData ProcessingMachine LearningData EngineerSqlSenior AnalystAnalystKafkaGCP BigQuerySQLPythonPostgresCloud ComposerGCSCloudSQLHadoopApache SparkGCP DataFlowCloud FunctionsPubSubIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
LatentView helps clients develop and deploy result-oriented analytics solutions that enable them to make smarter decisions using their data, on an ongoing basis.Our solutions help clients improve marketing performance; efficiently trade-off risks against available opportunities, maximize customer value, and increase employee effectiveness.
LatentView combines business domain knowledge in Consumer Lending, Consumer Financial Services, Insurance, Consumer Goods, Retail and Technology industries with expertise in analytics, quantitative modeling, decision management and business research to build practical solutions that deliver long term business value to our clients.
LatentView Analytics Ltd. is one of the world’s largest and fastest-growing digital analytics firms. We help companies drive digital transformation by helping them combine digital and traditional data to gain a competitive advantage. LatentView Analytics provides a 360-degree view of the digital consumer, enabling companies to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates and optimize investment decisions.
We specialize in Predictive Modeling, Marketing Analytics, Big Data Analytics, Advanced Analytics, Web Analytics, Data Science, Data Engineering, Artificial Intelligence, and Machine Learning Applications. We practice transparency and accountability at all levels. Every employee is aware of their responsibility and has access to every leadership level, including the CEO. We encourage our employees to think big and not be limited by current ideas and perspectives. Our long-term vision as a company is to inspire and transform businesses to excel in the digital world by harnessing the power of data and analytics.
Awards and Recognitions
- 3AI ACME Award 2022 for ‘Top Firms to work for in AI and Analytics in 2022’
- Best Blended learning strategy at the L&D Vision & Innovation Awards 2021
- Company recognized 9 consecutive times in Deloitte technology fast 50
- NASSCOM AI Award Winner 2018, AWS: Reinvent Case Study Presentation
- ESOMAR- Winner at 2017 Netherlands Conference
- Forrester: Strong Performer Forrester Wave, Customer Analytics Service Provider, 2019
Important dates & deadlines?
Application Deadline
26 Oct 25, 02:24 PM IST
Similar Jobs
View All
Don't Miss out any Updates
Subscribe now for the latest job alerts
and never miss an update
Senior Analyst - Data Engineering
Share with
