Data Engineer Level 3 [T500-30154]

Department Icon Data Science Analytics & Machine Learning
Posted: 2 weeks ago
2-5 years
Hyderabad, Telangana, India
Data Science Analytics & Machine Learning
work from office
Full Time
Closes 1 Jan 2027

Posted: 2 weeks ago
Let Jobaaj One apply for you

An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.

Job Description
About Company
Similar Jobs
Please verify your account first! Send OTP

Job Description

About the job About Costco Wholesale: Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members. About Costco Wholesale India: At Costco Wholesale India, we foster a collaborative space, working to support Costco Wholesale in developing innovative solutions that improve members’ experiences and make employees’ jobs easier. Our employees play a key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale. Position Title: Data Engineer. Role Summary: The Data Engineer is responsible for developing data pipelines and/or data integrations of for Costco’s enterprise certified data sets that are used for business-critical data consumption use cases (i.e. Reporting, Data Science/Machine Learning, Data APIs, etc.). The Data Engineer will partner with product owners, data architects, and data platform teams to design, build, test, and automate data pipelines that are relied upon across the company as the single source of truth. Roles & Responsibilities: Develops and operationalizes data pipelines to bring data into Costco’s GCP landscape for the delivery of certified data sets. Works in tandem with Data Architects, Data Stewards, and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration. Designs, develops, and implements ETL/ELT/CDC processes using Data Build Tool (DBT) and other native GCP Services (BigQuery Subscriptions, Dataproc, Dataflow, etc.). Uses GCP services such as BigQuery, AlloyDB, Spanner, Dataplex, Pub/Sub, Cloud Storage, etc. to improve and speed delivery of our data products and services. Identifies, designs, and implements internal process improvements: automating manual processes, optimizing pipeline delivery and support. Identifies ways to improve data reliability, efficiency, and quality of data management. Participate in off hours 24/7 on call support on a rotational basis. Experience Required: 8 - 12 years. Minimum Qualifications: 8+ years’ experience engineering and operationalizing data pipelines with large and complex datasets. 8+ years’ hands-on experience with Data Build Tool (DBT), Dataflow & Dataproc (Spark). 8+ years’ experience working with BigQuery, Google Cloud Storage, AlloyDB and Spanner. 8+ years’ experience with Data Pipeline, ETL/ELT, and Data Warehousing. Effective use of AI and/or LLMs to increase efficiency in deliverables. Extensive experience working with various data sources (DB2, SQL,Oracle, flat files (csv, delimited), APIs, XML, JSON). Experience implementing data integration techniques such as event/message based integration (Kafka, Google Pub/Sub). Advanced SQL skills; solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources. Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing). Experience with Git / Azure DevOps / Jira. CDMP (Certified Data Management Professional) Certification.

Skills

SQLNoSQLMachine LearningData ScienceKafkaDbtBigQueryETLData WarehousingOracleAzureGoogle CloudGCPDevOpsGit

If a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.

About Company

Costco Wholesale Corporation operates a chain of membership warehouses that carry a large variety of top-quality, nationally known brand-name merchandise at lowest possible prices.

Similar Jobs

View all
Loading...

Looking for something similar?

Bag Logo
Jobaaj
Get jobs like this by email

New Data Science Analytics & Machine Learning roles in Hyderabad.

Job Alert
Google hiring for Specific Roles Apply Now!
1 min ago
New Opportunity
Amazon is hiring freshers Apply Now!
5 min ago
Featured Jobs
Microsoft opening 50+ positions Apply Now!
10 min ago

One email a day. Unsubscribe any time.