Software Engineer - Data Engineering

Career Area:

:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.  We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

JOB DUTIES:   

As a Software Engineer you will contribute to development and deployment of Caterpillar’s state-of-the-art digital platform.  

Competent to perform all programming and development assignments without close supervision; normally assigned the more complex aspects of systems work.  Design and implement end-to-end near real-time data movement solutions. Works independently on complex systems or infrastructure components that may be used by one or more applications or systems.  Drives application development focused around delivering business valuable features  Maintains high standards of software quality within the team by establishing good practices and habits.  Identifies and encourage areas for growth and improvement within the team.  Mentor junior developers fostering a culture of technical excellence, collaboration, and continuous learning. Communicate with end users and internal customers to help direct development, debugging, and testing of application software for accuracy, integrity, interoperability, and completeness.  Performs integrated testing and customer acceptance testing of components that requires careful planning and execution to ensure timely, quality results. 

The position manages the completion of its own work assignments and coordinates work with others.  Based on past experiences and knowledge, the incumbent normally works independently with minimal management input and review of end results. 

Typical customers include Caterpillar customers, dealers, other external companies who purchase services offered by Caterpillar as well as internal business unit and/or service centre groups.  The position is challenged to quickly and correctly identify problems that may not be obvious. The incumbent solves problems by determining the best course of action, within departmental guidelines, from many existing solutions. The incumbent sets priorities and establishes a work plan in order to complete broadly defined assignments and achieve desired results. The position participates in brainstorming sessions focused on developing new approaches to meeting quality goals in the measure(s) stated. 

Basic qualifications: 

• Position requires a four-year degree from an accredited college or university. 

• 5+ years or more of software development experience or at least 3 years of experience with master’s degree in computer science or related field. 

• 5+ years or more of experience in designing and developing Data Pipelines in Python 

• Top candidates will also have: 

• Proven experience in many of the following, 

• Designing, developing, deploying and maintaining software at scale, with good understanding of concurrency. 

• Working experience in Python as an Object Oriented programming language 

• In-Depth understanding of how Data pipelines work in Big Data 

• Expertise and experience in building Large Data Lakes and Data Warehouse (Snowflake Preferred). 
• Expertise in building end-to-end near real-time data pipelines for OLTP & OLAP.
• Strong architecture exposure for building robust Data Platforms

• Expertise in SQL and NO-SQL databases 

• Message brokers and other AWS services such as Kafka/Kinesis, AWS SQS, AWS SNS, Lambda, API Gateway, DynamoDB, Aurora, AWS RDS PostgreSQL.  

• Deploying software using CI/CD tools such as Azure Devops(Preferred), Jenkins, GoCD, AWS CloudFormation, etc.  

• At least 2+ plus years of deploying and maintaining software using public clouds such as AWS or Azure. 
• Good understanding of AI concepts and latest developments (Gen AI, MCP, ATA, etc.).
• Test driven development and behaviour driven development. 

• Strong analytical skills. 
• Must demonstrate solid knowledge of computer science fundamentals like data structures and algorithms and object-oriented design. 
• Ability to work under pressure and within time constraints. 
• Passion for technology and an eagerness to contribute to a team-oriented environment. 
• Demonstrated leadership on medium to large-scale projects impacting strategic priorities. 
• Bachelor’s degree in Computer science or Electrical engineering or related field is required. 

Caterpillar is an Equal Opportunity Employer (EEO). 

Posting Dates:

Caterpillar is an Equal Opportunity Employer.  Qualified applicants of any age are encouraged to apply

Not ready to apply? Join our Talent Community.