Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Caterpillar
Software Engineer - Data Engineering
Caterpillar
Chennai•On-site•5-8 Yrs•3 days ago
Job description
Overview
Career Area: Technology, Digital and Data
Qualifications
- Position requires a four-year degree from an accredited college or university.
- 5+ years or more of software development experience or at least 3 years of experience with master’s degree in computer science or related field.
- 5+ years or more of experience in designing and developing Data Pipelines in Python
- Top candidates will also have:
- Proven experience in many of the following,
- Designing, developing, deploying and maintaining software at scale, with good understanding of concurrency.
- Working experience in Python as an Object Oriented programming language
- In-Depth understanding of how Data pipelines work in Big Data
- Expertise and experience in building Large Data Lakes and Data Warehouse (Snowflake Preferred).
- Expertise in building end-to-end near real-time data pipelines for OLTP & OLAP.
- Strong architecture exposure for building robust Data Platforms
- Expertise in SQL and NO-SQL databases
- Message brokers and other AWS services such as Kafka/Kinesis, AWS SQS, AWS SNS, Lambda, API Gateway, DynamoDB, Aurora, AWS RDS PostgreSQL.
- Deploying software using CI/CD tools such as Azure Devops(Preferred), Jenkins, GoCD, AWS CloudFormation, etc.
- At least 2+ plus years of deploying and maintaining software using public clouds such as AWS or Azure.
- Good understanding of AI concepts and latest developments (Gen AI, MCP, ATA, etc.).
- Test driven development and behaviour driven development.
- Strong analytical skills.
- Must demonstrate solid knowledge of computer science fundamentals like data structures and algorithms and object-oriented design.
- Ability to work under pressure and within time constraints.
- Passion for technology and an eagerness to contribute to a team-oriented environment.
- Demonstrated leadership on medium to large-scale projects impacting strategic priorities.
- Bachelor’s degree in Computer science or Electrical engineering or related field is required.