Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Southwest Airlines
Data Engineer – AI Ops
Southwest Airlines
Hyderabad•On-site•2-5 Yrs•4 days ago
Job description
Overview
Department: Technology
Responsibilities
- Assemble large, complex sets of data that meet non-functional and functional business requirements
- Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
- Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
- Work with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
- Work with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
- Generate or adapt equipment and technology to serve user needs
- May perform other job duties as directed by Employee's Leaders
- Knowledge of the practical application of engineering science and technology, including applying principles, techniques, procedures, and equipment to the design and production of various goods and services
- Knowledge of design techniques, tools, and principles involved in production of precision technical plans, blueprints, drawings, and models
- Ability to use logic and reasoning to identify the strengths and weaknesses of alternative solutions, conclusions or approaches to problems
- Ability to understand new information for both current and future problem-solving and decision-making
- Skilled in identifying complex problems and reviewing related information to develop and evaluate options and implement solutions
- Ability to recognize when an issue has occurred or is likely to occur, without needing to diagnose or resolve the problem.
- Ability to combine pieces of information to form general rules or conclusions (includes finding a relationship among seemingly unrelated events)
- Ability to switch efficiently between multiple tasks or information sources, such as spoken instructions, system alerts, or data inputs.
- Ability to organize data or actions in a defined sequence or structure based on specified rules or patterns (e.g., numerical, textual, visual, or mathematical sequences).
- Ability to recognize defined patterns—such as shapes, words, or signals—even when they are embedded within distracting or complex information.
- Knowledge, Skills and Abilities
Qualifications
- Required: Intermediate level experience, fully functioning broad knowledge in Cloud infrastructure, DataLake
- 2-5 years of relevant work-related experience
- ETL experience ensuring source to target data integrity
- Various filetypes (Delimited Text, Fixed Width, XML, JSON, Parque).
- ServiceBus, setting up ingress and egress within a subscription, or relevant AWS Cloud services administrative experience.
- Unit Testing, Code Quality tools, CI/CD Technologies, Security and Container Technologies
- Agile development experience and Agile ceremonies and practices
- 3+ years of experience in data engineering—ETL/ELT, SQL, Python
- 3+ years of experience with SQL, Python, and at least one orchestrator (Airflow/Glue/Step Functions)
- 1+ years of experience with data quality checks, schema validation, basic data observability
- 2+ years of experience with AWS data services—Glue, S3, Athena, basic Kinesis
- 2+ years of experience with Git, CI/CD, automated testing for data pipelines
- Preferred experience:
- Spark or Databricks exposure
- Exposure to data contracts or governance tooling
- Lakehouse formats (Iceberg, Delta, Hudi)
- Exposure to RDS and NoSQL DBs (Pinecone, OpenSearch, pgvector)
- Streaming basics—Kafka or Kinesis
- Infrastructure as Code (IaC) - Terraform
- Must meet confidentiality expectations as to confidential, proprietary and sensitive Company information
- Ability to work extended hours as needed
Education
- Required: Bachelor's degree in Computer Science, Engineering, Information Systems or related field and/or equivalent formal training