Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
Citi Bank
Assistant Vice President - Data Engineering with Python and PySpark
Citi Bank
Chennai•On-site•8-11 Yrs•2 days ago
Job description
Data EngineeringBig DataPythonPySparkETLMachine LearningData Pipeline
Overview
An intermediate level position responsible for participating in the establishment and implementation of new or revised data platform ecosystems and programs in coordination with the Technology team. Contribute to data engineering scrum teams to implement business requirements.
Responsibilities
- Build and maintain batch or real-time data pipelines in a data platform.
- Maintain and optimize data infrastructure for accurate extraction, transformation, and loading of data from various sources.
- Develop ETL (extract, transform, load) processes to extract and manipulate data from multiple sources.
- Monitor and control all phases of the development process including analysis, design, construction, testing, and implementation.
- Automate data workflows such as data ingestion, aggregation, and ETL processing.
- Analyze large datasets to identify trends, anomalies, and behavioral patterns.
- Apply machine learning and AI concepts (supervised / unsupervised learning) to support predictive and exploratory analysis.
- Perform feature engineering and data transformations to enable ML models.
- Support trend analysis, segmentation, clustering, and forecasting use cases.
- Interpret analytical results and translate them into business-friendly insights.
- Prepare raw data in Data Warehouses into a consumable dataset for technical and non-technical stakeholders.
- Build, maintain, and deploy data products for analytics and data science teams on the data platform.
- Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
- Monitor data systems performance and implement optimization solutions.
Qualifications
- 8-14 years of relevant experience in a Data engineering role.
- Advanced SQL/RDBMS skills with experience in relational databases and database design.
- Strong proficiency in object-oriented languages: Python, PySpark (must).
- Experience working with Bigdata - Hive/Impala/S3/HDFS.
- Experience working with data ingestion tools such as Talend or Ab Initio.
- Solid experience in data analysis, data exploration, and trend identification.
- Strong understanding of machine learning fundamentals like Regression, classification, clustering, and Feature engineering.
- Nice to have: Experience with data lakehouse architecture such as AWS Cloud/Airflow/Starburst/Iceberg.
- Strong proficiency in scripting languages like Bash and UNIX Shell scripting.
- Strong proficiency in data pipeline and workflow management tools.
- Project management and organizational skills.
- Excellent problem-solving, communication, and organizational skills.
- Proven ability to work independently and with a team.
- Demonstrated experience managing and implementing successful projects.
- Ability to adjust priorities quickly as circumstances dictate.
- Consistently demonstrates clear and concise written and verbal communication.
Nice to have
- Experience with AWS Cloud
- Airflow
- Starburst
- Iceberg
- Data lakehouse architecture
Education
- Bachelor’s degree/University degree or equivalent experience.