Tata Consultancy Services
Create a free account
One signup unlocks everything for this job:
- Apply to this job and track your application
- See your personalized profile match score
- Generate an AI cover letter for this role
Pune · On-site · 3-5 Yrs · Aug 28
Software Development · 10000+ Employees · Mumbai, India
Hiring: Engineering
What employees say
+ Good work life balance and nice work environment.
− Low hike not more than 7%
More reviews on the company profile.
Interview experience · Data Analyst
2 rounds. 1st round technical power bi and sql like cumulative total. What data sources you used. few scenario based questions, remove duplicate in sql. Optimization of slow performing report
Average difficulty · India · 22,544 reports
More interview insightsJob description
Overview
Greetings from TCS!!!
Responsibilities
- Design and implement distributed data processing on AWS EMR using PySpark for batch/stream workloads.
- Build robust, scalable ETL/ELT pipelines integrating diverse data sources (files, RDBMS, APIs, streaming).
- Optimize Spark jobs (partitioning, caching, broadcast joins), and tune EMR clusters (instance types, autoscaling, bootstrap actions).
- Implement data lake patterns on S3 with appropriate file formats (Parquet/ORC), schema evolution, and table management.
- Orchestrate workflows using AWS Step Functions, Airflow, or EMR managed workflow, and automate CI/CD.
- Ensure cost governance (spot instances, right-sizing, scaling policies) and observability (CloudWatch, Spark metrics).
- Enforce security & compliance (IAM, KMS, encryption at rest/in transit, VPC, SGs, Glue Catalog access controls).
- Collaborate with analytics teams to expose curated datasets to Redshift, Athena, Glue, or downstream BI tools.
- Troubleshoot performance bottlenecks and production issues; implement resiliency patterns and SLAs.
- Document architecture, standards, runbooks; mentor junior engineers.
- AWS Lambda
- Managed Airflow (MWAA)
- AWS S3
- AWS Glue
- Amazon Redshift
- Amazon EMR
- Snowflake
- Python
- PySpark
- SQL
- ETL / ELT Development
- Data Lake Architecture
- AWS Step Functions
- CI/CD Pipelines
Verify Python for this role
Free PRACTICE for Python adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Python free →Want match scores and deeper insight? Create a free candidate profile