WebSenor InfoTech
Create a free account
One signup unlocks everything for this job:
- Apply to this job and track your application
- See your personalized profile match score
- Generate an AI cover letter for this role
Noida · Hybrid · 4-7 Yrs · Aug 30
Information Technology Support Services · 51 to 200 Employees · Udaipur, India
Hiring: Engineering
What employees say
+ Good exposure of hr recurring, onboarding ,attendance management
− They don't give 5 days week no fun Friday
More reviews on the company profile.
Interview experience · QA Internship
The interview was quite solid and well-structured. Most of the questions were based on my resume, previous project experience, and overall background, along with a basic QA knowledge assessment. There were also a few sce
Average difficulty · Udaipur, Rajasthan · 11 reports
More interview insightsJob description
Overview
Job Title: Big Data Engineer (EL3)
Responsibilities
- Design, develop, and optimize highly scalable, rule-based data validation engines capable of validating data across multiple data pipelines.
- Build and maintain high-performance big data pipelines using Scala, PySpark, AWS, and AWS Glue.
- Develop clean, efficient, and well-tested code while utilizing optimized data formats such as Parquet for high-performance storage and retrieval.
- Perform data validation, profiling, and quality assessments to ensure consistency and accuracy across enterprise data systems.
- Leverage enterprise-approved AI coding assistants and code-generation tools to improve software development efficiency and automate repetitive tasks.
- Collaborate with business stakeholders and cross-functional engineering teams to translate business requirements into scalable technical solutions.
- Evaluate emerging big data technologies and AI-driven engineering practices to enhance platform capabilities.
- Participate in code reviews, testing, debugging, and performance tuning to ensure high-quality software delivery.
- Continuously optimize data processing performance, scalability, and reliability across distributed systems.
Qualifications
- Employment Type: Full-Time
- Job Summary
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- 4+ years of software engineering experience developing big data pipelines.
- 3+ years of hands-on programming experience in Scala and PySpark.
- 3+ years of experience building big data solutions on AWS.
- Strong experience with AWS Glue for ETL development.
- At least 1 year of experience in data validation, data profiling, or building rule-based data validation engines.
- Scala
- PySpark
- Apache Spark
- AWS
- AWS Glue
- Parquet
- ETL Development
- Data Validation
- Data Profiling
- Big Data Pipelines
- Distributed Data Processing
- SQL
- Git
- AI Coding Assistants (GitHub Copilot, Codex, etc.)
- Knowledge of data quality frameworks and governance practices.
- Strong analytical and problem-solving abilities.
- Familiarity with CI/CD pipelines and software engineering best practices.
- Excellent communication and collaboration skills.
Benefits
- Opportunity to work on enterprise-scale big data platforms.
- Exposure to AI-assisted software development practices.
- Collaborative and innovation-driven work environment.
- Career growth with modern cloud and big data technologies.
- Competitive compensation and benefits package.
Verify Engineering for this role
Free PRACTICE for Engineering adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Engineering free →Want match scores and deeper insight? Create a free candidate profile