Confidential
Create a free account
One signup unlocks everything for this job:
- See your personalized profile match score
- See the skills this role is missing for you
- Apply to this job and track your application
- Generate an AI cover letter for this role
Anywhere · Remote · 3-5 Yrs · 23 hours ago
Unknown · Sydney, Australia
Hiring: Engineering, Sales, Customer support and operations, Finance and accounts
What employees say
+ Great opportunities and best team to work with
− Work life balance was a concern at some time
More reviews on the company profile.
Interview experience · Software Engineer
3 rounds 1 intro , projects : 30 mins deep dive into projects , background etc 2DSA : one hour discusssion on 2 dsa problems and sql query 3 company fit round
Average difficulty · Indore · 56 reports
More interview insightsJob description
Overview
About TaskUs: TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands.
Responsibilities
- TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands. Leveraging a cloud-based infrastructure, TaskUs serves clients in the fastest-growing sectors, including social media, e-commerce, gaming, streaming media, food delivery, ride-sharing, HiTech, FinTech, and HealthTech.
- Build and maintain high-throughput ETL/ELT pipelines that ingest data from various sources into our Lakehouse.
- Drive the adoption of dbt for transformation and PySpark for heavy lifting. You will be responsible for writing modular, reusable code that follows strict CI/CD practices.
- Work closely with the BI team and Data Scientists to prepare "feature-ready" datasets.
- Deep-dive into SQL and Spark query plans to optimize slow-running jobs, reducing cost and latency.
- Implementing a workflow where engineers can develop and test complex SQL transformations locally using DuckDB, drastically reducing "waiting-for-cluster" time and lowering development costs.
- Exploring ways to use DuckDB as an embedded engine for internal tools or "edge" processing within the BPO's local site offices where bandwidth to the cloud might be a constraint.
Benefits
- 5+ Years in Data Engineering: You've lived through the "on-call" life and know how to build systems that don't break at 3 AM.
- The Power Trio: Expert-level proficiency in Python , SQL , and PySpark .
- Hands-on experience with Databricks (Delta Lake) or Snowflake . You understand the nuances of the Medallion Architecture (Bronze/Silver/Gold).
- Transformation & Modeling: Advanced experience with dbt (Data Build Tool) . You treat data models like software, including version control, testing, and documentation.
- Experience with Apache Airflow or Prefect, specifically building complex, idempotent DAGs.
- Streaming Experience: Familiarity with Kafka , Kinesis , or Spark Streaming is a huge plus-our BPO operations move in real-time.
- Infrastructure as Code (IaC): Comfort with Terraform or CloudFormation to manage your own data infrastructure.
- In-Process Analytics (DuckDB): Proven experience using DuckDB for high-speed local development, unit testing data transformations, or as a query engine for "small-to-medium" datasets (up to 100GB) without the overhead of a distributed cluster.
- Hybrid Execution Patterns: Ability to identify when to use heavyweight compute (PySpark/Databricks) versus lightweight compute (DuckDB/Python) to minimize cloud costs and reduce job latency.
- Experience using DuckDB to directly query data stored in S3/Azure Blob (via Parquet or Iceberg files) for rapid ad-hoc analysis or local dashboarding.
- Kubernetes (K8s) . Deep understanding of Pods, Deployments, Services, ConfigMaps, and Secrets management.
Verify Software Engineer for this role
Free PRACTICE for Software Engineer adds a verified skill signal that can boost how roles like this rank for you — optional, not required to browse or apply.
Sign up — verify Software Engineer free →Want match scores and deeper insight? Create a free candidate profile
Job application FAQ
Last updated 5 November 2026
- How do I apply for Senior Data Engineer - Remote or Hybrid at Confidential?
- Open this job on Feedback AI and sign up free (or sign in). You can apply from the job detail page; match scores and skill gaps appear when your profile is complete. Confidential may attach structured assessments to interview rounds after you apply.
- Does Feedback AI show a match score for this Senior Data Engineer - Remote or Hybrid role?
- Yes after you add a resume or skills. Match score ranks this role against your profile — skills met, gaps, level, and location — so you prioritise applications where fit is strongest.
- Is Senior Data Engineer - Remote or Hybrid remote or on-site in Anywhere?
- This listing is marked remote with location Anywhere. Confirm details on the job description before applying.
- What skills matter for this Senior Data Engineer - Remote or Hybrid role at Confidential?
- This is a senior Senior Data Engineer - Remote or Hybrid role. Key skills include skills listed in the job description. Feedback AI highlights matched vs missing skills on your profile after signup.