Browse Jobs
Explore open roles across India.Explore active software roles. Sign up to apply and get AI match scores.
Top MatchesTop Job Matches
Loading jobs…
Back to Browse Jobs
NYU Langone
Sr. AI Engineer
NYU Langone
New York•Remote•1-4 Yrs•2 hours ago
Job description
Remote
Overview
NYU Grossman School of Medicine is one of the nation's top-ranked medical schools.
Responsibilities
- Design and implement MLOps/LLMOps pipelines to deploy, monitor, and manage large language models in production healthcare environments, following software engineering best practices and team standards.
- Collaborate with data scientists to deploy and/or fine-tune high-performing Generative AI models (e.g., for summarization, triage, patient messaging) and apply modern techniques from relevant published work where appropriate.
- Develop scalable and robust data and ML pipelines for ingestion, preprocessing, validation, training, evaluation, and model deployment across the RPM ecosystem.
- Implement monitoring and observability for AI applications, including tracking performance metrics, latency, model drift, safety indicators, and data quality; maintain model versioning and experiment tracking using tools such as MLflow or Kubeflow.
- Evaluate and recommend AI tools and frameworks to meet clinical and operational requirements, including decisions around retrieval-augmented generation (RAG), vector databases, embedding models, and LLM providers, balancing compliance, performance, and cost.
- Optimize inference performance and cost efficiency through techniques such as model quantization, batching, caching, and effective resource allocation; leverage containerization and orchestration tools (Docker, Kubernetes) for scalable, reproducible deployments.
- Implement internal security and data protection standards in AI applications; ensure HIPAA compliance and adherence to institutional governance for PHI; assist with emerging AI risk, safety, and security controls.
- Support the team in preparation for technical reviews and internal documentation (architecture, IT Security, AI), including design documents, runbooks, and operational procedures.
- Collaborate with other team members and stakeholders to meet team objectives; partner with clinicians and product stakeholders to understand workflows, gather feature requirements, identify and document AI opportunities, create appropriate tickets, participate in backlog refinement, execute tickets, and engage in code-review activities.
- Integrate CI/CD practices for AI applications to enable reliable, automated testing, deployment, and rollback in cloud environments.
- Stay updated with the latest industry trends and advancements in Generative AI, LLMOps, and relevant cloud technologies; routinely share and demonstrate learnings with the team.
- Provide technical guidance and coaching to less experienced team members; contribute to standards, reusable components, and best practices for AI development and operations.
- Participate in all phases of the AI software development life cycle, including functional analysis, prototyping, development, evaluation, testing, deployment, refactoring, and technical support.
- Performs other duties as assigned.
Qualifications
- At least 1-3 years of hands-on experience in AI Solution development
- Strong programming skills in Python, or other languages commonly used in AI development.
- Substantial knowledge of AI, machine learning, and deep learning
- Experience with AI platforms like PyTorch or TensorFlow
- Experience with building large-scale and/or compute-intensive applications on clusters for data engineering, model training and evaluation (HPC, Spark, Kubernetes)
- Understanding of software development principles and methodologies, including data structures, data modeling and software architecture.
- Excellent problem-solving skills and ability to work in a team environment.
- Excellent communication skills, both verbal and written.
- Practical experience implementing retrieval-augmented generation (RAG), semantic search, and embedding models; knowledge of vector databases.
- Qualified candidates must be able to effectively communicate with all levels of the organization.
- NYU Grossman School of Medicine is an equal opportunity employer and committed to inclusion in all aspects of recruiting and employment. All qualified individuals are encouraged to apply and will receive consideration. We require applications to be completed online.
- View Know Your Rights: Workplace discrimination is illegal.
- NYU Langone Health provides a salary range to comply with the New York state Law on Salary Transparency in Job Advertisements. The salary range for the role is $97,589.96 - $140,000.00 Annually. Actual salaries depend on a variety of factors, including experience, specialty, education, and hospital need. The salary range or contractual rate listed does not include bonuses/incentive, differential pay or other forms of compensation or benefits.
- To view the Pay Transparency Notice, please click here
Nice to have
- Masters degree in computer science, data science, biomedical informatics, software engineering, or a related quantitative discipline.
- 35 years of hands-on experience delivering production AI solutions, including LLM-based applications.