Job Information
Randstad US machine learning operations (mlops) engineer in hollywood, Florida
machine learning operations (mlops) engineer.
hollywood , florida (remote)
posted 2 days ago
job details
summary
$80 - $80.01 per hour
contract
postgraduate degree
category computer and mathematical occupations
reference1056892
job details
job summary:
Generative AI science will develop Gen AI solutions, fine-tune and build Gen AI models, and help enterprise functions leverage these models to power end applications. This role will partner closely with other data science and ML teams, digital and product teams, data analytics teams, engineering, and business functions across the organization to drive the development and implementation of innovative Gen AI models and systems.
location: Hollywood, Florida
job type: Contract
salary: $80.00 - 80.01 per hour
work hours: 8am to 4pm
education: Masters
responsibilities:
Responsibilities:
LLM-Optimized MLOps Infrastructure: Design and implement MLOps infrastructure on AWS tailored for LLMs, leveraging services like SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and more.
LLM Deployment Pipelines: Build and manage CI/CD pipelines specifically for LLM deployment, addressing unique challenges like model size, inference optimization, and versioning.
LLMOps Practices: Implement LLMOps best practices for monitoring model performance, drift detection, prompt management, and feedback loops for continuous improvement.
RESTful API Development: Design and develop RESTful APIs to expose LLM capabilities to other applications and services, ensuring scalability, security, and optimal performance.
Model Optimization: Apply techniques like quantization, distillation, and pruning to optimize LLM models for efficient inference on AWS infrastructure.
Monitoring and Observability: Establish comprehensive monitoring and alerting mechanisms to track LLM performance, latency, resource utilization, and potential biases.
Prompt Engineering and Management: Develop strategies for prompt engineering and management to enhance LLM outputs and ensure consistency and safety.
Collaboration: Work closely with data scientists, researchers, and software engineers to integrate LLM models into production systems effectively.
Cost Optimization: Continuously optimize LLMOps processes and infrastructure for cost-efficiency while maintaining high performance and reliability.
Qualifications:
Experience: 3+ years of experience in MLOps or a related field, with hands-on experience in deploying and managing LLMs.
AWS Expertise: strong proficiency in AWS services relevant to MLOps and LLMs, including SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and API Gateway.
LLM Knowledge: Deep understanding of LLM architectures (e.g., Transformers), training techniques, and inference optimization strategies.
Programming Skills: Proficiency in Python and experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation), REST API frameworks (e.g., Flask, FastAPI), and LLM libraries (e.g., Hugging Face Transformers).
Monitoring: Familiarity with monitoring and logging tools for LLMs, such as Prometheus, Grafana, and CloudWatch.
Containerization: Experience with Docker and container orchestration (e.g., Kubernetes, ECS) for LLM deployment.
Problem Solving: Excellent problem-solving and troubleshooting skills in the context of LLMs and MLOps.
Communication: strong communication and collaboration skills to effectively work with cross-functional teams.
qualifications:
Experience level: Experienced
Minimum 7 years of experience
Education: Masters
skills:
- GenAIEqual Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).Applications accepted on ongoing basis until filled.