M
Mitratech Holdings

Senior Infrastructure Engineer - AI/ML

Germany - Remote Remote Posted 2026-05-26
Type
Full-time
Experience
5+ yr
Source
Greenhouse
At Mitratech, we are a team of technocrats focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions. We are a close-knit, globally dispersed team that thrives in an ecosystem that supports individual excellence and takes pride in its diverse and inclusive work culture centered around great people practices, learning opportunities, and having fun! Our culture is the ideal blend of entrepreneurial spirit and enterprise investment, enabling the chance to move at a rapid pace with some of the most complex, leading-edge technologies available.For over 35 years, the experts at Mitratech have been focused on solving the complex needs. Today, we serve 20,000 client companies of all sizes globally, representing 30% of the Fortune 500 and over 500,000 users in over 160 countries.As we continue to grow, we’re always looking for resourceful, enthusiastic, and fresh perspectives. Join our global team and see what makes Mitratech a truly exceptional place to work!
Given our continued growth, we always have room for more intellect, energy, and enthusiasm - join our global team and see why it's so special to be a part of Mitratech!
Job Overview 

We are seeking a highly skilled Senior Software Engineer specializing in Machine Learning, with a focus on Natural Language Processing (NLP), to join our dynamic team. The ideal candidate will play a pivotal role in understanding business objectives and leveraging machine learning models to meet these goals effectively. This position requires a blend of expertise in data science and software engineering, along with a passion for staying at the forefront of machine learning advancements.

Responsibilities




Design, deploy, and maintain  scalable and secure infrastructure  supporting AI and ML workloads.



Build and maintain  AWS cloud environments  for compute (EC2, ECS/EKS, Lambda), storage (S3, EFS, FSx), and networking (VPC, Transit Gateway, PrivateLink, Route 53, load balancers).



Implement  security best practices  using IAM, KMS, Secrets Manager, GuardDuty, and Security Hub.



Support and optimize  AI/ML workloads  across AWS services (SageMaker, Bedrock, Batch, Step Functions).



Develop and maintain  Infrastructure as Code (IaC)  using Terraform, AWS CDK, and CloudFormation.



Manage  containerized workloads  and orchestration platforms (Docker, EKS, Fargate), including GPU scheduling and scaling.



Set up and maintain  monitoring and observability  frameworks using CloudWatch and OpenTelemetry.



Build and manage  CI/CD pipelines  (CircleCI, GitHub Actions, GitLab CI) for infrastructure automation and ML/Gen AI deployments.



Collaborate with  ML and Generative AI teams  to scale models, optimize performance, and design efficient prompt or inference pipelines.



Develop  runbooks  and  SOPs  for AI service deployment, troubleshooting, and performance optimization.



Ensure  security, compliance, and data protection  across AI datasets and environments.


Required Skills & Experience



Strong proficiency in  Linux administration  and systems-level troubleshooting.



Deep expertise in  AWS cloud services , with experience in compute, storage, networking, and security domains.


• Proficiency in  container orchestration  (Kubernetes/EKS) and  infrastructure automation  tools.


Hands-on experience with  IaC tools  such as Terraform, AWS CDK, or CloudFormation.



Familiarity with  monitoring, logging, and observability  stacks (Prometheus, Grafana, OpenTelemetry).



Experience implementing  CI/CD pipelines  for automated deployment and testing.



Understanding of  AI/ML concepts , including model deployment, inference scaling, and LLM performance tuning.



Working knowledge of  security best practices , IAM roles, encryption, and compliance controls.



Excellent  collaboration and communication  skills to partner with ML engineers, data scientists, and product teams.


Education:                         


• A Master’s degree in Machine Learning, Computer Science with a preference for specialization in the NLP domain.

We are an equal-opportunity employer that values diversity at all levels. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity, disability, or veteran status.
AWSTerraformDockerKubernetesLLMEKS
Mitratech Holdings is hiring for the senior infrastructure engineer - ai/ml role. NewJob aggregates active openings directly from Mitratech Holdings's applicant tracking system, so this listing is current. More jobs at Mitratech Holdings →
Apply on company site