About this role
We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.
Responsibilities:
• Compress and optimize large language and vision models for on-device inference.
• Develop pipelines for model distillation and hardware-specific compilation.
• Benchmark performance across various NPU/GPU architectures.
Qualifications:
• Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
• Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
• Strong C++ and Python skills.
Responsibilities:
• Compress and optimize large language and vision models for on-device inference.
• Develop pipelines for model distillation and hardware-specific compilation.
• Benchmark performance across various NPU/GPU architectures.
Qualifications:
• Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
• Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
• Strong C++ and Python skills.
Tech stack
PythonC++
About Hyphen Connect Limited
Hyphen Connect Limited is hiring for the ai specialist role. NewJob aggregates active openings directly from Hyphen Connect Limited's applicant tracking system, so this listing is current.
More jobs at Hyphen Connect Limited →