Job Specifications
Position description Category
Engineering science
Contract
Internship
Job title
Internship in AI optimisation for Master's degree or engineering degree M/F
Subject
Fully Quantized Vision Transformers: Integer-Only Architecture for Object Detection
Contract duration (months)
6
Job Description
The French Alternative Energies and Atomic Energy Commission (CEA) is a leading research and innovation organization active in three major fields: energy, information and health technologies, and defense. Within the CEA, the Laboratory for Systems and Technology Integration (LIST), located in Saclay (Ile-de-France), drives technology transfer and innovation in embedded systems. The Embedded Artificial Intelligence Laboratory (LIAE) specializes in designing optimized AI solutions for embedded environments, with a focus on efficiency in surface, power consumption, and computing performance.
Vision Transformers (ViTs) have recently demonstrated superior performance over Convolutional Neural Networks (CNNs) in a wide range of computer vision tasks. Their strong representational capacity, however, comes at the price of significantly higher computational complexity and memory requirements. This poses a major challenge for deploying ViT-based models on resource-constrained devices such as mobile or embedded systems. To address this issue, our lab is actively exploring quantization techniques, which allow efficient inference by constraining all operations, including matrix multiplications and activations, to integer arithmetic. This line of research has already led to promising results in semantic segmentation with the development of the I-Segmenter [1], a fully quantized ViT framework that achieves competitive accuracy while drastically reducing the inference cost.
Internship Objective
The objective of this internship is to extend our ongoing work on ViTs by incorporating object detection. The project will first focus on quantizing a detection head, such as RT-DETR [2,3], in order to ensure its compatibility with an integer-only ViT encoder. The next step will be to integrate the quantized segmentation and detection heads into a unified integer-only multi-task ViT capable of handling both tasks simultaneously. Finally, the proposed system will be evaluated on PyTorch and TVM backends, with performance measured in terms of accuracy using mean Average Precision (mAP), as well as efficiency using throughput (FPS), parameter count, and computational cost (MACs).
Expected Outcomes
A proof-of-concept implementation of a fully quantized multi-task ViT for segmentation and detection.
Comparative benchmarks against mixed-precision or floating-point baselines.
Results with potential for inclusion in a scientific publication.
References:
[1] J. Sassoon, M. Szczepanski, and M. Poreba. 2025. I-Segmenter: Integer-Only Vision Transformer for Efficient Semantic Segmentation (under review)
[2] Y. Zhao, W. Lv, S. Xu, J. Wei, G. Wang, Q. Dang, Y. Liu, and J. Chen. DETRs Beat YOLOs on Real-time Object Detection.
[3] W. Lv, Y. Zhao, Q. Chang, K. Huang, G. Wang, and Y. Liu. RT-DETRv2
#AI #IA #edgeAI #edgeIA #ViT #CNN #Vision #VisionTransformer #detection #objectdetection #RT-DETR #quantization #integer #optimisation
Applicant Profile
Requested profile: Master degree (BAC+5) in Computer Science, Applied Mathematics, or related field.
Qualification: Strong knowledge of deep learning (CNNs, VIT) and PyTorch. Good programming skills in Python (C++ is a plus). Interest in efficient AI, embedded systems, or model quantization.
To apply: resume + cover letter + marks and ranking for the three previous academic years
Position location Site
Saclay
Job location
France, Ile-de-France, Essonne (91)
Location
2 Bd Thomas Gobert, 91120 Palaiseau
Candidate criteria Languages
English (Intermediate)
Prepared diploma
Bac+5 - Master 2
Recommended training
Computer Science, Applied Mathematics, or related field
PhD opportunity
Oui
Requester Position start date
31/01/2026
About the Company
The CEA is the French Alternative Energies and Atomic Energy Commission ("Commissariat à l'énergie atomique et aux énergies alternatives"). It is a public body established in October 1945 by General de Gaulle. A leader in research, development and innovation, the CEA mission statement has two main objectives: To become the leading technological research organization in Europe and to ensure that the nuclear deterrent remains effective in the future.
The CEA is active in four main areas: low-carbon energies, defense and secur...
Know more