Job Specifications
Role - Python Engineer
Job Description
seeking a Senior Staff Engineer who specializes in building large-scale, cloud-based big data and MLOps platforms and APIs to access timely, accurate, and relevant data. An ideal candidate would have built scalable platforms that can easily accommodate and integrate different data sources and provide comprehensive data capabilities to all Experian products and delivery channels.
Responsibilities
Partners with Architecture/Product/CloudOps/Engineering teams to craft highly scalable, flexible and resilient cloud architectures that address customer business problems and accelerate the adoption of cloud services.
Designs and implements complex architectural solutions using AWS design principles, best practices, and industry standards.
Build scalable, reliable, and cost-efficient ML pipelines using Python, AWS services (SageMaker, Lambda, Step Functions, S3, ECR, etc.), and container technologies (Docker, ECS/Fargate).
Lead technical design reviews, guide engineering teams on architectural best practices, and create high-level and low-level design documents.
Determines code quality and test coverage, designs and implements tests to make sure software is built to the highest quality possible.
Communicate and explain technical/architectural decisions to product, development, and delivery teams
Drive continual improvement in quality and efficiency, including defect prevention/root cause analysis, as well as suggest and adopt improvements to technology and efficiency.
Perform proof of concept work for integrating new technologies into the existing product.
Ability to comprehend detailed project specifications, as well as the ability to adapt to various technologies and simultaneously work on multiple projects.
Participates in reviews of software engineers’ code to deliver high-quality solutions.
Work closely with the product and actively participate in business requirement analysis.
Lead and mentor junior members of the team.
Research and implement performance tuning and enhancements to existing and newly developed systems to gain the most performance from the existing Infrastructure.
Key Qualifications:
BS in Computer Science or related fields; MS preferred
8+ years’ experience in key engineering roles, such as technical lead, software engineer, and software architect.
5+ years’ experience using Amazon Web Services (AWS) to architect and deploy reliable, cost-effective, scalable, and secure cloud native solutions. Experience working in an agile / scrum environment
Deep understanding of cloud computing technologies and workload transition challenges, knowledge of AWS Well-Architected Framework, industry standards, and best practices
Strong experience with MLOps platforms such as AWS Sagemaker, Kubeflow, or MLflow.
Hands-on design and development experience using Python, Flask, Django, AsyncIO, etc.
Systems integration experience, including design and development of APIs, Real-Time Systems, and Microservices
Current cloud technology experience, preferably AWS (EKS, S3, RDS, Lambda, Aurora, ECS-Fargate ...etc.)
Experience integrating with async messaging, logging, or queues, such as Kafka, RabbitMQ, or SQS.
Nice to have
Experience with monitoring and logging tools - Dynatrace, Splunk etc.
Experience with ML frameworks: TensorFlow, PyTorch, scikit-learn.
Experience with Kubeflow, MLflow, Airflow, or similar workflow orchestration tools.
Building automated and scheduled pipelines for analytical processes.