Job Specifications
Job#: 3011040
Job Description:
AI Solutions Engineer, Agent Platforms
Position: 6 month contract potential extensions
Client: Big Five Bank
Location: Hybrid
Application Process: Please apply via the medium on which you are seeing this posting. If you encounter technical difficulties submitting your resume, please send a Word version of your resume to Beth at [email protected] . Please reference Job : AI Solutions Engineer, Agent Platforms
Summary:
You will engineer production-grade AI solutions and agent workflows that integrate safely with the LOB. You’ll build containerized agent services on Azure, implement runtime safety guardrails, and instrument evaluation and A/B testing so product teams can experiment and scale with confidence.
What you’ll do:
Build agent solutions:
Develop agent-ready services (e.g., Python/FastAPI with LangGraph/LangChain) deployed on Azure App Service or containers.
Integrate with enterprise APIs via APIM; implement strong authN/Z patterns (e.g., AuthHub, Entra ID).
Safety and guardrails:
Enforce policy-as-code for toxicity/bias filtering, prompt shielding, PII leakage checks, quotas, and action scopes.
Integrate with centrally managed safeguards and ensure full auditability.
Evaluation and experimentation:
Implement evaluation harnesses for accuracy, faithfulness, hallucination risk, completeness, relevancy, tone/formatting.
Stand up A/B testing capabilities (exposure management, experiment registry, metrics) tied to adoption and business outcomes.
Observability and performance:
Instrument services with OpenTelemetry (traces/metrics/logs); expose dashboards for KPIs/KRIs and audit evidence.
Support streaming outputs, latency budgets, and back-pressure controls; optimize cost and throughput.
Durable execution:
Design long-running workflows with resumability, idempotency, retries/timeouts, and compensation where needed.
Define exception handling, unusual-request detection, and escalation paths with product owners.
Reliability and containerization:
Engineer solution to reuse shared components (telemetry, APIM, LLM services, CI/CD, config stores).
Package agent capabilities as containerized modules that can be deployed via established pipelines.
What you bring:
5+ years in backend or platform engineering with production services on Azure (App Service, Functions, Container Apps/Kubernetes).
Proficiency in Python (FastAPI); experience with agent frameworks (LangGraph/LangChain) and LLM service integration.
Practical experience implementing runtime safety controls and human-in-the-loop patterns.
Strong grounding in experimentation (A/B testing), evaluation metrics, and CI/CD automation for safe releases.
Knowledge of OpenTelemetry, API security, RBAC/ABAC, and Zero Trust concepts.
Track record of partnering across product, data, and governance teams to deliver measurable business outcomes.
Nice to have :
Experience integrating with Redis for low-latency state, Blob Storage, and event-driven patterns.
Familiarity with enterprise agent publishing, MLflow/feature stores, and Power BI for operational reporting.
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico.
Apex Benefits Overview: Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure. Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts. In terms of professional development, Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA. Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach. You can access a full list of our benefits, programs, support teams and resources within our ‘Welcome Packet’ as well, which an Apex team member can provide.
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex,
About the Company
Apex Systems is a leading global technology services firm that incorporates industry insights and experience to deliver solutions that fulfill our clients' digital visions. We offer a continuum of services, specializing in strategy, transformation, and managed services across application development, data, enterprise platforms, cloud and infrastructure, and cybersecurity. Through our ability to innovate alongside our customers, we build and deploy the right artificial intelligence solutions to realize business value and impr...
Know more