MLOps & Kubernetes Platform Engineer | LLM Agents, AI Infrastructure, HPC
- Verfügbarkeit einsehen
- 0 Referenzen
- 60€/Stunde
- 40137 Bologna
- Europa
- fa | az | tr | en | it
- 08.08.2026
- Contract ready
Kurzvorstellung
Geschäftsdaten
Qualifikationen
Projekt‐ & Berufserfahrung
1/2025 – offen
Tätigkeitsbeschreibung
Architect and lead developer of ExaMLOps, the AI production platform for the EuroHPC-JU project SEANERGYS, deployed and running at a national supercomputing centre. UNIBO work-package task lead.
- Designed the end-to-end MLOps architecture: Prefect training pipelines, MLflow model lifecycle (versioning, metric-gated promotion, drift detection), Ray Serve multi-model inference, MinIO artefact storage.
- Built the full observability stack: Prometheus, Grafana, Loki and Tempo across training and serving, with alerting on model and infrastructure health.
- Delivered three control surfaces over the same API: REST, a first-class CLI, and a natural-language interface backed by an LLM agent.
- Ran the platform across hybrid HPC and Kubernetes targets, including SLURM workload integration and GitLab CI/CD for reproducible deployment.
Continuous Integration, DevOps, Machine Learning Engineer, MLOps, Python-Programmierer, Docker, Linux Entwicklung, Cloud Computing, Kubernetes
1/2024 – offen
Tätigkeitsbeschreibung
Architect and lead engineer of KubeIntellect, an open-source multi-agent system that turns natural-language requests into safe, auditable Kubernetes operations across the full API surface.
- Designed a supervisor/worker agent architecture on LangGraph, with a stateful execution graph, PostgreSQL checkpointing and resumable runs.
- Enforced safety by construction: four-tier role-based access control, human-in-the-loop approval on every mutating operation, AST-based validation of generated code, and full audit logging.
- Built a Code-Generator agent that synthesises and registers new tools at runtime, so the system extends its own capability without redeployment.
- Implemented the backend in Python with FastAPI behind an OpenAI-compatible API, a LibreChat front end, and an SSH-tunnelled cluster access layer.
- Deployed to Azure AKS with Terraform, NGINX Ingress and Grafana dashboards.
- Published as peer-reviewed research and released under a dual open-source/commercial licence.
Postgresql, DevOps, Machine Learning Engineer, Python-Programmierer, Docker, Kubernetes
8/2022 – offen
Tätigkeitsbeschreibung
Research and engineering on AI-driven operation of large-scale HPC and Kubernetes infrastructure, contributing to several EU Horizon projects (REGALE, DECICE, Graph-Massivizer).
- Built anomaly-detection and predictive models over production HPC telemetry, combining deep learning, graph machine learning and statistical methods on time-series data at cluster scale.
- Developed digital-twin and power/thermal models used for energy-aware scheduling and sustainable-computing decisions.
- Integrated the models into MLOps pipelines and an observability framework spanning HPC and Kubernetes, so detection runs continuously against live telemetry rather than offline traces.
- Created AOBench, an open benchmark for LLM agents performing HPC operations, with fidelity-validated environment snapshots (SLURM, Prometheus, energy APIs) and a scoring method that hard-fails any access-control violation.
- Co-supervise two PhD students and have co-supervised five MSc theses; peer reviewer for international journals and conferences.
Data Science, Machine Learning Engineer, Python-Programmierer, Linux Entwicklung, Kubernetes
4/2009 – 8/2015
Tätigkeitsbeschreibung
Sole responsibility for the enterprise IT and network infrastructure of a 1,000-1,440 MW combined-cycle power plant across eleven operational zones (separate from the industrial process-control and PLC systems, which a different engineering division owned).
- Designed, deployed and operated a fibre-optic campus backbone interconnecting eleven zones, with managed switches, racks and structured cabling.
- Ran the central server room: Windows Server, Active Directory (users, groups, policy), Microsoft Exchange, DNS, DHCP, file and print services.
- Operated the perimeter: UTM firewall, internet access, and VPN for remote and inter-site connectivity.
- Designed and ran a VMware vSphere/ESXi virtualisation platform for server consolidation.
- Administered enterprise application servers for project management, stores, human resources and document management.
- Owned IT security and continuity: security policy, monitoring, backup procedures and disaster-recovery planning for all IT systems.
IT-Sicherheitsberater, Active Directory, Vmware Pivotal, Windows Server (allg.), Netzwerkadministration (allg.)
Ausbildung
University of Bologna (DEI), Italy
Bologna
University of Bologna (DEI), Italy
Bologna
Über mich
CURRENT WORK
Postdoctoral Research Fellow at the University of Bologna (DEI), working on AI-driven management of cloud-native and HPC systems. I lead the AI production-platform design in the EU Horizon project SEANERGYS, where I architected an MLOps platform now running at a national supercomputing centre: Prefect training pipelines, MLflow model lifecycle, Ray Serve multi-model inference, Prometheus/Grafana/Loki/Tempo observability, and REST, CLI and natural-language control surfaces.
I also build autonomous LLM agent systems for cluster operations. KubeIntellect is a multi-agent framework that turns natural-language requests into safe, auditable Kubernetes actions, with role-based access control and human-in-the-loop approval on every mutating operation (FastAPI, LangGraph, PostgreSQL checkpointing). AOBench is an open benchmark for LLM agents performing HPC operations. Both are open source.
BEFORE ACADEMIA
7+ years in enterprise IT and network operations, including full responsibility for the IT and network infrastructure of a 1,000+ MW combined-cycle power plant: a fibre-optic campus backbone across eleven operational zones, Windows Server / Active Directory / Exchange, VMware vSphere virtualisation, UTM firewalls and VPN, backup and disaster recovery. That operations background is why the platforms I build are designed to be run, not just demonstrated.
TYPICAL ENGAGEMENTS
- Kubernetes and OpenShift platform build-out, hardening and RBAC design
- MLOps / LLMOps pipeline design: training, registry, serving, autoscaling, drift detection
- LLM agent and RAG systems with guardrails, approval gates and audit trails
- Observability, anomaly detection and energy/cost efficiency for clusters
- HPC and SLURM workload integration; hybrid HPC/cloud architectures
- Architecture review and technical due diligence
Working language English. Based in Italy (EU), fully authorised to work in the EU without sponsorship, available remotely across European time zones.
Weitere Kenntnisse
MLOps / AI production: Prefect, MLflow, Kubeflow, Ray Serve, Ray Train, KServe, vLLM, Red Hat OpenShift AI, MinIO, DVC, model lifecycle (training, versioning, serving, drift detection, metric-gated promotion), GitLab CI/CD, GitHub Actions
LLM agents & agentic protocols: LangGraph, LangChain, ReAct loops, supervisor-worker orchestration, human-in-the-loop confirmation, dynamic tool synthesis, AST-based validation, runtime tool registration, Model Context Protocol (MCP), agent-to-agent (A2A), memory orchestration, Google ADK, Anthropic Claude API, OpenAI API
AI / machine learning: Python, PyTorch, TensorFlow, scikit-learn, Pandas, anomaly detection (deep learning, graph ML, statistical), FastAPI
Observability & data: Prometheus, Grafana, Loki, Tempo, Alertmanager, OpenTelemetry, time-series telemetry analysis, PySpark, Dask, PostgreSQL
HPC & parallel computing: SLURM, MPI, OpenMP, HPC telemetry and workload traces, power and thermal modelling, workload scheduling
Networking & system administration: Windows Server, Active Directory, DNS, DHCP, Microsoft Exchange, UTM firewalls, VPN, LAN/WAN, VLANs, fibre-optic campus networks, VMware vSphere/ESXi, Cisco networking, SDN, IT security, backup, disaster recovery
Languages: English (fluent) - Persian, Azerbaijani, Turkish (native) - Italian (basic)
Persönliche Daten
- Persisch (Muttersprache)
- Aserbaidschanisch (Muttersprache)
- Türkisch (Muttersprache)
- Englisch (Fließend)
- Italienisch (Grundkenntnisse)
- Europäische Union
Kontaktdaten
Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.
Jetzt Mitglied werden
