freiberufler MLOps & Kubernetes Platform Engineer | LLM Agents, AI Infrastructure, HPC auf freelance.de

MLOps & Kubernetes Platform Engineer | LLM Agents, AI Infrastructure, HPC

zuletzt online vor wenigen Minuten
  • 60€/Stunde
  • 40137 Bologna
  • Europa
  • fa  |  az  |  tr  |  en  |  it
  • 08.08.2026
  • Contract ready

Kurzvorstellung

AI-infrastructure engineer. I build and operate the Kubernetes, MLOps and LLM-agent platforms that take ML workloads from prototype to dependable production. 7+ years of enterprise IT operations, now PhD-level R&D on autonomous cluster operations.

Geschäftsdaten

 Freiberuflich
 Steuernummer bekannt

Qualifikationen

  • Cloud Computing1 J.
  • DevOps2 J.
  • Docker2 J.
  • Kubernetes4 J.
  • Linux Entwicklung4 J.
  • LLM Agents
  • Machine Learning Engineer4 J.
  • MLOps1 J.
  • Python-Programmierer4 J.
  • Terraform

Projekt‐ & Berufserfahrung

AI Production Platform Architect / MLOps Lead - EU Horizon SEANERGYS (Festanstellung)
University of Bologna (DEI) - EuroHPC-JU SEANERGYS, Bologna
1/2025 – offen (1 Jahr, 8 Monate)
Hochschulen und Forschungseinrichtungen
Tätigkeitszeitraum

1/2025 – offen

Tätigkeitsbeschreibung

Architect and lead developer of ExaMLOps, the AI production platform for the EuroHPC-JU project SEANERGYS, deployed and running at a national supercomputing centre. UNIBO work-package task lead.

- Designed the end-to-end MLOps architecture: Prefect training pipelines, MLflow model lifecycle (versioning, metric-gated promotion, drift detection), Ray Serve multi-model inference, MinIO artefact storage.
- Built the full observability stack: Prometheus, Grafana, Loki and Tempo across training and serving, with alerting on model and infrastructure health.
- Delivered three control surfaces over the same API: REST, a first-class CLI, and a natural-language interface backed by an LLM agent.
- Ran the platform across hybrid HPC and Kubernetes targets, including SLURM workload integration and GitLab CI/CD for reproducible deployment.

Eingesetzte Qualifikationen

Continuous Integration, DevOps, Machine Learning Engineer, MLOps, Python-Programmierer, Docker, Linux Entwicklung, Cloud Computing, Kubernetes

Lead Engineer - KubeIntellect, autonomous LLM agent platform for Kubernetes (Festanstellung)
University of Bologna (DEI) - KubeIntellect (open, Bologna
1/2024 – offen (2 Jahre, 8 Monate)
Hochschulen und Forschungseinrichtungen
Tätigkeitszeitraum

1/2024 – offen

Tätigkeitsbeschreibung

Architect and lead engineer of KubeIntellect, an open-source multi-agent system that turns natural-language requests into safe, auditable Kubernetes operations across the full API surface.

- Designed a supervisor/worker agent architecture on LangGraph, with a stateful execution graph, PostgreSQL checkpointing and resumable runs.
- Enforced safety by construction: four-tier role-based access control, human-in-the-loop approval on every mutating operation, AST-based validation of generated code, and full audit logging.
- Built a Code-Generator agent that synthesises and registers new tools at runtime, so the system extends its own capability without redeployment.
- Implemented the backend in Python with FastAPI behind an OpenAI-compatible API, a LibreChat front end, and an SSH-tunnelled cluster access layer.
- Deployed to Azure AKS with Terraform, NGINX Ingress and Grafana dashboards.
- Published as peer-reviewed research and released under a dual open-source/commercial licence.

Eingesetzte Qualifikationen

Postgresql, DevOps, Machine Learning Engineer, Python-Programmierer, Docker, Kubernetes

Postdoctoral Research Fellow - AI-driven management of HPC and cloud-native systems (Festanstellung)
University of Bologna (DEI) - EU Horizon REGALE, D, Bologna
8/2022 – offen (4 Jahre, 1 Monat)
Hochschulen und Forschungseinrichtungen
Tätigkeitszeitraum

8/2022 – offen

Tätigkeitsbeschreibung

Research and engineering on AI-driven operation of large-scale HPC and Kubernetes infrastructure, contributing to several EU Horizon projects (REGALE, DECICE, Graph-Massivizer).

- Built anomaly-detection and predictive models over production HPC telemetry, combining deep learning, graph machine learning and statistical methods on time-series data at cluster scale.
- Developed digital-twin and power/thermal models used for energy-aware scheduling and sustainable-computing decisions.
- Integrated the models into MLOps pipelines and an observability framework spanning HPC and Kubernetes, so detection runs continuously against live telemetry rather than offline traces.
- Created AOBench, an open benchmark for LLM agents performing HPC operations, with fidelity-validated environment snapshots (SLURM, Prometheus, energy APIs) and a scoring method that hard-fails any access-control violation.
- Co-supervise two PhD students and have co-supervised five MSc theses; peer reviewer for international journals and conferences.

Eingesetzte Qualifikationen

Data Science, Machine Learning Engineer, Python-Programmierer, Linux Entwicklung, Kubernetes

IT & Network Administrator - enterprise IT for a 1,000+ MW combined-cycle power plant (Festanstellung)
Sabalan Combined-Cycle Power Plant, Ardabil
4/2009 – 8/2015 (6 Jahre, 5 Monate)
Versorgungswirtschaft
Tätigkeitszeitraum

4/2009 – 8/2015

Tätigkeitsbeschreibung

Sole responsibility for the enterprise IT and network infrastructure of a 1,000-1,440 MW combined-cycle power plant across eleven operational zones (separate from the industrial process-control and PLC systems, which a different engineering division owned).

- Designed, deployed and operated a fibre-optic campus backbone interconnecting eleven zones, with managed switches, racks and structured cabling.
- Ran the central server room: Windows Server, Active Directory (users, groups, policy), Microsoft Exchange, DNS, DHCP, file and print services.
- Operated the perimeter: UTM firewall, internet access, and VPN for remote and inter-site connectivity.
- Designed and ran a VMware vSphere/ESXi virtualisation platform for server consolidation.
- Administered enterprise application servers for project management, stores, human resources and document management.
- Owned IT security and continuity: security policy, monitoring, backup procedures and disaster-recovery planning for all IT systems.

Eingesetzte Qualifikationen

IT-Sicherheitsberater, Active Directory, Vmware Pivotal, Windows Server (allg.), Netzwerkadministration (allg.)

Ausbildung

Electronics, Telecommunications and Information Technology
Ph.D.
University of Bologna (DEI), Italy
2022
Bologna
Telecommunications Engineering
M.Sc.
University of Bologna (DEI), Italy
2018
Bologna

Über mich

I design and operate the infrastructure that takes machine-learning and LLM workloads from prototype to dependable production: Kubernetes platforms, CI/CD and GitOps, training and inference pipelines, model lifecycle management, and the observability, anomaly detection and energy/cost telemetry around them.

CURRENT WORK
Postdoctoral Research Fellow at the University of Bologna (DEI), working on AI-driven management of cloud-native and HPC systems. I lead the AI production-platform design in the EU Horizon project SEANERGYS, where I architected an MLOps platform now running at a national supercomputing centre: Prefect training pipelines, MLflow model lifecycle, Ray Serve multi-model inference, Prometheus/Grafana/Loki/Tempo observability, and REST, CLI and natural-language control surfaces.

I also build autonomous LLM agent systems for cluster operations. KubeIntellect is a multi-agent framework that turns natural-language requests into safe, auditable Kubernetes actions, with role-based access control and human-in-the-loop approval on every mutating operation (FastAPI, LangGraph, PostgreSQL checkpointing). AOBench is an open benchmark for LLM agents performing HPC operations. Both are open source.

BEFORE ACADEMIA
7+ years in enterprise IT and network operations, including full responsibility for the IT and network infrastructure of a 1,000+ MW combined-cycle power plant: a fibre-optic campus backbone across eleven operational zones, Windows Server / Active Directory / Exchange, VMware vSphere virtualisation, UTM firewalls and VPN, backup and disaster recovery. That operations background is why the platforms I build are designed to be run, not just demonstrated.

TYPICAL ENGAGEMENTS
- Kubernetes and OpenShift platform build-out, hardening and RBAC design
- MLOps / LLMOps pipeline design: training, registry, serving, autoscaling, drift detection
- LLM agent and RAG systems with guardrails, approval gates and audit trails
- Observability, anomaly detection and energy/cost efficiency for clusters
- HPC and SLURM workload integration; hybrid HPC/cloud architectures
- Architecture review and technical due diligence

Working language English. Based in Italy (EU), fully authorised to work in the EU without sponsorship, available remotely across European time zones.

Weitere Kenntnisse

Cloud-native & infrastructure: Kubernetes, OpenShift, Helm, Docker, Terraform, Azure AKS, NGINX Ingress, GitOps, Linux, Bash, Git

MLOps / AI production: Prefect, MLflow, Kubeflow, Ray Serve, Ray Train, KServe, vLLM, Red Hat OpenShift AI, MinIO, DVC, model lifecycle (training, versioning, serving, drift detection, metric-gated promotion), GitLab CI/CD, GitHub Actions

LLM agents & agentic protocols: LangGraph, LangChain, ReAct loops, supervisor-worker orchestration, human-in-the-loop confirmation, dynamic tool synthesis, AST-based validation, runtime tool registration, Model Context Protocol (MCP), agent-to-agent (A2A), memory orchestration, Google ADK, Anthropic Claude API, OpenAI API

AI / machine learning: Python, PyTorch, TensorFlow, scikit-learn, Pandas, anomaly detection (deep learning, graph ML, statistical), FastAPI

Observability & data: Prometheus, Grafana, Loki, Tempo, Alertmanager, OpenTelemetry, time-series telemetry analysis, PySpark, Dask, PostgreSQL

HPC & parallel computing: SLURM, MPI, OpenMP, HPC telemetry and workload traces, power and thermal modelling, workload scheduling

Networking & system administration: Windows Server, Active Directory, DNS, DHCP, Microsoft Exchange, UTM firewalls, VPN, LAN/WAN, VLANs, fibre-optic campus networks, VMware vSphere/ESXi, Cisco networking, SDN, IT security, backup, disaster recovery

Languages: English (fluent) - Persian, Azerbaijani, Turkish (native) - Italian (basic)

Persönliche Daten

Sprache
  • Persisch (Muttersprache)
  • Aserbaidschanisch (Muttersprache)
  • Türkisch (Muttersprache)
  • Englisch (Fließend)
  • Italienisch (Grundkenntnisse)
Reisebereitschaft
Europa
Arbeitserlaubnis
  • Europäische Union
Home-Office
bevorzugt
Profilaufrufe
10
Berufserfahrung
19 Jahre und 9 Monate (seit 11/2006)
Projektleitung
4 Jahre

Kontaktdaten

Nur registrierte PREMIUM-Mitglieder von freelance.de können Kontaktdaten einsehen.

Jetzt Mitglied werden