
Explore a complete MLOps workflow using → KitOps for model packaging → Cog for local testing → KAITO for scalable Kubernetes deployment read full article! cncf.io/blog/2025/07/26/stan…

Kit is an open source #MLOps project that packages your model, datasets, code, and configuration so data scientists and developers can use their preferred tools

Explore a complete MLOps workflow using → KitOps for model packaging → Cog for local testing → KAITO for scalable Kubernetes deployment read full article! cncf.io/blog/2025/07/26/stan…

Your model, dataset, prompts, MCP config and skills, in one signed, versioned artifact. kit pack . -t registry.example.com/team/ag… kit push registry.example.com/team/ag… Works with the OCI registry you already run. github.com/kitops-ml/kitops

An agent is a model plus prompts, skills, MCP servers and policies. A Kitfile can hold all of it, and kit pack makes it one signed OCI artifact. Today, KitOps contributor @Jozu_AI released Agent Guard to do just that. Check out the GitHub: github.com/jozu-ai/agent-gua…

So impressed with the Opus 5.5 explainer videos - Here's another one - Serve Models from a @Kit_Ops ModelKit on @HAMiProject Detailed explanation of how Your model is packaged as a versioned ModelKit. KitOps pulls it from an OCI registry and unpacks it inside the Pod. HAMi schedules a controlled GPU share. SGLang loads the model locally and serves an OpenAI-compatible API. One clear path from model artifact to working inference. KitOps and HAMi.

Running AI workloads on Kubernetes? The scheduling part works fine. It's the GPU utilization and artifact management that breaks everything. Typical inference workload uses 20-40% of GPU compute and maybe 30 GiB memory. But Kubernetes Device Plugin only reports integer device counts. So nvidia/gpu: 1 means you get the entire H100, and every other workload waits. NVIDIA Time-Slicing lets multiple Pods share, but there's no VRAM isolation. One Pod OOMs, everything crashes. MIG works but only on A100/H100, and you're stuck with fixed partition sizes. Then there's the artifact problem. Which model version is deployed? Does config.json match the weights? Can this move through CI/CD without manual file transfers? I came across @HAMiProject + @Kit_Ops tutorial, and the pattern actually makes sense. HAMi handles GPU virtualization through CUDA API interception. No driver changes, no app changes. It exposes nvidia/gpu, nvidia/gpumem, and nvidia/gpucores as schedulable resources. One H100 becomes 10 vGPUs. Your Pod requests 30 GiB, gets scheduled, and can only see that allocation. Over-allocation returns OOM without crashing other workloads. KitOps handles artifact packaging. Models, datasets, configs, code → stored as OCI artifacts in the same registry you use for containers. The ModelKit gets pulled by an initContainer, unpacked into a flat directory, and the inference engine loads it from local disk. Registry-native supply chain, version controlled, reproducible. The lab workflow: → Pull Qwen3-4B-Instruct ModelKit from Jozu Hub → Unpack with kitunpacker initContainer → Schedule Pod with HAMi GPU shares (30 GiB memory) → Serve with SGLang → Optionally co-locate vLLM on same physical GPU Everything moves through standard K8s patterns. No one-off scripts, no S3 bucket coordination, no guessing which version is actually running. Useful if you're running LLMs in production and trying to avoid building custom deployment infrastructure.

Another guide with @rudrakshkarpe also in the works using @Kit_Ops to serve models with modelkits and serve them using @HAMiProject thus providing a safe way to securely get signed models with verifiable identity github.com/Project-HAMi/webs…
Had a lot of fun working with @rudrakshkarpe on this tutorial showing how to run @sgl_project inference on @kubernetesio using @HAMiProject GPU shares: complete with GPU memory quotas, compute throttling, and an OpenAI-compatible API @CloudNativeFdn project-hami.io/tutorials/la…

@Kit_Ops + @HAMiProject brings together two important pieces of the production inference stack. ModelKits make model packaging and distribution portable, while HAMi enables efficient GPU sharing and resource isolation on @kubernetesio Excited to see this lab coming up!
Another guide with @rudrakshkarpe also in the works using @Kit_Ops to serve models with modelkits and serve them using @HAMiProject thus providing a safe way to securely get signed models with verifiable identity github.com/Project-HAMi/webs…

Great tutorial for a collaboration between two @cncf projects @HAMiProject <> @Kit_Ops Kudos to @rudrakshkarpe as the co-author for this one, and we shared this during @KubeCon_ India

HAMi lab worth bookmarking: ModelKit → `kit unpack` in an initContainer → SGLang/vLLM on HAMi GPU shares. ~60 min · Jul 2026 project-hami.io/tutorials/la… Sample uses Jozu Hub; any OCI registry works the same way.

Need ModelPack format? kit pack . --use-model-pack -t myregistry/my-agent:1.2 Pull / unpack what you need (selective layers work). Docs: kitops.org/docs/get-started/


Tried rebuilding last Tuesday’s agent lately? Skills in git. MCP config… somewhere. Prompt in a wiki. KitOps: pack model · MCP · skills · policies as one OCI ModelKit. kit pack / push / pull — same registries you already run. CNCF KitOps + ModelPack kitops.org/docs/cli/installa…

MCP servers and agent skills are still being shared as ZIP files and GitHub links. That's a problem. These change what agents can access and how they behave. They need the same controls as production code: versioning, provenance, signing, and rollback. @Kit_Ops v1.13 lets teams package skills as OCI-based ModelKits, govern them in @Jozu_AI Hub, and install approved versions directly: kit unpack <modelkit> --as-skill Quick demo 👇

Weekend spent with #CloudNative Kolkata! Technology may evolve rapidly, but communities are what turn ideas into impact 🚀 Discussed about @Kit_Ops and ModelKit addresses a fundamental challenge for ML/Data Scientists — making AI projects reproducible, portable to share! #meetup

We're securing AI agents at the wrong layer. A 2026 review of 85 agent-security papers found 66% focus on perception attacks like prompt injection and jailbreaks. Only 4.7% study what happens when an agent actually takes action. That's the problem. Prompt injection is only dangerous because of what it makes an agent do: Read a database. Run code. Call a tool. Delete a file. Move money. So the better question isn't: "Can I stop the agent from being manipulated?" It's: "If it gets manipulated, what can it actually do?" That shifts security from trying to make agents impossible to fool to making them safe to operate. → Least privilege → Scoped tools → Runtime policies → Signed artifacts → Human approval for high-risk actions The model will make mistakes. The real security boundary is what happens after.

The interesting shift in AI security: the threat is no longer just the model. OWASP's 2026 agentic security work shows real incidents across goal hijacking, tool misuse, identity abuse, supply-chain attacks, and unexpected code execution. We're already seeing agents escape test environments and interact with real systems without explicit human direction. That changes how you think about agent security. You don't just need to secure what an agent knows. You need to control what it can do. That means: → Verify the agent and its dependencies before execution → Control individual tool calls at runtime → Enforce least privilege → Keep an audit trail of every decision @Jozu_AI is building Agent Guard for this: a zero-trust runtime that scans and signs agents, MCP servers and models, then enforces policy at both admission and runtime. Agentic AI is moving from "generate an answer" to "take an action." Security needs to catch up.