←
KitOps578 posts
KitOps avatar

KitOps

@Kit_Ops

Kit is an open source #MLOps project that packages your model, datasets, code, and configuration so data scientists and developers can use their preferred tools

◷ Joined March 2024▧ 104 Photos and videos
KitOps avatar
KitOps@Kit_Ops·30 Jul 2025

Explore a complete MLOps workflow using → KitOps for model packaging → Cog for local testing → KAITO for scalable Kubernetes deployment read full article! cncf.io/blog/2025/07/26/stan…

Shivay Lamba avatar
⟳ KitOps retweeted
Shivay Lamba@HowDevelop·Sep 26

So impressed with the Opus 5.5 explainer videos - Here's another one - Serve Models from a @Kit_Ops ModelKit on @HAMiProject Detailed explanation of how Your model is packaged as a versioned ModelKit. KitOps pulls it from an OCI registry and unpacks it inside the Pod. HAMi schedules a controlled GPU share. SGLang loads the model locally and serves an OpenAI-compatible API. One clear path from model artifact to working inference. KitOps and HAMi.

0:30
Mr. Ånand avatar
⟳ KitOps retweeted
Mr. Ånand@Astrodevil_·Sep 22

Running AI workloads on Kubernetes? The scheduling part works fine. It's the GPU utilization and artifact management that breaks everything. Typical inference workload uses 20-40% of GPU compute and maybe 30 GiB memory. But Kubernetes Device Plugin only reports integer device counts. So nvidia/gpu: 1 means you get the entire H100, and every other workload waits. NVIDIA Time-Slicing lets multiple Pods share, but there's no VRAM isolation. One Pod OOMs, everything crashes. MIG works but only on A100/H100, and you're stuck with fixed partition sizes. Then there's the artifact problem. Which model version is deployed? Does config.json match the weights? Can this move through CI/CD without manual file transfers? I came across @HAMiProject + @Kit_Ops tutorial, and the pattern actually makes sense. HAMi handles GPU virtualization through CUDA API interception. No driver changes, no app changes. It exposes nvidia/gpu, nvidia/gpumem, and nvidia/gpucores as schedulable resources. One H100 becomes 10 vGPUs. Your Pod requests 30 GiB, gets scheduled, and can only see that allocation. Over-allocation returns OOM without crashing other workloads. KitOps handles artifact packaging. Models, datasets, configs, code → stored as OCI artifacts in the same registry you use for containers. The ModelKit gets pulled by an initContainer, unpacked into a flat directory, and the inference engine loads it from local disk. Registry-native supply chain, version controlled, reproducible. The lab workflow: → Pull Qwen3-4B-Instruct ModelKit from Jozu Hub → Unpack with kitunpacker initContainer → Schedule Pod with HAMi GPU shares (30 GiB memory) → Serve with SGLang → Optionally co-locate vLLM on same physical GPU Everything moves through standard K8s patterns. No one-off scripts, no S3 bucket coordination, no guessing which version is actually running. Useful if you're running LLMs in production and trying to avoid building custom deployment infrastructure.

Post attachment
Shivay Lamba avatar
⟳ KitOps retweeted
Shivay Lamba@HowDevelop·Sep 12

Another guide with @rudrakshkarpe also in the works using @Kit_Ops to serve models with modelkits and serve them using @HAMiProject thus providing a safe way to securely get signed models with verifiable identity github.com/Project-HAMi/webs…

Post attachment

Had a lot of fun working with @rudrakshkarpe on this tutorial showing how to run @sgl_project inference on @kubernetesio using @HAMiProject GPU shares: complete with GPU memory quotas, compute throttling, and an OpenAI-compatible API @CloudNativeFdn project-hami.io/tutorials/la…

Rudraksh avatar
⟳ KitOps retweeted
Rudraksh@rudrakshkarpe·Sep 13

@Kit_Ops + @HAMiProject brings together two important pieces of the production inference stack. ModelKits make model packaging and distribution portable, while HAMi enables efficient GPU sharing and resource isolation on @kubernetesio Excited to see this lab coming up!

Another guide with @rudrakshkarpe also in the works using @Kit_Ops to serve models with modelkits and serve them using @HAMiProject thus providing a safe way to securely get signed models with verifiable identity github.com/Project-HAMi/webs…

Post attachment
KitOps avatar
KitOps@Kit_Ops·Sep 21

HAMi lab worth bookmarking: ModelKit → `kit unpack` in an initContainer → SGLang/vLLM on HAMi GPU shares. ~60 min · Jul 2026 project-hami.io/tutorials/la… Sample uses Jozu Hub; any OCI registry works the same way.

Post attachment
KitOps avatar
KitOps@Kit_Ops·Sep 18

Quick how-to if you already speak Docker: brew tap kitops-ml/kitops && brew install kitops kit pack . -t myregistry/my-agent:1.2 kit push myregistry/my-agent:1.2

Post attachment
KitOps avatar
KitOps@Kit_Ops·Sep 18

Tried rebuilding last Tuesday’s agent lately? Skills in git. MCP config… somewhere. Prompt in a wiki. KitOps: pack model · MCP · skills · policies as one OCI ModelKit. kit pack / push / pull — same registries you already run. CNCF KitOps + ModelPack kitops.org/docs/cli/installa…

Post attachment
Arindam Majumder 𝕏 avatar
⟳ KitOps retweeted
Arindam Majumder 𝕏@Arindam_1729·Aug 5

MCP servers and agent skills are still being shared as ZIP files and GitHub links. That's a problem. These change what agents can access and how they behave. They need the same controls as production code: versioning, provenance, signing, and rollback. @Kit_Ops v1.13 lets teams package skills as OCI-based ModelKits, govern them in @Jozu_AI Hub, and install approved versions directly: kit unpack <modelkit> --as-skill Quick demo 👇

1:10
Suman Chakraborty avatar
⟳ KitOps retweeted
Suman Chakraborty@itsmesumanc·Aug 23

Weekend spent with #CloudNative Kolkata! Technology may evolve rapidly, but communities are what turn ideas into impact 🚀 Discussed about @Kit_Ops and ModelKit addresses a fundamental challenge for ML/Data Scientists — making AI projects reproducible, portable to share! #meetup

Post attachmentPost attachmentPost attachmentPost attachment
Arindam Majumder 𝕏 avatar
⟳ KitOps retweeted
Arindam Majumder 𝕏@Arindam_1729·Aug 19

We're securing AI agents at the wrong layer. A 2026 review of 85 agent-security papers found 66% focus on perception attacks like prompt injection and jailbreaks. Only 4.7% study what happens when an agent actually takes action. That's the problem. Prompt injection is only dangerous because of what it makes an agent do: Read a database. Run code. Call a tool. Delete a file. Move money. So the better question isn't: "Can I stop the agent from being manipulated?" It's: "If it gets manipulated, what can it actually do?" That shifts security from trying to make agents impossible to fool to making them safe to operate. → Least privilege → Scoped tools → Runtime policies → Signed artifacts → Human approval for high-risk actions The model will make mistakes. The real security boundary is what happens after.

Post attachment
Arindam Majumder 𝕏 avatar
⟳ KitOps retweeted
Arindam Majumder 𝕏@Arindam_1729·Aug 14

The interesting shift in AI security: the threat is no longer just the model. OWASP's 2026 agentic security work shows real incidents across goal hijacking, tool misuse, identity abuse, supply-chain attacks, and unexpected code execution. We're already seeing agents escape test environments and interact with real systems without explicit human direction. That changes how you think about agent security. You don't just need to secure what an agent knows. You need to control what it can do. That means: → Verify the agent and its dependencies before execution → Control individual tool calls at runtime → Enforce least privilege → Keep an audit trail of every decision @Jozu_AI is building Agent Guard for this: a zero-trust runtime that scans and signs agents, MCP servers and models, then enforces policy at both admission and runtime. Agentic AI is moving from "generate an answer" to "take an action." Security needs to catch up.

Post attachment