What are the top challenges you face in managing cloud spending? And how do you expect those might change in the year ahead?
When you listen to your provider or clients, they tend to ask for bigger infrastructures than they actually need, just in case. And if you do a one-to-one migration, you might get a shock when you see the bill at the end of the month. Now, we get billed every month, and it's a way for us to keep our costs in check. For me, it's much more manageable. I have an analysis that tracks our billing, and it's become a regular thing, unlike before when we had annual billing. This way, it's easier to spot where we're spending too much on things we don't really use.
Also the cloud is so vast, depending on which platform you select there's an abundance of different services available, and often, the user is in the dark about the costs associated with using those services. This, to me, is another extreme challenge.
Take AWS, for example; they have a multitude of services. Azure and Google are in the same boat. For someone who doesn't spend their time in IT, it's not only about understanding how these processes work but also figuring out how much they're going to cost the organization.
I'd love to add on to that point because cloud models can be pretty complex, and each one is different. Every public IAS provider has their own different way of billing things. But here's another tricky part: when a development team is working on an application or some workload in the cloud, they often don't test it at scale. So, they have no idea how "chatty" it's going to be or how much it's going to interact with various components. Before you know it, you get sticker shock and it just balloons out of control. Predicting the behavior of all these applications they're developing is another real challenge for teams.
But, if you don't implement a regular review of current cloud resources usage and check options to lower the costs, you will end up with the complex task of managing IT budget costs.
It's only going to get worse, especially with everyone playing around with generative AI and AGI. There's going to be a lot of difficulty if we do not manage that visibility and control. I see that as one of the top challenges right now in managing my cloud spend.