Why Lack Of Agile and Efficient Cloud Management Is Hindering Cloud Based Modernization

This blog is an extract from a three-part blog series on Cloud Management published earlier this year. Readers can find the various parts – here , here and here. In this article, I want to share our point of view and some insights into  Cloud Management capabilities that large enterprises need to put in place in order to support digital transformation in their organization, as they support both legacy infrastructure as well as new, modern applications and technologies.

Photo by Made By Morro on Unsplash

Given the strains that cloud puts on IT Ops, we often see that large and complex enterprises that have invested in Cloud Management Platform (CMP) capabilities struggle to identify the highest priority areas to target across lines of business or in shared services, and can’t really realize the promise of CMPs to optimize their IT processes across various company initiatives. The CMP implementation often becomes another ‘Moby Dick’ endless chase, sucking time and resources and causing frustration throughout the organization, with often not a lot to show for it.

Why Move to Hybrid Cloud? Because Legacy, Monolithic IT is a Digital Disabler

In most organizations, the process of identifying the correct set of IT capabilities needed for the various line of business projects looks something like this:

1. Lines of business leadership works with product management teams on IT requests to satisfy the needs of new projects t- either in support of new business initiatives or to revamp existing offerings
2. IT teams follow a structured process to identify the appropriate (silo’ed) technology elements to create the solution
3. Development teams follow a mix of Agile and Waterfall development processes to stand up the solution which then gets deployed and managed by an Operations team
4. Feedback from end users and on-going update requests from the business owners get slowly implemented and reflected in the product, causing dissatisfaction with customers and possible loss of revenue or user retention.

Given this reality, how can legacy systems and architectures re-invent themselves to become Cloud Native? How can these be updated in a faster pace to benefit the business, and with better quality and reliability? And, more importantly, what does it mean from a Cloud Management standpoint?

Hence The Need for Agile Enterprise Cloud Management

Almost every customer I work with has complex and diverse infrastructure, in the service of a complex and diverse application portfolio that enterprise IT has to support. Enterprise IT has to juggle supporting many different types of applications (legacy applications, mainframe, monolithic, cloud-native apps, microservices, serverless, and more), each requiring their own technology stack and type of infrastructure, that is operated and maintained in a fundamentally different way.

Even moderately sized customers typically have large investments in VMware, are possibly exploring investments in OpenStack, Containers, and even Serverless. Most are also using public clouds for some workloads, alongside on-premises data centers. Accordingly, one of the key challenges that customers need us to help with is Cloud Management: both private and public.

Challenges with existing CMP solutions:

Some of the key challenges we see with existing CMPs are:

1. High cost –CMP technologies are typically proprietary and charge heavy license fees. Most prongs of CMP are implemented as point-products, which require considerable and lengthy investments in Professional Services and custom integrations in order to implement effectively. This typically breaks right off the bat one of the key benefits of the cloud, which is around reducing cost and increasing the time to value to make provisioning and on-going management smoother.
2. Unnecessary Complexity –CMP products have evolved into offering a lot of functionality which is often duplicated in other ITSM (IT Service Management Systems) that ends up as shelf-ware. These products are also over-designed and overly complex from an install, provisioning, licensing and Day-2 operations standpoint.
3. Lack of Developer Engagement –Developers lead the adoption of the cloud because it is a faster way to build and ship products; especially vs legacy IT virtualization farms. Being dissatisfied with the provisioning processes and responsiveness of corporate IT, developers often turn to the public cloud on their own (“Shadow IT”, anyone?) simply to accelerate their work and enable themselves to move faster. CMP products have done a poor job catering to developers as a critical audience to facilitate digital transformation. This is mainly around:
   • The user interface of common CMPs is usually off-putting to developers. Instead of self-service, on-demand experience via automation-friendly APIs, developers find that they often need to file “service request” tickets and then twiddle their thumbs while they’re stuck waiting for IT to complete the request.
   • Governance controls are often poorly implemented and frustrate developers (e.g. limiting capacity usage by enforcing tickets instead of quotas)
   • Developers are adopting IaaS and PaaS solutions in order to more easily build and deliver their applications. CMPs make IaaS and PaaS redundant, yet developers see them as critical to their work.
4. Lack of Management Support for Cloud-Native Workloads and Public clouds –The majority of proprietary CMPs are mostly tailored to manage virtualization providers such as VMware. A key challenge that needs to be solved in commercial CMPs is the inclusion of support for Cloud-Native workloads and public cloud management capabilities.

Conclusion

Cloud Management is a key aspect that organizations are looking at in order to simplify operations, increase IT efficiency and reduce data center cost. However, Cloud Management has become a somewhat loosely defined concept. We feel that it needs to enable an IT Department to deal with integrating an extensive & differing set of IaaS capabilities. These key tasks include handling all of the operations described above without leading to a multi-year PS heavy approach. Cloud Management initiatives that are unduly complex and lack architectural simplicity are doomed to fail.