“We’ve seen a surprising number of contributors to CloudEvents, including a number of major hyperscale cloud providers and serverless startups,” said Chris Aniszczyk, COO at the Cloud Native Computing Foundation. “Events are increasingly common, especially with serverless adoption growing so quickly. A common way of describing event data helps with the portability of serverless applications and aids tooling for developers building libraries across serverless environments.”
The industry-wide cloudevents.io project, led by the CNCF Working Group, is expected to be formally proposed as a CNCF sandbox project to the CNCF TOC in June.
The CNCF created the Serverless Working Group to ‘explore the intersection of cloud native and serverless technology.’ The Working Group published a serverless white paper and landscape recently, and, at the same time, kicked off the vendor-neutral effort to standardize how event data is described. CloudEvents hits another developer hot button: enabling better tooling for building, testing and handling the end-to-end lifecycle of event-driven and serverless architectures.
“Fostering an open ecosystem by enabling cloud providers, startups and other members a neutral place to collaborate is a key goal for the CNCF and our Serverless WG is the center of cross organization open source serverless collaboration,” said Aniszczyk. “Serverless continues to be a hot topic in the industry and we expect our serverless track on Friday to be one of the most popular at KubeCon.”
KubeCon offers many opportunities to meet the community members doing this interesting work. You’ll find Doug Davis running a CloudEvents Working Group session on Wednesday, May 2 • 20:20 – 21:40 to discuss the latest issues and proposals from members. As with all WG, the session is open so check it out. Doug will also present a Serverless WG BoF on Wednesday, May 2 • 16:25 – 17:00.
As part of Friday’s track, “The Serverless and Event-Driven Future,”presented by Austen Collins, the creator of the Serverless Framework, will cover the latest trends and use-cases of the serverless movement, as well as the CloudEvents effort. And, you might even see Austen doing a demo that showcases CloudEvents interoperability by being used across a variety of Cloud providers. Sarah Allen of Google will look at the convergence of serverless APIs and compute, while Chad Arimura and Matt Stephenson of Oracle will discuss how to operate a global-scale FaaS on top of Kubernetes. Bitnami’s Sebastien Goasguen will drill into securing serverless functions via Kubernetes Objects. To view all sessions in the serverless track click here.
Founded 80 years ago, Haufe Group has evolved from a traditional publisher to a provider of cloud and Internet-based workplace and enterprise solutions. Read the case study to learn more about their digital transformation that began in the 1990s. The Germany company is one of the first mid-sized businesses in the country to embrace cloud native and an API-first strategy. Haufe.Group uses infrastructure-as-code across the entire software deployment lifecycle via Docker and is going live with two services in production using Kubernetes orchestration on Microsoft Azure and Amazon Web Services.
According to Solution Architect Martin Danielsson, “Over the next couple of years, people won’t even think that much about it when they want to run containers. Kubernetes is going to be the go-to solution.”
To learn more how companies of every size, in all industries are benefiting from a cloud native approach, be sure to register for KubeCon + CloudNativeCon taking place May 2-4 in Copenhagen. Adidas, The New York Times, Spotify, The Financial Times, among others will be talking about the impact Kubernetes and cloud native projects have on their businesses.
Zalando, Europe’s leading online fashion platform, has experienced exponential growth since it was founded in 2008. Today Zalando has more than 14,000 employees, 3.6 billion Euro in revenue for 2016 and operates across 15 countries.
Read this new case study that talks about Zalando’s need to scale, which ultimately led the company on a cloud-native journey.
A few years ago, Zalando’s technology department began rewriting its applications to be cloud-ready and started moving its infrastructure from on-premise data centers to the cloud.
While orchestration wasn’t immediately considered, as teams migrated to Amazon Web Services (AWS), the Berlin-based company realized their teams were experiencing too much pain with infrastructure and cloud formation. To provide better support, cluster management was brought into play. The company now runs its Docker containers on AWS using Kubernetes orchestration.
In parallel to rewriting their applications, Zalando had set a goal of expanding beyond basic e-commerce to a platform offering multi-tenancy, a dramatic increase in assortments and styles, same-day delivery and even their own personal online stylist.
“We envision all Zalando delivery teams running their containerized applications on a state-of-the-art, reliable and scalable cluster infrastructure provided by Kubernetes. With growth in all dimensions, and constant scaling, it has been a once-in-a-lifetime experience,” says Henning Jacobs, Head of Developer Productivity at Zalando.
In the past few years, Amadeus, which provides IT solutions to the travel industry around the world, found itself in need of a new platform for the 5,000 services supported by its service-oriented architecture. The public cloud and its existing systems couldn’t quickly and efficiently deliver new services and features.
Read this in-depth case study to learn how the Spain-based company increased automation in managing its infrastructure, optimized the distribution of workloads, introduced new workloads and use data center resources more efficiently.
Amadeus turned to Kubernetes and OpenShift Container Platform, Red Hat’s enterprise container platform. In doing so, Amadeus was able to economically enhance everyone’s travel experience, without interrupting workflows for the customers who depend on their technology.
By rethinking IT and making applications as cloud native as possible, Amadeus is reaping major benefits. Its flight search solution is now handling in production several thousand transactions per second, deployed in multiple data centers throughout the world. Be sure to also check out this Amadeus presentation from the March 28, 2017, OpenShift Commons Gathering in Berlin @KubeCon. If you are attending KubeCon + CloudNativeCon EU from May 2-4, 2018, catch Amadeus’ session on Pod Anomaly Detection and Eviction using Prometheus Metrics.
CNCF Demos Kubernetes Enabling ONAP Running On Any Public, Private, or Hybrid Cloud at Open Networking Summit This Week
To ensure CNCF projects work across all cloud providers, the CNCF CI Working Group has been working on the Cross-cloud CI project to integrate, test and deploy projects within the CNCF ecosystem. The group recently released CI Dashboard v1.3.0, which is licensed under the Apache License 2.0 and publishes results daily.’
The Cross-Cloud CI team, pictured below, has been adding CNCF projects to the dashboard at the rate of about one a month. The dashboard displays the status on both the latest release and the latest development version (i.e., head). The newest release includes, for the first time, the Linux Foundation Open Network Automation Platform (ONAP) project. It can be seen at:https://cncf.ci.
Meet the Cross-Cloud CI Team
CNCF contracted with a team from Vulk Coop to design, build, maintain and deploy the cross-cloud project.
The Cross-cloud CI project consists of a cross-cloud testing system, status repository server and a dashboard. The cross-cloud testing system has 3 components (build, cross-cloud, cross-project) that continually validate the interoperability of each CNCF project for any commit on stable and head across all supported cloud providers. The cross-cloud testing system can reuse existing artifacts from a project’s preferred CI system or generate new build artifacts. The status repository server collects the test results and the dashboard displays them. To better understand the genesis of the project and work to date, view this Updated High-Level Overview README.
CNCF & ONAP at Open Networking Summit This Week in Los Angeles
Kubernetes is being used to enable ONAP to run on any public, private, or hybrid cloud. Kubernetes allows the ONAP platform for real-time, policy-driven orchestration and automation of physical and virtual network functions to deploy seamlessly into all these environment.
Backed by many of the world’s largest global service providers and technology leaders, including Amdocs, AT&T, Bell, China Mobile, China Telecom, Cisco, Ericsson, Cloudify, Huawei, IBM, Intel, Jio, Nokia, Orange, Tech Mahindra, Verizon, VMware, Vodafone and ZTE, ONAP brings together global carriers and vendors to enable end users to automate, design, orchestrate and manage services and virtual functions. ONAP enables nearly 60 percent of the world’s mobile subscribers.
“The promise of containerization is the ability to deploy to any public, private, or hybrid cloud. CNCF continues to see ongoing migration from VMs to containers and our architecture enables that,” said Dan Kohn, CNCF executive director. “CNCF is attending ONS this week in Los Angeles to expand our focus beyond the enterprise market to the networking industry. Our CNCF demo at ONS will illustrate to carriers that Kubernetes and ONAP are key to the future of network virtualization.”
To learn more, be sure to check out “Intro to Cross-cloud CI” and “Deep Dive for Cross-cloud CI” at KubeCon + CloudNativeCon Europe, May 2-4 in Copenhagen.
To get involved:
Join the CNCF CI Working Group: https://github.com/cncf/wg-ci
Established, global organizations like Uber, Bloomberg, Blackrock, BlaBlaCar, The New York Times, Lyft, eBay, Buffer, Ancestry, GolfNow, Goldman Sachs and many others use Kubernetes in production at massive scale. Three of the largest cloud providers offer their own managed Kubernetes services. Furthermore, according to Redmonk, 71 percent of the Fortune 100 use containers and more than 50 percent of Fortune 100 companies use Kubernetes as their container orchestration platform.
For these reasons and many more outlined here, the CNCF Technical Oversight Committee (TOC) voted for Kubernetes to become CNCF’s first project to graduate. This designation by theTOC benefits Kubernetes in many ways. It signals that Kubernetes is mature and resilient enough to manage containers at scale across any industry in companies of all sizes. As a graduate, Kubernetes is in an even stronger position to grow faster and sustain a vibrant, healthy and diverse technical community.
Reaching milestones like 11, 258 contributing developers, 75,000+ commits on GitHub, and 158,000 members in global Meetup groups show how vibrant and far-reaching the Kubernetes community is today. Kubernetes is ranked #3 in the30 highest velocity open source projects. With rankings like this it’s no surprise that Kubernetes is defined by many as one of the highest velocity projects in the history of open source. Even Redmonk agrees in a recent blog post that it is no surprise that Kubernetes became one of the fastest growingtechnologies they have ever seen!
The project is so large, with nearly 100 repositories, that we had to develop our own mechanism to manage approval permissions. We have hundreds of approvers, listed in more than 4,000 OWNERS files across the project. To see the impressive ongoing flow of commits and merged contributions, check out CNCF’s Devstats dashboard, which shows thousands of PRs merged per month.
To officially graduate from incubating status, Kubernetes also had to earn (and maintain) a Core Infrastructure Initiative Best Practices Badge. Completed in August of 2016, the CII badge signals a strong commitment to code quality and security best practices.
To sustain this breakneck speed, the project’s governance and community-management practices continue to evolve and mature as the project grows. Early on Kubernetes adopted the CNCF Code of Conduct, and the project recognizes that no contribution is too small or mundane.
COO Chris Aniszczyk presented the Chop Wood/Carry at KubeCon in Austin.
On the technical front, Kubernetes issued four releases in 2017. The latest 1.9 release includes a stable core workloads API, beta support for Windows server containers so users can run Windows-based and .Net-based containers on Kubernetes. The project also made huge gains with cloud native storage by enabling CSI support. This makes it easier for storage vendors to support Kubernetes and creates more storage options and openness for end users. The release received more press than the past 5 releases; generating 237 global articles shared more than 4,000 times across social media channels. The Kubernetes 1.10 release is expected out toward the end of March, so stay tuned at http://blog.kubernetes.io/ for release details.
Kubernetes, congratulations! Today is your day. You’re off to More Great Places! You’re off and away!
Huawei is one of the largest telecommunications equipment manufacturers in the world. It has eight data centers for its internal I.T. department, which run 800+ applications in 100K+ VMs to serve 180,000 employee users.
Huawei recently turned to containerization and Kubernetes, which the company discovered brings agility, scale-out capability, and DevOps practice to cloud-based applications. To learn more, read the in-depth case study.
In the past, Huawei used virtual machines to encapsulate applications, but every time it would start a VM, it took a lot of time. The rapid increase of new applications and the cost and efficiency of management and deployment of VM-based apps created critical challenges.
Development cycles decreased from a week to minutes using a Kubernetes-based Platform as a Service (PaaS) solution. Operating expenses went down, in some circumstances by 20-30 percent. Both a user and a vendor, the company has built the technologies into FusionStage™, the PaaS solution it offers its customers.
We’ve rung in the New Year, but these popular webinar recordings from our vault are worth watching if you missed them last year.
These are our top 5 best attended CNCF webinars of 2017. It’s not surprising that the very recent “What’s New in Kubernetes 1.9” ranks No. 1 on this list. Ihor Dvoretskyi, SIG-PM Lead and CNCF Developer Advocate, hosted a panel with Ken Owens (SIG-Apps Lead), Saad Al (SIG-Storage Lead), David Eads (SIG-API Machinery Lead), and Michael Michael (SIG-Windows). Listen to learn more about 1.9 highlights and major features.
Saad sets the stage for the alpha implementation of the Container Storage Interface (CSI) and the problem it aims to solve. Moving away from entry volume plugins, CSI makes installing new volume plugins as easy as deploying a pod. Michael looks at the results of nearly two years of work in the SIG-Windows community to provide Windows server support to the entire Kubernetes ecosystem. Their goal is for Kubernetes to become the best cross platform heterogeneous cluster manager.
“Cloud Native Networking” from last January took second place, holding broad appeal with both networking engineers and a growing number of developers who increasingly find networking a part of their daily work. In this CNCF webinar, Christopher Liljenstolpe, CTO/Founder of Tigera, and Brian Boreham, Director of Engineering, Weaveworks, dive into networking for containers and microservices. Cloud native computing embraces a much more dynamic and flexible scale up and scale down infrastructure where you need to spin up new containers much faster than in the past with VMs. In this world, Christopher and Brain make the case that new networking technologies are needed. With IP-per-container now an established best practice, container networking is becoming simpler than before for developers and operations.
Brian examines the control plane and data plane, outlines specifics on how control planes are built and the kind of technologies you commonly see within container networking platforms.
Jumping out of order, but sticking with the networking theme, is “Intro to CNI,” our 5th most-attended webinar. Perhaps it has something to do with networking cited as a challenge, admittedly one on the decline, according to our recent cloud native survey.
“Kubernetes 1.8” clocked in as our 4th most popular webinar. Aparna Sinha (PM SIG Lead), Anthony Yeh, workloads and extensibility, and Bradley Childs (Storage SIG Lead) looked at functional improvements in this release as well as the maturing process and formalizing architecture that help to strengthen Kubernetes.
In third is “What is Cloud Native and Why Should I Care?” featuring CNCF TOC Chair Alexis Richardson and Weaveworks CEO. Alexis gives a history of our 3-year-old Foundation, its structure, goals and the processes for accepting new projects and new members.
Back to the present – we invite you to register for our upcoming “Machine Learning and AI in the Datacenter and How It Will Affect You” webinar, 10:00 am – 11:00 am PST on February 6. Nick Chase, Head of Technical and Marketing Content for Mirantis and a member of the Kubernetes documentation team, will explore growing excitement for machine learning (ML) and AI and its sudden accessibility in the form of open source libraries. Nick will give a fast-paced introduction to ML and how it actually works, as well as what it might look like in action in your datacenter — especially in terms of projects that already exist.
BlackRock, the world’s largest asset manager that saw record net inflows in 2017 of $367 billion, recently rolled out a full production Kubernetes environment in 100 days and released a new investor research web app on it, within one quarter.
While enterprises without legacy systems are seeing similar results with Kubernetes, BlackRock’s experience is different in that it didn’t have to disrupt everything so that it could work with Kubernetes. Instead, it integrated Kubernetes into existing well-orchestrated machinery within BlackRock’s framework.
The team worked around corporate firewalls, implemented service discovery and customized messaging protocols across different environments. BlackRock didn’t throw everything out, and it still reaped the rewards of rapid deployment.
It looks at how Kubernetes integrated into BlackRock’s existing framework and how much time and costs were involved (less than they thought!).
Leading up to KubeCon + CloudNativeCon North America (December 6-8, 2017), the Cloud Native Computing Foundation conducted a survey of our community to learn more about the current landscape of cloud native technologies. More than 550 community members responded; here are a few responded highlights:
44% are in the technology industry
49% work for North America-based companies; 32% work for Europe-based companies
37% identified as DevOps and 29% identified as Developers
55% worked at companies under 500 employees
28% came from companies with more than 5000 employees
The goal of these surveys, which are issued in advance of our bi-annual conferences, is to understand the state of Kubernetes’ deployments and other container management platforms, as well the progress of container deployment in general. This is the third time CNCF has taken the temperature of the container management marketplace. We continue to include comparisons to other surveys, such as Google’s own Kubernetes Surveys in March 2016 and June 2016 to highlight important trends in this space.
We added new questions that shed light on serverless technologies, Kubernetes ingress providers, and monitoring and logging tools.
You can view the results from our previous survey from CloudNativeCon + KubeCon Europe (March 29-30, 2017) here. This is also the first time we are conducting the survey in Chinese and will publish those results soon.
The Container Orchestration Landscape is Changing
Breakdown of how companies/organizations are managing containers
Kubernetes continues to lead as the container orchestration tool of choice. However, we’re beginning to see more respondents choosing managed container orchestrators such as:
Google Container Engine (now Google Kubernetes Engine) (20%), Amazon ECS (18%), and Rancher (9%). These platforms will be included in future graphs so we can track their growth in the container management space.
Based upon our survey data, it would appear that OpenStack’s role in the container space is evolving. OpenStack’s use on a standalone basis for container management is continuing to decline, dropping from 37% in November 2016, to 17% in March 2017, and now to 0% in this most recent survey. Note, OpenStack was not explicitly included as an option in this question; however, no respondents noted its usage in the “other” category. However, many respondents continue to deploy containers on top of the OpenStack platform, in conjunction with orchestrators like Kubernetes(up to 22% in December 2017 from 2% in November 2016).
Container Deployment Remains Strong Both On-Premise and in the Cloud
Breakdown of environments where companies/organizations are deploying containers
Amazon (EC2/ECS) continues to grow as the leading container deployment environment (69%). Digital Ocean (7% to 14%) is also showing increased usage between March 2016 and December 2017. On premise deployment decreased for the first time in the December 2017 survey since March 2016 (51%), but still remains a leading deployment environment.
This survey is also the first time we’re tracking the following deployment environments: Alibaba Cloud (3%), IBM BlueMix (5%), Oracle Cloud (1%), Packet (2%), SAP Cloud Platform (2%).
The top deployment environments (cloud and on-prem) for Kubernetes are mirroring the results for the top container deployment environments.
Environments where companies are deploying containers vs. where companies are running Kubernetes
Kubernetes is mostly being run in AWS (57%), On-Premise Services (42%), and Google Cloud Platform (33%).
Kubernetes Continues to Move from Development to Production
Stages in the development process where Kubernetes is being used
Containers continue to be used across a variety of development stages and increasingly in production (75% up from 69% in March 2016). These survey results are consistent with what we are hearing about more and more companies moving from proof-of-concept (POC) to successful and scalable production applications. Check out these case studies on how companies are using Kubernetes from development to production here.
Similar to the the trend we saw in March 2017, it’s notable that 25% of companies have future plans to expand their container usage into production.
Container Usage Continues to Rise to 250+
Number of containers in use
Companies are continuing to deploy an increasing number of containers with 49% deploying 250+ (up from 45% in March 2017). Low-volume deployments (<50 units) decreased from 27% to 23% and high-volume deployments (>5000 units) increased from 11% to 15%.
As Container Usage Expands, New Challenges Arise
Top challenges companies are facing when deploying containers
Existing challenges of deploying containers, such as networking, security, and storage, started to decrease across the board. This survey explored new challenges that we expect companies to encounter as they deploy larger volumes of containers. Monitoring (38%) and scaling deployments based upon load (24%) were newly added to the survey and are clearly also important challenges faced by our respondents.
Adoption of CNCF Projects
Kubernetes is the most used CNCF project in production (84%), followed by Prometheus (48%), and Fluentd (38%). The growth across CNCF projects remained mostly flat between November 2016 and March 2017 with the exception of gRPC usage in production increased 34%.
Companies are evaluating the following cloud native technologies: Kubernetes (61%), Prometheus (49%), gRPC (29%), OpenTracing (25%).
The Expansion of Serverless Technology
For the first time in this survey, we started to track the usage of serverless technology: 41% of survey respondents currently use serverless technology, while 31% do not. An additional 28% have plans to use it within the next 12-18 months. Of the respondents currently using serverless technology, 70% are using AWS Lambda. Followed by Apache OpenWhisk (12%), Azure Functions (12%), and Google Cloud Functions (13%).
As more companies plan to add serverless technologies to their stacks, the CNCF is working to become the intersection of cloud native and serverless. If you’re interested in getting involved, join our Serverless Working Group.
The Future of Cloud Native Technologies
Cloud native technologies are continuing to expand into all sizes of companies and at a greater scale in production. While companies are growing their usage of containers in all facets of their development cycle, they’re also adding new cloud native technologies that complement Kubernetes to their technology stack.
The future of cloud native is exciting, with more than 93% of respondents recommending CNCF technologies.
Upcoming Events – Join Us to Learn More Kubernetes in Production
Interested in learning more about how to use Kubernetes and other cloud native technologies in production?
The CNCF’s flagship KubeCon + CloudNativeCon will take place May 2-4 in Copenhagen. The event gathers leading technologists from multiple open source cloud native communities to further the education and advancement of cloud native computing.