Microsoft Rolls Out OpenJDK Preview Release

Java developers got a preview today of the soon-to-be-released Microsoft build of OpenJDK, a Long-Term Support (LTS) distribution of Redmond's version of the ubiquitous open-source Java dev kit. This preview release includes binaries based on OpenJDK 11 for x64 platforms covering the three major operating systems: macOS, Linux, and Windows.

The Microsoft build of OpenJDK binaries for Java 11 are based on OpenJDK source code, the company says, following the same build scripts used by the Eclipse Adoptium project and tested against the Eclipse Adoptium Quality Assurance suite (including OpenJDK project tests. The binaries for Java 11 have passed the Java Technical Compatibility Kit (TCK) for Java 11, which is used to verify compatibility with the Java 11 specification. 

This build is free, of course, and designed to be a simple drop-in replacement for any OpenJDK distribution available in the Java ecosystem.

Microsoft is also publishing an early access release for Java 16 for Windows on ARM, the company says, based on the latest OpenJDK 16+36 release.

"Java is one of the most important programming languages used today," wrote Java Champ Bruno Borges, principal product manager for Microsoft's Java group, in a blog post. "Developers use Java to build everything from critical enterprise applications to hobby robots. At Microsoft, we’ve seen increasing growth in customer use of Java across our cloud services and development tools. We’re continually working to broaden and deepen our Java support for customers and developers."

As my colleague, David Ramel, pointed out in his report in our sister publication Visual Studio Magazine, "Microsoft jumped on the Java bandwagon in a big way back in 2019 by forming the Java Engineering Group in its Developer Division and acquiring jClarity to optimize Java workloads in its Azure cloud platform (despite the similarities between Java and Microsoft's own C#). "Last year, it ported OpenJDK for Windows 10 on Arm (AArch64)-based devices."

(We also covered Microsoft's assimilation into the OpenJDK ecosystem on ADTmag.)

Scott Sellers, CEO of open-source Java platform provider Azul Systems, sees the release as further evidence of a strong Java ecosystem.

“We believe that a thriving OpenJDK community is key to Java’s continued success," Sellers told me in an email, "and we welcome Microsoft to the impressive list of those offering builds of OpenJDK. This is great news for OpenJDK and Java in general, and further fuels the momentum as enterprises and developers move off proprietary Java offerings to OpenJDK distributions. We look forward to our ongoing collaboration with Microsoft in support of Azure’s Java users and of the Java user community as a whole."

Along with the upcoming Eclipse Adoptium builds of OpenJDK, the community of ongoing OpenJDK distributions currently includes Azul’s Zulu builds of OpenJDK, the Red Hat builds of OpenJDKAmazon’s Corretto builds of OpenJDKSAP’s SAPMachine builds of OpenJDKAlibaba’s Dragonwell builds of OpenJDK, and BellSoft’s Liberica builds of OpenJDK. (Eclipse Adoptium is a continuation of the AdoptOpenJDK project.)

"Our contributions to OpenJDK started small as we learned about the process and how to participate in a meaningful way," Borges wrote. "Over the past 18 months, we contributed more than 50 patches covering areas such as macOS packaging, build and infrastructure, GC fixes, and enhancements for Windows."

In fact, Java has become an essential technology at Microsoft, which once viewed Java's creator, Sun Microsystems, as a mortal enemy, and open-source in general as a danger to the industry. Microsoft currently deploys more than 500,000 Java Virtual Machines (JVMs) internally, the company says, excluding all Azure services and customer workloads with needs that go from back-end microservices to Big Data systems, message brokers, event streaming services, and gaming servers, the company says. More than 140,000 of these JVMs are already based on the Microsoft Build of OpenJDK.

Later this year, the Microsoft Build of OpenJDK will become the default distribution for Java 11 across Azure-managed services, Microsoft said in a statement. "Customers won’t have to perform any maintenance tasks, as the transition will be smooth and transparent through application deployments," the company says. "For all other Azure services, customers can bring their JDK of choice including Microsoft Build of OpenJDK. We will provide more updates on that in the coming months."

Posted by John K. Waters on 04/06/2021 at 9:39 AM0 comments


VMware Launches New Multi-Cloud Platform

VMware unveiled a new distributed, multi-cloud platform this week designed to help its customers simplify the adoption and operation of multi-cloud environments.

The pitch for the new VMware Cloud is aimed at both software developers and IT operators. The platform is designed to boost the productivity of devs by enabling them to build and deploy to any cloud. The platform also gives IT the ability to modernize infrastructure and operations with better economics and less risk.

VMware Cloud brings its customers what the company calls "a more integrated experience," via the new Cloud Console, a single monitoring and management environment for VMware Cloud infrastructure, regardless of where it’s deployed; the App Navigator, a new tool for assessing and prioritizing application transformation initiatives across an application estate based on the value of each app; and VMware Cloud Universal , a flexible subscription that simplifies the purchase and consumption of VMware multi-cloud infrastructure and management services.

VMware has been heading for some version of this offering for years—20 of them, more or less. The company justifiably claims some huge numbers: 300,000 organizations have built and run more than 85 million workloads on VMware, and more than 5 million developers have built apps on its technology.

“We are on the cusp of the next evolution of cloud and apps," said VMware COO Raghu Raghuram, in a statement. "Architectures are becoming distributed and increasingly multi-cloud, while modern applications will soon outnumber traditional apps. The challenge for any CIO is to take advantage of this new innovation without introducing more complexity and risk."

VMware Cloud is the solution for this challenge, Raghuram said. It's the only cloud solution that customers can use today in the datacenter and on any cloud to "accelerate their modernization journey with speed, simplicity, and better security."

The company's pitch for the new platform aside, Raghuram offered a great observation about the impact of the quarantine on demand for these kinds of cloud from the enterprise in a blog post.

"Today we see incredible demand for digital-first services," he wrote, "from telemedicine to distance learning to touchless systems in retail and financial services. Nearly three-fourths of businesses we surveyed are expanding their investment in new services that engage customers or support what is now a long-term remote workforce with the tools to be productive. It’s one of the reasons why we see cloud adoption accelerating faster than ever, with cloud deployments expected to grow by 26%. And even more interesting, why businesses are investing so heavily in app modernization. In fact, of the organizations we’ve studied this year, 90% of executives are prioritizing migration and modernization of their legacy apps. The message is clear: the apps and services powering businesses today simply must evolve to meet the needs of the business in the future."

And there's an opportunity here for developers.

"We see a model for cloud that is both increasingly distributed and diverse – with apps deployed across a range of public clouds, within the data center and at the edge – but unified with centralized management and operations, centralized governance and security," he wrote. "This distributed multi-cloud model delivers the flexibility to build and run any application in the best environment, and access to the vast array of innovation from cloud providers, along with a unified model for security and operations at the level every enterprise demands."

That model, Raghuram said, is at the heart of the VMware Cloud platform.

Posted by John K. Waters on 03/31/2021 at 9:58 AM0 comments


Eclipse Foundation Launches Adoptium Working Group Focused on AdoptOpenJDK Mission

The Eclipse Foundation this week announced the formation of the Eclipse Adoptium Working Group, a collaboration of vendors supporting the efforts of the Eclipse Adoptium Project, formerly known as AdoptOpenJDK.

AdoptOpenJDK is an open, community-led initiative formed to provide free, pre-built binaries of the reference implementation of the Java platform from OpenJDK. Since it was founded in 2017 by Martijn Verburg, a leader of the London Java Community, AdoptOpenJDK has seen more than 240 million downloads.

The Eclipse Adoptium Project is the continuation of the original AdoptOpenJDK mission, explained Mike Milinkovich, executive director of the Eclipse Foundation, and the working group was created in collaboration with the AdoptOpenJDK Technical Steering Committee.

"AdoptOpenJDK is about providing enterprises with high-quality Java runtimes, without requiring them to enter into a long-term support contracts with Oracle or one of the other vendors playing in that space," Milinkovich told me. "And Adoptium is a multi-vendor, vendor-neutral effort to reduce the costs for getting Java runtimes."

The Adoptium Working Group was created to provide the Java ecosystem with fully compatible distributions of Java runtimes based on OpenJDK source code—not a fork of OpenJDK, Milinkovich emphasized. "The intent here is for the community to pool its resources to build open JDK source code and deliver high-quality runtimes," he said.

The new working group has the support of Oracle, Milinkovich said. "We negotiated an agreement with them to get access to the TCKs, so that we know every runtime we deliver from Adoptium is going to be fully certified is 100% Java SE compliant," he said.

The Foundation emphasized this cooperation in its announcement: "This new open source working group was only possible through the successful negotiation of the OpenJDK Community TCK License Agreement (OCTLA) with Oracle, the steward of OpenJDK, the Java Community Process, and the Java compatibility brand. Under the terms of this agreement, Adoptium will run compatibility tests to ensure conformance to the Java specification."

Adoptium was founded by individual Java developers and a list of vendors that includes Alibaba Cloud, Huawei, IBM, iJUG, Karakun AG, Microsoft, New Relic, and Red Hat. The working group "complements the Eclipse Adoptium project" and will "provide the infrastructure, marketing, community building, and developer advocacy work needed to continue to ensure timely releases to the community and further the adoption of Eclipse Adoptium"

AdoptOpenJDK was popular and well established when its Technical Steering Committee decided it needed the Eclipse umbrella. "In every open source project’s life comes a time to take the necessary steps to enshrine its independence and longevity in a proven cultural and legal framework," Verburg wrote in a blog post announced the move last June. "A project of AdoptOpenJDK’s size and scale also needs an awful lot of logistical support, and the cracks in some places are starting to show!"

"Joining the Eclipse Foundation allows AdoptOpenJDK to continue to grow and to focus on our mission," he added.

"What the Eclipse Foundation brings to AdoptOpenJDK is a well-regarded, vendor-neutral governance model, and a well-documented development process," Milinkovich said. "Our IT staff is going to be doing a lot of work on the additional infrastructure required. There's quite a large-scale of infrastructure needed for doing the builds. We also have to provide the private infrastructure for doing the TCK tests. Oracle's TCK's are proprietary, so we can't do them out in the open, like we do most things. And then there's the additional test suite for quality testing that has to be supported in our infrastructure. The working group will be sharing the cost of creating that infrastructure, as well as doing a little developer advocacy, building some websites, etc. But we really are leveraging the good work that was done at adopt OpenJDK over the last couple of years."

Posted by John K. Waters on 03/24/2021 at 3:42 PM0 comments


RedMonk Ranks Programming Languages Using GitHub and StackOverflow

Programming language rankings get regular headlines, and they should, at least from trend trackers like us. Among my favorite is the RedMonk quarterly, published this week. I like the methodology of their system, which extracts data from GitHub and Stack Overflow and combines them for "a ranking that attempts to reflect both code (GitHub) and discussion (Stack Overflow) traction."

In other words, it correlates what the cool kids are talking about with actual language usage "in an effort to extract insights into potential future adoption trends." It's a mix that makes it meaningful.

The latest ranking was posted by veteran industry analyst Stephen O'Grady on his RedMonk blog. "GitHub and Stack Overflow are used here, first, because of their size, and second, because of their public exposure of the data necessary for the analysis," he wrote.

O'Grady's post includes thoughtful observations about JavaScript, TypeScript, Ruby, Go, R, Kotlin, Rust, and Dart.

There's quite a lot of change afoot in the programming world, the analysts found, but constant has been the rise of Python, which has maintained its top ranking ahead of Java. "Java was extremely hot on Python's heels – and was in fact closer to the number one ranking than to PHP behind it – but Python's ability to defend its new high ranking is notable," O'Grady wrote.

Half of the Top 20 languages experienced "a degree of movement," O'Grady added, "which is very unusual. It's difficult to attribute this definitively to any higher level macro trends, but the data is consistent with an industry that picked the pace back up in the last two quarters of the year after the initial chaos of lockdowns and so on gave way to livable if extremely suboptimal new routines."

JavaScript is holding its own in the rankings. "[I]t is worth noting just how robust JavaScript's performance remains," O'Grady observed. "In spite of all of the competition from up and coming languages, all the discussion of fragmentation and even criticisms of JavaScript the language itself, it remains remarkably popular.

JavaScript pull requests are up 453% since Q1 of January of 2018, and they were up 96% from the last quarter "on an already massive base of commits." '

'Simply put, JavaScript remains – its detractors notwithstanding – a force of nature like no other within the industry," he wrote, "and there are no indications in the data that this is likely to change any time soon."

TypeScript, which is a superset of JavaScript, moved up for the sixth of its latest eight quarterly RedMonk rankings, "and its popularity is evident when one looks around the industry." Ruby is on a gentle long-term downward trajectory, the analysts found. Go is slipping, too. R, a language for statistical computing and graphics, appears to be on a slow upswing. Both Kotlin and Rust showed signs of growing popularity. And Dart, an open source, purely object-oriented, optionally typed, and a class-based language, has risen since the advent of the Flutter framework.

Th RedMonk report surrounds a cool plotting of the language rankings with detailed analysis of key trends over the past quarter. As far as I'm concerned, it's a must read.

Posted by John K. Waters on 03/04/2021 at 11:54 AM0 comments


Foojay: A Place for Friends of OpenJDK

Foojay.io, the community site for developers who use, target, and run their applications on top of Java and OpenJDK, today announced the companies who will make up its advisory board. The roster includes Azul, Datadog, DataStax, JFrog, Payara, and Snyk. This board will guide the direction, content and oversight of the site, with a focus on growing the community and meeting its mission to provide free information for everyday Java developers.

In case you missed it (which I must confess, I did), Foojay is a nascent-but-evolving-at-warp-speed Java information consolidation site for everyone from hard-core, in-the-trenches Java jocks to the Java curious. And it is a thing of beauty. It organizes information from multiple sources into logical categories and delivers the warts-and-all info you won't see on the vendors' sites.

The site has articles, definitions (via the adorably named "Foojaypedia"), an events calendar, a Java Version Almanac that goes back to the Java 1 released in 1996, and up to Java 16. It lists OpenJDK vendors and distributions. There's a "What's New in OpenJDK/OpenJDK Update Release Details" section, and a section called "OpenJDK Command Line Arguments," with info on all the JVM command line arguments from Java 6 onwards. And the "Foojay Today" section publishes blog posts.

Running the project is the inimitable (and unpronounceable) Geertjan Wielenga, senior director of Open Source Projects at Azul and author of the must-read book Developer, Advocate! He talked with me about the project, which was started in April of last year, and has grown rapidly beyond early expectations. He said he thinks of it as a Java dashboard curating all the latest information for developers using Java daily,

"Back when I worked at Sun Microsystems," Wielenga told me, "you could go to Java.net and find blogs, opinion polls, and information about Java on a common community platform. And it was easy, because there was only one JDK and there were new releases only every year or so. And there was only one vendor. Since then, you could say Java has diversified, or you could say it has fragmented, but either way, we now need a layer on top of all these different OpenJDK vendors, distributions, releases, and various disparate Java communities, so that somebody starting from scratch has a place to go, and so does someone wanting a launching pad for being productive in a safe place."

The ultimate goal is to create a community like Java.net, Wielenga said.

"Foojay is an example of the strength and longevity of the Java community that is greater than any single company," said Stephen Chin, VP of Developer Relations at JFrog, in a statement. "It is composed of active, passionate, and caring individuals who want to share their expertise and help mentor the next generation of developers. We're excited to be part of the conversation and help the community leverage modern CI/CD and cloud-native technologies for our beloved Java."

Posted by John K. Waters on 02/04/2021 at 9:16 PM0 comments


Eclipse Foundation Puts Down Formal Roots in Belgium

The Eclipse Foundation's move to Europe continues apace with the formal establishment last week of the Eclipse Foundation AIBL, its new international non-profit association in Brussels, Belgium. The new European entity launches with the support of founding members Bosch, Daimler TSS, IBM, and SAP, the Foundation said in an announcement.

The Eclipse Foundation is one of the world's leading open-source software foundations, steward of the Eclipse IDE, enterprise Java, and the Eclipse MicroProfile, and the heart of a global ecosystem of developers, companies, and public sector entities. By moving its legal residence from the United States to Belgium, the Foundation has created "a global institution that builds on its existing membership base, active developer community, and strong institutional relationships to enable collaboration and the free flow of open source software innovation throughout the entire world," the announcement reads.

I talked with the Foundation's executive director, Mike Milinkovich, who has led the organization since its founding nearly 17 years ago, about the move last year. This seemed like another milestone moment to catch up, and he reminded me that "this is a proh-sess, not an event." (Canadians.)

"This is going to end up being a couple of years from the time we started to the time we're done" he said, "before we can say that we've fully completed the transition and emerged on the other side with our organization as it's going to be in the long term."

When Milinkovich talks about "the transition," he's not talking about shipping office furniture, of course. The move of the Eclipse.org Foundation, Inc., from a Delaware-based 501 C (6) non-profit organization to a Belgium-based 501 C (6) non-profit (also recognized by U.S. laws) involves some heavy lifting on the software side, and a couple of moving vans worth of membership agreements; working group documentation; intellectual property, trust policy, and trademark guidelines; and now, with Jakarta EE, platform specifications. Nevermind remapping of the Foundation's bylaws from the U.S. to a different legal framework.

"It's going to end up being a couple of years from the time we started to the time we come out on the other side, fully completed," he said.

The story of how the Eclipse Foundation got here stems from the organization's discovery of an already large European footprint.

"It started in October 2019, when, during a Foundation strategy session held in conjunction with the EclipseCon Europe event just outside Stuttgart, Germany," Milinkovich explained. "We were doing strategy setting for the following year, and one our European based directors said that we seemed to be doing really well in Europe, and wondered if we could do an analysis of where we were Europe. And so we started crunching some numbers and we found out that 70% of our paying members and 70% of our developers were based in Europe. We had, gradually over time, become a very Euro-centric organization; in terms of the number of employees, projects, and developers we had over there, we actually already were the largest open-source foundation in Europe. Seeing the numbers in black-and-white really brought it all home."

"And if we didn't do something," he added, "someone else would."

The move has been "remarkably smooth so far," Milinkovich said. To keep track of the Foundation's progress, be sure to subscribe to the organization's blog.

And while you're at it, keep reading this one.

Posted by John K. Waters on 01/21/2021 at 7:28 AM0 comments


Bruno Souza on Eclipse Jakarta EE 9 and the Future of Java

One of the biggest events in the Java universe last year was the official release of the Eclipse Jakarta EE 9 Platform, Web Profile specifications, and related TCKs. It moved enterprise Java fully from the javax.* namespace to the jakarta.* namespace. That's about all it did, actually, but it was an extremely consequential change.

I talked with lots of people about the latest shift in the evolution of enterprise Java, and one of the guys I was most excited to connect with on this topic was Bruno Souza, founder and leader of the Brazil-based SouJava, the largest Java User Group (JUG) in the world. Souza was one of the initiators of the Apache Harmony project to create a non-proprietary Java virtual machine, he serves on the Executive Committee of the Java Community Process (JCP), and he's on the board of advisors at Java-based Platform-as-a-Service (PaaS) provider Jelastic.

"I was very excited about Jakarta EE, and we [at SouJava] were onboard from the very beginning," Souza told me. "I think it was a very courageous move for Oracle to get all this awesome and extremely valuable IP and donate it to the Eclipse Foundation.… [When] you have this big player that does everything, it's very hard for anyone to come in and help. Oracle was this big guy doing everything, and so, everyone was just kind of doing small things around design… The only way to get a Java EE [community] that was more open and participatory was for Oracle to reduce its participation. And they did it!"

Souza offered kudos to the Eclipse Foundation and its executive director, Mike Milinkovich, even though Oracle refused to give up the javax.* namespace, forcing the foundation to adopt jakarta.*, and he believes the change will be better for the enterprise Java community in the long run. Souza was also on the side of the slow move, he said, and not a supporter of the so-called Big Bang, the plan for a complete change-over from javax.* to  jakarta.*, which the foundation did employ.

"Mike was a superb negotiator in all this," he said, "I don't think people realize what a huge thing this was…. The Java trademark is very valuable and it impacts a lot of different things, so I do understand [Oracle's position]…. And I wasn't a fan of the Big Bang, but honestly, I got convinced, and when the decision was made, I got behind it. Instead of us having this process that's going to take years and years and years, let's do it once, 'ripping off the band aid,' so everyone can get mad this one time, and we move on from there."

The release of Jakarta EE 9 might not seem like a big deal, Souza said, because it was primarily a shift of name spaces with very little in the way of upgrades. But now that that herculean task is complete, the community has the ability to innovate free of potential constraints from a dominant commercial player.

"My expectation is that now people will feel that this change was slow," he said, "but if you look at the long history of Java EE, it's relatively fast, and the process is going to get a lot faster…. And I think people want an ecosystem they can trust."

I asked Souza about what seems to be the background role played by the JCP in this exceedingly consequential change in the Java world.

"The JCP is the standards organization, and the truth is, innovation does not happen within the JCP," he said. "Innovation has always happened outside the JCP, in the field, where you can experiment, go as fast as you want, and break things. The standards process is not the place to innovate. But I will say that the JCP was very clear and very much at peace with that idea. And the elephant in the room is that the JCP is an Oracle entity. It's very open, and we've made it even more open in the last few years. And at the same time I think that there's always a barrier to how open you can be when you're inside a company. With Jakarta EE, we broke from this barrier and now we have an independent organization, which Oracle and IBM and others are part of, that can run a standards process. So, I don't see the JCP as reducing in size, but Java as growing."

You can hear the rest of my conversation with Bruno Souza, in which he reflects on the future of Java, on The WatersWorks Podcast. It's available on Apple Podcasts, Spotify, and most other providers.

Posted by John K. Waters on 01/07/2021 at 10:40 AM0 comments


New App Intelligence Platform Gets Control of 'Chaos'

Bionic, a company offering a new application intelligence platform, emerged from stealth recently and caught my eye. The platform was designed to provide enterprises with the ability to understand and control the "chaos" created by the "onslaught" of application changes pushed to production every day."

"Basically, we realized is that, with everybody moving to cloud containers, Kubernetes, Agile, and DevOps, it's empowering developers like never before," Idan Ninyo, co-found and CEO, told me. "And they're releasing more and more changes into production every day. The result is developers are so empowered and independent it creates this chaos, because every developer can kind of do whatever he wants."

The Palo Alto, Calif.-based company was founded in 2019 by Ninyo and CTO Eyal Mamo to manage this chaos, Ninyo said. Both co-founders spent over five years in Unit 8200, the Israeli Intelligence Corps unit of the Israel Defense Forces responsible for collecting intelligence and code decryption.

Bionic's application intelligence platform automatically reverse engineers applications to deliver a comprehensive inventory with architecture and dataflows, monitoring critical changes in production, and enabling developer "guardrails" to enforce architecture. Bionic is agentless and designed to work across all environments, from on-premises monolithic apps to hosted cloud-native microservices.

Ninyo emphasized that Bionic's offering is not an observability solution.

"You can think about this technology as a kind of automated reverse engineering engine that deciphers the architecture when the developers get out of the binary or the script or whatever it is. And by doing so, we can create a full map of the production environment within minutes.  after the point. Our current customers include developers, DevOps platform engineers, security--basically everybody needs this data."

The current pandemic could have thrown a wrench into the company's plans, but because it turned out to be something of an accelerator of digital transformation initiatives, Ninyo said, the  platform has seen a rapid adoption uptake. (He and his partner ran the launch from Tel Aviv.) Bionic's app intelligence platform is currently in use by IT, operations, and security teams at pharmaceutical, financial services, and technology companies.

"The pandemic accelerated digital transformation efforts across almost all organizations, especially since employees are working from home and enterprises are becoming more reliant on their digital offerings," Ninyo said in a follow-up email. "That has made the issue of application chaos ever more acute for enterprise IT teams. All these organizations realize that they must maintain compliance, reduce risk, and improve resiliency without slowing down the rate of development."

Posted by John K. Waters on 12/17/2020 at 12:00 PM0 comments


Intel Distro of OpenVINO Helps Devs with Inferencing Beyond Computer Vision

Developers continue to adapt to the advent in nearly everything of Artificial Intelligence (AI), or more precisely, machine learning (ML) and deep learning (DL). And the tools are evolving with them and this growing demand.

One example is the OpenVINO toolkit. OpenVINO stands for Open Visual Inference and Neural Network Optimization. It's a toolkit developed and open sourced by Intel to facilitate faster inferencing in deep learning models on Intel hardware. It's based on convolutional neural networks (CNN), a deep learning algorithm designed for working with two-dimensional image data, although it can also be used with one-dimensional and three-dimensional data. The open-source version is licensed under and Apache License v2.

I talked with Bill Pearson, VP of Intel's IoT group, about his company's distro of OpenVINO.

"I suppose the key thing this tool does is to simplify the process of helping developers with their high performance inferencing needs," Pearson told me. "We're seeing a number of different use cases and requirements for doing inference--which silicon do I need, and what programming models on top of it. This can be quite confusing, so with OpenVINO, we created an API-based programming model that allows you to write once and deploy anywhere. What that means practically is, we take all the complexity of writing for FPGA, GPU, CPU, or whatever. We hide that complexity, so the developers have a consistent interface that lets them literally write once and then deploy to any of those different architecture types, depending on their needs and their requirements."

The first set of use cases Intel focused on were all computer vision related, Pearson said, because that's where most developers needed with inferencing. But with the most recent release of the toolkit, Intel is looking at inference beyond computer vision.

OpenVINO 2021.1, announced in October, is designed to enable end-to-end capabilities that leverage the toolkit for workloads beyond computer vision. These capabilities include audio, speech, language, and recommendation with new pretrained models; support for public models, code samples, and demos; and support for non-vision workloads in the DL Streamer component.

This release also introduces official support for models trained in the TensorFlow 2.2.x framework; support for 11th generation Intel Core processors (formerly code named Tiger Lake); and new inference performance enhancements with Intel Iris Xe graphics, Intel Deep Learning Boost (Intel DL Boost) instructions, and Intel Gaussian & Neural Accelerator 2.0 for low-power speech processing acceleration.

It comes with the OpenVINO model server, which is an add-on to the Intel distro, and a scalable microservice. "This add-on provides a gRPC or HTTP/REST endpoint for inference, making it easier to deploy models in cloud or edge server environments," the company said in a statement. Also, it's now implemented in C++, which enables reduced container footprint (for example, less than 500 MB), and delivers higher throughput and lower latency.

There's also a beta release due this quarter that integrates the Deep Learning Workbench with the Intel DevCloud for the Edge. The result: developers can now graphically analyze models using the Deep Learning Workbench on Intel DevCloud for the Edge, instead of being stuck on a local machine only, to compare, visualize, and fine-tune a solution against multiple remote hardware configurations. And there's another add-on: the OpenVINO model server, which provides a gRPC or HTTP/REST endpoint for inference, making it easier to deploy models in cloud or edge server environments. It's now implemented in C++, to enable reduced container footprint (for example, less than 500 MB), and deliver higher throughput and lower latency.

"We have to deliver features, of course, but we also need to deliver on performance," Pearson said. "With this release, that's what we've done. Applying CNN is helping us to take advantage of modern AI, to be able to get models that do a much better job at delivering what we'd expect from inference, and to be able to detect that defect or notice that object."

Pearson offered a customer example: "There are some great you know customer examples where we've seen this be the true. The earliest things we've seen are in finding manufacturing defects. There's an aluminum engine provider, who was doing inspections the old way--by hand. They had to wait for these objects to cool so that a person could turn it and look at it. You can imagine that doing that with a computer and a camera is going to be much more accurate and much quicker. And we've just seen this expand way beyond that to use cases in health care for medical screenings, and things like sewer pipe inspections--which basic, but essential--and in businesses like retail, where we're going through these frictionless checkout systems and trying to be able to see what objects are going through the scanner and track tell what what's being processed"

Intel OpenVINO is available today on its DevCloud.

Posted by John K. Waters on 12/15/2020 at 12:00 PM0 comments