Testing a Chinese x86 CPU: A Deep Dive into Zen-based Hygon Dhyana Processors

https://www.anandtech.com/show/15493/hygon-dhyana-reviewed-chinese-x86-cpus-amd

原贴有分页

 

                          We Tested Hygon Dhyana Processors                       Our Hygon Systems: 8-core Dhyana and dual 32-core Dhyana Plus                       Hygon CPUs: Chinese Crypto, Different Performance                       Benchmarks: Windows                       Conclusions            

In 2016, through a series of joint ventures and created companies, AMD licensed the design of its first generation Zen x86 processors to be sold into China. The goal of this was two-fold: China wanted a ‘home grown’ solution for high-performance x86 compute, and AMD at the time needed a cash injection. The outcome of this web of businesses was the Hygon Dhyana range of processors, which ranged from commercial to server use. Due to the Zen 1 design on which it was based, it has been assumed that the performance was in line with Ryzen 1000 and Naples EPYC, and no-one in the west has publicly tested the hardware. Thanks to a collaboration with our friend Wendell Wilson over at YouTube channel Level1Techs, we now have the first full review of the Hygon CPUs.

Let’s Start From The Beginning

There are two/three primary manufacturers of x86 processors: Intel, AMD, and Via/Centaur. Both Intel and AMD have been competing in the high performance compute space for multiple decades, and the reason there hasn’t been any other competitors is due to licensing. Due to patents surrounding the x86 architecture, Intel doesn’t want anyone else coming in and treading on its market share dominance, and to complicate matters, it is AMD’s version of 64-bit x86 that is currently being used by all involved. Intel and AMD are inextricably linked in this way. Meanwhile. Via/Centaur is along for the ride, with a very small market share mostly in Asia, and a lack of a leading edge high performance competitor.

For those who haven’t been following AMD, the company has been through a number of ups and downs. A significant down was during its Bulldozer CPU architecture years, where costs were high, performance wasn’t great, and Intel pulled ahead significantly in all areas: laptop, desktop, commercial, and enterprise. The design of Intel’s CPUs and its market dominance strategy, combined with the lack of a leading edge competitive product for AMD along with the purchase of graphics IP company ATI, nearly bankrupted AMD. Through the leadership of the former CEO, Rory Read, AMD became stable, and under the auspices of current CEO Dr. Lisa Su, the company put heavy investment back into its x86 CPU design. At one point, AMD’s debt was higher than its tangible assets, and the company had to even sell its headquarters and lease the buildings back from the new owners to find the funds to stay afloat.

Another element of this ‘staying alive’ tactic was the sublicensing of AMD’s x86 IP, which ultimately created the Hygon Dhyana x86 processors for China. Some people will quote this as being a keystone for AMD staying alive, however it is of a general consensus that this sublicensing ultimately secured AMD only around $200m (until the US entity list ban) out of the original $293m deal. At that time AMD was already making quick strides into the consumer market with its Ryzen 1000-series processors, which offered eight cores with modestly competitive performance while beating Intel on performance-per-dollar, giving AMD enough to reinvest in its key areas. The sublicensing ultimately provided AMD more of a safety net, depending on the success of the first generation Ryzen product portfolio.

AMD Does Due Diligence

Simply stating ‘AMD sublicensed the IP of one of its x86 designs’ sounds a bit farfetched on most days of the week. If either AMD or Intel believed that the opportunity to let others sell its CPU designs was profitable, how come it took until 2015/2016 to ever come to fruition? Part of this story covers that while there was clearly some money in it for AMD here, it didn’t fall foul of any Intel-AMD licensing agreements. And most importantly, it didn’t contravene any US laws regarding the export of high-performance computing intellectual property.

This last point is important. The US government gives every CPU that comes out of Intel, AMD, and others, a value based on its performance. This is some combination of FLOPs and power, and those that surpass a specific threshold are deemed too powerful to be sold in certain markets. This includes semi-custom processors, where AMD/Intel fiddle with the core count/frequency and provide off-roadmap parts.

AMD at the time made the following statement:

Starting in 2015, AMD diligently and proactively briefed the Department of Defense, the Department of Commerce and multiple other agencies within the U.S. Government before entering into the joint ventures. AMD received no objections whatsoever from any agency to the formation of the joint ventures or to the transfer of technology – technology which was of lower performance than other commercially available processors. In fact, prior to the formation of the joint ventures and the transfer of technology, the Department of Commerce notified AMD that the technology proposed was not restricted or otherwise prohibited from being transferred. Given this clear feedback, AMD moved ahead with the joint ventures.

AMD had contacted the DoD and DoC, as well as all others, and had been given the green light. The new microarchitecture was deemed of low enough performance to not hit any of the export bans. AMD was also given crystal clear confirmation that the ‘technology proposed was not restricted or otherwise prohibited from being transferred’, which is a rather stark statement. At this point it should be clear that AMD may have submitted a modified version of its IP to the relevant US departments, rather than the microarchitecture we saw in the Ryzen 1000-series. This is part of what this review is about.

Joint Venture in a Joint Venture

The end goal of all of this was to be able to provide China a version of AMD’s Zen 1 CPUs that could be called ‘Chinese’, rather than ‘American’. As has been the case of the last decade or more, China has wanted to rely less on American technology and intellectual property in order to become self-sufficient. The way in which AMD’s joint ventures worked for the Hygon Dhyana designs was built to essentially do that in a very roundabout way.

The name of the joint venture overseeing the operation is called THATIC, or Tianjin Haiguang Advanced Technology Investment Co. Ltd. This company is owned by AMD and a mix of Chinese companies, both public and private, including the Chinese Academy of Sciences, but is at least 51% owned by AMD.

Two companies were created in order to perform the web of steps required – these companies would be jointly owned between AMD and THATIC (note that AMD also owns part of THATIC). These companies are:

• HMC: Haiguang Microelectronics Co. Ltd.
• Hygon: Chengdu Haiguang Integrated Circuit Design Co. Ltd.

Of these companies,

• HMC is 51% owned by AMD and 49% by THATIC. 
• Hygon is 30% owned by AMD, and 70% by THATIC. 

These companies fulfill different roles in the chain. HMC works with AMD for design and GlobalFoundries for manufacturing, while Hygon works with HMC to add co-design elements and packaging, then selling the silicon to China.

Licensing Core IP is Different to Sub-Licensing x86

A lot of confusion was made when the creation of the THATIC joint venture happened. The big overriding question was if AMD had somehow licensed the full x86 (and x64) architectures to a Chinese company, allowing them to build fully capable custom x86 CPUs and push both Intel and AMD out of the market there. This is not the case with the joint venture.

What AMD did was license a single core design to HMC, along with an SoC layout. From this point on, AMD is officially ‘hands-off’, but AMD engineers and executives are involved at HMC, so technically they are still present. With these core designs and SoC layouts, HMC sent the floorplans, not the RTL, to Hygon for requested updates. Hygon submitted the updates to HMC, which were either approved or rejected by AMD’s engineers. HMC would integrate the changes, and then take orders from Hygon for manufacturing. With Hygon’s order, HMC went to GlobalFoundries with the design and ordered the silicon. HMC then sold the silicon to Hygon, which packages the CPU into various configurations and sells it into the Chinese market. It is also up to Hygon to help design motherboards for the new platform(s).

Broken down into steps:

1. AMD licenses core design to HMC with suggested SoC layouts
2. HMC provides floorplan to Hygon
3. Hygon suggests changes to HMC
4. AMD engineers at HMC approve/reject changes
5. HMC offers final floorplan to Hygon, ready to take orders
6. Hygon orders wafers / silicon die from HMC
7. HMC approaches GlobalFoundries for manufacturing
8. GlobalFoundries achieves particular frequency/yield on new design
9. HMC sells completed silicon to Hygon
10. Hygon performs packaging on the silicon in China
11. Hygon sells completed CPUs into China

Because HMC is the one providing Hygon with the IP, the CPU can now be classified as ‘Chinese’, despite the underlying design coming from AMD.

When AMD announced the creation of THATIC, it spoke about sub-licensing its Zen core IP to the joint venture. It was described as a multi-year partnership, however it was confirmed at a trade show that AMD was only sub-licensing a single version of its IP, and that there were no plans to sub-license any others in the works.

At the time, it was assumed that AMD had sub-licensed the same version of its Zen core IP that had already been released as the Ryzen 1000-series processors and EPYC Naples processors. However as part of this review will show, it would appear that AMD made some performance changes to the design before it was given to the joint venture – specific instructions have a lower throughput than what we saw from the processors coming directly out of AMD.

Not only this, but in that list of steps, point (4) is most apt. Hygon requested specific changes for the Chinese market. Before everyone leaps to ‘creating backdoors for the *’, we know of several modifications that were made due to Linux kernel updates. In China different elliptic cryptographic algorithms are used compared to the west, and so the hardware accelerated functions for these were changed, and different microcode used in order to enable these. Part of this review is to try and discover if there are any other changes as well.

The final product out of this spider web of arrangements is the Hygon Dhyana x86 core, an ‘updated Zen core for China’, which Hygon packaged for both embedded, commercial, and enterprise systems. We saw at Computex 2018 that Chinese server vendor Sugon was involved in this project, with the company showcasing its servers built on 32-core Hygon CPUs. Users that follow online benchmark databases also saw submissions for 8-core commercial and embedded variants, likely to be used for government and education deployments.

We should point out that we asked AMD several times what differences were in the Hygon Dhyana designs compared to the original Zen 1 cores. With ‘AMD’ playing a limited role in all of this, we were simply told that if we could get hold of one, if we identified changes to the design in our testing, they might consider confirming or denying them. For as open as AMD has been with us about the Ryzen and EPYC processor families, it was a stark contrast when talking about Hygon.

The first Hygon CPUs went into the Chinese market in 2018, however they were almost impossible to source. The Hygon CPUs were never meant to be sold to the west, and the nature of the CPU and the companies dealing with it meant that none that we could identify were ever interested in sampling us.

In 2019, the US created an ‘entity list’ of Chinese companies what are deemed a potential security threat to the US market. As a result, any commercial interaction with these companies, with products or IP that were at least 25% created in the US, are restricted and forbidden. THATIC was one of the companies placed on the list, which means that AMD can no longer license any additional IP to the joint venture. THATIC still has access to the original IP it licensed however, and can continue to manage it (albeit without AMD’s assistance), however the ban also restricts HMC’s ability to order silicon from GlobalFoundries, making the whole process in limbo if not defunct.

A big thanks to Usman Pirzada’s great write up, from which much of this was based on, as well as Drew Prairie from AMD who has provided additional context to AMD’s arrangement.

Working with Wendell: Sourcing Hygon CPUs

For this review, we were able to test two systems remotely housed in the lab of Wendell Wilson, the charismatic host of the Level1Techs YouTube channel. We were both approached by sources asking if we wanted to purchase systems, which we gather were old engineering samples from a Hygon or Sugon subsidiary based in the US that was performing post-manufacturing analysis and performance testing. That subsidiary has now been dissolved, a knock-on effect of the entity list ban, and the engineering hardware within that company was (unbeknown to us) sold off. We were given the opportunity to borrow a couple of systems that fell out of the dissolution. Due to location, Wendell offered to house them, take some pictures and video, while we both did performance benchmarks. Linus’ team from the popular LinusTechTips channel were also invited to participate – you can see the video that was produced here.

Ultimately we ended up with two systems to test – one commercial ‘Hygon Dhyana’ and one enterprise ‘Hygon Dhyana Plus’.

The commercial system looks like a normal 8-core Ryzen 1000-series system, however it is actually a BGA design and is not upgradeable. In fact this seems to be an early engineering sample, as the CPU doesn’t even have a number associated with it. There’s also something interesting going on with the mounting points, which we’ll cover in due course.

The enterprise system is a dual 32-core Hygon 2U server. These CPUs state that they are the ‘7185’ models, which we know to be the highest core count that Hygon offered, and one of the highest performance 32-core parts as well. Putting two of them into a server looks very much like a 2P EPYC Naples design.

It should be noted that we did see a Hygon processor before at a trade show, and you may notice some Chinese writing at the bottom. Interestingly enough, we got the bottom right of the CPU translated. A literal translation is 

'Using Cores to Calculate The Future'

However, the second character used in the slogan is a homonym, which could be translated as:

'Using Passion to Calculate The Future'

Over the next couple of pages we’ll examine the two systems in more detail, and then a look into the fundamental differences we found at a core and SoC level compared to the Ryzen 1000 and EPYC Naples processors we’ve already tested in years gone by.

 

 

Testing a Chinese x86 CPU: A Deep Dive into Zen-based Hygon Dhyana Processors

by Dr. Ian Cutress & Wendell Wilson on February 27, 2020 9:00 AM EST

• Posted in
• CPUs
• AMD
• x86
• Zen
• Dhyana
• Hygon
• Sugon
• China

136Comments+ Add A
Comment                         We Tested Hygon Dhyana Processors                       Our Hygon Systems: 8-core Dhyana and dual 32-core Dhyana Plus                       Hygon CPUs: Chinese Crypto, Different Performance                       Benchmarks: Windows                       Conclusions            

Hygon be Bygon

Every processor made in the US has to be of a certain performance level in order to be deemed suitable for export. Companies have pages and pages of documents relating to the performance of their hardware as determined by the metrics that govern the laws in the USA. These metrics include raw processing power, measured in gigaflops (GFLOPs), adjusted peak performance (APP), and/or the composite theoretical performance (CTP). Depending on which territory you export to, one or more of these metrics may apply.

One way around this, if you cannot import the CPU, is to have a license to build it. But more than that, if you can adjust the license and have a custom input into the design, you can relabel the hardware as a homespun device and be somewhat within the realms of plausibility. This is how one of AMD’s core designs, with modifications, has made it into a ‘Chinese’ x86 CPU for the Chinese market. The big plus on the packaging isn’t so much that it avoids import issues, but the ‘中国’ label that comes attached. Then again, one assumes that the people using these CPUs don’t exactly have a choice in what they can buy.

We discovered that these processors have been changed from the Zen 1 design in a number of ways. To say they are carbon copies of the Zen 1 SoCs, which is what a lot of people have suspected, is not true – enough has changed in the design to say that these parts are rebalanced, mostly for worse performance than their Zen 1 counterparts. The integer performance is essentially identical, however the floating point performance has been reduced – common instructions having half the throughput, and random number generation has been adjusted to be both slow and produce lower quality random numbers. The cryptography engines have also been replaced, such that common AES instructions are no longer accelerated but others more specific to the Chinese security, such as SM2, SM3, and SM4, are now included. In our testing, despite the processors showing AVX/AVX2 support when probed, it appeared to be disabled. We suspect this to be more of a firmware bug than a limitation of the Hygon CPU.

The method by which AMD was able to get an edited version of its first generation Zen core design into a ‘Chinese’ designed x86 CPU is highly convoluted. By first creating a joint venture with other Chinese companies called THATIC, then by forming two companies called HMC and Hygon each owned in different amounts between AMD and THATIC, how each business was able to discuss and control parts of the IP was sculpted in order to keep the secret sauce still in AMD’s hands, but allow the Chinese side of the ventures to request modifications. Those requests have to then be approved, and then HMC commissions the chips from GlobalFoundries, while Hygon packages them and sells them to companies like Sugon. We go into detail on this in our overview back on the first page, but suffice to say trying to follow where all the pieces are is almost like playing a game of Risk blindfolded.

With AMD unwilling to discuss on the record any of the finer details of the arrangement or changes to the processors, when asked if they could disclose how the processors were changed, we were told ‘if you find anything out, we may confirm it’. The one time I was able to see a Hygon Dhyana processor was due to a miscommunication with one of the Hygon vendors at Computex, and the person who let me take pictures suddenly stopped communicating with me after the event (I presume to keep his job). It still took over a year from those discussions to get hold of the chips for testing, and only then we were able to obtain the chips due to the current US Entity List ban covering one of the joint venture companies. This essentially killed the project dead, and caused one of the US subsidiaries to be mothballed, allowing some parts to leak onto the market where they had once been meticulously controlled.

Overall these Hygon CPUs offered China an alternative to the Intel market, and arguably something faster than they might have been able to purchase through import restrictions. AMD made some money at a time it badly needed it, but with the success of its Zen 2 platform, I don’t foresee AMD needing to do something similar over the next decade. The nature of the agreement between AMD, its joint venture THATIC, and the joint companies, was only for a single core design, Zen 1, and not Zen 2, limiting its competitiveness. Moreover, the US Entity List ban on one of the joint venture companies, for all intents and purposes, has made the project dead. The Chinese Hygon Dhyana x86 processors will still be in use by governments and other such organizations for a number of years to come, but this is bound to end up one of the oddest annals of the history of semiconductors.