Standard Performance
Evaluation Corporation

*** SPEC Members' Archive ***

[SPEC: Mail | WebEx Meetings | PacMan (Account Management) | Password Updates]
[Redmine]    [Trac]    [Wiki]    [Information for Benchmark Developers]    [Services Available to Subcommitees]

[OSG: FTP | Mail | Benchmarks | Results/RepoMan]
[GWPG: Mail | Wiki | Benchmarks | APC FTP | GPC FTP | WPC FTP | Results Review Site]
[HPG: FTP | Mail | Benchmarks | Results/RepoMan]
[RG: FTP | Mail | Wiki | Big Data WG | Cloud WG | DevOps WG | IDS WG]

SPEC Corner:

OSG Corner:
Open Systems Group

HPG Corner:
High Performance Group

GWPG Corner:
Graphics and Workstation
Performance Group

RG Corner:
Research Group

All material on http://pro.spec.org/ and/or the mirror site at https://spec.cs.miami.edu/private/mirror/ should be considered SPEC Confidential unless stated otherwise. Please be sure to review the guidelines for handling SPEC information.

What's New?

I Bandwidth usage (max = 100 Mb/s in)
O Bandwidth usage (max = 100 Mb/s out)
Current bandwidth utilization: 0.29 [I] + 19.29 [O] = 19.58 Mb/s

    12/04/2018: U.S. EPA adopts SPEC SERT 2.0.1: The United States Department of Energy's (DOE) Environmental Protection Agency (EPA) released the final version of the "ENERGY STAR Version 3.0 Computer Servers Program Requirements" which defines the Active State Efficiency Thresholds that will determine ENERGY STAR eligibility effective June 17, 2019. The new thresholds have been determined using data collected by running the SPEC Server Efficiency Rating Tool (SERT).

    09/12/2018: SPEC/OSG releases SPECjEnterprise2018 Web Profile, a new benchmark measuring full-system performance of Java EE 7 Web Profile application servers and their supporting infrastructure such as JVM, Database, CPU, disk and servers. OSG members can download the software from the benchmarks directory.

    08/15/2018: SPEC's Application Performance Characterization (SPECapc) project group has updated its performance evaluation software for systems running Dassault Systemes' Solidworks CAD/CAM application. The new SPECapc for Solidworks 2017 benchmark is designed to run on Microsoft Windows 10 64-bit platforms. GWPG members can download the software from the benchmark directory.

    06/25/2018: The 10th ACM/SPEC International Conference on Performance Engineering (ICPE 2019) has issued a call for contributions and it will be held April 7-11, 2019 in Mumbai, India. ICPE brings together researchers and practitioners to report state-of-the-art and in-progress research on performance engineering of software and systems, including performance measurement, modeling, benchmark design, and run-time performance management.

    This year's main theme is "performance engineering in the Artificial Intelligence era." The ICPE program committee is looking for contributions that use AI techniques to enhance the performance modeling, estimation, and optimization of complex systems. At the same time, contributions that analyze and improve AI systems are invited for submission.

    05/30/2018: SPEC's Research Group has issued a call for nominations for the Kaivalya Dixit Distinguished Dissertation Award recognizing outstanding doctoral dissertations in the field of computer benchmarking, performance evaluation, and experimental system analysis. The award is open to dissertations that have been defended between October 2017 and September 2018.

    05/23/2018: The SPEC Graphics Performance Characterization Group (SPECgpc) has released an all-new version of its SPECviewperf graphics performance benchmark. SPECviewperf 13 features new volume visualization viewsets for energy and medical applications, a redesigned GUI, improved scoring and reporting methods, and updated viewsets to support more recent versions of the applications on which they are based.

    01/07/2018: SPEC relies on contributors outside of its membership to help develop far-reaching benchmark suites such as SPEC CPU2017. Here's the story of one of those contributors.

    12/13/2017: SPECapc released an updated version of the Maya 2017 benchmark that improves the way multi-sample anti-aliasing (MSAA) is measured. Results from V1.0.6 of SPECapc for Maya 2017 are not comparable to those from previous versions of the benchmark.

    10/17/2017: The research and industrial/experience paper submission deadline for the ICPE 2018 conference to be held April 9-13, 2018 in Berlin, has been extended to October 25, 2017. Please see the important dates for abstract and paper submission and notification deadlines.

    10/12/2017: The SPECjbb2015 benchmark has been updated to version 1.01. This update adds support for Java SE 9. OSG members can download the V1.01 update; other licensees are entitled to a free upgrade. SPEC will be retiring SPECjbb2015 V1.0 in January 2018, after which time all result submissions must be made with V1.01.

    09/27/2017: SPEC's Application Performance Characterization (SPECapc) project group has released all-new performance evaluation software for systems running Autodesk Maya 2017 3D animation software. SPECapc for Maya 2017 software includes nearly 80 individual tests that reflect the processes used to model, animate and render scenes within the application. The new benchmark was developed by SPECapc in cooperation with Autodesk, which supplied seven new graphics models and scenes.

    08/14/2017: With the release of SPEC CPU2017, SPEC will be retiring SPEC CPU2006 in January 2018. Full details on the retirement schedule can be found here.

    07/11/2017: Michael Hines, a senior engineer at DigitalOcean, is not your typical user of a SPEC CPU benchmark suite. He's not a high-end server user, a hardware system vendor, a researcher or an independent software vendor (ISV). Then why does he find the SPEC CPU2017 benchmark suite critically important to his work? Find out here.

    06/27/2017: SPEC's High-Performance Group (SPEC/HPG) has released a new version of its SPEC ACCEL software that adds a suite of OpenMP applications for measuring the performance of systems using hardware accelerator devices and supporting software. Other major updates in SPEC ACCEL 1.2 include the ability to add and change directives within the OpenMP and OpenACC suites to expose more parallelism for peak performance testing, and revised applications in the OpenACC suite to allow for successful GNU compiling.

    06/20/2017: SPEC announces the release of SPEC CPU2017, an all-new version of the benchmark suite for evaluating compute-intensive performance across a wide range of hardware systems. CPU2017 contains 43 individual benchmarks organized into four suites. Among the new features are the option to use OpenMP for several of the SPECspeed 2017 benchmarks and the ability to optionally measure and report power statistics. OSG members can download the ISO starting immediately.

    06/08/2017: The 9th ACM/SPEC International Conference on Performance Engineering (ICPE 2018) has issued a call for contributions. Topics of interest include: performance modeling of software; performance and software development processes/paradigms; performance measurement, monitoring and analysis; benchmarking; run-time performance management; power and performance, energy efficiency; performance modeling and evaluation in different environments and application domains; and other topics related to performance of software and systems. ICPE2018 will take place April 9-13, 2018 in Berlin, Germany.

    06/05/2017: SPECpower has released a new version of PTDaemon, the software that allows power measurement devices to be incorporated into performance evaluation software. PTDaemon 1.8.1 includes new support for Windows USBTMC using Keysight drivers and the Hioki PW3335 (single channel) power measurement device. Users of SPECpower_ssj2008 and the SERT suite are encouraged to download and apply the update.

    05/23/2017: SPEC's Research Group has issued a call for nominations for the Kaivalya Dixit Distinguished Dissertation Award recognizing outstanding doctoral dissertations in the field of computer benchmarking, performance evaluation, and experimental system analysis. The award is open to dissertations that have been defended between October 2016 and September 2017.

    05/22/2017: In an exclusive interview, Klaus-Dieter Lange, SPECpower chair, discusses the origin of SERT, the challenges of creating an international standard, the prospect of continued improvements in server efficiency, and his own personal growth in leading a diverse group of technologists.

    05/22/2017: SPEC's High-Performance Group (HPG) is offering rewards of up to $5,000 and a free benchmark license for application code and datasets accepted under its new SPEC MPI Accelerator Benchmark Search Program. Applications that make it through the entire search program will be incorporated into a new benchmark currently called SPEC MPI ACCEL. The new benchmark will combine components of the current SPEC MPI and SPEC ACCEL benchmark suites. (Note: The search program is not open to any employees or contractors of any SPEC participating organizations and their immediate families.)

    04/18/2017: Version 2.0 of the Chauffeur Workload Development Kit (WDK) has been released. This major release is based on the SERT 2.0 infrastructure and includes significant enhancements to the hardware detection, customization options of generating HTML reports, and developer documentation. It has now reduced memory requirements for the Director when signing results files and reduced the size of the result output for large systems or clusters. There is also an updated list of supported operating systems including Ubuntu (14.04 LTS and 16.04 LTS) as well as current versions of Windows Server, RHEL, SLES, AIX, and Solaris. OSG members can download the ISO here.

    04/04/2017: OSG's SFS subcommittee is now known as the Storage committee.

    04/04/2017: A patch has been released for SPECvirt_sc2013 which addresses an issue encountered when running the webserver workload with TLS encryptions which would cause any result to be marked as invalid. Any submissions using TLSv1, TLSv1.1, or TLSv1.2 encryptions for the webserver workload must use this patch.

    03/28/2017: SPEC announces the release of the Server Efficiency Rating Tool (SERT) 2.0, which adds a single-value metric, reduces runtime, improves automation and testing, and broadens device and platform support. Designed to be simple to configure and use via a comprehensive graphical user interface, the SERT suite uses a set of synthetic worklets to test discrete system components such as processors, memory and storage, providing detailed power consumption data at different load levels.

    01/03/2017: SPEC Cloud IaaS 2016 V1.1 is now available. This update includes bug fixes and usability improvements, libcloud support for easy adapter development, and OpenStack driver updates. Starting January 23, 2017, all result submissions must be made using version 1.1 and version 1.0 will be retired.

    12/09/2016: Holiday Submission/Review Schedule: SPECvirt_sc2013 results received for Dec. 14 review will not complete their review cycle until Jan. 4, 2017. Submissions received for Dec. 21 and Dec. 28 review cycles will not start review until Jan. 4 2017.

    09/21/2016: SPECvirt_sc2013 has been updated to version 1.1. This update includes added support for TLSv1, TLSv1.1 and TLSv1.2 with several new ciphers, an updated PTDaemon version, and documentation updates. OSG members can download the ISO here.

    08/24/2016: The SPEC Graphics Performance Characterization Group (SPECgpc) has released an updated version of its SPECviewperf benchmark that features a new Autodesk 3ds Max viewset, Microsoft Windows 10 support, and GUI and reporting improvements. The benchmark runs under the 64-bit versions of Microsoft Windows 7 and Windows 10. Results from V12.1 remain comparable to those from V12.0.1 and V12.0.2.

    08/17/2016: The SPEC JMS 2007 benchmark will be retired on November 23, 2016. New result submissions will be accepted through November 9, 2016. After that time, no further submissions will be accepted and technical support will no longer be offered.

SPEC Members:

Acer Inc. * Action S.A. * Advanced Micro Devices * Amazon Web Services, Inc. * Apple Inc. * ARM * ASUSTek Computer Inc. * AuriStor Inc. * Avere Systems * Bull SAS * Chengdu Haiguang IC Design Co., Ltd * Cisco Systems, Inc. * Dell, Inc. * Digital Ocean * Epsylon Sp. z o.o. Sp. Komandytowa * Format Sp. z o.o. * Fujitsu * Gartner, Inc. * Giga-Byte Technology Co., Ltd. * Google Inc. * Guizhou Huaxintong Semiconductor Technology Co. Ltd * Hitachi Data Systems * Hitachi Ltd. * HP Inc. * Hewlett Packard Enterprise * Huawei Technologies Co. Ltd. * IBM * Inspur Corporation * Intel * iXsystems Inc. * Lenovo * Marvell Technology * Microsoft * NEC Corporation * NetApp * New H3C Technologies Co., Ltd. * NVIDIA * Oracle * Principled Technologies * Pure Storage * Qualcomm Technologies Inc. * Quanta Computer Inc. * Red Hat * Samsung * Sugon * Super Micro Computer, Inc. * SUSE * Taobao (China) Software Co. Ltd. * Veritas Technologies * VIA Technologies * VMware * WekaIO *

SPEC Associates:

Institute of Information Science, Acadamia Sinica * Argonne National Laboratory * Charles University * China Academy of Information and Communications Technology * Dresden University of Technology ZIH * ForTISS An-Institut der Technischen Universität München * Grigore T. Popa University of Medicine and Pharmacy * Helmholtz-Zentrum Dresden Rossendorf (HZDR) * Indiana University * Japan Advanced Institute of Science and Technology (JAIST) * Karlsruhe Institute of Technology * Lawrence Berkeley National Laboratory * Leibniz Rechenzentrum - Bavarian Academy of Science * Linaro Limited * National University of Singapore * Oak Ridge National Laboratory * Ohio State University * Purdue University * RWTH Aachen University * Seoul National University * Technische Universität Darmstadt * Technische Universität Dresden, ZIH * Telecommunications Technology Association * Tsinghua University * University of Aizu * University of Basel * University of California - Berkeley * University of Cologne * University of Delaware * University of Illinois at Urbana-Champaign (UIUC) * University of Maryland * University of Miami * University of Texas at Austin * University of Tsukuba * University of Wuerzburg * Virginia Polytechnic Institute and State University *

SPEC Research Group:

Advanced Strategic Technology LLC * Apple Inc. * ARM * bankmark UG * BEZNet * Charles University * Cisco Systems * Delft University of Technology * Dell * Escuela Superior Politecnica del Litoral * ForTISS An-Institut der Technischen Universität München * Friedrich-Alexander-University Erlangen-Nuremberg * Goethe University Frankfurt, Big Data Lab * Hewlett Packard Enterprise * Huawei * IBM * Imperial College London * Intel * Karlsruhe Institute of Technology * Kiel University * Linkoping University * Microsoft * NICTA * NovaTec Consulting GmbH * Oracle * Purdue University * Queen's University * Red Hat * RETIT GmbH * RWTH Aachen University * SalesForce.com * San Francisco State University * SAP AG * Stiftung University of Hildesheim * SINTEF ICT * Software Performance and Scalability Consulting * TaoBao (China) Software Co., Ltd. * Tata Consultancy Services * Telecommunications Technology Association * Technische Universität Berlin * Technische Universität Darmstadt * Technische Universität Dresden * The MITRE Corporation * Umea University * University of Alberta * University of Calgary * University of Coimbra * University of Lugano * University of Miami * University of Minnesota * University of North Florida * University of Paderborn * University of Pavia * University of Stuttgart * University of Texas at Austin * University of Wuerzburg * University Politehnica of Bucharest * University Politehnica of Timisoara * VMware * Vrije Universiteit Amsterdam * York University *

SPEC Supporting Contributors:

Walter Bays (OSG Power) * Hansfried Block (OSG Power) * Richard Caneca (OSG CPU) * Alexander Carlton (SPEC Board) * Yun-seng Chao (OSG Cloud) * Greg Darnell (OSG Power) * Nutanix (OSG Storage) * Brian Pawlowski (OSG Storage) * Julie Reilly (OSG CPU) * Karin Wulf (OSG Power) *

To access any of the contents here, you will need a valid ID and PASSWORD. If you do not know an appropriate ID, contact your primary SPEC-member representative or the SPEC Administrator.

Last updated: Thu Dec 6 16:38:20 EST 2018
Copyright © 1996 - 2010 Standard Performance Evaluation Corporation