Phoronix Test Suite supports over 220 test profiles and over 60 test suites. It uses an XML-based testing architecture. Tests available to use include MEncoder, FFmpeg and lm sensors, along with OpenGL games such as Doom 3, Nexuiz, and Enemy Territory: Quake Wars, and many more.[5] The suite also contains a feature called PTS Global where users may upload their test results and system information for sharing. By executing a single command, other users can compare their test results to a selected system in an easy-comparison mode.[6] Before 2014, these benchmark results could be uploaded to the Phoronix Global online database, but since 2013, these benchmark results can be uploaded to openbenchmarking.org.[7] Phoronix supports automated Git bisecting on a performance basis to find performance regressions, and features statistical significance verification.
Components
Phoromatic
Phoromatic is a web-based remote test management system for the Phoronix Test Suite. It allows the automatic scheduling of tests. It's aimed at the enterprise. It can manage multiple test nodes simultaneously within a test farm or distributed environment.
Phoromatic Tracker
Phoromatic Tracker is an extension of Phoromatic that provides a public interface into test farms.[8] Currently, their reference implementations autonomously monitor the performance of the Linux kernel on a daily basis,[9]Fedora Rawhide,[10] and Ubuntu.[11]
PTS Desktop Live
PTS Desktop Live was a stripped-down x86-64 Linux distribution, which included Phoronix Test Suite 2.4. It was designed for testing/benchmarking computers from a LiveDVD / LiveUSB environment.[12]
Phodevi
Phodevi (Phoronix Device Interface) is a library that provides a clean, stable, platform-independent API for accessing software and hardware information.[13]
PCQS
Phoronix Certification & Qualification Suite (PCQS) is a reference specification for the Phoronix Test Suite.
Phoronix was started in June 2004 by Michael Larabel, who currently serves as the owner and editor-in-chief.
History
Founded on June 5, 2004,[14] Phoronix started as a website with a handful of hardware reviews and guides,[15][16] moving to articles covering operating systems based on Linux and open-source software such as Ubuntu, Fedora, SUSE,[17] and Mozilla (Firefox/Thunderbird) around the start of 2005.[18] Phoronix focuses on benchmarking hardware running Linux, with a slant toward graphics articles that monitor and compare free and open-source graphics device drivers and Mesa 3D with AMD's and Nvidia's proprietary graphics device drivers. In June 2006, the website added forums to accompany news content.[19] On April 20, 2007, Phoronix redesigned its website and began publishing Solaris hardware reviews and news in addition to Linux content.[20][21]
Other technical publications, such as CNET News, have cited Phoronix benchmarks.[22][23]
Open Benchmarking
OpenBenchmarking.org is a web-based service created to work with the Phoronix Test Suite. It is a collaborative platform that allows users to share their hardware and software benchmarks through an organized online interface.[24]
It is primarily used for performance benchmarking and testing hardware/software performance, typically in the context of Linux-based systems (unlike SoapUI, which is used for testing web services).[25]
Release history
On June 5, 2008, Phoronix Test Suite 1.0 was released under the codename Trondheim.[26] This 1.0 release was made up of 57 test profiles and 23 test suites.[27]
On September 3, 2008, Phoronix Test Suite 1.2 was released with support for the OpenSolaris operating system,[28] a module framework accompanied by tests focusing upon new areas,[29] and new test profiles.
Phoronix Test Suite 1.8 includes a graphical user interface (GUI) using GTK+ written using the PHP-GTK bindings.
3.4 includes MATISK benchmarking module and initial support for the GNU Hurd.
^"Phoronix Test Suite 1.2 To Support OpenSolaris", trondheim-pts (mailing list), Jul 2008, archived from the original on 2011-07-15, retrieved 2008-07-14