This article's lead sectionmay be too short to adequately summarize the key points. Please consider expanding the lead to provide an accessible overview of all important aspects of the article.(March 2023)
In the field of mathematics, norms are defined for elements within a vector space. Specifically, when the vector space comprises matrices, such norms are referred to as matrix norms. Matrix norms differ from vector norms in that they must also interact with matrix multiplication.
Preliminaries
Given a field of either real or complex numbers (or any complete subset thereof), let be the K-vector space of matrices with rows and columns and entries in the field A matrix norm is a norm on
Norms are often expressed with double vertical bars (like so: ). Thus, the matrix norm is a function that must satisfy the following properties:[1][2]
For all scalars and matrices
(positive-valued)
(definite)
(absolutely homogeneous)
(sub-additive or satisfying the triangle inequality)
The only feature distinguishing matrices from rearranged vectors is multiplication. Matrix norms are particularly useful if they are also sub-multiplicative:[1][2][3]
Suppose a vector norm on and a vector norm on are given. Any matrix A induces a linear operator from to with respect to the standard basis, and one defines the corresponding induced norm or operator norm or subordinate norm on the space of all matrices as follows:
where denotes the supremum. This norm measures how much the mapping induced by can stretch vectors.
Depending on the vector norms , used, notation other than can be used for the operator norm.
Matrix norms induced by vector p-norms
If the p-norm for vectors () is used for both spaces and then the corresponding operator norm is:[2]These induced norms are different from the "entry-wise"p-norms and the Schatten p-norms for matrices treated below, which are also usually denoted by
Geometrically speaking, one can imagine a p-norm unit ball in , then apply the linear map to the ball. It would end up becoming a distorted convex shape , and measures the longest "radius" of the distorted convex shape. In other words, we must take a p-norm unit ball in , then multiply it by at least , in order for it to be large enough to contain .
p = 1 or ∞
When or we have simple formulas.
which is simply the maximum absolute column sum of the matrix.
which is simply the maximum absolute row sum of the matrix.
For example, for
we have that
Spectral norm (p = 2)
When (the Euclidean norm or -norm for vectors), the induced matrix norm is the spectral norm. The two values do not coincide in infinite dimensions — see Spectral radius for further discussion. The spectral radius should not be confused with the spectral norm. The spectral norm of a matrix is the largest singular value of , i.e., the square root of the largest eigenvalue of the matrix where denotes the conjugate transpose of :[5]where represents the largest singular value of matrix
, where is the Frobenius norm. Equality holds if and only if the matrix is a rank-one matrix or a zero matrix.
.
Matrix norms induced by vector α- and β-norms
We can generalize the above definition. Suppose we have vector norms and for spaces and respectively; the corresponding operator norm isIn particular, the defined previously is the special case of .
In the special cases of and , the induced matrix norms can be computed by where is the i-th row of matrix .
In the special cases of and , the induced matrix norms can be computed by where is the j-th column of matrix .
Hence, and are the maximum row and column 2-norm of the matrix, respectively.
Properties
Any operator norm is consistent with the vector norms that induce it, giving
Suppose ; ; and are operator norms induced by the respective pairs of vector norms ; ; and . Then,
this follows from
and
Square matrices
Suppose is an operator norm on the space of square matrices
induced by vector norms and .
Then, the operator norm is a sub-multiplicative matrix norm:
Moreover, any such norm satisfies the inequality
1
for all positive integers r, where ρ(A) is the spectral radius of A. For symmetric or hermitianA, we have equality in (1) for the 2-norm, since in this case the 2-norm is precisely the spectral radius of A. For an arbitrary matrix, we may not have equality for any norm; a counterexample would be
which has vanishing spectral radius. In any case, for any matrix norm, we have the spectral radius formula:
Energy norms
If the vector norms and are given in terms of energy norms based on symmetricpositive definite matrices and respectively, the resulting operator norm is given as
Using the symmetric matrix square roots of and respectively, the operator norm can be expressed as the spectral norm of a modified matrix:
Consistent and compatible norms
A matrix norm on is called consistent with a vector norm on and a vector norm on , if:
for all and all . In the special case of m = n and , is also called compatible with .
All induced norms are consistent by definition. Also, any sub-multiplicative matrix norm on induces a compatible vector norm on by defining .
"Entry-wise" matrix norms
These norms treat an matrix as a vector of size , and use one of the familiar vector norms. For example, using the p-norm for vectors, p ≥ 1, we get:
This is a different norm from the induced p-norm (see above) and the Schatten p-norm (see below), but the notation is the same.
The special case p = 2 is the Frobenius norm, and p = ∞ yields the maximum norm.
L2,1 and Lp,q norms
Let be the dimension m columns of matrix . From the original definition, the matrix presents n data points in an m-dimensional space. The norm[6] is the sum of the Euclidean norms of the columns of the matrix:
The norm as an error function is more robust, since the error for each data point (a column) is not squared. It is used in robust data analysis and sparse coding.
For p, q ≥ 1, the norm can be generalized to the norm as follows:
When p = q = 2 for the norm, it is called the Frobenius norm or the Hilbert–Schmidt norm, though the latter term is used more frequently in the context of operators on (possibly infinite-dimensional) Hilbert space. This norm can be defined in various ways:
where the trace is the sum of diagonal entries, and are the singular values of . The second equality is proven by explicit computation of . The third equality is proven by singular value decomposition of , and the fact that the trace is invariant under circular shifts.
The Frobenius norm is an extension of the Euclidean norm to and comes from the Frobenius inner product on the space of all matrices.
Frobenius norm is often easier to compute than induced norms, and has the useful property of being invariant under rotations (and unitary operations in general). That is, for any unitary matrix . This property follows from the cyclic nature of the trace ():
and analogously:
where we have used the unitary nature of (that is, ).
It also satisfies
and
where is the Frobenius inner product, and Re is the real part of a complex number (irrelevant for real matrices)
Max norm
The max norm is the elementwise norm in the limit as p = q goes to infinity:
This norm is not sub-multiplicative; but modifying the right-hand side to makes it so.
Note that in some literature (such as Communication complexity), an alternative definition of max-norm, also called the -norm, refers to the factorization norm:
The Schatten p-norms arise when applying the p-norm to the vector of singular values of a matrix.[2] If the singular values of the matrix are denoted by σi, then the Schatten p-norm is defined by
These norms again share the notation with the induced and entry-wise p-norms, but they are different.
All Schatten norms are sub-multiplicative. They are also unitarily invariant, which means that for all matrices and all unitary matrices and .
The most familiar cases are p = 1, 2, ∞. The case p = 2 yields the Frobenius norm, introduced before. The case p = ∞ yields the spectral norm, which is the operator norm induced by the vector 2-norm (see above). Finally, p = 1 yields the nuclear norm (also known as the trace norm, or the Ky Fan 'n'-norm[7]), defined as:
In particular, this implies the Schatten norm inequality
Monotone norms
A matrix norm is called monotone if it is monotonic with respect to the Loewner order. Thus, a matrix norm is increasing if
The Frobenius norm and spectral norm are examples of monotone norms.[8]
Cut norms
Another source of inspiration for matrix norms arises from considering a matrix as the adjacency matrix of a weighted, directed graph.[9] The so-called "cut norm" measures how close the associated graph is to being bipartite:
where A ∈ Km×n.[9][10][11] Equivalent definitions (up to a constant factor) impose the conditions 2|S| > n & 2|T| > m; S = T; or S ∩ T = ∅.[10]
The cut-norm is equivalent to the induced operator norm ‖·‖∞→1, which is itself equivalent to another norm, called the Grothendieck norm.[11]
To define the Grothendieck norm, first note that a linear operator K1 → K1 is just a scalar, and thus extends to a linear operator on any Kk → Kk. Moreover, given any choice of basis for Kn and Km, any linear operator Kn → Km extends to a linear operator (Kk)n → (Kk)m, by letting each matrix element on elements of Kk via scalar multiplication. The Grothendieck norm is the norm of that extended operator; in symbols:[11]
The Grothendieck norm depends on choice of basis (usually taken to be the standard basis) and k.
for some positive numbers r and s, for all matrices . In other words, all norms on are equivalent; they induce the same topology on . This is true because the vector space has the finite dimension.
Moreover, for every matrix norm on there exists a unique positive real number such that is a sub-multiplicative matrix norm for every ; to wit,
A sub-multiplicative matrix norm is said to be minimal, if there exists no other sub-multiplicative matrix norm satisfying .
Examples of norm equivalence
Let once again refer to the norm induced by the vector p-norm (as above in the Induced norm section).
For matrix of rank, the following inequalities hold:[12][13]
^
The condition only applies when the product is defined, such as the case of square matrices (). More generally, multiplication of the matrices must be possible: and further, the two norms and must either have the same definitions, only differing in the matrix dimensions, or two different types of norms that are none the less "consistent" (see below).
References
^ abWeisstein, Eric W. "Matrix norm". mathworld.wolfram.com. Retrieved 2020-08-24.
^Malek-Shahmirzadi, Massoud (1983). "A characterization of certain classes of matrix norms". Linear and Multilinear Algebra. 13 (2): 97–99. doi:10.1080/03081088308817508. ISSN0308-1087.
^Horn, Roger A. (2012). Matrix analysis. Johnson, Charles R. (2nd ed.). Cambridge, UK: Cambridge University Press. pp. 340–341. ISBN978-1-139-77600-4. OCLC817236655.
^Carl D. Meyer, Matrix Analysis and Applied Linear Algebra, §5.2, p.281, Society for Industrial & Applied Mathematics, June 2000.
^Ding, Chris; Zhou, Ding; He, Xiaofeng; Zha, Hongyuan (June 2006). R1-PCA: Rotational invariant L1-norm principal component analysis for robust subspace factorization. 23rd International Conference on Machine Learning. ICML '06. Pittsburgh, PA: Association for Computing Machinery. pp. 281–288. doi:10.1145/1143844.1143880. ISBN1-59593-383-2.
^Ciarlet, Philippe G. (1989). Introduction to numerical linear algebra and optimisation. Cambridge, England: Cambridge University Press. p. 57. ISBN0521327881.
^ abLovász László (2012). "The cut distance". Large Networks and Graph Limits. AMS Colloquium Publications. Vol. 60. Providence, RI: American Mathematical Society. pp. 127–131. ISBN978-0-8218-9085-1. Note that Lovász rescales ‖A‖□ to lie in [0, 1].
Artikel ini sebatang kara, artinya tidak ada artikel lain yang memiliki pranala balik ke halaman ini.Bantulah menambah pranala ke artikel ini dari artikel yang berhubungan atau coba peralatan pencari pranala.Tag ini diberikan pada Oktober 2022. Hungry Ghosts: Mao's Secret Famine PengarangJasper BeckerNegaraBritania RayaBahasaInggrisGenreSejarahPenerbitHolt Paperbacks pada 15 April 1998Tanggal terbit15 April 1998Jenis mediaCetak (Sampul keras)ISBNISBN 0805056688 Hungry Ghosts: Mao's ...
Artikel ini sebatang kara, artinya tidak ada artikel lain yang memiliki pranala balik ke halaman ini.Bantulah menambah pranala ke artikel ini dari artikel yang berhubungan atau coba peralatan pencari pranala.Tag ini diberikan pada Februari 2023. Darul Aman adalah daerah, wilayah atau negara yang berpenduduk dan berpemerintahan bukan Islam tetapi minta perlindungan kepada pemerintahan negara Islam.[1] Atas dasar kesepakatan atau perjanjian, penghuni dan harta benda mereka dilindungi da...
1959 film The IndestructibleDirected byJean BoyerWritten byRobert Goffin (story)Henri TorrèsJacques VilfridJean BoyerProduced byRoland GirardStarringFernandelLine RenaudMichel GalabruCinematographyCharles SuinEdited byJacqueline BrachetMusic byLouis GastéProductioncompanyLes Films du CyclopeDistributed byColumbia FilmsRelease date29 April 1959Running time84 minutesCountryFranceLanguageFrench The Indestructible (French: L'increvable) is a 1959 French comedy film directed by Jean Boyer and st...
Conspiracy theories as to Hitler's death Hitler depicted by the US Secret Service in 1944 to show how he might disguise himself to evade capture Conspiracy theories about the death of Adolf Hitler, dictator of Germany from 1933 to 1945, contradict the accepted fact that he committed suicide in the Führerbunker on 30 April 1945. Stemming from a campaign of Soviet disinformation, most of these theories hold that Hitler and his wife, Eva Braun, survived and escaped from Berlin, with some assert...
2012 film by Ang Lee Life of PiTheatrical release posterDirected byAng LeeScreenplay byDavid MageeBased onLife of Piby Yann MartelProduced by Gil Netter Ang Lee David Womark Starring Suraj Sharma Irrfan Khan Tabu Rafe Spall Gérard Depardieu CinematographyClaudio MirandaEdited byTim SquyresMusic byMychael DannaProductioncompanies Fox 2000 Pictures Dune Entertainment Ingenious Media Haishang Films Distributed by20th Century FoxRelease dates September 28, 2012 (2012-09-28) (N...
Ulster loyalist attack in Northern Ireland 1991 Cappagh killingsPart of the TroublesLocationBoyle's Bar,Cappagh, County TyroneNorthern IrelandCoordinates54°32′29.40″N 6°55′27.19″W / 54.5415000°N 6.9242194°W / 54.5415000; -6.9242194Date3 March 1991 10:30 pmAttack typeShootingDeaths4Injured1PerpetratorUlster Volunteer Force The 1991 Cappagh killings was a gun attack by the loyalist Ulster Volunteer Force (UVF) on 3 March 1991 in the village of Cappagh, County...
This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Cherok Paloh – news · newspapers · books · scholar · JSTOR (August 2009) (Learn how and when to remove this message) Cherok Paloh village. Cherok Paloh is a village in Pekan District, Pahang, Malaysia. It is situated about 38 kilometer south from Kuantan town a...
Conquista islamica della penisola ibericaRe Rodrigo arringa le sue truppe nella battaglia del Guadalete di Bernardo Blanco y Pérez (1871)Data711-718 LuogoPenisola iberica EsitoVittoria del Califfato omayyadeDistruzione del Regno visigotoAvvio della Reconquista Modifiche territorialiConquista musulmana della penisola iberica eccetto le AsturieIstituzione di al-Andalus SchieramentiCaliffato omayyadeRegno visigoto (fino al 721)Regno delle Asturie (718/722) ComandantiMusa ibn NusayrTariq ibn Ziy...
San Tomaso AgordinoKomuneComune di San Tomaso AgordinoNegaraItaliaWilayahVenetoProvinsiProvinsi Belluno (BL)FrazioniPecolLuas • Total19,2 km2 (74 sq mi)Populasi (Desember 2004) • Total766 • Kepadatan4,0/km2 (10/sq mi)Zona waktuUTC+1 (CET) • Musim panas (DST)UTC+2 (CEST)Kode pos32020Kode area telepon0437 San Tomaso Agordino adalah sebuah comune di Italia. San Tomaso Agordino terletak 110 km utara Venezia dan 35 ...
Wanita Kikuyu mengenakan pakaian tradisional. Mwai Kibaki berasal dari etnis Kikuyu. Kikuyu adalah nama kelompok suku terbesar Kenya. Sebutan Kikuyu diambil dari bahasa Inggris, sementara penyebutan aslinya adalah Gĩkũyũ dan mereka menyebut suku mereka dengan Agĩkũyũ. Populasi suku Kikuyu adalah 5.347.000 jiwa di Kenya atau sekitar 22% dari total penduduk Kenya.[1] Mereka adalah kelompok suku yang paling aktif secara ekonomi di Kenya, sebaian besar mengusahakan pertanian di data...
Brighton and Hove City Council is a unitary authority in East Sussex, England. It was created as Brighton and Hove Borough Council on 1 April 1997 replacing Brighton and Hove Borough Councils. It was granted city status in 2001. Council elections See Brighton Borough Council elections or Hove Borough Council elections for election prior to 1996 1996 Brighton and Hove Borough Council election 1999 Brighton and Hove Borough Council election 2003 Brighton and Hove City Council election (New war...
ساشا أوغنينوفسكي معلومات شخصية الميلاد 3 أبريل 1979 (العمر 45 سنة)ملبورن الطول 195 سـم (6 قدم 5 بوصة) مركز اللعب مدافع الجنسية أستراليا معلومات النادي النادي الحالي Preston Lions FC [الإنجليزية] (player & assistant coach) الرقم 22 المسيرة الاحترافية1 سنوات فريق م. (هـ.) 1997–20...
Artikel ini perlu dikembangkan agar dapat memenuhi kriteria sebagai entri Wikipedia.Bantulah untuk mengembangkan artikel ini. Jika tidak dikembangkan, artikel ini akan dihapus. Satish GujralLahirSatish Gujral25 Desember 1925 (umur 98)Jhelum, Punjab, India BritaniaMeninggal26 Maret 2020(2020-03-26) (umur 94)KebangsaanIndiaPendidikanMumbaiDikenal atasMelukis, Memahat, Mural & MenulisSuami/istriKiranPenghargaanPadma Vibhushan 1999 Satish Gujral (25 Desember 1925 – ...
American assassin (1835–1865)George AtzerodtAtzerodt in 1865BornGeorg Andreas Atzerodt(1835-06-12)June 12, 1835Dörna [de] (now in Anrode), Saxony, Prussia, GermanyDiedJuly 7, 1865(1865-07-07) (aged 30)Arsenal Penitentiary, Fort McNair, Washington, D.C., U.S.Cause of deathExecution by hangingOccupationCarriage repair businessCriminal statusExecutedConviction(s)Conspiracy to assassinate Andrew JohnsonCriminal penaltyDeath George Andrew Atzerodt (June 12, 1835 R...
CabramattaSydney, New South WalesFriendship Arch, Freedom PlazaJumlah penduduk19.812 (2006)Kode pos2166Letak30 km (19 mi) sebelah baratdaya Sydney CBDLGACity of FairfieldDaerah pemilihan negara bagianCabramattaDivisi FederalBlaxland Suburban di sekitar Cabramatta: Canley Heights Canley Vale Carramar Cabramatta West Cabramatta Lansvale Liverpool Warwick Farm Chipping Norton Koordinat: 33°53′40″S 150°56′15″E / 33.89444°S 150.93750°E / -33.89444...
Questa voce o sezione sull'argomento storia è priva o carente di note e riferimenti bibliografici puntuali. Sebbene vi siano una bibliografia e/o dei collegamenti esterni, manca la contestualizzazione delle fonti con note a piè di pagina o altri riferimenti precisi che indichino puntualmente la provenienza delle informazioni. Puoi migliorare questa voce citando le fonti più precisamente. Segui i suggerimenti del progetto di riferimento. Il Crystal Palace di Londra sede della prima gr...