Jacobian matrix and determinant

In vector calculus, the Jacobian matrix (/əˈkbiən/,[1][2][3] /ɪ-, jɪ-/) of a vector-valued function of several variables is the matrix of all its first-order partial derivatives. When this matrix is square, that is, when the function takes the same number of variables as input as the number of vector components of its output, its determinant is referred to as the Jacobian determinant. Both the matrix and (if applicable) the determinant are often referred to simply as the Jacobian in literature.[4] They are named after Carl Gustav Jacob Jacobi.

Motivation

The Jacobian can be derived by considering a unit area in the new coordinate space; and examining how that unit area transforms when mapped into xy coordinate space in which the integral is visually understood.[5][6][7] The process involves taking partial derivatives with respect to the new coordinates, then applying the determinant and hence obtaining the Jacobian.

Definition

Suppose f : RnRm is a function such that each of its first-order partial derivatives exists on Rn. This function takes a point xRn as input and produces the vector f(x) ∈ Rm as output. Then the Jacobian matrix of f, denoted JfRm×n, is defined such that its (i,j)th entry is , or explicitly where is the transpose (row vector) of the gradient of the -th component.

The Jacobian matrix, whose entries are functions of x, is denoted in various ways; other common notations include Df, , and .[8][9] Some authors define the Jacobian as the transpose of the form given above.

The Jacobian matrix represents the differential of f at every point where f is differentiable. In detail, if h is a displacement vector represented by a column matrix, the matrix product J(x) ⋅ h is another displacement vector, that is the best linear approximation of the change of f in a neighborhood of x, if f(x) is differentiable at x.[a] This means that the function that maps y to f(x) + J(x) ⋅ (yx) is the best linear approximation of f(y) for all points y close to x. The linear map hJ(x) ⋅ h is known as the derivative or the differential of f at x.

When m = n, the Jacobian matrix is square, so its determinant is a well-defined function of x, known as the Jacobian determinant of f. It carries important information about the local behavior of f. In particular, the function f has a differentiable inverse function in a neighborhood of a point x if and only if the Jacobian determinant is nonzero at x (see Jacobian conjecture for a related problem of global invertibility). The Jacobian determinant also appears when changing the variables in multiple integrals (see substitution rule for multiple variables).

When m = 1, that is when f : RnR is a scalar-valued function, the Jacobian matrix reduces to the row vector ; this row vector of all first-order partial derivatives of f is the transpose of the gradient of f, i.e. . Specializing further, when m = n = 1, that is when f : RR is a scalar-valued function of a single variable, the Jacobian matrix has a single entry; this entry is the derivative of the function f.

These concepts are named after the mathematician Carl Gustav Jacob Jacobi (1804–1851).

Jacobian matrix

The Jacobian of a vector-valued function in several variables generalizes the gradient of a scalar-valued function in several variables, which in turn generalizes the derivative of a scalar-valued function of a single variable. In other words, the Jacobian matrix of a scalar-valued function in several variables is (the transpose of) its gradient and the gradient of a scalar-valued function of a single variable is its derivative.

At each point where a function is differentiable, its Jacobian matrix can also be thought of as describing the amount of "stretching", "rotating" or "transforming" that the function imposes locally near that point. For example, if (x′, y′) = f(x, y) is used to smoothly transform an image, the Jacobian matrix Jf(x, y), describes how the image in the neighborhood of (x, y) is transformed.

If a function is differentiable at a point, its differential is given in coordinates by the Jacobian matrix. However, a function does not need to be differentiable for its Jacobian matrix to be defined, since only its first-order partial derivatives are required to exist.

If f is differentiable at a point p in Rn, then its differential is represented by Jf(p). In this case, the linear transformation represented by Jf(p) is the best linear approximation of f near the point p, in the sense that

where o(‖xp‖) is a quantity that approaches zero much faster than the distance between x and p does as x approaches p. This approximation specializes to the approximation of a scalar function of a single variable by its Taylor polynomial of degree one, namely

In this sense, the Jacobian may be regarded as a kind of "first-order derivative" of a vector-valued function of several variables. In particular, this means that the gradient of a scalar-valued function of several variables may too be regarded as its "first-order derivative".

Composable differentiable functions f : RnRm and g : RmRk satisfy the chain rule, namely for x in Rn.

The Jacobian of the gradient of a scalar function of several variables has a special name: the Hessian matrix, which in a sense is the "second derivative" of the function in question.

Jacobian determinant

A nonlinear map sends a small square (left, in red) to a distorted parallelogram (right, in red). The Jacobian at a point gives the best linear approximation of the distorted parallelogram near that point (right, in translucent white), and the Jacobian determinant gives the ratio of the area of the approximating parallelogram to that of the original square.

If m = n, then f is a function from Rn to itself and the Jacobian matrix is a square matrix. We can then form its determinant, known as the Jacobian determinant. The Jacobian determinant is sometimes simply referred to as "the Jacobian".

The Jacobian determinant at a given point gives important information about the behavior of f near that point. For instance, the continuously differentiable function f is invertible near a point pRn if the Jacobian determinant at p is non-zero. This is the inverse function theorem. Furthermore, if the Jacobian determinant at p is positive, then f preserves orientation near p; if it is negative, f reverses orientation. The absolute value of the Jacobian determinant at p gives us the factor by which the function f expands or shrinks volumes near p; this is why it occurs in the general substitution rule.

The Jacobian determinant is used when making a change of variables when evaluating a multiple integral of a function over a region within its domain. To accommodate for the change of coordinates the magnitude of the Jacobian determinant arises as a multiplicative factor within the integral. This is because the n-dimensional dV element is in general a parallelepiped in the new coordinate system, and the n-volume of a parallelepiped is the determinant of its edge vectors.

The Jacobian can also be used to determine the stability of equilibria for systems of differential equations by approximating behavior near an equilibrium point.

Inverse

According to the inverse function theorem, the matrix inverse of the Jacobian matrix of an invertible function f : RnRn is the Jacobian matrix of the inverse function. That is, the Jacobian matrix of the inverse function at a point p isand the Jacobian determinant is

.

If the Jacobian is continuous and nonsingular at the point p in Rn, then f is invertible when restricted to some neighbourhood of p. In other words, if the Jacobian determinant is not zero at a point, then the function is locally invertible near this point.

The (unproved) Jacobian conjecture is related to global invertibility in the case of a polynomial function, that is a function defined by n polynomials in n variables. It asserts that, if the Jacobian determinant is a non-zero constant (or, equivalently, that it does not have any complex zero), then the function is invertible and its inverse is a polynomial function.

Critical points

If f : RnRm is a differentiable function, a critical point of f is a point where the rank of the Jacobian matrix is not maximal. This means that the rank at the critical point is lower than the rank at some neighbour point. In other words, let k be the maximal dimension of the open balls contained in the image of f; then a point is critical if all minors of rank k of f are zero.

In the case where m = n = k, a point is critical if the Jacobian determinant is zero.

Examples

Example 1

Consider a function f : R2R2, with (x, y) ↦ (f1(x, y), f2(x, y)), given by

Then we have and and the Jacobian matrix of f is and the Jacobian determinant is

Example 2: polar-Cartesian transformation

The transformation from polar coordinates (r, φ) to Cartesian coordinates (x, y), is given by the function F: R+ × [0, 2π) → R2 with components:

The Jacobian determinant is equal to r. This can be used to transform integrals between the two coordinate systems:

Example 3: spherical-Cartesian transformation

The transformation from spherical coordinates (ρ, φ, θ)[10] to Cartesian coordinates (x, y, z), is given by the function F: R+ × [0, π) × [0, 2π) → R3 with components:

The Jacobian matrix for this coordinate change is The determinant is ρ2 sin φ. Since dV = dx dy dz is the volume for a rectangular differential volume element (because the volume of a rectangular prism is the product of its sides), we can interpret dV = ρ2 sin φ as the volume of the spherical differential volume element. Unlike rectangular differential volume element's volume, this differential volume element's volume is not a constant, and varies with coordinates (ρ and φ). It can be used to transform integrals between the two coordinate systems:

Example 4

The Jacobian matrix of the function F : R3R4 with components is

This example shows that the Jacobian matrix need not be a square matrix.

Example 5

The Jacobian determinant of the function F : R3R3 with components is

From this we see that F reverses orientation near those points where x1 and x2 have the same sign; the function is locally invertible everywhere except near points where x1 = 0 or x2 = 0. Intuitively, if one starts with a tiny object around the point (1, 2, 3) and apply F to that object, one will get a resulting object with approximately 40 × 1 × 2 = 80 times the volume of the original one, with orientation reversed.

Other uses

Dynamical systems

Consider a dynamical system of the form , where is the (component-wise) derivative of with respect to the evolution parameter (time), and is differentiable. If , then is a stationary point (also called a steady state). By the Hartman–Grobman theorem, the behavior of the system near a stationary point is related to the eigenvalues of , the Jacobian of at the stationary point.[11] Specifically, if the eigenvalues all have real parts that are negative, then the system is stable near the stationary point. If any eigenvalue has a real part that is positive, then the point is unstable. If the largest real part of the eigenvalues is zero, the Jacobian matrix does not allow for an evaluation of the stability.[12]

Newton's method

A square system of coupled nonlinear equations can be solved iteratively by Newton's method. This method uses the Jacobian matrix of the system of equations.

Regression and least squares fitting

The Jacobian serves as a linearized design matrix in statistical regression and curve fitting; see non-linear least squares. The Jacobian is also used in random matrices, moments, local sensitivity and statistical diagnostics.[13][14]

See also

Notes

  1. ^ Differentiability at x implies, but is not implied by, the existence of all first-order partial derivatives at x, and hence is a stronger condition.

References

  1. ^ "Jacobian - Definition of Jacobian in English by Oxford Dictionaries". Oxford Dictionaries - English. Archived from the original on 1 December 2017. Retrieved 2 May 2018.
  2. ^ "the definition of jacobian". Dictionary.com. Archived from the original on 1 December 2017. Retrieved 2 May 2018.
  3. ^ Team, Forvo. "Jacobian pronunciation: How to pronounce Jacobian in English". forvo.com. Retrieved 2 May 2018.
  4. ^ W., Weisstein, Eric. "Jacobian". mathworld.wolfram.com. Archived from the original on 3 November 2017. Retrieved 2 May 2018.{{cite web}}: CS1 maint: multiple names: authors list (link)
  5. ^ Soh, Caleb (2024-10-20). Jacobian motivation, intuition, derivation/proof. Retrieved 2024-10-22 – via YouTube.
  6. ^ Larson, Ron; Edwards, Bruce H. (2017). Calculus: early transcendental functions (7th ed.). Boston, MA: Cengage Learning. p. 1033. ISBN 978-1-337-55251-6.
  7. ^ Stewart, James (2021). Calculus (9th ed.). Cengage. pp. 1110–1112. ISBN 978-0-357-11351-6.
  8. ^ Holder, Allen; Eichholz, Joseph (2019). An Introduction to computational science. International Series in Operations Research & Management Science. Cham, Switzerland: Springer. p. 53. ISBN 978-3-030-15679-4.
  9. ^ Lovett, Stephen (2019-12-16). Differential Geometry of Manifolds. CRC Press. p. 16. ISBN 978-0-429-60782-0.
  10. ^ Joel Hass, Christopher Heil, and Maurice Weir. Thomas' Calculus Early Transcendentals, 14e. Pearson, 2018, p. 959.
  11. ^ Arrowsmith, D. K.; Place, C. M. (1992). "The Linearization Theorem". Dynamical Systems: Differential Equations, Maps, and Chaotic Behaviour. London: Chapman & Hall. pp. 77–81. ISBN 0-412-39080-9.
  12. ^ Hirsch, Morris; Smale, Stephen (1974). Differential Equations, Dynamical Systems and Linear Algebra. ISBN 0-12-349550-4.
  13. ^ Liu, Shuangzhe; Leiva, Victor; Zhuang, Dan; Ma, Tiefeng; Figueroa-Zúñiga, Jorge I. (March 2022). "Matrix differential calculus with applications in the multivariate linear model and its diagnostics". Journal of Multivariate Analysis. 188: 104849. doi:10.1016/j.jmva.2021.104849.
  14. ^ Liu, Shuangzhe; Trenkler, Götz; Kollo, Tõnu; von Rosen, Dietrich; Baksalary, Oskar Maria (2023). "Professor Heinz Neudecker and matrix differential calculus". Statistical Papers. 65 (4): 2605–2639. doi:10.1007/s00362-023-01499-w. S2CID 263661094.

Further reading

Read other articles:

قرية كاناجوهاري   الإحداثيات 42°54′11″N 74°34′16″W / 42.9031°N 74.5711°W / 42.9031; -74.5711   [1] تقسيم إداري  البلد الولايات المتحدة[2]  التقسيم الأعلى كاناجوهاري  خصائص جغرافية  المساحة 3.622772 كيلومتر مربع3.621851 كيلومتر مربع (1 أبريل 2010)  ارتفاع 93 متر  عدد ا...

 

 

American actress (born 1989) For the other comedian with the same birth name, see Punkie Johnson. Jessica WilliamsWilliams in 2016BornJessica Renee Williams (1989-07-31) July 31, 1989 (age 34)Los Angeles, California, U.S.Alma materCalifornia State University, Long BeachOccupation(s)Actress, comedianYears active2006–present Jessica Renee Williams (born July 31, 1989)[1] is an American actress and comedian. She has appeared as a senior correspondent on The Daily Show, a...

 

 

Cet article est une ébauche concernant une chronologie ou une date et la France. Vous pouvez partager vos connaissances en l’améliorant (comment ?) selon les recommandations des projets correspondants. Chronologies François Hollande, élu président de la République le 6 mai 2012 face à Nicolas Sarkozy.Données clés 2009 2010 2011  2012  2013 2014 2015Décennies :1980 1990 2000  2010  2020 2030 2040Siècles :XIXe XXe  XXIe  XXIIe XXIIIeMil...

Election for the Governor of Vermont 1823 Vermont gubernatorial election ← 1822 October 9, 1823 (1823-10-09) 1824 →   Nominee Cornelius P. Van Ness Dudley Chase Party Democratic-Republican Democratic-Republican Popular vote 11,479 1,088 Percentage 85.6% 8.1% Governor before election Richard Skinner Democratic-Republican Elected Governor Cornelius P. Van Ness Democratic-Republican Elections in Vermont Federal government Presidential elections 1792...

 

 

Ekonomi Lituania[1]Jalan Gediminas, VilniusMata uang€1 Euro (EUR) = 1,20 USD[2]Tahun fiskalTahun kalenderOrganisasi perdaganganUni Eropa, Organisasi Perdagangan DuniaStatistikPDB€38,3 miliar / $42,8 miliar (2016, nominal), $90,4 miliar (2017, KKB)[3]Pertumbuhan PDB 1,7% (2015) [4][5]PDB per kapita€13.500 / $15.090 (2017, nominal), $31,850 (2017, PPP)[3]PDB per sektorJasa 72,9%, industri 23,6%, pertanian 3,5% (2014)[butuh rujukan]In...

 

 

Peter Løvenkrands Løvenkrands bermain untuk Newcastle UnitedInformasi pribadiNama lengkap Peter Rosenkrands LøvenkrandsTanggal lahir 29 Januari 1980 (umur 44)Tempat lahir Hørsholm, DenmarkTinggi 1,81 m (5 ft 11+1⁄2 in)[1]Posisi bermain PenyerangKarier junior1985–1997 Lillerød IFKarier senior*Tahun Tim Tampil (Gol)1998–2000 Akademisk Boldklub 32 (7)2000–2006 Rangers 129 (37)2006–2009 Schalke 04 44 (6)2008–2009 Schalke 04 II 3 (2)2009 Newcastle ...

Untuk kegunaan lain, lihat Romansa. RomansaAlbum studio karya Cindy BernadetteDirilis2012GenrePop, R&B, JazzLabelPlatinum RecordsKronologi Cindy Bernadette Miracles (2012)Miracles2012 Romansa (2012) Serenata (2015)Serenata2015 Sampul alternatif Romansa adalah album musik kelima Cindy Bernadette. Dirilis para 11 Desember 2012. Ini adalah album audiophile pertama Cindy. Berisi lagu-lagu lama milik Titi DJ, Dewa 19, Rossa, Ruth Sahanaya, Yana Julio, dan Reza yang diaransemen ulang.[1...

 

 

追晉陸軍二級上將趙家驤將軍个人资料出生1910年 大清河南省衛輝府汲縣逝世1958年8月23日(1958歲—08—23)(47—48歲) † 中華民國福建省金門縣国籍 中華民國政党 中國國民黨获奖 青天白日勳章(追贈)军事背景效忠 中華民國服役 國民革命軍 中華民國陸軍服役时间1924年-1958年军衔 二級上將 (追晉)部队四十七師指挥東北剿匪總司令部參謀長陸軍�...

 

 

Syrian philosopher, sociologist and Arab nationalist (1910–1989) Aflak redirects here. For the village, see Aflak, Yüreğir. For the insurance company, see Aflac. Michel Aflaqميشيل عفلقMichel Aflaq in 1963Secretary General of the National Command of the Iraq-based Ba'ath PartyIn office8 February 1968 – 23 June 1989DeputyShibli al-AysamiPreceded byPosition establishedSucceeded bySaddam HusseinSecretary General of the National Command of the Arab Socialist Ba'ath PartyIn ...

Перуанский анчоус Научная классификация Домен:ЭукариотыЦарство:ЖивотныеПодцарство:ЭуметазоиБез ранга:Двусторонне-симметричныеБез ранга:ВторичноротыеТип:ХордовыеПодтип:ПозвоночныеИнфратип:ЧелюстноротыеГруппа:Костные рыбыКласс:Лучепёрые рыбыПодкласс:Новопёрые �...

 

 

Science museum in West Palm Beach, Florida, US Cox Science Center and AquariumFlorida, USAEstablished1961 (1961)Location4801 Dreher Trail NorthWest Palm Beach, FloridaCoordinates26°40′11″N 80°04′08″W / 26.66978°N 80.06878°W / 26.66978; -80.06878TypeScience[1]PresidentKate ArrizzaWebsitewww.coxsciencecenter.org The Cox Science Center and Aquarium, formerly the South Florida Science Center and Aquarium, is a science museum located in West Palm Be...

 

 

Not to be confused with 165 West 57th Street, which also contained a performance hall named Judson Hall. United States historic placeJudson Memorial Church,Campanile and Judson HallU.S. National Register of Historic PlacesNew York State Register of Historic PlacesNew York City Landmark Show map of Lower ManhattanShow map of New YorkShow map of the United StatesLocation55 Washington Square South at Thompson Street, Manhattan, New York, United StatesCoordinates40°43′49″N 73°59′54″W&#x...

Pour les articles homonymes, voir discrimination (homonymie). Campagne Yo tengo sida (« J'ai le sida ») contre la discrimination envers les personnes ayant le sida. Affiche de Roberto Jacoby, Argentine, 1994. Le mot discrimination vient du latin discriminis, qui signifie « séparation ». Action de distinguer, traiter, considérer, sélectionner des entités selon des critères spécifiques ou distinctifs.[style à revoir] La discrimination sociale est un processus li�...

 

 

Untuk nama bandara, lihat: Bandar Udara Depati Amir. Untuk nama stadion, lihat: Stadion Depati Amir. Depati Amir (lahir di Mendara, Bangka, 1805 - meninggal di Air Mata, Kota Lama, Kupang, Nusa Tenggara Timur, 28 September 1869) merupakan salah satu pahlawan nasional dari Bangka. Semangat kepahlawanannya menggema hampir di seluruh Pulau Bangka. Depati Amir aktif melawan penjajahan Belanda di Bangka yang saat itu memiliki kepentingan terhadap aktivitas tambang timah. Karena perlawanannya dinil...

 

 

日語寫法日語原文日本標準時假名にほんひょうじゅんじ平文式罗马字Nihon Hyōjunji此條目可参照日語維基百科相應條目来扩充。若您熟悉来源语言和主题,请协助参考外语维基百科扩充条目。请勿直接提交机械翻译,也不要翻译不可靠、低品质内容。依版权协议,译文需在编辑摘要注明来源,或于讨论页顶部标记{{Translated page}}标签。兵庫縣明石市的明石市立天文科學館(...

يفتقر محتوى هذه المقالة إلى الاستشهاد بمصادر. فضلاً، ساهم في تطوير هذه المقالة من خلال إضافة مصادر موثوق بها. أي معلومات غير موثقة يمكن التشكيك بها وإزالتها. (ديسمبر 2018) 108° خط طول 108 شرق خريطة لجميع الإحداثيات من جوجل خريطة لجميع الإحداثيات من بينغ تصدير جميع الإحداثيات من ك...

 

 

一中同表,是台灣处理海峡两岸关系问题的一种主張,認為中华人民共和国與中華民國皆是“整個中國”的一部份,二者因為兩岸現狀,在各自领域有完整的管辖权,互不隶属,同时主張,二者合作便可以搁置对“整个中國”的主权的争议,共同承認雙方皆是中國的一部份,在此基礎上走向終極統一。最早是在2004年由台灣大學政治学教授張亞中所提出,希望兩岸由一中各表�...

 

 

Pagar yang runtuh secara tidak sengaja di sebuah stadion Kecelakaan merujuk kepada peristiwa yang terjadi secara tidak sengaja. Sebagai contoh kecelakaan lalu lintas, kecelakaan tertusuk benda tajam dan sebagainya. Perkataan kecelakaan diambil dari kata dasar celaka. Penambahan imbuhan ke... dan ...an menunjukkan nasib buruk yang terjadi atau menimpa. Secara teknis, kecelakaan tidak termasuk dalam kejadian yang disebabkan oleh kesalahan seseorang, contohnya jika dia lengah dan gagal mengambil...

2003 Cantabrian regional election ← 1999 25 May 2003 2007 → All 39 seats in the Parliament of Cantabria20 seats needed for a majorityOpinion pollsRegistered476,924 2.5%Turnout348,377 (73.0%)4.2 pp   First party Second party Third party   Leader José Joaquín Martínez Sieso Dolores Gorostiaga Miguel Ángel Revilla Party PP PSOE PRC Leader since 1995 16 December 2000 1983 Last election 19 seats, 42.5% 14 seats, 33.1% 6 seats, 13.5% Seats won...

 

 

English antiquarian Anthony WoodPortrait of Wood by Michael BurghersBorn(1632-12-17)17 December 1632Oxford, EnglandDied28 November 1695(1695-11-28) (aged 62)Oxford, EnglandResting placeMerton College, OxfordNationalityEnglishOther namesAnthony à WoodEducationNew College School, Oxford; Lord Williams's School, Thame; Merton College, OxfordOccupationAntiquaryEmployerUniversity of OxfordAwardsMA (Oxford, 1655) Anthony Wood (17 December 1632 – 28 November 1695), who styled himself An...