Seemingly unrelated regressions

In econometrics, the seemingly unrelated regressions (SUR)[1]: 306 [2]: 279 [3]: 332  or seemingly unrelated regression equations (SURE)[4][5]: 2  model, proposed by Arnold Zellner in (1962), is a generalization of a linear regression model that consists of several regression equations, each having its own dependent variable and potentially different sets of exogenous explanatory variables. Each equation is a valid linear regression on its own and can be estimated separately, which is why the system is called seemingly unrelated,[3]: 332  although some authors suggest that the term seemingly related would be more appropriate,[1]: 306  since the error terms are assumed to be correlated across the equations.

The model can be estimated equation-by-equation using standard ordinary least squares (OLS). Such estimates are consistent, however generally not as efficient as the SUR method, which amounts to feasible generalized least squares with a specific form of the variance-covariance matrix. Two important cases when SUR is in fact equivalent to OLS are when the error terms are in fact uncorrelated between the equations (so that they are truly unrelated) and when each equation contains exactly the same set of regressors on the right-hand-side.

The SUR model can be viewed as either the simplification of the general linear model where certain coefficients in matrix are restricted to be equal to zero, or as the generalization of the general linear model where the regressors on the right-hand-side are allowed to be different in each equation. The SUR model can be further generalized into the simultaneous equations model, where the right-hand side regressors are allowed to be the endogenous variables as well.

The model

Suppose there are m regression equations

Here i represents the equation number, r = 1, …, R is the individual observation, and we are taking the transpose of the column vector. The number of observations R is assumed to be large, so that in the analysis we take R, whereas the number of equations m remains fixed.

Each equation i has a single response variable yir, and a ki-dimensional vector of regressors xir. If we stack observations corresponding to the i-th equation into R-dimensional vectors and matrices, then the model can be written in vector form as

where yi and εi are R×1 vectors, Xi is a R×ki matrix, and βi is a ki×1 vector.

Finally, if we stack these m vector equations on top of each other, the system will take the form [4]: eq. (2.2) 

The assumption of the model is that error terms εir are independent across observations, but may have cross-equation correlations within observations. Thus, we assume that E[ εir εis | X ] = 0 whenever r ≠ s, whereas E[ εir εjr | X ] = σij. Denoting Σ = [σij] the m×m skedasticity matrix of each observation, the covariance matrix of the stacked error terms ε will be equal to [4]: eq. (2.4) [3]: 332 

where IR is the R-dimensional identity matrix and ⊗ denotes the matrix Kronecker product.

Estimation

The SUR model is usually estimated using the feasible generalized least squares (FGLS) method. This is a two-step method where in the first step we run ordinary least squares regression for (1). The residuals from this regression are used to estimate the elements of matrix :[6]: 198 

In the second step we run generalized least squares regression for (1) using the variance matrix :

This estimator is unbiased in small samples assuming the error terms εir have symmetric distribution; in large samples it is consistent and asymptotically normal with limiting distribution[6]: 198 

Other estimation techniques besides FGLS were suggested for SUR model:[7] the maximum likelihood (ML) method under the assumption that the errors are normally distributed; the iterative generalized least squares (IGLS), where the residuals from the second step of FGLS are used to recalculate the matrix , then estimate again using GLS, and so on, until convergence is achieved; the iterative ordinary least squares (IOLS) scheme, where estimation is performed on equation-by-equation basis, but every equation includes as additional regressors the residuals from the previously estimated equations in order to account for the cross-equation correlations, the estimation is run iteratively until convergence is achieved. Kmenta and Gilbert (1968) ran a Monte-Carlo study and established that all three methods—IGLS, IOLS and ML—yield numerically equivalent results, they also found that the asymptotic distribution of these estimators is the same as the distribution of the FGLS estimator, whereas in small samples neither of the estimators was more superior than the others.[8] Zellner and Ando (2010) developed a direct Monte Carlo method for the Bayesian analysis of SUR model.[9]

Equivalence to OLS

There are two important cases when the SUR estimates turn out to be equivalent to the equation-by-equation OLS. These cases are:

  1. When the matrix Σ is known to be diagonal, that is, there are no cross-equation correlations between the error terms. In this case the system becomes not seemingly but truly unrelated.
  2. When each equation contains exactly the same set of regressors, that is X1 = X2 = … = Xm. That the estimates turn out to be numerically identical to OLS estimates follows from Kruskal's tree theorem,[1]: 313  or can be shown via the direct calculation.[6]: 197 

Statistical packages

  • In R, SUR can be estimated using the package “systemfit”.[10][11][12][13]
  • In SAS, SUR can be estimated using the syslin procedure.[14]
  • In Stata, SUR can be estimated using the sureg and suest commands.[15][16][17]
  • In Limdep, SUR can be estimated using the sure command [18]
  • In Python, SUR can be estimated using the command SUR in the “linearmodels” package.[19]
  • In gretl, SUR can be estimated using the system command.

See also

References

  1. ^ a b c Davidson, Russell; MacKinnon, James G. (1993). Estimation and inference in econometrics. Oxford University Press. ISBN 978-0-19-506011-9.
  2. ^ Hayashi, Fumio (2000). Econometrics. Princeton University Press. ISBN 978-0-691-01018-2.
  3. ^ a b c Greene, William H. (2012). Econometric Analysis (Seventh ed.). Upper Saddle River: Pearson Prentice-Hall. pp. 332–344. ISBN 978-0-273-75356-8.
  4. ^ a b c Zellner, Arnold (1962). "An efficient method of estimating seemingly unrelated regression equations and tests for aggregation bias". Journal of the American Statistical Association. 57 (298): 348–368. doi:10.2307/2281644. JSTOR 2281644.
  5. ^ Srivastava, Virendra K.; Giles, David E.A. (1987). Seemingly unrelated regression equations models: estimation and inference. New York: Marcel Dekker. ISBN 978-0-8247-7610-7.
  6. ^ a b c Amemiya, Takeshi (1985). Advanced Econometrics. Cambridge, Massachusetts: Harvard University Press. p. 197. ISBN 978-0-674-00560-0.
  7. ^ Srivastava, V. K.; Dwivedi, T. D. (1979). "Estimation of seemingly unrelated regression equations: A brief survey". Journal of Econometrics. 10 (1): 15–32. doi:10.1016/0304-4076(79)90061-7.
  8. ^ Kmenta, Jan; Gilbert, Roy F. (1968). "Small sample properties of alternative estimators of seemingly unrelated regressions". Journal of the American Statistical Association. 63 (324): 1180–1200. doi:10.2307/2285876. JSTOR 2285876.
  9. ^ Zellner, A.; Ando, T. (2010). "A direct Monte Carlo approach for Bayesian analysis of the seemingly unrelated regression model". Journal of Econometrics. 159: 33–45. CiteSeerX 10.1.1.553.7799. doi:10.1016/j.jeconom.2010.04.005.
  10. ^ Examples are available in the package's vignette.
  11. ^ Zeileis, Achim (2008). "CRAN Task View: Computational Econometrics". {{cite journal}}: Cite journal requires |journal= (help)
  12. ^ Kleiber, Christian; Zeileis, Achim (2008). Applied Econometrics with R. New York: Springer. pp. 89–90. ISBN 978-0-387-77318-6.
  13. ^ Vinod, Hrishikesh D. (2008). "Identification of Simultaneous Equation Models". Hands-on Intermediate Econometrics Using R. World Scientific. pp. 282–88. ISBN 978-981-281-885-0.
  14. ^ "SUR, 3SLS, and FIML Estimation". SAS Support.
  15. ^ "sureg — Zellner's seemingly unrelated regression" (PDF). Stata Manual.
  16. ^ Baum, Christopher F. (2006). An Introduction to Modern Econometrics Using Stata. College Station: Stata Press. pp. 236–242. ISBN 978-1-59718-013-9.
  17. ^ Cameron, A. Colin; Trivedi, Pravin K. (2010). "System of Linear Regressions". Microeconometrics Using Stata (Revised ed.). College Station: Stata Press. pp. 162–69. ISBN 978-1-59718-073-3.
  18. ^ "Archived copy". Archived from the original on 2016-04-24. Retrieved 2016-04-13.{{cite web}}: CS1 maint: archived copy as title (link)
  19. ^ "System Regression Estimators — linearmodels 3.5 documentation". bashtage.github.io. Retrieved 2017-07-03.

Further reading

  • Davidson, James (2000). Econometric Theory. Oxford: Blackwell. pp. 308–314. ISBN 978-0-631-17837-8.
  • Fiebig, Denzil G. (2001). "Seemingly Unrelated Regression". In Baltagi, Badi H. (ed.). A Companion to Theoretical Econometrics. Oxford: Blackwell. pp. 101–121. ISBN 978-0-631-21254-6.
  • Greene, William H. (2012). Econometric Analysis (Seventh ed.). Upper Saddle River: Pearson Prentice-Hall. pp. 332–344. ISBN 978-0-273-75356-8.

Read other articles:

Five classic road cycling races Cycling monument First appeared in Ce soir newspaper by Albert Baker d'Isy Information Published: 17 April 1949 Origin: France Newspaper: Ce soir Author: Albert Baker d'Isy Race: Paris–Roubaix Article: monument du cyclisme The Monuments are five classic cycle races generally considered to be the oldest, hardest, longest and most prestigious one-day events in men's road cycling, with distances between 240 and 300 km.[1][2][3] They each ...

 

Persatuan Guru Republik IndonesiaLogo Resmi Persatuan Guru Republik IndonesiaSingkatanPGRITanggal pendirian25 November 1945Kantor pusatJl. Tanah Abang III No. 24, 10160Jakarta, IndonesiaKetua UmumProf. Dr. Unifah Rosyidi, M.PdSitus webwww.pgri.or.id Hymne PGRIMars PGRI Prangko Peringatan Hari Guru di Indonesia. Persatuan Guru Republik Indonesia (disingkat PGRI) adalah organisasi di Indonesia yang anggotanya berprofesi sebagai guru. Organisasi ini didirikan dengan semangat perjuangan para guru...

 

Extinct genus of jawless fishes HibernaspisTemporal range: Early Devonian Hibernaspis macrolepis Scientific classification Kingdom: Animalia Phylum: Chordata Class: Pteraspidomorphi Order: Cyathaspidiformes (unranked): Amphiaspidida Superfamily: Hibernaspidoidei Family: Hibernaspididae Genus: Hibernaspis Type species Hibernaspis macrolepisObruchev, 1939 Species H. macrolepis H. tenuicristata[1] Hibernaspis is a genus of extinct amphiaspidid heterostracan agnathans whose fossils are re...

79AuEmasKristal emas yang dibuat secara sintetis Garis spektrum emasSifat umumNama, lambangemas, AuPengucapan/êmas/[1] Penampilankuning metalikEmas dalam tabel periodik 79Au Hidrogen Helium Lithium Berilium Boron Karbon Nitrogen Oksigen Fluor Neon Natrium Magnesium Aluminium Silikon Fosfor Sulfur Clor Argon Potasium Kalsium Skandium Titanium Vanadium Chromium Mangan Besi Cobalt Nikel Tembaga Seng Gallium Germanium Arsen Selen Bromin Kripton Rubidium Strontium Yttrium Zirconium N...

 

Short HairAlbum mini karya AOADirilis19 Juni 2014Direkam2014GenreK-pop, electropop, dance-popDurasi24:08LabelFNC EntertainmentProduserBrave BrothersKronologi AOA Miniskirt(2014)Miniskirt2014 Short Hair(2014) Like a Cat(2014)Like a Cat2014 Singel dalam album Short Hair Short HairDirilis: 19 Juni 2014 Joa Yo!Dirilis: 24Juli 2014 Video musikShort Hair di YouTube Short Hair (Hangul: 단발머리; RR: Danbalmeori) adalah album mini pertama grup vokal wanita asal Korea Sel...

 

Questa voce sull'argomento stagioni delle società calcistiche italiane è solo un abbozzo. Contribuisci a migliorarla secondo le convenzioni di Wikipedia. Segui i suggerimenti del progetto di riferimento. Voce principale: Circolo Sportivo Ponziana 1912. Circolo Sportivo Ponziana TriesteStagione 1950-1951Sport calcio SquadraCircolo Sportivo Ponziana 1912 Allenatore Pietro Pasinati Presidente Tullio Rilotta Serie C14º posto nel girone B. 1949-1950 1951-1952 Si invita a seguire il modell...

Artikel ini bukan mengenai Daun bawang. Bawang daun Allium fistulosum pada suatu pertanian Klasifikasi ilmiah Kerajaan: Plantae (tanpa takson): Tracheophyta (tanpa takson): Angiospermae (tanpa takson): Monokotil Ordo: Asparagales Famili: Amaryllidaceae Genus: Allium Spesies: Allium fistulosumL. Sinonim[1][2] Allium bouddae Debeaux Allium fistulosum var. caespitosum Makino Allium fistulosum var. giganteum Makino Allium kashgaricum Prokh. Allium saxatile Pall. Allium wakegi Arak...

 

Pour les articles homonymes, voir Château des Ducs. Château des ducs de Bar Le Neuf-Castel. Nom local Château Ducal Période ou style Renaissance Type Château Début construction Xe siècle Fin construction XVIe siècle Propriétaire initial Comtes puis ducs de BarDucs de Lorraine Destination initiale Château fort, lieu d'habitat Propriétaire actuel Commune Destination actuelle Musée Protection  Inscrit MH (1981) Site classé (1911) Coordonnées 48° 46′...

 

Fossil-bearing rock formation in the Canadian Rockies Further information: Burgess Shale type fauna, Fossils of the Burgess Shale, and Paleobiota of the Burgess Shale Burgess ShaleStratigraphic range: Miaolingian ~508 Ma PreꞒ Ꞓ O S D C P T J K Pg N ↓ Ottoia, a soft-bodied worm, abundant in the Burgess Shale. (From Smith et al. 2015)TypeGeological formationUnit ofStephen FormationThickness161 meters (528 ft)[1]LithologyPrimaryShaleLocationCoordinates51°26′N 116°...

Disambiguazione – Se stai cercando altri significati, vedi Castelrotto (disambigua). Castelrottocomune(IT) Castelrotto(DE) Kastelruth(LLD) Ciastel Castelrotto – VedutaCastelrotto visto dall'alto LocalizzazioneStato Italia Regione Trentino-Alto Adige Provincia Bolzano AmministrazioneSindacoCristina Pallanch (SVP) dal 13-11-2022 Lingue ufficialiItaliano, Tedesco TerritorioCoordinate46°34′04.23″N 11°33′34.87″E / 46.567843°N 11.559685°E46....

 

Тамга племени чепни согласно М. Кашгари Чепни (также: джебни; туркм. Çepni) - историческое туркменское племя из списка 24-х огузо-туркменских племен, ведущих происхождение от внуков древнего родоначальника туркмен Огуз-хана. Содержание 1 Происхождение 2 История 3 Этнонимия 4 П�...

 

UFC mixed martial arts event in 2016 UFC 202: Diaz vs. McGregor 2The poster for UFC 202: Diaz vs. McGregor 2InformationPromotionUltimate Fighting ChampionshipDateAugust 20, 2016 (2016-08-20)VenueT-Mobile ArenaCityParadise, NevadaAttendance15,539[1]Total gate$7,700,810[2]Buyrate1,650,000[3]Event chronology UFC Fight Night: Rodríguez vs. Caceres UFC 202: Diaz vs. McGregor 2 UFC on Fox: Maia vs. Condit UFC 202: Diaz vs. McGregor 2 was a mixed martial arts ...

此条目序言章节没有充分总结全文内容要点。 (2019年3月21日)请考虑扩充序言,清晰概述条目所有重點。请在条目的讨论页讨论此问题。 哈萨克斯坦總統哈薩克總統旗現任Қасым-Жомарт Кемелұлы Тоқаев卡瑟姆若马尔特·托卡耶夫自2019年3月20日在任任期7年首任努尔苏丹·纳扎尔巴耶夫设立1990年4月24日(哈薩克蘇維埃社會主義共和國總統) 哈萨克斯坦 哈萨克斯坦政府...

 

دوشان أوهرين (بالتشيكية: Dušan Uhrin)‏  معلومات شخصية الميلاد 5 فبراير 1943 (العمر 81 سنة) الطول 1.83 م (6 قدم 0 بوصة) مركز اللعب وسط الجنسية تشيكوسلوفاكيا  أبناء دوشان أوهرين جونيور  المسيرة الاحترافية1 سنوات فريق م. (هـ.) 1959–1964 FK Admira Prague [الإنجليزية]‏ 1964–1965 سلافيا �...

 

Polish-born prelate The Most ReverendJoseph Casimir PlagensBishop of Grand RapidsChurchRoman Catholic ChurchSeeDiocese of Grand RapidsIn officeFebruary 18, 1941March 31, 1943PredecessorJoseph G. PintenSuccessorFrancis J. HaasOther post(s)Auxiliary Bishop of Detroit1924 to 1935Bishop of Sault Sainte Marie-Marquette1935 to 1940OrdersOrdinationJuly 4, 1903by John Samuel FoleyConsecrationSeptember 30, 1924by Michael GallagherPersonal detailsBorn(1880-01-29)January 29, 1880Czeszewo, Pola...

Arieh WarshelLahir20 November 1940Kibbutz Sde-Nahum, IsraelKebangsaanUSA, IsraelDikenal atasComputer simulation, Computational enzymology, elektrostatika, enzyme catalysis.PenghargaanNobel Kimia (2013)Karier ilmiahBidangChemistry, Biokimia, BiofisikaInstitusiUniversity of Southern California Arieh Warshel (lahir 20 November 1940) adalah seorang ahli biokimia dan profesor di University of Southern California warga negara Amerika Serikat yang mendapat hadiah Nobel untuk bidang kimia tahun 2013...

 

Pour les articles homonymes, voir Hartley. Ralph HartleyBiographieNaissance 30 novembre 1888Sprucemont (en)Décès 1er mai 1970 (à 81 ans)Summit ou New JerseyNationalité américaineFormation Université d'Utah (baccalauréat universitaire) (jusqu'en 1909)St John's College (baccalauréat universitaire) (jusqu'en 1912)St John's College (baccalauréat universitaire ès sciences) (jusqu'en 1913)Activités Informaticien, inventeurAutres informationsA travaillé pour Laboratoires Bell (1925...

 

Palazzo Gonzaga di VescovatoLocalizzazioneStato Italia LocalitàPortiolo IndirizzoStrada Portiolo, 3,5 Coordinate45°02′50″N 10°51′35″E45°02′50″N, 10°51′35″E Informazioni generaliCondizioniin abbandono CostruzioneXIV-XV secolo Usoresidenziale RealizzazioneProprietarioProprietà privata CommittenteGonzaga di Vescovato Modifica dati su Wikidata · Manuale Palazzo Gonzaga di Vescovato è una corte rurale fortificata di Portiolo, frazione di San Benedetto Po, in provi...

この項目では、宮城県の放送局について説明しています。開局時に「ラジオ東北」を名乗った秋田県の民間放送局については「秋田放送」をご覧ください。 東北放送株式会社TOHOKU BROADCASTING CO., LTD. 八木山香澄町にあるtbc社屋種類 株式会社略称 tbc本社所在地 日本〒980-8668[注 1][1]宮城県仙台市太白区八木山香澄町26-1 北緯38度14分49.6秒 東経140度51分21.8秒 ...

 

This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages) This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: List of dukes in the peerages of Britain and Ireland – news · newspapers · books · scholar · JSTOR (August 2023) (L...