In statistics, data transformation is the application of a deterministic mathematical function to each point in a data set—that is, each data point zi is replaced with the transformed value yi = f(zi), where f is a function. Transforms are usually applied so that the data appear to more closely meet the assumptions of a statistical inference procedure that is to be applied, or to improve the interpretability or appearance of graphs.
Nearly always, the function that is used to transform the data is invertible, and generally is continuous. The transformation is usually applied to a collection of comparable measurements. For example, if we are working with data on peoples' incomes in some currency unit, it would be common to transform each person's income value by the logarithm function.
Guidance for how data should be transformed, or whether a transformation should be applied at all, should come from the particular statistical analysis to be performed. For example, a simple way to construct an approximate 95% confidence interval for the population mean is to take the sample mean plus or minus two standard error units. However, the constant factor 2 used here is particular to the normal distribution, and is only applicable if the sample mean varies approximately normally. The central limit theorem states that in many situations, the sample mean does vary normally if the sample size is reasonably large. However, if the population is substantially skewed and the sample size is at most moderate, the approximation provided by the central limit theorem can be poor, and the resulting confidence interval will likely have the wrong coverage probability. Thus, when there is evidence of substantial skew in the data, it is common to transform the data to a symmetric distribution[1] before constructing a confidence interval. If desired, the confidence interval for the quantiles (such as the median) can then be transformed back to the original scale using the inverse of the transformation that was applied to the data.[2][3]
Data can also be transformed to make them easier to visualize. For example, suppose we have a scatterplot in which the points are the countries of the world, and the data values being plotted are the land area and population of each country. If the plot is made using untransformed data (e.g. square kilometers for area and the number of people for population), most of the countries would be plotted in tight cluster of points in the lower left corner of the graph. The few countries with very large areas and/or populations would be spread thinly around most of the graph's area. Simply rescaling units (e.g., to thousand square kilometers, or to millions of people) will not change this. However, following logarithmic transformations of both area and population, the points will be spread more uniformly in the graph.
Another reason for applying data transformation is to improve interpretability, even if no formal statistical analysis or visualization is to be performed. For example, suppose we are comparing cars in terms of their fuel economy. These data are usually presented as "kilometers per liter" or "miles per gallon". However, if the goal is to assess how much additional fuel a person would use in one year when driving one car compared to another, it is more natural to work with the data transformed by applying the reciprocal function, yielding liters per kilometer, or gallons per mile.
Data transformation may be used as a remedial measure to make data suitable for modeling with linear regression if the original data violates one or more assumptions of linear regression.[4] For example, the simplest linear regression models assume a linear relationship between the expected value of Y (the response variable to be predicted) and each independent variable (when the other independent variables are held fixed). If linearity fails to hold, even approximately, it is sometimes possible to transform either the independent or dependent variables in the regression model to improve the linearity.[5] For example, addition of quadratic functions of the original independent variables may lead to a linear relationship with expected value of Y, resulting in a polynomial regression model, a special case of linear regression.
Another assumption of linear regression is homoscedasticity, that is the variance of errors must be the same regardless of the values of predictors. If this assumption is violated (i.e. if the data is heteroscedastic), it may be possible to find a transformation of Y alone, or transformations of both X (the predictor variables) and Y, such that the homoscedasticity assumption (in addition to the linearity assumption) holds true on the transformed variables[5] and linear regression may therefore be applied on these.
Yet another application of data transformation is to address the problem of lack of normality in error terms. Univariate normality is not needed for least squares estimates of the regression parameters to be meaningful (see Gauss–Markov theorem). However confidence intervals and hypothesis tests will have better statistical properties if the variables exhibit multivariate normality. Transformations that stabilize the variance of error terms (i.e. those that address heteroscedaticity) often also help make the error terms approximately normal.[5][6]
Equation: Y = a + b X {\displaystyle Y=a+bX}
Equation: log --> ( Y ) = a + b X {\displaystyle \log(Y)=a+bX}
Equation: Y = a + b log --> ( X ) {\displaystyle Y=a+b\log(X)}
Equation: log --> ( Y ) = a + b log --> ( X ) {\displaystyle \log(Y)=a+b\log(X)}
Generalized linear models (GLMs) provide a flexible generalization of ordinary linear regression that allows for response variables that have error distribution models other than a normal distribution. GLMs allow the linear model to be related to the response variable via a link function and allow the magnitude of the variance of each measurement to be a function of its predicted value.[8][9]
The logarithm transformation and square root transformation are commonly used for positive data, and the multiplicative inverse transformation (reciprocal transformation) can be used for non-zero data. The power transformation is a family of transformations parameterized by a non-negative value λ that includes the logarithm, square root, and multiplicative inverse transformations as special cases. To approach data transformation systematically, it is possible to use statistical estimation techniques to estimate the parameter λ in the power transformation, thereby identifying the transformation that is approximately the most appropriate in a given setting. Since the power transformation family also includes the identity transformation, this approach can also indicate whether it would be best to analyze the data without a transformation. In regression analysis, this approach is known as the Box–Cox transformation.
The reciprocal transformation, some power transformations such as the Yeo–Johnson transformation, and certain other transformations such as applying the inverse hyperbolic sine, can be meaningfully applied to data that include both positive and negative values[10] (the power transformation is invertible over all real numbers if λ is an odd integer). However, when both negative and positive values are observed, it is sometimes common to begin by adding a constant to all values, producing a set of non-negative data to which any power transformation can be applied.[3]
A common situation where a data transformation is applied is when a value of interest ranges over several orders of magnitude. Many physical and social phenomena exhibit such behavior — incomes, species populations, galaxy sizes, and rainfall volumes, to name a few. Power transforms, and in particular the logarithm, can often be used to induce symmetry in such data. The logarithm is often favored because it is easy to interpret its result in terms of "fold changes".
The logarithm also has a useful effect on ratios. If we are comparing positive quantities X and Y using the ratio X / Y, then if X < Y, the ratio is in the interval (0,1), whereas if X > Y, the ratio is in the half-line (1,∞), where the ratio of 1 corresponds to equality. In an analysis where X and Y are treated symmetrically, the log-ratio log(X / Y) is zero in the case of equality, and it has the property that if X is K times greater than Y, the log-ratio is the equidistant from zero as in the situation where Y is K times greater than X (the log-ratios are log(K) and −log(K) in these two situations).
If values are naturally restricted to be in the range 0 to 1, not including the end-points, then a logit transformation may be appropriate: this yields values in the range (−∞,∞).
1. It is not always necessary or desirable to transform a data set to resemble a normal distribution. However, if symmetry or normality are desired, they can often be induced through one of the power transformations.
2. A linguistic power function is distributed according to the Zipf-Mandelbrot law. The distribution is extremely spiky and leptokurtic, this is the reason why researchers had to turn their backs to statistics to solve e.g. authorship attribution problems. Nevertheless, usage of Gaussian statistics is perfectly possible by applying data transformation.[11]
3. To assess whether normality has been achieved after transformation, any of the standard normality tests may be used. A graphical approach is usually more informative than a formal statistical test and hence a normal quantile plot is commonly used to assess the fit of a data set to a normal population. Alternatively, rules of thumb based on the sample skewness and kurtosis have also been proposed.[12][13]
If we observe a set of n values X1, ..., Xn with no ties (i.e., there are n distinct values), we can replace Xi with the transformed value Yi = k, where k is defined such that Xi is the kth largest among all the X values. This is called the rank transform,[14] and creates data with a perfect fit to a uniform distribution. This approach has a population analogue.
Using the probability integral transform, if X is any random variable, and F is the cumulative distribution function of X, then as long as F is invertible, the random variable U = F(X) follows a uniform distribution on the unit interval [0,1].
From a uniform distribution, we can transform to any distribution with an invertible cumulative distribution function. If G is an invertible cumulative distribution function, and U is a uniformly distributed random variable, then the random variable G−1(U) has G as its cumulative distribution function.
Putting the two together, if X is any random variable, F is the invertible cumulative distribution function of X, and G is an invertible cumulative distribution function then the random variable G−1(F(X)) has G as its cumulative distribution function.
Many types of statistical data exhibit a "variance-on-mean relationship", meaning that the variability is different for data values with different expected values. As an example, in comparing different populations in the world, the variance of income tends to increase with mean income. If we consider a number of small area units (e.g., counties in the United States) and obtain the mean and variance of incomes within each county, it is common that the counties with higher mean income also have higher variances.
A variance-stabilizing transformation aims to remove a variance-on-mean relationship, so that the variance becomes constant relative to the mean. Examples of variance-stabilizing transformations are the Fisher transformation for the sample correlation coefficient, the square root transformation or Anscombe transform for Poisson data (count data), the Box–Cox transformation for regression analysis, and the arcsine square root transformation or angular transformation for proportions (binomial data). While commonly used for statistical analysis of proportional data, the arcsine square root transformation is not recommended because logistic regression or a logit transformation are more appropriate for binomial or non-binomial proportions, respectively, especially due to decreased type-II error.[15][3]
Univariate functions can be applied point-wise to multivariate data to modify their marginal distributions. It is also possible to modify some attributes of a multivariate distribution using an appropriately constructed transformation. For example, when working with time series and other types of sequential data, it is common to difference the data to improve stationarity. If data generated by a random vector X are observed as vectors Xi of observations with covariance matrix Σ, a linear transformation can be used to decorrelate the data. To do this, the Cholesky decomposition is used to express Σ = A A'. Then the transformed vector Yi = A−1Xi has the identity matrix as its covariance matrix.
{{cite book}}
См. также: Долгая ночь Полярная ночь в Нарьян-Маре, 23 декабря 2014 года, 11:27. В полдень, из-за сумеречного освещения чуть светлее, чем в остальное время суток Полярная ночь 2 января на полуострове Нордкинн (англ.) (рус. в Норвегии (через 45 минут после полудня) Поля́рн
Untuk keuskupan di Argentina, lihat Keuskupan San Isidro. Keuskupan San Isidro de El GeneralDioecesis Sancti IsidoriKatolik Catedral de San Isidro LabradorLokasiNegara Kosta RikaProvinsi gerejawiProvinsi San José de Costa RicaStatistikLuas10.346 km2 (3.995 sq mi)Populasi- Total- Katolik(per 2010)369.000359,000 (97.3%)Paroki26InformasiDenominasiKatolik RomaRitusRitus LatinPendirian19 Agustus 1954 (69 tahun lalu)KatedralKatedral Santo IsidorusKepemimpinan k…
Brazilian association football club based in Cruz do Espírito Santo, Paraíba, Brazil Soccer clubSão Paulo CrystalFull nameSão Paulo Crystal Futebol ClubeNickname(s)Carcará (Crested caracara)FoundedFebruary 10, 2008 (15 years ago) (2008-02-10)GroundCarneirãoCapacity1,200PresidentMúcio CarlosHead coachWilton BezerraLeagueCampeonato Paraibano2020Paraibano, 6thWebsiteClub website Home colors Away colors São Paulo Crystal Futebol Clube, formerly known as Lucena Sport Clube, is a…
هذه المقالة يتيمة إذ تصل إليها مقالات أخرى قليلة جدًا. فضلًا، ساعد بإضافة وصلة إليها في مقالات متعلقة بها. (يوليو 2022) السينما العالمية من منظور الأنواع السينمائية World Cinema through Global Genres معلومات الكتاب المؤلف وليام ف. كوستانزو اللغة العربية الناشر مؤسسة هنداوي تاريخ النشر 2013 - 2014 …
Halaman ini memuat daftar pulau dan kepulauan di Pulau Kalimantan. Daftar ini tidak dimaksudkan sebagai suatu daftar yang lengkap atau selalu terbarui. Jika Anda melihat artikel yang seharusnya tercantum di sini, silakan sunting halaman ini dan tambahkan pranala ke artikel tersebut. Gunakan perubahan terkait untuk melihat perubahan terbaru dari artikel-artikel yang tercantum pada halaman ini. Daftar Provinsi dan pulau Di Pulau Kalimantan Kalimantan Barat Pulau Aur Besar Pulau Aur Kecil Pulau Aye…
Luka Gagnidze Luka Gagnidze en 2022Datos personalesNacimiento Kutaisi28 de febrero de 2003 (20 años)País GeorgiaNacionalidad(es) GeorgianaAltura 1,75 m (5′ 9″)Peso 72 kg (158 lb)Carrera deportivaDeporte FútbolClub profesionalDebut deportivo 2020(SK Dinamo Tiflis)Club FC Dinamo MoscúLiga Liga Premier de RusiaPosición CentrocampistaDorsal(es) 34Goles en clubes 1Selección nacionalSelección GEO GeorgiaDebut 25 de marzo de 2023Part. (goles) 5 (0)[editar d…
هذه المقالة يتيمة إذ تصل إليها مقالات أخرى قليلة جدًا. فضلًا، ساعد بإضافة وصلة إليها في مقالات متعلقة بها. (يناير 2019) فرناندو ألبرتو دوس سانتوس كاردينال معلومات شخصية الميلاد 26 يونيو 1985 (العمر 38 سنة)بورتو الطول 1.82 م (5 قدم 11 1⁄2 بوصة) الجنسية ألمانيا معلومات ا…
Mauvières Entidad subnacional MauvièresLocalización de Mauvières en Francia Coordenadas 46°34′26″N 1°05′19″E / 46.573888888889, 1.0886111111111Entidad Comuna de Francia • País Francia • Región Centro • Departamento Indre • Distrito distrito de Le Blanc • Cantón cantón de Bélâbre • Mancomunidad Communauté de communes du Val d'AnglinAlcalde Raymond Patraud(2008-2014)Superficie • Total 23.94 km²Altit…
Frans Stoppelman Frans Stoppelman, 1965 Persoonsgegevens Geboren 9 januari 1921 Overleden Mexico-stad, 23 oktober 2007 Geboorteland Nederland Beroep(en) fotograaf RKD-profiel Portaal Kunst & Cultuur Frans Stoppelman (Amsterdam, 9 januari 1921 - Mexico-stad, 23 oktober 2007) was een Nederlandse persfotograaf die zich na de Tweede Wereldoorlog in Latijns-Amerika vestigde. Zijn oog voor bizarre situaties leverde hem internationale erkenning op. Zijn foto's werden gepubliceerd in Li…
Malayic language dialect Perak Malayبهاس ملايو ڤيراقBahasa Melayu PerakNative toMalaysiaRegionPerakEthnicityPerakian MalaysNative speakers1.4 million (2010 census)[1]Language familyAustronesian Malayo-Polynesian(disputed)MalayicPerak MalayDialects Kuala Kangsar Perak Tengah Writing systemLatin (Malay alphabet)Arabic (Jawi)Gangga Malayu[2]Language codesISO 639-3–Linguist Listmly-perGlottologNoneThis article contains IPA phonetic symbols. Without proper re…
فامسيكلوفير الاسم النظامي 2-[(acetyloxy)methyl]-4-(2-amino-9H-purin-9-yl)butyl acetate يعالج هربس نطاقي، وهربس تناسلي[1] اعتبارات علاجية اسم تجاري Famvir ASHPDrugs.com أفرودة مدلاين بلس a694038 فئة السلامة أثناء الحمل B1 (أستراليا), B (الولايات المتحدة) طرق إعطاء الدواء Oral بيانات دوائية توافر حيوي 75–77% ربط…
Harry Yount Henry S. Yount (* 18. März 1837; † 16. Mai 1924), auch bekannt als Rocky Mountain Harry Yount, war ein US-Bürgerkriegsveteran, Mountain Man, Berufsjäger, Trapper, Prospektor, Wildnisführer und der erste Ranger des Yellowstone-Nationalparkes in den USA. Yount kam erstmals als Cowboy bei der Hayden-Studie von 1878 mit der Yellowstone-Gegend in Berührung. Als er damals zusammen mit einem Kollegen den Park betreten wollte, wurde ihr Camp von Bannock-Indianern niedergebrannt. Auße…
Volcán de San Vicente (Chichontepec) Volcán de San Vicente.Localización geográficaContinente AméricaCordillera Cordillera americanaCoordenadas 13°35′42″N 88°50′13″O / 13.595, -88.836944444444Localización administrativaPaís El SalvadorDivisión Departamento de San VicenteCaracterísticas generalesTipo EstratovolcánAltitud 2182 m s. n. m.GeologíaObservatorio El Salvador Instituto de Ciencias de la Tierra (fr)Última erupción DesconocidoMapa de localización Volc…
جامعة الغردقة الأسماء السابقة جامعة جنوب الوادي، فرع الغردقة معلومات التأسيس 2020 النوع جامعة حكومية تكاليف الدراسة حسب كل كلية الموقع الجغرافي إحداثيات 27°17′49″N 33°42′06″E / 27.297072321271°N 33.701657600026°E / 27.297072321271; 33.701657600026 المدينة البحر الأحمر المكان شمال مدينة الغردق…
54th season of FIA Formula One motor racing Formula One 2000 redirects here. For video game, see Formula One 2000 (video game). F1 2000 redirects here. For other uses, see F1 2000 (disambiguation). 2000 FIA Formula OneWorld Championship Drivers' Champion: Michael SchumacherConstructors' Champion: Ferrari Previous 1999 Next 2001 Races by countryRaces by venueSupport series: Formula 3000Porsche Supercup Michael Schumacher (pictured in 1998) won his third championship, and his first for Ferrari, in…
Painting genre Annalena Altarpiece with predella by Fra Angelico, c. 1438–40 (frame removed), sometimes considered the first instance of the sacra conversazione format[1] In art, a sacra conversazione (Italian: [ˈsaːkra koɱversatˈtsjoːne]; plural: sacre conversazioni), meaning holy (or sacred) conversation, is a genre developed in Italian Renaissance painting, with a depiction of the Virgin and Child (the Virgin Mary with the infant Jesus) amidst a group of saints in…
John Locke filozof kontraktualizmu, który dał podwaliny współczesnej demokracji Ten artykuł dotyczy filozoficznego i politycznego pojęcia umowy społecznej, tzw. kontraktualizmu, a nie prawnej teorii kontraktów czy zobowiązań w ramach choćby dogmatyki prawa cywilnego. Umowa społeczna – termin filozoficzny łączący w sobie wiele różnych teorii, których tematem są umowy dorozumiane, przy pomocy których ludzie tworzą narody i utrzymują porządek społeczny. Teoria umowy społe…
GURPS CyberpunkCover of GURPS CyberpunkDesignersLoyd BlankenshipPublishersSteve Jackson GamesPublication1990GenresCyberpunkSystemsGURPS 3 GURPS Cyberpunk is a genre toolkit for cyberpunk-themed role-playing games set in a near-future dystopia, such as that envisioned by William Gibson in his influential novel Neuromancer. It was published in 1990 after a significant delay caused by the original draft being a primary piece of evidence in Steve Jackson Games, Inc. v. United States Secret Service. …
Type of Chinese rice noodle This article relies largely or entirely on a single source. Relevant discussion may be found on the talk page. Please help improve this article by introducing citations to additional sources.Find sources: Mixian noodle – news · newspapers · books · scholar · JSTOR (June 2020) MixianMixian noodles served in pork broth with sliced pork, coriander, and chivesTypeChinese noodlesPlace of originChinaRegion or stateYunnanMain ing…
United States Marine Corps general This article includes a list of general references, but it lacks sufficient corresponding inline citations. Please help to improve this article by introducing more precise citations. (February 2008) (Learn how and when to remove this template message) Logan FelandBorn(1869-08-11)August 11, 1869Hopkinsville, Kentucky, U.S.DiedJuly 17, 1936(1936-07-17) (aged 66)Columbus, Ohio, U.S.Allegiance United States of AmericaService/branch United States Mari…
Lokasi Pengunjung: 3.147.48.254