Testing the Multivariate Normality of Australian Stock Returns.Abstract: The multivariate The use of multiple variables in a forecasting model. normality normality, in chemistry: see concentration. of stock returns is a crucial assumption in many tests of assets pricing models. While past Australian Australian pertaining to or originating in Australia. Australian bat lyssavirus disease see Australian bat lyssavirus disease. Australian cattle dog a medium-sized, compact working dog used for control of cattle. research has examined the univariate univariate adjective Determined, produced, or caused by only one variable normality of returns, univariate test statistics are unreliable for testing multivariate normality since they ignore the contemporaneous con·tem·po·ra·ne·ous adj. Originating, existing, or happening during the same period of time: the contemporaneous reigns of two monarchs. See Synonyms at contemporary. correlation between asset returns. This paper utilises a multivariate test procedure, based on the generalised Adj. 1. generalised - not biologically differentiated or adapted to a specific function or environment; "the hedgehog is a primitive and generalized mammal" generalized biological science, biology - the science that studies living organisms method of moments, to test whether residuals from market model regressions are multivariate normal. The results suggest violations of the multivariate normality assumption which cast doubt over the validity over inferential in·fer·en·tial adj. 1. Of, relating to, or involving inference. 2. Derived or capable of being derived by inference. in procedures commonly used in the extant ex·tant adj. 1. Still in existence; not destroyed, lost, or extinct: extant manuscripts. 2. Archaic Standing out; projecting. empirical literature. Keywords: MULTIVARIATE NORMALITY; GMM GMM Generalized Method of Moments (economics) GMM Gaussian Mixture Model GMM General Membership Meeting GMM Good Mobile Messaging GMM GPRS Mobility Management GMM Global Marijuana March GMM Genetically Modified Microorganisms ; SKEWNESS Skewness A statistical term used to describe a situation's asymmetry in relation to a normal distribution. Notes: A positive skew describes a distribution favoring the right tail, whereas a negative skew describes a distribution favoring the left tail. ; KURTOSIS Kurtosis A statistical measure used to describe the distribution of observed data around the mean. Notes: Used generally in the statistical field, it describes trends in charts. . 1. Introduction Whether or not stock returns conform to Verb 1. conform to - satisfy a condition or restriction; "Does this paper meet the requirements for the degree?" fit, meet coordinate - be co-ordinated; "These activities coordinate well" a multivariate normal distribution
In probability theory and statistics, a multivariate normal distribution, also sometimes called a multivariate Gaussian distribution is an issue of general importance to researchers in finance. From a theoretical perspective, the mean-variance framework which underlies the Sharpe-Lintner capital asset pricing model Capital asset pricing model (CAPM) An economic theory that describes the relationship between risk and expected return, and serves as a model for the pricing of risky securities. (CAPM CAPM See: Capital asset pricing model CAPM See capital-asset pricing model (CAPM). ) is predicated on certain assumptions required for rational agents to hold mean-variance efficient portfolios Mean-variance efficient portfolio Related: Markowitz efficient portfolio . A sufficient assumption is that asset returns are distributed multivariate normal. Since a normal distribution is described completely by its first two moments (mean and variance The discrepancy between what a party to a lawsuit alleges will be proved in pleadings and what the party actually proves at trial. In Zoning law, an official permit to use property in a manner that departs from the way in which other property in the same locality ), the assumption of normality fits neatly with the mean-variance framework of CAPM. From an empirical perspective, the multivariate normality assumption is a feature of several well-known tests of asset pricing models Asset pricing model A model for determining the required or expected rate of return on an asset. Related: Capital asset pricing model and arbitrage pricing theory. . For example, based on the assumption of multivariate normality, Gibbons Famous people named Gibbons include:
British physician. He won a 1902 Nobel Prize for proving that malaria is transmitted to humans by the bite of the mosquito. and Shanken (1989) and MacKinlay (1987) derive a finite finite - compact sample test of the mean-variance efficiency of a portfolio, while Gibbons (1982), Kandel (1984), Shanken (1985, 1986) and Zhou (1991) provide tests of Black's zero-beta CAPM. In the Australian context, Stokie (1982a), Faff (1991) and Wood (1991) have tested asset pricing models relying on the multivariate normality assumption. Given the importance of the assumption, it is surprising how little research has been conducted on the multivariate normality of stock returns. While the distribution of stock returns has been studied for decades,(1) the focus of this research has largely been univariate normality. On face value, a univariate test of normality might appear sufficient to test multivariate normality: if asset returns are multivariate normal, then each asset's marginal distribution In probability theory, given two jointly distributed random variables X and Y, the marginal distribution of X is simply the probability distribution of X ignoring information about Y is normal. Conversely con·verse 1 intr.v. con·versed, con·vers·ing, con·vers·es 1. To engage in a spoken exchange of thoughts, ideas, or feelings; talk. See Synonyms at speak. 2. , if an asset's return is not univariate normally distributed, then the joint distribution of all assets' returns cannot be multivariate normal. Hence, rejection of univariate normality implies returns are not multivariate normal. However, Richardson and Smith (1993) note that univariate tests ignore contemporaneous correlation between assets and consequently tests based on univariate statistics may be misleading. By allowing for cross-sectional dependence in returns, Richardson and Smith provide the first multivariate test of the normality of stock returns. In the Australian context, only a handful of papers have examined the distribution of stock returns, and these have been exclusively univariate tests. This paper provides a test of the multivariate normality of Australian stock returns. Following Richardson and Smith (1993), we employ the distribution theory for parameter (1) Any value passed to a program by the user or by another program in order to customize the program for a particular purpose. A parameter may be anything; for example, a file name, a coordinate, a range of values, a money amount or a code of some kind. estimates under Hansen's (1982) generalised method of moments (GMM) to derive test statistics which explicitly accommodate cross-correlations in returns. The remainder of the paper is structured as follows. Section 2 discusses univariate testing methodology commonly employed and reviews several prior Australian studies of the distribution of stock returns. Section 3 outlines the multivariate test procedure advocated by Richardson and Smith (1993). In particular, the asymptotic distribution In mathematics and statistics, an asymptotic distribution is a hypothetical distribution that is in a sense the "limiting" distribution of a sequence of distributions. A distribution is an ordered set of random variables
for i of parameter estimates under GMM is employed to derive joint tests of skewness and kurtosis which explicitly account for contemporaneous correlation between asset returns. This approach is also extended to utilise the multivariate structure of asset returns in test statistics by calculating several cross-moments of returns. To assess the validity of the multivariate normality assumption in tests of asset pricing models, section 4 applies the multivariate tests to the residuals from market model regressions for ten size portfolios. Section 5 concludes the paper. 2. Background 2.1 Univariate Test Statistics Before reviewing previous research on the distribution of Australian stock returns, it is useful to outline the univariate test statistics which have been commonly employed in testing for normality. The (univariate) normal distribution is completely described by its first two moments--mean ([Mu]) and variance ([[Sigma SIGMA - A scientific visual programming environment from NASA. http://fi-www.arc.nasa.gov/fia/projects/sigma/. ].sup.2]). All odd moments higher than one are zero and all even moments are a function of variance.(2) Testing whether a variable is normally distributed requires comparison of sample moments with their theoretical values under the normal null hypothesis null hypothesis, n theoretical assumption that a given therapy will have results not statistically different from another treatment. null hypothesis, n . Denote de·note tr.v. de·not·ed, de·not·ing, de·notes 1. To mark; indicate: a frown that denoted increasing impatience. 2. by [R.sub.it] the return on asset i in period t. The sample mean and variance of [R.sub.it] are calculated: [MATHEMATICAL EXPRESSION A group of characters or symbols representing a quantity or an operation. See arithmetic expression. NOT REPRODUCIBLE re·pro·duce v. re·pro·duced, re·pro·duc·ing, re·pro·duc·es v.tr. 1. To produce a counterpart, image, or copy of. 2. Biology To generate (offspring) by sexual or asexual means. IN ASCII ASCII or American Standard Code for Information Interchange, a set of codes used to represent letters, numbers, a few symbols, and control characters. Originally designed for teletype operations, it has found wide application in computers. ], Denote by [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], and [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], the sample third moment (skewness) and sample fourth moment (kurtosis) of asset i respectively: [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] Univariate tests of skewness and kurtosis are based on standardised Adj. 1. standardised - brought into conformity with a standard; "standardized education" standardized standard - conforming to or constituting a standard of measurement or value; or of the usual or regularized or accepted kind; "windows of standard width"; measures of [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], and [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], which we denote [S.sub.i] and [K.sub.i] respectively. Namely, under the normal null A character that is all 0 bits. Also written as "NUL," it is the first character in the ASCII and EBCDIC data codes. In hex, it displays and prints as 00; in decimal, it may appear as a single zero in a chart of codes, but displays and prints as a blank space. : (1) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], (2) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII], Hence, a univariate test for the normality of returns to asset/portfolio i will involve testing whether sample values of [S.sub.i] and [K.sub.i] differ significantly from zero. In the following section, we note that these tests have been the primary method of testing the normality of Australian stock returns in previously published research. 2.2 Extant Australian Evidence Several studies have examined the normality of Australian stock returns, either directly or indirectly. Ball, Brown and Officer (1976) primarily test several asset pricing models, but in doing so, consider the normality of returns on beta-sorted portfolios during the 1958-1970 period. They calculate [S.sub.i] for each portfolio and finding only two out of 20 test statistics differ significantly from zero, conclude there is little evidence of skewness.(3) Praetz and Wilson (1978) calculate [S.sub.i] and [K.sub.i] for 578 stocks listed between 1958 and 1973, as well as portfolios of various sizes. They find that 72% of individual stocks are not skewed skewed curve of a usually unimodal distribution with one tail drawn out more than the other and the median will lie above or below the mean. skewed Epidemiology adjective Referring to an asymmetrical distribution of a population or of data , and that of the remaining 28%, the majority are positively skewed. Nearly 70% of individual stocks exhibit excess kurtosis Excess kurtosis Kurtosis measures the "fatness" of the tails of a distribution. Positive excess kurtosis means that distribution has fatter tails than a normal distribution. Fat tails means there is a higher than normal probability of big positive and negative returns realizations. . Over 76% of stocks have an acceptable goodness-of-fit to a t-distribution t-distribution see t statistic. , a result consistent with US findings that a fat-tailed distribution describes stock returns well (see Blattberg & Gonedes 1974). Stokie (1982b) argues that much of the non-normality non-normality said of values of which the frequency distribution is markedly different from that of the normal (3) probability distribution. reported in Praetz and Wilson (1978) can be attributed to the high incidence of zero returns, especially in the less frequently traded smaller companies. Using the Praetz and Wilson dataset, Stokie examines the top 40 stocks (by market capitalisation Noun 1. market capitalisation - an estimation of the value of a business that is obtained by multiplying the number of shares outstanding by the current price of a share market capitalization ) which have few zero returns and finds that the percentage of top 40 stocks which fail skewness (13%) and kurtosis (56%) tests is only slightly less than that of all listed firms Listed firm A company whose stock trades on a stock exchange, and conforms to listing requirements. (28% and 63% respectively). Hence, Stokie's (1982b, p. 168) conclusion that `[there are] no conclusive Determinative; beyond dispute or question. That which is conclusive is manifest, clear, or obvious. It is a legal inference made so peremptorily that it cannot be overthrown or contradicted. grounds for rejecting the normal distribution as a representation of the monthly log-returns' is not entirely consistent with his findings. Beedles (1986) notes that the said findings evidence more asymmetry Asymmetry A lack of equivalence between two things, such as the unequal tax treatment of interest expense and dividend payments. in return distributions than Stokie recognises. Over the 1974-1980 period, Beedles examines the cross-sectional and time-series properties of return asymmetry. He finds that 81% of stocks exhibit significant skewness, with positive skewness predominating. Splitting the sample into industrial and resource stocks, Beedles finds little difference in the total rate of rejection of normality (for either positive or negative skewness), but notes that positive skewness is more frequent in resource stocks.(4) In seeking an explanation for the size effect in share returns, Beedles, Dodd and Officer (1988) examine the possibility that distributional asymmetry in returns is priced. Acknowledging the potential problem with univariate skewness statistics caused by cross-correlation Cross-Correlation A statistical measure timing the movements and proximity of alignment between two different information sets of a series of information. Notes: Cross correlation is generally used when measuring information between two different time series. between asset returns, Beedles, Dodd and Officer calculate [S.sub.i] for residuals from market model regressions which they argue neutralizes the cross-correlation's.(5) Their findings indicate statistically significant positive skewness in residuals on the smallest three size portfolios. Finally, in a recent study examining higher moments of equity returns, Alles and Spowart (1995) calculate [S.sub.i] and [K.sub.i] for 144 stocks listed over the 1984-1990 period. They find around 80% of stocks exhibit significant skewness, with approximately equal numbers positively and negatively skewed. Alles and Spowart document positive kurtosis on average, but do not report the rate of statistically significant departures from zero. 2.3 Limitations of Univariate Tests The introduction noted that rejection of univariate normality is generally a sufficient condition for rejecting multivariate normality. However, it can be misleading to draw inferences regarding the multivariate distribution of asset returns from univariate tests of normality such as those outlined in section 2.1. Since asset returns are contemporaneously con·tem·po·ra·ne·ous adj. Originating, existing, or happening during the same period of time: the contemporaneous reigns of two monarchs. See Synonyms at contemporary. correlated cor·re·late v. cor·re·lat·ed, cor·re·lat·ing, cor·re·lates v.tr. 1. To put or bring into causal, complementary, parallel, or reciprocal relation. 2. , the univariate test statistics will also be dependent. To clarify this point, re-consider the finding of Stokie (1982b) that 13% of the top 40 stocks exhibit significant skewness. Even if these stock returns were distributed multivariate normal, we would expect some of our sample statistics to exhibit (spurious spu·ri·ous adj. Similar in appearance or symptoms but unrelated in morphology or pathology; false. spurious simulated; not genuine; false. ) skewness.(6) Given that returns on the top 40 stocks are likely to be correlated, any spurious skewness that occurs is likely to be evident in several stocks even if the joint distribution is in fact multivariate normal. Hence, based on univariate test statistics alone, it is difficult if not impossible to know whether the sample incidence of skewness is spurious or represents a statistically significant departure from multivariate normality. This important point is emphasized by Richardson and Smith (1993) and motivates their development of a multivariate test procedure which recognizes the cross-correlation's between individual asset returns by allowing for the correlation's between univariate test statistics. The following section outlines this multivariate methodology. 3. Multivariate Test Procedure 3.1 Overview of GMM Richardson and Smith (1993) derive tests of multivariate normality using the generalized gen·er·al·ized adj. 1. Involving an entire organ, as when an epileptic seizure involves all parts of the brain. 2. Not specifically adapted to a particular environment or function; not specialized. 3. method of the moments. The asymptotic distribution theory for parameter estimates under GMM, developed by Hansen (1982), can be employed to derive a test methodology which allows for cross-correlation's between univariate test statistics, as well as exploiting the multivariate structure of assets returns. A brief overview of GMM follows. Denote by [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] the n-dimensional time series of asset returns. A null hypothesis (e.g. that stock returns are multivariate normal) places restrictions on the moments of the data, which are written as: (3) E [h ([R.sub.t], [Theta])] = 0, where [Theta] is an m-vector of parameters governing gov·ern v. gov·erned, gov·ern·ing, gov·erns v.tr. 1. To make and administer the public policy and affairs of; exercise sovereign authority in. 2. the distribution of R and h(.) is an r-vector of functional forms.(7) Asymptotically, under the null hypothesis, the sample counterparts of equation 3 converge con·verge v. con·verged, con·verg·ing, con·verg·es v.intr. 1. a. To tend toward or approach an intersecting point: lines that converge. b. to zero: (4) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] GMM finds the values of the unknown parameters ([Theta]) which set the vector of sample moments in equation 4 to zero. Using only mild regularity assumptions,(8) Hansen (1982) derives the asymptotic distribution of the parameter estimates as: (5) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] where: [D.sub.0] = E [[Delta]h ([R.sub.t], [Theta])]/[[Delta][Theta]'] and [S.sub.0] = E [h ([R.sub.t], [Theta]) h ([R.sub.t], [Theta])']. In many applications of GMM, there are more moment conditions than unknown parameters (r [is greater than] m) and the system is `over-identified'. In such a case, m linear combinations of gT([Theta]) can be set to zero, and the null hypothesis is tested by determining whether the remaining r-m `over-identifying restrictions' are (close to) zero.(9) In empirical applications, while So is usually unknown, any consistent estimator suffices and the heteroscedasticity- and autocorrelation-consistent estimators of Newey and West (1987) or Andrews (1991) are often used. In this paper, however, the vector of functional forms h(.) is exactly identified (r = m). That is, there are m unknown parameters and m moment restrictions. An analytic an·a·lyt·ic or an·a·lyt·i·cal adj. 1. Of or relating to analysis or analytics. 2. Expert in or using analysis, especially one who thinks in a logical manner. 3. Psychoanalytic. expression for the variance-covariance matrix of the parameters [[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]] can be derived and this is central to the development of a test for multivariate normality. In the next section, the moment restrictions h(.) under the multivariate normal null are specified and the test statistics applied in this paper are derived. 3.2 Estimating the Joint Distribution of Univariate Test Statistics Testing the multivariate normality of stock returns using GMM requires specification of the r-vector of functional forms h(.) from equation 3. Following Richardson and Smith (1993), and without loss of generality Without loss of generality (abbreviated to WLOG or WOLOG and less commonly stated as without any loss of generality) is a frequently used expression in mathematics. , consider the case where the returns on two assets ([R.sub.it] and [R.sub.jt]) are distributed bivariate bi·var·i·ate adj. Mathematics Having two variables: bivariate binomial distribution. Adj. 1. normal. From the bivariate normal moment generating function, (6) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] we can specify as many moments as required.(10) To illustrate the procedure, the following set of moment conditions represents the first four (univariate) moments of assets i and j: [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] where [Theta] [equivalence] ([[Mu].sub.i], [[Mu].sub.j], [[Sigma].sub.i], [[Sigma].sub.j], [S.sub.i], [S.sub.j], [K.sub.i], [K.sub.j]). The first two restrictions pertain to pertain to verb relate to, concern, refer to, regard, be part of, belong to, apply to, bear on, befit, be relevant to, be appropriate to, appertain to means, and the next two variances. The next two restrictions identify skewness and follow from equation 1, whilst the last two restrictions identify kurtosis and follow from equation 2. Using the distributional properties of GMM estimators (equation 5), the joint asymptotic distribution of univariate skewness and kurtosis statistics can be analytically an·a·lyt·ic or an·a·lyt·i·cal adj. 1. Of or relating to analysis or analytics. 2. Dividing into elemental parts or basic principles. 3. obtained. Richardson and Smith (1993) show that the joint distribution of [S.sub.i] and [K.sub.i] for assets i and j is: (7) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] where [[Rho].sub.ij] is the correlation between assets i and j. Note that result 7 contains the distributional results 1 and 2 underlying popular univariate test procedures. However, it can also be seen from 7 that the asymptotic covariance Covariance A measure of the degree to which returns on two risky assets move in tandem. A positive covariance means that asset returns move together. A negative covariance means returns vary inversely. of these univariate statistics is non-zero [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] and [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] respectively), suggestive of suggestive of Decision making adjective Referring to a pattern by LM or imaging, that the interpreter associates with a particular–usually malignant lesion. See Aunt Millie approach, Defensive medicine. the danger of drawing inference (logic) inference - The logical process by which new facts are derived from known facts by the application of inference rules. See also symbolic inference, type inference. about multivariate normality from univariate tests. Given the joint distribution of (say) the univariate skewness statistics, the interdependence in·ter·de·pen·dent adj. Mutually dependent: "Today, the mission of one institution can be accomplished only by recognizing that it lives in an interdependent world with conflicts and overlapping interests" of univariate statistics can be explicitly accommodated in testing whether [S.sub.i] = 0, [inverted inverted reverse in position, direction or order. inverted L block a pattern of local filtration anesthesia commonly used in laparotomy in the ox. A] i = 1, ..., n with an appropriate multivariate test. For example, a Wald test The Wald test is a statistical test, typically used to test whether an effect exists or not. In other words, it tests whether an independent variable has a statistically significant relationship with a dependent variable. of this hypothesis is: (8) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] where S is the n-vector of skewness measures and Vs is the variance-covariance matrix of these measures shown in the upper-left block of the covariance matrix In statistics and probability theory, the covariance matrix is a matrix of covariances between elements of a vector. It is the natural generalization to higher dimensions of the concept of the variance of a scalar-valued random variable. in equation 7. Similarly, a Wald test that the kurtosis measures [K.sub.i] = 0, [inverted A] i = 1, ..., n can be conducted. Since the above procedure utilizes the correlation between univariate test statistics, it overcomes the fundamental problem with univariate tests of normality outlined in section 2.3. Hence, the Wald test is sufficient to test the multivariate normality hypothesis. Note, however, that this test has utilized only the marginal distributions of the assets. It is also possible to exploit the multivariate structure of returns by estimating the cross-moments implied under the multivariate normal null. This avenue is explored next. 3.3 Utilizing Cross-Moments in Test Procedures In addition to restrictions on the univariate distribution In statistics, a univariate distribution is a probability distribution of only one random variable. This is in contrast to a multivariate distribution, the probability distribution of a random vector. See also
[MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] where [[Rho].sub.ij] is the sample correlation coefficient Correlation Coefficient A measure that determines the degree to which two variable's movements are associated. The correlation coefficient is calculated as: between assets i and j. Again, using the moment generating function, the first step is to specify an exactly identified vector of functional forms: [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] where [Theta] [equivalence] ([[Mu].sub.i], [[Mu].sub.j], [[Mu].sub.k], [[Mu].sub.l], [[Sigma].sub.i], [[Sigma].sub.j], [[Sigma].sub.k], [[Sigma].sub.l], [S.sub.ij], [S.sub.kl], [K.sub.ij], [K.sub.kl] [[Sigma].sub.ij], [[Sigma].sub.kl]). Each asset has a mean and variance restriction. Two covariance, two cross-skewness and two cross-kurtosis restrictions are specified giving an exactly identified system of 14 equations and 14 parameters. The joint distributions of the cross-skewness and cross-kurtosis measures follow from equation 5. Richardson and Smith (1993) report the following extracts from the variance-covariance matrix [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII]: (9) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] (10) [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] Wald tests of the joint restrictions on [S.sub.ij] or [K.sub.ij], [inverted A]i, j can be conducted once the relevant correlation coefficients have been calculated. 4. Empirical Results Many previous papers have examined the distributional properties of individual stock returns.(11) Tests of asset pricing models, however, often utilise size and/or industry portfolios to test the mean-variance efficiency of the market proxy. For example, the popular Gibbons, Ross and Shanken (1989) test of the Sharpe-Lintner CAPM involves running market model regressions for size portfolios and calculating a test statistic statistic, n a value or number that describes a series of quantitative observations or measures; a value calculated from a sample. statistic a numerical value calculated from a number of observations in order to summarize them. , the distribution of which is based on the assumption that market model residuals are multivariate normal. Therefore, while the multivariate normality of raw stock returns is of some interest, the multivariate normality of market model residuals is of direct relevance to several popular tests of asset pricing models. This paper examines the latter issue with a view to assessing the reasonableness of the multivariate normality assumption in tests of financial models. Hence, in the previous discussion of restrictions under the multivariate normal null, asset returns [R.sub.it] are replaced with market model residuals [[Epsilon 1. (language) EPSILON - A macro language with high level features including strings and lists, developed by A.P. Ershov at Novosibirsk in 1967. EPSILON was used to implement ALGOL 68 on the M-220. ].sub.it]. Data consist of all stocks listed on the Australian Stock Exchange Australian Stock Exchange (ASX) Australia's major securities market, formed when the six state stock exchanges (Adelaide, Brisbane, Hobart, Melbourne, Perth, and Sydney stock exchanges) were merged in 1987. from January 1974 to December 1997 obtained from the Centre for Research in Finance (CRIF CRIF Conseil Représentatif des Institutions Juives de France CRIF Center for Research in International Finance CRIF Cargo Routing Information File CRIF Commercial Reserve Imagery Fleet CRIF Cryogenics Research and Integration Facility ) at the Australian Graduate School of Management The Australian Graduate School of Management (AGSM), based in Sydney, is a business school with an international reputation for management research and is widely regarded as the leading business school in Australia. . In each calendar year, stocks were ranked according to according to prep. 1. As stated or indicated by; on the authority of: according to historians. 2. In keeping with: according to instructions. 3. market capitalisation in the previous December and ten size portfolios were formed each containing an equal number of stocks. Monthly portfolio returns were calculated by weighting stock returns equally. For size portfolio p, market model residuals [[Epsilon].sub.pt] were estimated by OLS OLS Ordinary Least Squares OLS Online Library System OLS Ottawa Linux Symposium OLS Operation Lifeline Sudan OLS Operational Linescan System OLS Online Service OLS Organizational Leadership and Supervision OLS On Line Support OLS Online System regression regression, in psychology: see defense mechanism. regression In statistics, a process for determining a line or curve that best represents the general trend of a data set. : [R.sub.pt] - [R.sub.ft] = [[Alpha].sub.p] + [[Beta].sub.p] ([R.sub.mt] - [R.sub.ft]) + [[Epsilon].sub.pt], [inverted A]p = 1, ..., 10. Table 1 reports the correlation matrix Noun 1. correlation matrix - a matrix giving the correlations between all pairs of data sets statistics - a branch of applied mathematics concerned with the collection and interpretation of quantitative data and the use of probability theory to estimate population for market model residuals on the ten size portfolios. The highest and lowest correlations are 0.76 and -0.57 between portfolios 9 and 10 and portfolios 5 and 7 respectively. Table 1 also reveals distinctive patterns in the correlations. The residuals of small market capitalisation portfolios are positively correlated, as are the residuals of large portfolios. However, the correlations between small and large market capitalisation portfolios are negative.(12) Given the joint distribution of univariate skewness and kurtosis measures in equation 7 and the high correlation between certain portfolios, the univariate skewness and/or kurtosis measures for these portfolios are clearly not independent.
Table 1
Correlation between Market Model Residuals(1)
Portfolio 1 2 3 4 5
1 1.00
2 0.29 1.00
3 0.10 0.40 1.00
4 0.07 0.20 0.31 1.00
5 -0.11 -0.06 0.12 0.09 1.00
6 -0.35 -0.27 -0.11 -0.06 -0.04
7 -0.35 -0.43 -0.27 -0.17 -0.01
8 -0.44 -0.57 -0.48 -0.38 -0.13
9 -0.44 -0.56 -0.55 -0.40 -0.24
10 -0.40 -0.43 -0.50 -0.46 -0.37
Portfolio 6 7 8 9 10
1
2
3
4
5
6 1.00
7 0.29 1.00
8 0.25 0.38 1.00
9 0.08 0.23 0.67 1.00
10 0.00 0.18 0.47 0.76 1.00
Note: (1.) Correlation coefficients are for market model residuals on ten size portfolios constructed from monthly returns on stocks from the AGSM AGSM Australian Graduate School of Management AGSM Anderson Graduate School of Management AGSM American Graduate School of Management AGSM Art Gallery of Southwestern Manitoba (Canada) AGSM Agricultural Systems Management database from January 1974 to December 1997 (288 observations). The market model residuals for portfolio p are calculated using the regression: [R.sub.pt] - [R.sub.ft] = [[Alpha].sub.p] + [[Beta].sub.p] ([R.sub.mt] - [R.sub.ft]) + [[Epsilon].sub.pt], [inverted A] p = 1, ..., 10. 4.1 Tests Utilising Univariate Normal Moments Table 2 reports univariate tests for skewness and kurtosis on individual size portfolios as per equations 1 and 2 respectively. The probability values of test statistics reported in this paper are based on two measures. First, p-values are based on the theoretical distribution of the statistics under the null. Since these follow from the distributional results in Hansen (1982), they are valid only asymptotically. Second, Monte Carlo Monte Carlo (môNtā` kärlō`), town (1982 pop. 13,150), principality of Monaco, on the Mediterranean Sea and the French Riviera. p-values are calculated by simulating residuals for ten size portfolios from a multivariate normal distribution with a variance-covariance matrix equal to the empirical variance-covariance matrix, and calculating the relevant test statistic for that simulation.(13) Ten thousand repetitions of the simulations are performed and the Monte Carlo p-value is the proportion of the simulated test statistics which exceed the reported statistic.
Table 2
Univariate Skewness and Kurtosis Tests(1)
Univariate Monte Univariate
Portfolio Skewness p-value Carlo p Kurtosis
Smallest 1.61 0.0000 0.0000 4.07
2 0.86 0.0000 0.0000 1.79
3 1.58 0.0000 0.0000 6.28
4 0.85 0.0000 0.0000 2.72
5 0.26 0.0732 0.0676 0.82
6 -0.14 0.3383 0.3362 1.51
7 -0.03 0.8445 0.8392 1.10
8 -0.24 0.1011 0.1014 0.78
9 -0.15 0.3027 0.2908 0.92
Largest 0.04 0.8058 0.8005 2.37
[MATHEMATICAL 318.34 0.0000 0.0000 869.46
EXPRESSION NOT
REPRODUCIBLE
IN ASCII]
Monte
Portfolio p-value Carlo p
Smallest 0.0000 0.0000
2 0.0000 0.0002
3 0.0000 0.0000
4 0.0000 0.0000
5 0.0047 0.0092
6 0.0000 0.0004
7 0.0001 0.0028
8 0.0072 0.0121
9 0.0014 0.0047
Largest 0.0000 0.0001
[MATHEMATICAL 0.0000 0.0000
EXPRESSION NOT
REPRODUCIBLE
IN ASCII]
Note: (1.) These tests utilise market model residuals for ten size portfolios constructed from monthly returns on stocks from the AGSM database from January 1974 to December 1997 (288 observations). Columns 2 and 3 report the univariate skewness statistic and asymptotic p-value respectively as per equation 1. Columns 5 and 6 report the univariate kurtosis statistic and asymptotic p-value respectively as per equation 2. Monte Carlo p-values for each portfolio are based on a simulation of 288 returns from a multivariate normal distribution with a variance-covariance matrix equal to the empirical variance-covariance matrix of the ten size portfolios. Ten thousand repetitions of the simulation are performed. The Monte Carlo p-value is the proportion of simulated test statistics which exceed the reported statistic. In table 2, only the four smallest portfolios exhibit significant positive skewness. However, by taking correlations between skewness measures into account, the Wald test rejects the null hypothesis that [S.sub.i] = 0, [inverted A] i = 1, ..., 10. Univariate kurtosis tests indicate that all portfolios are significantly leptokurtic and the Wald test reinforces this conclusion. In summarising table 2, the tests which utilise the moments of a univariate normal distribution provide strong evidence that residuals from market model regressions are not multivariate normal. 4.2 Tests Utilising the Multivariate Structure of Returns Tests exploiting the multivariate structure of asset returns under the null hypothesis are outlined in equations 9 and 10. Following Richardson and Smith (1993), we select portfolio 1 (the smallest decile decile one of the groups when a series of ranked data is divided into ten equal parts, or dividing points between such groups. See also quartile. of firms ranked by market capitalisation) as the benchmark portfolio and calculate all cross-skewness and cross-kurtosis measures relative to that portfolio. Table 3 reports tests of cross-skewness [S.sub.1,p] = 0, [inverted A] p = 2, ..., 10 and cross-kurtosis [K.sub.1,p] = 0, [inverted A] p = 2, ..., 10. In terms of cross-skewness, the restrictions of the bivariate normal null hypothesis are violated vi·o·late tr.v. vi·o·lat·ed, vi·o·lat·ing, vi·o·lates 1. To break or disregard (a law or promise, for example). 2. To assault (a person) sexually. 3. for all combinations except [S.sub.1,3] and [S.sub.1,4]. Cross-kurtosis restrictions are violated for all pairs except [K.sub.1,7]. These findings once again suggest that market model residuals are not multivariate normal and the Wald tests of [S.sub.1,p] = 0 and [K.sub.1,p] = 0, [inverted A] p = 2, ..., 10 both support this conclusion.
Table 3
Cross-Skewness and Cross-Kurtosis Tests
Portfolio 1 Cross- Monte
with Skewness p-value Carlo
Portfolio [S.sub.1,p] p-value
2 0.44 0.0000 0.0000
3 0.07 0.4360 0.4310
4 -0.07 0.4207 0.4128
5 -0.24 0.0045 0.0045
6 -0.45 0.0000 0.0000
7 -0.44 0.0000 0.0000
8 -0.55 0.0000 0.0000
9 -0.53 0.0000 0.0000
Largest -0.48 0.0000 0.0000
[MATHEMATICAL EXPRESSION 78.32 0.0000 0.0000
NOT REPRODUCIBLE IN ASCII]
Portfolio 1 Cross- Monte
with Kurtosis p-value Carlo
Portfolio [K.sub.1,p] p-value
2 0.99 0.0000 0.0000
3 1.04 0.0000 0.0000
4 1.56 0.0000 0.0000
5 1.06 0.0000 0.0000
6 0.33 0.0208 0.0176
7 0.18 0.2103 0.1897
8 0.64 0.0000 0.0013
9 0.79 0.0000 0.0004
Largest 0.79 0.0000 0.0002
[MATHEMATICAL EXPRESSION 336.40 0.0000 0.0000
NOT REPRODUCIBLE IN ASCII]
Note: 1. These tests utilise market model residuals for ten size portfolios constructed from monthly returns on stocks from the AGSM database from January 1974 to December 1997 (288 observations). Columns 2 and 3 report the cross-skewness statistic and asymptotic p-value respectively as per equation 9. Columns 5 and 6 report the cross-kurtosis statistic and asymptotic p-value respectively as per equation 10. Monte Carlo p-values for each portfolio are based on a simulation of 288 returns from a multivariate normal distribution with a variance-covariance matrix equal to the empirical variance-covariance matrix of the ten size portfolios. Ten thousand repetitions of the simulation are performed. The Monte Carlo p-value is the proportion of simulated test statistics which exceed the reported statistic. 4.3 Sub-Period Analysis In empirical studies Empirical studies in social sciences are when the research ends are based on evidence and not just theory. This is done to comply with the scientific method that asserts the objective discovery of knowledge based on verifiable facts of evidence. , it is common to estimate market model regressions over periods of approximately 60 observations and assume that regression residuals are multivariate normal over this period. To assess the reasonableness of such assumptions, the sample is broken into four non-overlapping 6-year sub-periods each containing 72 observations. For each sub-period, Table 4 reports how many of the univariate skewness and kurtosis statistics were rejected (max = 10), as well as the Wald tests which take contemporaneous correlations into account. Table 5 reports, for each sub-period, how many of the cross-skewness and cross-kurtosis tests were rejected (max = 9), as well as the Wald tests.
Table 4
Sub-Period Analysis--Skewness and Kurtosis Tests(1)
Skewness
Univariate Wald Test Monte
Period Rejections Skewness p-value Carlo
(max = 10) p-value
1974-1979 2 48.44 0.0000 0.0000
1980-1985 1 32.35 0.0003 0.0006
1986-1991 5 84.97 0.0000 0.0000
1992-1997 3 91.90 0.0000 0.0000
Kurtosis
Univariate Wald Test Monte
Period Rejections Kurtosis p-value Carlo
(max = 10) p-value
1974-1979 5 94.04 0.0000 0.0003
1980-1985 1 44.58 0.0000 0.0033
1986-1991 3 128.66 0.0000 0.0002
1992-1997 3 176.46 0.0000 0.0000
Note: (1) These tests utilise market model residuals for ten size portfolios constructed from monthly returns on stocks from the AGSM database over four 6-year sub-periods (72 observations each). Column 2 reports how many of the univariate skewness statistics were significant (max = 10) at the 1% level. Column 3 contains the multivariate Wald test for skewness, and columns 4 and 5 report p-values on this test. Column 6 reports how many of the univariate kurtosis statistics were significant (max = 10) at the 1% level. Column 7 contains the multivariate Wald test for kurtosis, and columns 8 and 9 report p-values. Monte Carlo p-values are based on a simulation of 72 returns from a multivariate normal distribution with a variance-covariance matrix equal to the empirical variance-covariance matrix of the ten size portfolios. Ten thousand repetitions of the simulation are performed. The Monte Carlo p-value is the proportion of simulated test statistics which exceed the reported statistic. The results in table 4 illustrate the shortcomings A shortcoming is a character flaw. Shortcomings may also be:
In table 5, the tests which examine the cross-moments of portfolio returns relative to the benchmark portfolio 1 have mixed results. The cross-skewness tests reject the majority of portfolios in the 1974-1979 and 1992-1997 sub-periods. The cross-kurtosis tests, however, seem to have little power. The Wald tests for cross-skewness and cross-kurtosis reject the null in every sub-period.
Table 5
Sub-Period Analysis--Cross-Skewness and Cross-Kurtosis Tests
Skewness
Rejections Wald Test p-value Monte
Period (max = 9) for Cross- Carlo
Skewness p-value
1974-1979 6 30.59 0.0003 0.0009
1980-1985 1 19.11 0.0242 0.0232
1986-1991 4 21.33 0.0113 0.0136
1992-1997 5 54.81 0.0000 0.0000
Kurtosis
Rejections Wald Test p-value Monte
Period (max = 9) for Cross- Carlo
Kurtosis p-value
1974-1979 2 39.81 0.0000 0.0035
1980-1985 1 20.52 0.0150 0.0276
1986-1991 7 61.74 0.0000 0.0011
1992-1997 2 124.01 0.0000 0.0001
Note: These tests utilise market model residuals for ten size portfolios constructed from monthly returns on stocks from the AGSM database over four 6-year sub-periods (72 observations each). Market model residuals for portfolio I were used as the benchmark for cross-skewness and cross-kurtosis tests. Column 2 reports the how many of the cross-skewness statistics were significant (max = 9) at 1% level. Column 3 contains the multivariate Wald test for cross-skewness, and columns 4 and 5 report p-values. Column 6 reports how many of the cross-kurtosis statistics were significant (max = 9) at 1% level. Column 7 contains the multivariate Wald test for cross-kurtosis, and columns 8 and 9 report p-values. Monte Carlo p-values are based on a simulation of 72 returns from a multivariate normal distribution with a variance-covariance matrix equal to the empirical variance-covariance matrix of the ten size portfolios. Ten thousand repetitions of the simulation are performed. The Monte Carlo p-value is the proportion of simulated test statistics which exceed the reported statistic. 5. Conclusion From both a theoretical and empirical perspective, the multivariate normality of stock returns is an important issue to researchers in finance. While univariate tests of normality are commonly employed, they are unreliable since they fail to accommodate cross-correlations between test statistics. Using the distribution theory relating to relating to relate prep → concernant relating to relate prep → bezüglich +gen, mit Bezug auf +acc GMM estimates, the joint distribution of univariate test statistics is derived and, by allowing for the covariance between test statistics, a multivariate test of normality is conducted. This approach is extended to exploit the multivariate structure of asset returns by calculating several cross-moments implied under the multivariate normal null hypothesis. The multivariate tests are applied to the residuals from market model regressions for ten size portfolios. High levels of correlation between portfolios are documented reinforcing the need to accommodate cross-correlations in univariate test statistics. While univariate skewness and kurtosis test statistics do not provide an unambiguous result (particularly in sub-periods of the length typical in empirical studies), the multivariate skewness and kurtosis test statistics provide strong evidence that market model residuals are not multivariate normal. This is true for the entire 1974-1997 sample, as well as in all sub-periods. These documented violations of the multivariate normality assumption for market model residuals have important implications for researchers using regression techniques for capital markets and asset pricing studies. For example, in testing an asset pricing model such as the Sharpe-Lintner CAPM, the researcher may have more confidence in tests which are based on distribution-free procedures rather than the strong and seemingly seem·ing adj. Apparent; ostensible. n. Outward appearance; semblance. seem ing·ly adv. inappropriate assumption of multivariate normal
market model residuals.
(1.) For example, see Fama (1965) and Officer (1972). (2.) In general, for a variable X ~ N([Mu], [[Sigma].sup.2] the moment generating function shows that, for all integers n [is greater than or equal to] 1, any odd or even moment is easily calculated as: E [(X - [Mu])[.sup.2n-1]] = 0, and E [(X - [Mu])[.sup.2n]] = [[Sigma].sup.2n](2n)!/[2.sup.n]n! (3.) Ball, Brown and Officer also used normal probability plots to show that the sample data was an adequate approximation approximation /ap·prox·i·ma·tion/ (ah-prok?si-ma´shun) 1. the act or process of bringing into proximity or apposition. 2. a numerical value of limited accuracy. of a normal distribution. However, this procedure was only used for one of the 20 portfolios, as well as the market index. (4.) Beedles argues that Stokie's focus on industrial stocks, which are less frequently positively skewed, is the reason he concluded skewness was not significant. (5.) In section 4 of this paper, however, we show that market model residuals are themselves highly correlated. Hence, univariate skewness tests of market model residuals are also susceptible to misleading inference. (6.) Note that Stokie used a 1% level of significance in his tests for skewness. (7.) The r rows of equation 3 are a set of orthogonality orthogonality In mathematics, a property synonymous with perpendicularity when applied to vectors but applicable more generally to functions. Two elements of an inner product space are orthogonal when their inner product—for vectors, the dot product (see conditions. In sections 3.2 and 3.3, the moment conditions comprising h(.) are specified. (8.) Namely, the time series of returns [R.sub.t] is stationary Stationary can mean:
(9.) The over-identifying test statistic is [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] (see Hansen 1982). (10.) The joint moment [MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII] is calculated by differentiating M ([t.sub.i], [t.sub.j]) p times with respect to [t.sub.i] and q times with respect to [t.sub.j] and setting [t.sub.i] and [t.sub.j] equal to zero. See, for example, Mood, Graybill and Boes (1974, p. 164). (11.) For example, see Praetz and Wilson (1978), Stokie (1982b) and Beedles (1986). (12.) These patterns are consistent with previous findings (see Brown, Kleidon and Marsh 1983, p. 47). (13.) For each size portfolio, 288 residuals are simulated for statistics covering the whole sample, while 72 residuals are simulated for sub-period analyses. (Date of receipt of final typescript: June 1998 Accepted by Garry Twite twite n. A small songbird (Carduelis flavirostris) of northern Great Britain and Scandinavia that resembles the linnet. [Imitative of its call.] , Area Editor.) References Alles, L. & Spowart, A. 1995, `Higher moments of Australian equity returns: Characteristics and determinants', Accounting Research Journal, vol. 8, pp. 66-76. Andrews, D. 1991, `Heteroskedasticity and autocorrelation Autocorrelation The correlation of a variable with itself over successive time intervals. Sometimes called serial correlation. consistent covariance matrix estimation', Econometrica, vol. 59, pp. 817-58. Ball, R., Brown, P. & Officer, R.R. 1976, `Asset pricing in the Australian industrial equity market', Australian Journal of Management The Australian Journal of Management (AJM) is an academic journal publishing papers about management. History The journal was founded in 1976 by the Australian Graduate School of Management [1]. , vol. 1, pp. 1-32. Beedles, W.L. 1986, `Asymmetry in Australian equity returns', Australian Journal of Management, vol. 11, pp. 1-12. Beedles, W.L., Dodd, P. & Officer, R.R. 1988, `Regularities in Australian share returns', Australian Journal of Management, vol. 13, pp. 1-29. Blattberg, R. & Gonedes, N. 1974, `A comparison of the stable and student distributions as statistical models for stock prices', Journal of Business, vol. 47, pp. 244-80. Brown, P., Kleidon, A.W. & Marsh, T.A. 1983, `New evidence of the nature of size-related anomalies in stock price', Journal of Financial Economics, vol. 12, pp. 33-56. Faff, R. 1991, `A likelihood ratio test of the zero-beta CAPM in Australian equity returns', Accounting and Finance, vol. 31, Nov., pp. 88-95. Fama, E.F. 1965, `The behaviour of stock market prices', Journal of Business, vol. 38, pp. 34-105. Gibbons, M.R. 1982, `Multivariate tests of financial models: A new approach', Journal of Financial Economics, vol. 10, pp. 3-27. Gibbons, M., Ross, S. & Shanken, J. 1989, `A test of the efficiency of a given portfolio', Econometrica, vol. 57, pp. 1121-52. Hansen, L.P. 1982, `Large sample properties of generalised method of moments estimators', Econometrica, vol. 50, pp. 1029-54. Kandel, S. 1984, `The likelihood ratio test statistic of mean-variance efficiency without a riskless asset', Journal of Financial Economics, vol. 13, pp. 575-92. MacKinlay, A.C. 1987, `On multivariate tests of the CAPM', Journal of Financial Economics, vol. 18, pp. 341-72. Mood, A.M., Graybill, F.A. & Boes, D.C. 1974, Introduction to the Theory of Statistics, 3rd edn, McGraw-Hill, Singapore. Newey, W. & West, K. 1987, `A simple positive semi-definite, heteroskedasticity and autocorrelation consistent covariance matrix', Econometrica, vol. 55, pp. 703-8. Officer, R. 1972, `The distribution of stock returns', Journal of the American Statistical Association Established in 1888 and published quarterly in March, June, September, and December, the Journal of the American Statistical Association (JASA) has long been considered the premier journal of statistical science. , vol. 67, pp. 807-12. Praetz, P. & Wilson, E.J.G. 1978, `The distribution of stock market returns: 1958-1973', Australian Journal of Management, vol. 3, pp. 79-90. Richardson, M. & Smith, T. 1993, `A test for multivariate normality in stock returns', Journal of Business, vol. 66, pp. 295-321. Shanken, J. 1985, `Multivariate tests of the zero-beta CAPM', Journal of Financial Economics, vol. 14, pp. 177-83. Shanken, J. 1986, `Testing portfolio efficiency when the zero-beta rate is unknown: A note', Journal of Finance, vol. 41, 269-76. Stokie, M.D. 1982a, `The testing of Australian stock market indices Commonly used stock market indices include: Global Large companies not ordered by any nation or type of business (in alphabetical order).
Stokie, M.D. 1982b, `The distribution of stock market returns: Tests of normality', Australian Journal of Management, vol. 7, pp. 159-78. Wood, J. 1991, `A cross-sectional regression A Cross-sectional regression is a type of regression model in which the explained and explanatory variables are associated with one period or point in time. This is in contrast to a time-series regression or longitudinal regression in which the variables are considered to be test of the mean-variance efficiency of an Australian value-weighted market portfolio', Accounting and Finance, vol. 31, Nov., pp. 96-107. Zhou, G. 1991, `Small sample tests of portfolio efficiency', Journal of Financial Economics, vol. 30, pp. 165-91. Philip Gray, Australian Graduate School of Management, The University of New South Wales The University of New South Wales, also known as UNSW or colloquially as New South, is a university situated in Kensington, a suburb in Sydney, New South Wales, Australia. , Sydney NSW NSW New South Wales Noun 1. NSW - the agency that provides units to conduct unconventional and counter-guerilla warfare Naval Special Warfare 2052; E-mail: pgray@agsm.unsw.edu.au Egon Kalotay, School of Economic and Financial Studies, Macquarie University Location University publications and material indicate that its campus is located in the suburb of North Ryde, although the Geographical Names Board of NSW indicates it is located in the suburb of Macquarie Park. The University has its own postcode: 2109. , Ryde NSW 2109. Julie McIvor, School of Economics and Finance, Queensland University of Technology, Gardens Point Campus, GPO Box 2434, Brisbane QLD QLD or Qld Queensland 4001. The authors are grateful for the comments of Garry Twite (Deputy General Editor), Tom Smith (Finance Area Editor) and an anonymous referee A judicial officer who presides over civil hearings but usually does not have the authority or power to render judgment. Referees are usually appointed by a judge in the district in which the judge presides. .3 |
|
||||||||||||||||

ing·ly adv.
Printer friendly
Cite/link
Email
Feedback
Reader Opinion