| Value-at-Risk for Fixed Income Portfolios | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Standard Approaches to VaR estimates Extreme Value Theory and Value-at-Risk Issues in Modeling the risk of Fixed Income securities Appendix 1- Extreme Value Theory - an overview
Value-at-Risk for Fixed Income Portfolios A comparison of alternative models |
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
The
biggest problem we now have with the whole evolution of the risk is the
fat-tailed problem, which is really creating very large conceptual diffculties.Because
as we all know, the assumption of normality enables us to drop off the
huge amount of complexity in our equations.. Because once you start
putting in non-normality assumptions, which is unfortunately what
characterizes the real world, then these issues become extremely diffcult." -
Alan Greenspan (1997). Value-at-Risk
(VaR) has been widely promoted by regulatory groups and embraced by
financial
institutions as a way of monitoring and man-aging market risk - the risk
of loss due to adverse movements in interest rate, exchange rate, equity
and commodity exposures - and as a basis for setting regulatory minimum
capital standards. The revised Basle Accord, implemented in January 1998,
allows banks to use VaR as a basis for deter-mining how much additional
capital must be set aside to cover market risk beyond that required for
credit risk. Market related risk has become more relevant and important due
to the trading activities and market positions taken by large banks.
Another impetus for such a measure has come from the numerous and
substantial losses that have arisen due to shortcomings in risk management
procedures that failed to detect errors in derivatives pricing (Natwest,
UBS), excessive risk taking (Orange County, Proctor and Gamble), as well
as fraudulent behavior (Barings and Sumitomo). VaR models usually use historical data to evaluate maximum (worst case) trading losses for a given portfolio over a certain holding period at a given confidence interval*1 .As a result, it is essentially determined by two parameters, (holding) time period and a confidence level. It is a measure of the loss (expressed in say rupees crores) on the portfolio that will not be exceeded by the end of the time period with the specified confidence level. If a is the confidence level and N days is the time period, the calculation of VaR is based on the probability distribution of changes in the portfolio value over N days. Specifically, VaR is set equal to the loss in the portfolio at the (1-a)*100 percentile point of the distribution. A important observation that VaR applies to the extreme lower tail of the return distribution, i.e. large losses far way from the mean. Bank regulators have recognized this and typically chosen a equal to 99 percent. This number obviously reflects regulators' natural tendency for conservativeness in their prudential supervision of banks. The same tendency also comes out in Basle regulators' choice of holding period, the second important model parameter. While the industry typically uses daily VaRs for its internal risk control (Danielsson, Hartman and de Vries (2000)), for the purpose of determining their minimum regulatory capital against market risk, banks will be obliged to assume that they can not liquidate their trading portfolios quicker than within 10 business days. In order to facilitate the transition from their internal daily VaR models to the regulatory 10-day VaR models, the application of a simple square-root-of-time rule permitted. 10-day VaR, therefore, is derived by multiplying a 1-day VaR with a factor equal to square root of holding period. For the purpose of setting adequate capital, Basle accord suggests another factor by which the computed VaR for the 10-day period should be multiplied with. While
the VaR measure has been rightly criticised by the risk managers for being
inadequate, it bridges the gap between the need to measure the risk
accurately and for non-technical parties to be able to understand such a
measure*2. The
concept of VaR has several shortcomings. First, it is only the minimum
amount of
losses (best of the worst scenarios) that can not indicate anything about
the intensity of losses. For example, if VaR of a position is estimated
to be Rs.100, we do not know whetehr the maximum loss is Rs.150 or
Rs.1000. Other measures such as Expected Shortfall (ES) or Tail
Conditional Excpectation (TCE) are proposed to deal with nature of losses
beyond the threshold defined by VaR (Danielsson (2000) and Acerbi(2000)).
Second criticism against VaR has been that it, being linked to the extreme
quantiles of the distribution of returns, is excessively volatile leading
to difficulties in implimentation of capital norms. While this may not
be such a serious issue from the point of regulatory capital, as the latter
includes provision for factors other than market risk and typically larger
by an order of magnitude than market risk VaR, it is a matter of concern
for internal risk management purposes. For example, when VaR is used to
allocate position limits to individual traders, high volatility of risk
measures is serious problem as it is very hard to manage individual
positions with highly volatile position limits. Another
property of VaR that is not typically recognised but has serious
consequences for risk management is that it is not, in general,
sub-additive in the sense that the sum of VaRs of components of a
portfolio is not always greater than the VaR of a portfolio. This property
would imply that a user has to recompute the entire portfolio VaR every
time a new instrument enters or leaves the portfolio. The current practice
of computing VaR for equity, interest and forex VaRs separately and
summing up to arrive at the total portfolio VaR may, therefore, lead to
misleading estimates of risk*3 .
If a risk measure is sub-additive then computation by parts would always
lead to a conservative estimate of the portfolio risk and if one is
willing to be conservative such a measure risk would significantly reduce
the costs of computation*4 . Notwithstanding these
limitations, we, for the purpose of this paper, consider VaR as the
measure of risk and concentrate on alternative estimation methods. Fundamentally,
all the statistical risk modelling techniques fall into one of the three
categories or a combination thereof. Fully parametric methods based on
modelling the entire distribution of returns, usually with some form of
conditional volatility, the non-parametric method of historical
simulation, and parametric modelling of the tails of the return
distribution. The latter is the recent introduction into the literature on
risk management and is based on Extreme Value theory that models the tail
probabilities directly without making any assumption about the
distribution of the entire return process. All these methods have pros and
cons, generally ranging from easy and inaccurate to difficult and precise.
No method is perfect and usually the choice of a technique depends upon a
market in question, and the availability of data, computational and human
resources. In
this paper, we compare various approaches to the estimation of VaR of
portfolios of fixed income securities supplied by the Primary Dealers
Association of India (PDAI), with special focus on Extreme Value theory
(EVT) and that the EVT method provides the best VaR estimator in terms of
correct failure ratio and the size of VaR. The rest of this paper is
organised as follows. In section 2, we briefly discuss the advantages and
disadvantages of standard approaches to VaR estimation. Section 3 presents
the summary of the Extreme Value method of estimating VaR. Section 4
discusses issues related to `scale' factors needed to arrive at the
multi-day VaR an adequate bank capital. Section 5 outlines some specific
issues related to modeling risk of a income portfolio, and in
particular, why we need to combine the historical simulation method with
the extreme value method in computing VaR. Section 6 presents the data
details and results. Section 7 concludes. 2.
Standard approaches to VaR estimation The
most diffcult part in VaR estimations is the derivation of the
distribution of the underlying risk factor*5.
Three
important stylized facts about asset returns that any risk measurement
technique is expected to address are: fat-tails, volatility clustering,
and asymmetry in return distribution. The fat-tail property of asset
returns, while recognised long back by the researchers (Mandelbrot (1962)
and Fama (1962)), has increasingly been noticed by the regulatory
authorities and risk managers. "..the biggest problem we now have
with the whole evolution of the risk is the fat-tailed problem, which is
really creating very large conceptual difficulties. Because as we all
know, the assumption of normality enables us to drop off the huge
amount of complexity in our equations.. Because once you start putting in
non-normality assumptions, which is unfortunately what characterizes the
real world, then these issues become extremely difficult." Greenspan
(1998). To put in simple terms, the fat-tailed property would imply that
one would observe extreme price movements in asset prices with a higher
probability than predicted by the normal distribution. The assumption of
normality for lower tail (dealing with losses) would increasingly be
inaccurate, the farther into the tail that one considers the difference. Two
popular approaches in the literature for the calculation of VaR are
Variance-covariance analysis and historical simulation.
Variance-covariance analysis relies on the assumption that financial
returns are normally distributed. This method is easy to implement because
the VaR can be computed from a simple linear formula with variances and
co-variances of the returns as the only inputs. Its major drawback is that
the assumption that financial
market returns are normally distributed is shown to be invalid in
thousands of empirical studies on asset returns (Pagan (1998)). The latter
are typically characterized by fat-tails and volatility clustering.
Fat-tail property of the asset returns implies that losses are much more
frequent than predicted by the variance-covariance analysis. The
Variance-covariance analysis becomes particularly week where a VaR model
for regulatory purposes and risk control is strong, i.e. in the prediction
of extreme quantiles or large losses. Another
variant of variance-covariance analysis is the Exponential weighting
approach. This approach, popularised by JP Morgan's Risk Metrics, applies
exponentially declining weights to past returns to calculate conditional
volatilities. This technique is justified by the presence of conditional
heteroskedasticity or volatility clustering in the data, meaning that a
volatile day is typically followed by volatile days. The exponential (Exp)
approach also has the drawback that a conditional normality assumption
needs to be made to calculate the VaR of a portfolio from its conditional
volatility, an assumption that, more often that not, is not satisfied by financial
data. Although the exponential smoothing approach addresses the issue of
non-normality in the (unconditional) distribution of returns, it may not
be applicable for the regulatory VaR purposes on three grounds. First,
while daily returns re ect strong volatility clustering, they can hardly
be detected in bi-weekly returns such as the regulatory 10-day holding
period (Drost and Nijman (1993) and Diebold, Schuterman and Inoue (1999)).
Second, the volatility clustering observed in the data largely emanates
from medium and small range volatility periods. Extreme events, such as
losses at or beyond 99interval scatter rather independently overtime
(Jackson, Maude and Peraudin (1997) and Danielsson and de Vries (2000)).
Finally, as has been established by the theoretical and empirical
literature, interest rate and bond return processes typically display a
complicated dependence structure in both mean and variance, thereby making
the simple exponential weighting schemes (so often used in computing the
equity VaR) inapplicable (Longstaff, Schwartz and Karyoli (1998)). The
historical simulation (HS) method, by using empirical percentiles from the
historical return distribution, gets around the problem of making
distributional assumptions. By applying the full empirical market return
distribution to all the items in the current trading portfolio, the
outcome exactly reflects the historical frequency of the large losses over
specific data window. Another advantage of this approach compared to
variance-covariance analysis is that it can incorporate non-linear
positions, such as derivative positions, in a natural way (Kupiec and
O'Bbrien (1997)). In the context of fixed income portfolios also this
property becomes very useful. We shall comeback to this point later. The
problem with the HS method is that it is very sensitive to the particular
data window, which the Basle committee has chosen to be at least one year
of past returns. In other words, whether returns from a highly volatile or
a crash period is included or not makes a huge difference for the
value-at-risk predicted. To put it differently, the empirical distribution
function is `dense' and smooth around the mean, so that no parametric
model based on a standard distribution, such as normal, can beat the
accuracy of the empirical distribution there. Due to the few occurrences
of few extremely large price movements, however, it becomes `discrete' in
the tails. Hence VaR predictions based on HS exhibit high variability.
Moreover, at its lower end, the empirical distribution sharply drops to
zero and remains there, i.e. more severe losses in the future than the
largest one during the past (sample data) is given a probability of zero,
which may not clearly be the correct thing to do. The
hybrid approach proposed by Boudokh, Richardson and Whitelaw (1998) draws
on the strengths of each of the above approaches to estimate the
percentiles of returns directly (the HS approach), using declining weights
on past observations (the Exp approach). Ordering returns over the
historical simulation period, the hybrid approach attributes exponentially
diminishing weights to each observation in building the conditional
empirical distribution. This would result in choice of different
observations using the HS and hybrid approaches. Thus, while computation
of 99 percent VaR using 850 observations involves choosing the 9th
lowest observation using HS, the hybrid
approach could result in the choice of a different observation. Although
the BRW-HS method combines the strengths of above mentioned methods, it
still suffers from the tail- discreteness problem that we discussed
earlier and it may not be very effective particularly in predicting the
extremely large losses. In
our view, a good value-at-risk model to satisfy regulatory minimum capital
standards should correctly represent the likelihood of extreme events by
providing smooth tail estimates of the portfolio return distribution which
extend beyond the sample. It should also be robust to the nature of the
frequency distribution followed by the asset returns. In what follows we
shall brie y summarize one such method, based on Extreme Value theory,
that deals with directly the modeling of the extreme tail events without
making any assumptions about how asset returns are distributed. 3.
Extreme Value theory and Value-at-Risk As
pointed out above, financial risk management, either for the regulatory
purpose or for internal control, is intimately concerned with tail
quantiles (for example, the value of return, y, such that P(Y
³ y)=0.01) and tail probabilities (for example, P(Y
³ y) for a large y).
Extreme quantiles and probabilities are of particular interest, because
the ability to assess them accurately translates into the ability to
manage extreme financial risks effectively. Unfortunately, the traditional
parametric statistical and econometric models,
typically based on estimation of entire densities, may be ill-suited to
the assessment of extreme quantiles and event probabilities. Traditional
parametric models, such as variance-covariance method and Risk metrics
method, implicitly strive to produce a good fit in regions where most of
the data fall, potentially at the expense of a good fit in the tails,
where, by definition, few observations fall. It is common, moreover, to
require estimates of quantiles and probabilities not only near the
boundary of the range of observed data, but also beyond the boundary. That
is, one would like to allow for the possibility that the expected loss on
any future date to be greater than that observed in the past. A
key idea in the Extreme Value theory is that one can estimate extreme
quantiles and probabilities by fitting a "model" to the
empirical survival function (or one minus the cumulative distribution
function (CDF)) of a set of data using only the extreme event data rather
than all the data, thereby
fitting the tail and only
the tail. This approach has history in the study of catastrophic events,
such as natural phenomena and disasters and the insurance field. The
theory itself is developing rapidly (Embrechts et all (1997)) and there
have been number notable applications in the field of
finance and risk
measurement (Longin (1996), McNeil and Frey (2000) and Danielsson and de
Vries (2000)). EVT
uses statistical techniques that focus only that part of a sample of
return data that carry information about extreme behavior. Typically, the
sample is divided into N blocks of non-overlapping returns with say n
returns in each block. From each block the largest rise and biggest fall
in returns are extracted to create a series of maxima and minima
respectively. An extreme value model (more speciffcally a Generalised
Extreme Value (GEV) or Generalised Pareto (GP) distributions) is fftted to
either of these series, via Maximum likelihood or method of moments, to
estimate the `tail index' parameter that characterizes the way the extreme
events in the data can occur. Once an estimate of the `tail index' is
available, one can compute the probability of occurrence of a large event
from the CDF, or VaR value for a given probability . In this study, we
estimate the tail index parameter for the lower tail (related only to the
losses) using the maximum likelihood approach*6 .
5.
Issues in modeling the risk of Fixed Income securities The
computation of VaR for a fixed income portfolio differs in important ways
from that of an equity portfolio. First, unlike in the case of an equity
portfolio where observed prices can be directly used for the computation
of VaR, the price of each fixed income instrument in a portfolio is an
outcome of many security-specific attributes, in addition to the
fundamental factor, the underlying term structure. This rules out the use
of prices directly for the computation of VaR if the objective is to
measure the interest rate risk that the portfolio is subject to . Use of a
zero coupon yield curve (ZCYC) is central to the exercise, as
yield-to-maturity (YTM) based approaches are also subject to the same
problem as with use of observed prices. Movements of the ZCYC, inasmuch as
they depict the changes in the interest rate structure, are reactive of
changes in the value of the portfolio occurring on account of interest
rate changes alone. Estimation
of VaR for a portfolio of fixed income securities is complicated by two
reasons: one, the changes in market values of the securities are
non-linearly related to changes in spot interest rates leading to difficulties
in making simple assumptions about the distribution of the portfolio
returns. A related point is that since one needs to know the entire term
structure of interest rates to value a fixed income security (up to the
relevant maturity), to study the VaR of the security we need to model the
distribution of a great number of interest rates. The popular practice of
cash-ow mapping considers a selected set of interest rates and maps the
cash flow timings to that of the tenor of the selected interest rates
through linear interpolations. Underling in this strategy is interest
rates are distributed as normal or conditional normal, an assumption not
typically supported by the data. In addition, the cash-ow interpolations
may also lead to significant approximation errors. A better strategy would
be to generate 'returns' on (a portfolio of) fixed
income instruments at the first stage by valuing the said portfolio on
observed yield curves, and estimate the VaR directly from the returns on
the bond portfolio. A major advantage of this approach is that it does not
require an assumption about the interest rates. Since the VaR is estimated
based on bond portfolio returns, this approach has the disadvantage of
being portfolio specific thereby necessitating the model parametrization,
and estimation to be done for each portfolio separately. The NSE-VaR
system follows the latter approach of generating returns via historical
simulation and fitting a model of VaR to the return series.
7.
Conclusion In
this exercise, we have presented a case for a new method of computing the
VaR for a set of fixed income securities based on extreme value theory
that models the tail probabilities directly without making any assumption
about the distribution of entire return process. We also compare the
estimates of VaR for a portfolio of fixed income securities across three
methods: Variance-Covariance method (under the assumption that returns on
fixed income instruments are normally distributed), Historical Simulation
method and Extreme Value method. We ffnd that extreme value method
provides the best VaR estimator in terms of correct failure ratio and
lowest VaR for the represenative sample of portfolios of ten PDs. For the
purpose of risk based bank capital regulation, it is instructive to extend
this analysis over all PDs and for various scale factors. Selected
References Altzner,
P., F.Delbaen, J-M. Eber and D. Heath, 1999, "Coherent Measures of
Risk", Mathematical Finance, 9, pp. 203-208. Danielsson,
J. 2000, "The Emporor has no clothes: limits to risk modelling",
Mimeograph, London School of Economics. Available on http://www.riskresearch.org. Danielsson,
J. and C.G. de Vries, 2000, "Value-at-Risk and Extreme Returns",
Mimeograph, London School of Economics. Available on http://www.riskresearch.org. Diebold,
F., and R. Mariano, 1995, "Comparing Predictive Accuracy",
Journal of Business and Economic Statistics, 3, 363-385. Lopez,
J.A, 1999, "Regulatory Evaluation of Value-at-Risk models",
Journal of Risk, 1, 201-242. Embrechts,
P. ed., 2000, Extremes and Integrated Risk Management, UBS
Warburg. Hendricks,
D., and B. Hirtle, 1997, "Bank Capital requiremnts for market risk:
The Internal models approach.", Federal Reserve Bank of New York
Economic Policy Review, 4, 1-12. Longin,
F., 1996, "The asymptotic distribution of extreme stock market
returns", Journal of Business, 63, 383-406. Longin,
F., 2000, "From Value-at-Risk to Stress testing: The Extreme Value
Approach", in Embrechts ed. Extremes and Integrated Risk Management,
UBS Warburg. Pagan,
A., 1998, "The Econometrics of Financial Markets", Journal of
Empirical Finance, 1, 1-70. Extreme
value theory is a branch of the theory of order statistics, which dates
back to the poineering works by Frchet (1927), and Fisher and Trippet
(1928), and the celebrated extremal type theorem of Gnedenko (1943).
Gumbel (1958) gives a clear presentation of the important elements of the
theory and more recent and advanced treatments can be found in the
references cited earlier. In what follows we brei y summarize the basic
theory used in the present study. Let the basic return observed on the time interval [t-1,t] of length f is denoted by Rt. Let us call FR the cumulative distribution function of R. It can take values in the interval (l,u). For a normally distributed variable, the limits range from -a to + a . Let R1; R2; :::; Rn, be the returns observed over n basic time intervals [0,1], [1,2],..,[T-1,T]. For a given return frequency f, the two parameters T and n are linked by the relation T=nf. Extremes are deffned as the minimum and maximum of n random variables R1; R2; :::; Rn. Let Zn denote the minimum observed over n trading intervals: Zn=Min(R1;
R2; :::; Rn)*12 . Assuming that returns Rt
are drawn from an i.i.d FR, the exact
distrbution of the minimal return is given by: FZn
(z) = 1 - (1 - FR(z))n
(1) The
probability of observing a minimal return above a given threshold is
denoted by pext . This probability implicitly depends upon the number of
basic returns n from which the minimal return is selected. The probability
of observing a return above the same threshold over one tarding period is
denoted by p. From Eq. (1) the two probabilities, pext
and p, are related by the
equation: pext = pn . In practice the distribution of returns is not precisely known and, therefore, neither is the exact distribution of the minimal returns. From Eq. (1), it can also be concluded that the limiting distribution of Zn obtained by letting n tends to infinity is degenrate in the sense that it is degenrate for z less than the lower bound l, and equal to 1 for z greater than l. To find a non-degenrate limiting distribution, the minimum Zn is normalised with a scale parameter an, and location parameter bn such that the distribution of the standardised minimum (Zn - bn)/an is non-degenerate. The so-called extreme value theorem specifies the form of the limiting distribution as the length of the time-period over which the minimu is selected (the variables n or T for given frequency f) tends to infinity. The limiting distribution of the minimal return, denoted by FZ, is given by FZ(z) = {1 - exp( - (1 + xz)-1/x ) if x 6 ¹ 0,
{1- exp( -e-z ) if x = 0 (2) for
(1 +xz) > 0.
The parameter
x,
called the tail index, models the distribution tail. Feller(1971) shows
that the tail index value is independent of the the frequency f implying
that the tail is stable under time-aggregation. According to the tail
index value three types of distribuions are distinguished: the Frechet
distribution (x > 0),
the Weibull distribution (x < 0)
and the Gumbel distribution (x
= 0). The
Frechet distribution is obtained for fat-tailed distributions of returns
such as Student and stable Paretian distributions. The fatness of the tail
is directly to the tail index. More precisely, the shape parameter k
(equal to 1/x)
represents the maximal orderof finite moments. For example, if k is
greater than 1, mean of the distribution exists; k sis greater than 2,
variance is finite and so on. The shape parameter is an intrinsic
parameter of the distribution and does not depend on the number of returns
n from which the miniml returns are selected. The shape parameter
corresponds to the number of degrees of freedom of Student distribution
and to the characterstic exponent of a stable Paretian distribution. The
Weibull distribution is obtained when the distribution of returns has no
tail (we cannot observe any observations beyond a given threhsold defined
by the end point of the distribution). Finally, the Gumbel distribution is
reached for thin-tailed distributions such as the normal or log-normal
distributions. For small values of
x
Frechet and Weibull distributions are very close to Gumbel distribution. These theoritical results show the generality of the extreme value theorem: all the mentioned distributions of returns lead to the same form of distribution for the extreme return, the extreme value distributions obtained from different distributions of returns being differentiated only by the value of the scale and location parameters and the tail index. EV
theory for conditional processes Till
now we have presented the resulst under the assumption that the basic
return series are i.i.d, an assumption generally not satisfied. Howevrr,
it can be shown that a great deal of results could be carried over, with
modiffcations, for stationary random sequences. For processes whose
dependence structure is not "too strong" (such as volatility
clustering), the same limiting extreme-value distribution FZ
given by Eq. (2) is obtained (Leadbetter et al.
(1983)). With stronger dependence structure the behaviour of extremes is affected
by the local dependence in the process as clusters of extreme values
appear. In this case it can still be shown that an extreme value modelling
can be applied, the limiting extreme-value distribution being equal to FZ(z)
= 1 - exp( - (1 +
xz)-q/x
) (3) where
the parameter
q,
called the extremal index, models the relationship between the dependence
structure and the extremal behavior of the process. This parameter is
related to the mean size of clusters of extremes (see Embrechts et all
(1997) and McNeil (1998)). The extremal index
q
veriffes: 0
£ q = n-1 ln(1 - (Ku/m)) ln(1
- (Nu/mn)) (4) where
Nu is the
number of exceedances of the threshold and Ku
is the number of
blocks in which the threshold is exceeded. For Ku=m
and Nu=mn small,
this estimator reduces to Ku=Nu. Berman (1964) shows that the same form for the limiting extreme-value distribution is obtained for stationary normal sequences under week assumptions on the correlation structure. Leadbetter et al. (1983) consider various processes such as discrete mixture of normal distributions and mixed diffusion jump processes all have thin tails so that they lead to a Gumbel distribution for the extremes. Longin (1997) shows that the volatility of the process returns (modelled by the class of ARCH processes) is mainly in uenced by the extremes. De Haan et al. (1989) show that if returns follow an ARCH process, then the minimum has a Frechet distribution. Steps
involved in the compuatation of VaR
Table
1 Portfolio-wise estimates of 99 percent VaR - 1-day
Table
2 Portfolio-wise estimates of 99 percent VaR - 10-day and 1 month
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||