To weed out underperformers, we first need to set bar

The two main weaknesses of our superannuation system are the proliferation of multiple member accounts and the defaulting of members into underperforming funds. These are both problems that have been highlighted by the Productivity Commission, and they need to be fixed in order to make the system more efficient and deliver improved retirement outcomes. Identifying underperforming funds is the focus of this article and is also the focus of APRA’s newly launched ‘Heatmap’. APRA’s methodology is broadly similar to ours and we comment later on what it could mean for our industry.

The problem of unintended multiple accounts could be solved relatively simply by changing how the default fund procedure works. People often drift into having multiple accounts because, when they start a new job, what happens to their new employer’s contributions is not the most important thing on their minds. Since they are unlikely to take positive action, the way to save them from inadvertently starting yet another account is to have the new contributions directed into their most recent active account.

This was the Productivity Commission’s ‘Default Once’ recommendation and the Royal Commission’s ‘Stapling’ recommendation and it makes absolute sense. Combined with a more streamlined process for consolidating existing accounts, such as integrating it with the TFN notification process, this would go a long way towards the ideal where most members carry just one default super fund with them throughout their working lifetime.

The second problem of defaulting members into underperforming funds is more complex and any solution is likely to be more contentious. The Productivity Commission’s favoured solution was to limit the funds to which members could be defaulted to the Top 10 so-called ‘Best in Show’. This approach, while superficially appealing, has many shortcomings.

One is that it is too restrictive on employers. We have run many corporate super tenders over the years where the successful fund was not in the top ten according to our ratings criteria. Our medium to large employer clients chose funds that were better suited to their particular needs – perhaps because they could replicate the existing insurance design or because their member services were regarded as superior.

Perhaps the biggest shortcoming of the Top 10 approach, assuming it would have a high weighting to investment performance, is that it would be inherently unstable. The performance differential between the 20 top-performing funds is quite small, so any list of the ten top-performing funds will be constantly changing. Table 1 shows the 10 top-performing Growth options (61 to 80% growth assets) for 10 years to 31 December 2018, 30 June 2019 and 30 September 2019. The highlighted funds are the only ones that appear in the top 10 over each period – there are only five!


Note: Performance figures used are net of investment fees and tax (gross of administration fees).

We also get different results if we choose different periods for measurement. Table 2 shows the 10 top performing growth options over 15, 10 and 7 years to 30 September 2019 – all of which could be considered to be longer term. Again, the highlighted funds are those that appear in the top 10 over each period – and again there are only 5. A position on or off the list could be a ‘make or break’ for some funds, so which period to choose? The relatively arbitrary decision on which end date or timeframe to use can determine half of the top 10 list.


Note: Performance figures used are net of investment fees and tax (gross of administration fees).

There is currently also a timing issue where some funds have become concerned with the overvaluation of investment markets and have dialled down their equity exposure to protect members from an anticipated correction. In doing so they have shown a preparedness for their performance to be significantly different from their peers. Such an approach may be very appropriate given the average age of their members. If the top 10 funds were chosen now, simply based on performance, it would penalise all those that have taken action to protect their members in good faith, but in hindsight may have done so too early. If a market correction were to take place, the top 10 funds could look very different.

A better way

Rather than nominate an arbitrary number of funds, a better solution is to identify a qualifying standard that funds have to meet in order to retain their MySuper status. This was the Productivity Commission’s ‘Right to Remain’ test. Funds that do not meet this standard may lose their right to retain their MySuper status and would need either to rectify their shortcomings to APRA’s satisfaction or else surrender their MySuper licence. The merit of this approach is that it would apply objective criteria to identify and potentially remove underperforming funds without the risk of penalising the many very good funds that just fail to make the Top 10.

Chart 1 below illustrates the difference between applying the ‘Best in Show’ and the ‘Right to Remain’ tests. The ‘Right to Remain’ test focuses on removing the underperforming funds shown in the grey segment, which is the recognised problem, whereas ‘Best in Show’ would also remove many good funds in the blue segment.


There has been much talk about the ‘Right to Remain’ test but little on how the test could work. Given that Chant West has access to all the data necessary to formulate such a test, we have looked at how it might be conceived and structured.

We should note here that the object of this exercise is not the same as when we analyse funds as part of our ratings process. That process calls for a comprehensive examination of all the factors that contribute to the member experience and to retirement outcomes. Some of these factors – for example member services, insurance design and organisational strengths – are less measurable than others and involve us exercising our professional judgement based on our in-depth interaction with the funds. This information and the insights we gain from it would be difficult to fit into a “Right to Remain” test or a Heatmap so we have restricted our suggestion for the ‘Right to Remain’ test to areas that are both objective and measurable.

We believe there are two main areas that should be considered, namely investments and fees. We considered factoring in insurance premiums, but that area is problematic as insurance cover and premium levels are highly dependent on each fund’s membership demographic profile. Likewise, we have not included sustainability measures (metrics such as scale, cashflows, membership trends, active member ratios etc). These are forward-looking measures that provide insights as to the future stability and growth of a fund and its ability to continue to deliver strong member outcomes. APRA does collect this information, but we believe it is best used as part of its outcomes assessment, especially for underperforming funds, rather than as an input to the ‘Right to Remain’ test.

Investment performance – but compared with what?

Clearly, investments are the most important area to consider if we are to identify underperforming funds. In our own ratings procedure we give a lot of weight to factors other than past performance, because what we are looking for is the likelihood of a fund producing strong long-term returns in the future. These factors include investment governance, the fund’s own investment resources, its use of external advisers, its asset allocation policies and so on.

Chart 2 shows the high level criteria we consider and their weightings. Each of these criteria has a number of sub-criteria that we score.


When we look back on our past ratings we find that they are quite consistent with the ensuing performance – in other words they have been very good predictors. Funds that we assessed as strong in these areas 10 to 15 years ago have generally performed well since that time.

This sort of analysis is probably not appropriate for inclusion in a Heatmap as it would require the application of professional judgment for areas like investment governance, how a fund works with its investment consultant, the resourcing and experience of the investment team, and the structure of its portfolios. No doubt APRA would look at these issues as part of its ongoing supervisory work with funds but for a ‘Right to Remain’ test or Heatmap, an objective series of metrics is more appropriate to be used and applied in a consistent manner across all funds. This means that in a Heatmap, or the setting of objective benchmarks for a ‘Right to Remain’ test, we are probably stuck with measures of past performance – preferably past performance taking risk into account in some way. But we need to acknowledge the limitations of this approach as strong past peer-relative performance does not secure strong future peer-relative performance.

We believe the best measure of investment performance is the return after investment fees and tax, which APRA calls the ‘net investment return’. By deducting investment fees and costs, but not administration fees, we can identify whether any underperformance at the member level is attributable to investments rather than just higher administration fees. This is better than the ‘net of all fees’ measure which can be distorted by historically higher administration fees that no longer apply. Administration fees are important but are best considered as a separate matter from investments.

We now need to decide on the appropriate period(s) of measurement which, as we saw earlier, can have a significant effect on funds’ relative performance. Ideally, we would want a period that spans at least one full market cycle and is long enough to remove the short-term ‘noise’. Ordinarily, something like 10 years would be appropriate to ensure we incorporate a full market cycle but given the length of the current market cycle, an even longer timeframe would be required for that. However, since the MySuper regime only came into force in January 2014, we only have 5½ years of performance history to 30 June 2019 upon which to assess funds. It must be acknowledged that this is a very short period to determine the success of a fund’s investment strategy and whether it deserves to retain its MySuper status. This is especially the case since the period does not include a sustained market downturn and more cautious strategies designed to protect the downside for members have not paid off in this period. For those funds where their MySuper offering is simply a continuation of their previous default options, we have been able to use their 10-year performance as a further data point for comparison.

The next step is to determine a suitable benchmark against which to measure these returns. Here we need a measure that ‘sets the bar’ so we can differentiate between funds that are meeting a reasonable standard and those that are underperforming. One suggestion is that funds should be measured against their own stated objectives, which are typically framed as ‘CPI + x% per annum over y years’. We would reject this on two main grounds. Firstly, if failing to meet a self-imposed objective had negative consequences with the regulator there would be a motivation for funds to set that objective as low as possible. Secondly, just as a rising tide lifts all boats, strong investment markets would likely see all funds achieve their objectives (and conversely fail to meet their objectives in a protracted market downturn). This would not be helpful when the objective is to identify underperforming funds.

We could of course simply compare the performance of all MySuper products. However that assumes a degree of homogeneity that does not exist. The problem is risk. MySuper portfolios range from 95% growth assets down to about 20% growth assets so they are very different in terms of their risk/return profiles. At a time like now, when markets have been favourable to growth assets for several years, funds at the higher end of the risk spectrum have typically been rewarded with higher returns. So risk has paid off in recent years but that will not always be the case. Even if we were to limit our comparison to funds in the same risk category (High Growth, Growth, Balanced and Conservative in our terminology) we would still not be recognising the variation in risk between products in a particular category – for example our Growth category has a range of 61 to 80% growth assets. Indeed, the performance of a fund with about 80% growth assets over the past 10 years would have been about 1% per annum higher than a fund with 61% growth assets, simply due to the level of growth assets.

Similar risk reference portfolios highlight added value

We believe a better way to assess funds’ performance is to compare them with reference portfolios with a similar level of risk, which is the approach advocated by the Productivity Commission. A reference portfolio is a vanilla passive portfolio with a given level of risk, preferably constructed from investible market indices and measured net of tax. If a MySuper fund is doing its job well, we would expect to see evidence of added value against this passive benchmark of similar risk.

For our analysis we have used a simplified version of the Productivity Commission’s BP1 reference portfolio using each fund’s growth/defensive split as the measure of risk. We know there is inconsistency in the way funds categorise their assets as growth or defensive, especially in the case of unlisted property and infrastructure, so for the purpose of this exercise we have adopted a ‘normalised’ metric by treating those unlisted assets as 50% growth for all funds. We have, however, accepted each funds’ own categorisation of alternative assets as there is no simple way for us to assess the nature of these portfolios. APRA takes a slightly different approach, classifying unlisted property and unlisted infrastructure as 75% growth and alternatives as 50% growth.

For each MySuper product we have constructed a reference portfolio by combining the growth and defensive assets shown in Table 3 in proportions that match our normalised growth/defensive assessment for that product each year. This includes lifecycle products where the reference portfolios used for each year reflects the average level of growth assets over the year, which for certain lifestages changes quite significantly over a 5-10 year period.


Note: The 35% hedging level for international shares is close to the median in our asset allocation surveys in recent years.

Compared to the reference portfolio that APRA is using in its Heatmap analysis, there is no difference in the defensive asset composition and the only difference in the growth asset composition is the hedging percentage on international shares (we have used 35% versus APRA’s 50%). Our tax assumption is the most significant difference from APRA’s methodology where the effective tax rate is built up from tax assumptions for individual asset sectors. APRA assumes a zero tax rate for Australian shares and either 14% or 15% for all other asset sectors. We have used the tax rates from ASIC’s MoneySmart website for portfolios with different levels of growth assets, increased by 0.5% p.a. as we believe ASIC’s tax rates are a little low (but this difference makes negligible difference to the overall results).

/Public Release. This material comes from the originating organization/author(s)and may be of a point-in-time nature, edited for clarity, style and length. The views and opinions expressed are those of the author(s).View in full here.