Chapter 8: Indices and Benchmarking — Part 4: Performance Benchmarking and Evaluation

8.8 Performance Benchmarking: Concepts and Frameworks

Performance benchmarking is a critical, ongoing process that allows investors to monitor and evaluate the investment returns generated by Alternative Investment Funds (AIFs). Rather than evaluating returns in a vacuum, benchmarking provides a comparative framework. By comparing a fund's performance to an appropriate benchmark, investors can determine whether a fund manager is generating true excess return (alpha) through active management skill, or simply tracking market risk (beta).

Definition of a Benchmark

A benchmark is a comparable fund or index that exhibits similar risk-return characteristics to the AIF being evaluated. The benchmark return is the rate of return generated by this chosen reference point over the identical reporting period.

Selecting an Appropriate Benchmark: The CFA Institute / GIPS Standards

According to the CFA Institute and the Global Investment Performance Standards (GIPS), the benchmark for a segregated account is typically determined by the client or consultant, whereas the benchmark for a composite or pooled fund (such as an AIF) is selected by the investment firm.

The GIPS standards require that the selected benchmark must be an appropriate total return benchmark that reflects the pooled fund's investment mandate, objective, or strategy.

Core Characteristics of a Valid Benchmark (Box 8.5):

To be considered valid, a benchmark must satisfy the following qualitative criteria:

• Specified in Advance: The benchmark must be defined before the evaluation period begins so that managers cannot retroactively select a benchmark to make their performance look superior.
• Relevant: The benchmark must accurately reflect the investment mandate, objective, or specific strategy of the fund.
• Measurable: The benchmark’s returns must be quantifiable and calculated on a frequent, reliable basis.
• Unambiguous: The constituents and weights of the benchmark must be clearly identified and priced.
• Representative: The benchmark must reflect the current investment options available to the manager, meaning the manager must have active knowledge of the underlying universe.
• Accountable: The investment manager must accept responsibility for any deviations in the fund’s performance relative to the benchmark.
• Investable: It must be possible to replicate the benchmark passively (i.e., by simply buying and holding the index constituents) instead of employing active management.
• Complete: The benchmark must represent a broad and comprehensive coverage of the market segment to which it pertains.

The Challenge of Benchmarking Alternative Investments

In traditional mutual funds, benchmarking is straightforward because funds generally invest in highly liquid, exchange-traded assets. However, in the Indian AIF industry, constructing perfect benchmarks is highly challenging due to:

1. Varying Asset Classes: Funds invest across diverse and often illiquid assets, including listed equities, unlisted equities, private credit, derivatives, and commodities.
2. Complex Strategies: Funds employ a wide array of strategies, such as long-short equity, market-neutral, convertible arbitrage, and event-driven models.
3. Varying Levels of Leverage: Different funds deploy different levels of leverage, which alters their systematic risk profile.

The Practical Solution: When a perfect benchmark is unavailable, the investment manager benchmarks the fund against the most appropriate broad-market index published by major stock exchanges (like the NSE or BSE), based on the targeted sector and market-capitalisation profile defined in the fund's Private Placement Memorandum (PPM). This is known as an indicative benchmark.

8.8.1 Benchmarking Absolute-Return Strategies

Some Category III AIFs (such as market-neutral or long-short hedge funds) follow an absolute-return strategy. The goal of an absolute-return strategy is to generate positive returns for investors regardless of whether the broader stock market is rising or falling.

These funds use complex mechanisms such as:

• Leveraged positions in equity, index, or commodity derivatives.
• Highly concentrated stock portfolios.
• Market-neutral positions (taking offsetting long and short positions to reduce portfolio beta to zero).

The Absolute-Return Benchmark Rule

Because absolute-return funds aim to perform independently of market indices, they are not benchmarked against relative, broad-based market indices.

Instead, the benchmark for an absolute-return strategy is a fixed rate of return pre-determined by the investment manager at the time of launching the scheme (e.g., 10% per annum).

• If the fund's annual return exceeds this pre-determined fixed rate, the fund is said to have outperformed.
• If the fund's annual return falls below this rate, it has underperformed.
• Returns can be calculated over shorter reporting intervals, such as monthly or quarterly, to monitor consistency.

8.8.2 Real-World Case Studies in AIF Benchmarking

Example 8.7: Analyzing Investment Strategies and Recommending Benchmarks

The following case study evaluates three distinct Category III AIFs from their Private Placement Memorandums (PPMs) to determine their underlying strategy and assign the most appropriate benchmark:

Solution and Rationale for Recommended Benchmarks

Recommended Benchmark for Fund X:

Since Fund X invests 100% in large-cap listed equities, the benchmark must represent the large-cap segment.

• Recommended Benchmarks: NIFTY 50, S&P BSE SENSEX, NIFTY Next 50, NIFTY 100, or S&P BSE 100.
• Rationale: If the fund focuses purely on blue-chip stocks, the NIFTY 50 or S&P BSE SENSEX are the most appropriate options.

Recommended Benchmark for Fund Y:

Fund Y is a mid-cap fund with highly specific, thematic sectoral allocations. It can be benchmarked using two distinct methods:

1. Weighted Custom Benchmark: A custom benchmark can be constructed by applying weights to sectoral indices matching the fund's target asset allocation:
   • BFSI (20% Weight): NIFTY Financial Services, NIFTY Bank, S&P BSE Finance, or S&P BSE BANKEX.
   • FMCG (20% Weight): NIFTY FMCG or S&P BSE Fast Moving Consumer Goods.
   • Pharma (20% Weight): NIFTY Pharma or S&P BSE Healthcare.
   • IT (20% Weight): NIFTY IT or S&P BSE Information Technology.
   • Realty (10% Weight): NIFTY Realty or S&P BSE Realty.
   • Metals (10% Weight): NIFTY Metal or S&P BSE Metal.
2. Standard Mid-cap Benchmark: Alternatively, the manager can track general mid-cap indices, such as NIFTY Midcap 100, NIFTY Midcap 150, or S&P BSE Midcap.
3. Blended Benchmark Solution: To capture both sector and market-cap dynamics, a blended benchmark is recommended, allocating 75% weight to Sectoral Benchmarks and 25% weight to a Mid-cap Benchmark.

Recommended Benchmark for Fund Z:

Fund Z focuses on the small-cap and SME segments, requiring a split benchmark:

• Small-cap Listed Equity (50% Weight): Benchmark against NIFTY Smallcap 100, NIFTY Smallcap 250, or S&P BSE Small Cap.
• Listed and Unlisted SMEs (50% Weight): Benchmark against NIFTY SME or the S&P 250 SME Index.

8.8.3 SEBI Regulations on AIF Benchmarking Agencies

To eliminate subjectivity and ensure that managers do not cherry-pick benchmarks, the Securities and Exchange Board of India (SEBI) has mandated the development of standardised industry-wide performance benchmarks.

The Registration and Notification Process

• 33% Membership Rule: Any AIF association that represents at least 33% of the registered AIFs in India by membership has the authority to notify one or more Benchmarking Agencies.
• The Association: The Indian Private Equity and Venture Capital Association (IVCA) is the primary industry body representing AIFs.
• Appointed Agencies: The IVCA has officially appointed three prominent Benchmarking Agencies:
  1. CRISIL
  2. NSE Indices Limited
  3. Preqin
• Data Sharing and Confidentiality: Every AIF must enter into a formal agreement with the notified Benchmarking Agency to report quarterly financial and valuation data while strictly maintaining investor confidentiality.
• Reporting Trigger: Any AIF scheme that has completed at least 1 year from the date of its First Close is legally required to report its performance, cash-flow, and valuation data to the designated Benchmarking Agency.
• Mandatory PPM Disclosures: AIFs are required to disclose these benchmarked performance comparisons, as determined by the Benchmarking Agency, in all marketing materials, private placement memorandums (PPMs), and periodic investor reports.

8.8.4 SEBI Operational Guidelines for Performance Benchmarking

SEBI has issued strict operational guidelines to standardise performance reporting and benchmarking across the industry (Box 8.6). These rules ensure consistency in data compilation and calculation:

1. Reporting Periodicity and Timing

• Half-Yearly Benchmarking: Benchmarking is conducted on a half-yearly basis, using financial data as of September 30 and March 31 of each year.
• Audited vs. Unaudited Data: Performance data reported as of March 31 must be audited data, while data reported as of September 30 can be unaudited data.
• Standard Valuation Timelines: Managers must ensure that investee companies provide audited accounts within a specific timeframe (written into their subscription/investment agreements). This allows the AIF to report its March 31 audited valuation data to Benchmarking Agencies within the mandated 7-month timeline.

2. Assets under Management (AUM) Definition

For the specific purpose of performance reporting and benchmarking, AUM is defined as the value of the total capital drawn down under the scheme (not the total capital committed by investors).

3. Net Asset Value (NAV) Specifications

The performance reporting and benchmarking calculations must be carried out using the pre-tax Net Asset Value (NAV) of the scheme.

4. Categorisation and Vintage Tracking

• Separate Category Benchmarks: Benchmarking agencies must compile and publish separate performance benchmarks for Category I, Category II, and Category III AIFs.
• Vintage-Based Year Tracking: Performance benchmarks must be created and tracked separately for each year since 2012 (representing the vintage of the fund, based on its First Close year).
• Currency Denomination: Benchmarks and performance data must be reported in both Indian Rupees (INR) and US Dollars (USD) terms.

5. Standard Reports vs. Customized Reports (Section B Guidelines)

• Benchmark Report: This is the standard report mandated by SEBI, comparing the AIF against its designated category/vintage benchmark.
• Performance Report (Customized): At the specific request of an AIF, Benchmarking Agencies can compile customized reports comparing the AIF to a specific peer group. To generate a customized report, the agency must:
  1. Identify the target peer set of AIFs based on self-attestation or independent verification.
  2. Obtain express consent from all the peer AIFs whose data is used to compile the report.
  3. Treat this as a customized, fee-based service.
  4. Label the output exclusively as a "Performance Report" to distinguish it from the mandated "Benchmark Report".

8.8.5 Benchmarking Methodology for Category III AIFs

Category III AIFs deploy unique structures, requiring distinct benchmarking calculations compared to Category I and II private equity/venture capital funds:

• Asset-Weighted Indices: Unlike other categories, Benchmarking Agencies construct Category III benchmarks as asset-weighted indices. This weighting scheme uses the individual AUM of the funds and their quarterly returns.
• Return Formula Components: The returns of the underlying funds are computed using post-expense, pre-carry, pre-tax values. This means management fees and operational costs are deducted, but performance-based incentive fees (carried interest/carry) and direct taxes are excluded from the return calculation.

8.8.6 The Role of Benchmarks in Evaluating Alpha (CAPM Framework)

An index serves as the foundation for measuring the value added by an active fund manager. This value is measured using Alpha (α), which represents the excess return generated by an AIF relative to its risk-adjusted benchmark.

Calculating Expected Return using CAPM

Before calculating alpha, an investor must calculate the Expected Return of the portfolio given its systematic risk level, using the Capital Asset Pricing Model (CAPM):

• E(R) = Rf + Beta * (Rm - Rf)

Where:

• E(R) = Expected Rate of Return on the fund
• Rf = Risk-Free Rate of return (typically proxied by the yield on a 364-day Treasury Bill in India)
• Beta (β) = Systematic risk coefficient of the fund portfolio, reflecting its volatility relative to the benchmark index
• Rm = Return on the reference market portfolio or AIF index (such as the CRISIL AIF Category III Index)
• (Rm - Rf) = Market Risk Premium

Calculating Fund Alpha

Once the expected return is calculated, the Alpha (α) is the difference between the actual return achieved by the fund and its CAPM-derived expected return:

• Alpha = Actual Return - Expected Return

• Alpha = Net IRR - E(R)

• Positive Alpha (α > 0): The manager has outperformed the market on a risk-adjusted basis, demonstrating superior security selection or timing skills.

• Negative Alpha (α < 0): The manager has underperformed, failing to generate returns sufficient to compensate for the systematic risk taken.

Example 8.8: Alpha Evaluation Under Multiple Scenarios

This case study evaluates the risk-adjusted performance (Alpha) of Fund XYZ under two performance scenarios using the CAPM framework:

Given Parameters:

• Risk-Free Rate (Rf): 5.60% (based on the 364-day Treasury Bill rate)
• Benchmark Index Return (Rm): 9.25% (CRISIL AIF Category III 1-Year Index)
• Fund Return (R): Measured using Net IRR (reflecting net returns after investor-borne fees and expenses)
  • Best-Case Scenario Net IRR: 12.77%
  • Worst-Case Scenario Net IRR: 3.38%
• Portfolio Beta (β):
  • Best-Case Scenario Beta: 1.30
  • Worst-Case Scenario Beta: 1.50

1. Best-Case Scenario Calculations

First, calculate the CAPM expected return:

• E(R) = Rf + Beta * (Rm - Rf)
• E(R) = 5.60% + 1.30 * (9.25% - 5.60%)
• E(R) = 5.60% + 1.30 * (3.65%)
• E(R) = 5.60% + 4.745% = 10.35%

Next, calculate the alpha:

• Alpha = Net IRR - E(R)
• Alpha = 12.77% - 10.35% = 2.42%

Interpretation: Under the best-case scenario, the manager generated a positive risk-adjusted alpha of 2.42%, demonstrating that active portfolio management successfully added value over a passive strategy.

2. Worst-Case Scenario Calculations

First, calculate the expected return:

• E(R) = 5.60% + 1.50 * (9.25% - 5.60%)
• E(R) = 5.60% + 1.50 * (3.65%)
• E(R) = 5.60% + 5.475% = 11.08%

Next, calculate the alpha:

• Alpha = Net IRR - E(R)
• Alpha = 3.38% - 11.08% = -7.70%

Interpretation: Under the worst-case scenario, the fund generated a negative alpha of -7.70%. The fund significantly underperformed what was expected given the systematic risk (Beta of 1.50) introduced by the manager.

Important Analytical Conclusions and CAPM Limitations

• Net IRR Preference: Active returns must be evaluated using Net IRR (post-fees) because investors ultimately bear all fixed expenses and management fees. Evaluating performance using Gross IRR artificially inflates alpha.
• The Beta-Shift Phenomenon: In the worst-case scenario, the fund’s Beta rose from 1.30 to 1.50. This occurs because during macroeconomic downturns, the investment manager may take on additional systematic risk in an attempt to recover losses, making the fund more volatile.
• The CAPM Expected Return Anomaly: On comparison of the expected returns under the two scenarios, the expected return in the worst-case scenario rose (from 10.35% to 11.08%) when it logically should have decreased due to unfavorable market conditions. This illustrates a key limitation of the static CAPM model—it assumes risk premiums are constant and ignores dynamic market regimes.

Summary of Performance Benchmarking Principles

Important Terms & Definitions

1. Benchmark Return: The rate of return generated by a chosen reference standard index or comparable fund over a specified historical period.
2. Absolute-Return Strategy: An investment approach that aims to achieve positive returns completely independent of broad market movements.
3. Indicative Benchmark: A broad-based index used as an approximate reference point when a perfect custom match for a complex strategy does not exist.
4. Benchmarking Agency: An independent institution notified by an AIF association (representing 33% of membership) to collect, verify, and maintain performance databases.
5. AUM (Benchmarking Definition): The total value of capital drawn down under the scheme, rather than total committed capital.
6. Alpha (α): The excess return generated by an active investment portfolio over and above the expected return predicted by its systematic risk level under the CAPM.

Candidates’ Exam-Relevant Takeaways

• 👉 Under GIPS standards, composite or pooled fund benchmarks must be appropriate total return benchmarks and defined in advance.
• 👉 Absolute-return funds are not benchmarked against broad-based relative indices; they utilize a fixed rate defined at the scheme's launch.
• 👉 SEBI requires AIF performance benchmarking for all schemes that have completed at least one year from the date of their First Close.
• 👉 Any AIF association representing at least 33% of AIFs by membership can notify a Benchmarking Agency.
• 👉 The three SEBI-recognized benchmarking agencies in India are CRISIL, NSE Indices, and Preqin.
• 👉 Benchmarking reports are compiled half-yearly using audited data for March 31 and unaudited data for September 30.
• 👉 For benchmarking, AUM is defined as the total capital drawn down, not total capital commitments.
• 👉 Category III AIF benchmarks are calculated as asset-weighted indices using post-expense, pre-carry, pre-tax returns.
• 👉 In the CAPM formula, the risk-free rate of return (Rf) is represented by the yield on a 364-day Treasury Bill.
• 👉 Alpha is calculated as: Alpha = Net IRR - E(R), where E(R) is the CAPM expected return.

Chapter 8 Practice Questions & Solutions

These practice questions reflect the conceptual, regulatory, and mathematical scenarios covered in Chapter 8 of the NISM Workbook.

Question 1

An open-ended Category III AIF has a target strategy of absolute returns. What is the most appropriate benchmark for this fund?

• A. NIFTY 50 Index
• B. NIFTY Midcap 150 Index
• C. A pre-determined fixed rate of return (e.g., 10% per annum)
• D. CRISIL Category III AIF Index
• Correct Answer: C
• Rationale: Absolute-return strategies aim to generate positive returns independent of market directions and are benchmarked against a pre-determined fixed rate rather than a relative market index.

Question 2

According to SEBI operational guidelines, what value must be used as the Assets under Management (AUM) for compiling performance benchmarks?

• A. Total Capital committed by investors at inception
• B. Value of total capital drawn down under the scheme
• C. Current market value of equity assets only
• D. Total net asset value including borrowed funds
• Correct Answer: B
• Rationale: SEBI guidelines explicitly specify that AUM for the purpose of reporting and benchmarking shall be the value of total capital drawn down under the Scheme.

Question 3

To notify a Benchmarking Agency under SEBI regulations, an AIF association must represent at least what proportion of registered AIFs by membership?

• A. 10%
• B. 25%
• C. 33%
• D. 51%
• Correct Answer: C
• Rationale: Under SEBI guidelines, any association of AIFs representing at least 33 percent of the number of registered AIFs may notify a Benchmarking Agency.

Question 4

Calculate the CAPM Expected Return for an AIF given the following data: Risk-Free Rate is 5.0%, Beta is 1.20, and the Category III AIF Index return is 11.0%.

• A. 12.2%
• B. 13.0%
• C. 11.2%
• D. 7.2%
• Correct Answer: A
• Rationale: Use the CAPM formula: E(R) = Rf + Beta * (Rm - Rf). Replacing the parameters: E(R) = 5.0% + 1.20 * (11.0% - 5.0%) = 5.0% + 1.20 * 6.0% = 5.0% + 7.2% = 12.2%.

Question 5

The performance benchmarking reports compiled by CRISIL and NSE for Category III AIFs are constructed as:

• A. Price-weighted indices
• B. Equal-weighted indices
• C. Fundamental-weighted indices
• D. Asset-weighted indices
• Correct Answer: D
• Rationale: For Category III AIFs, industry benchmarks are created as asset-weighted indices using the AUM of the funds and their quarterly returns.