Core experiments in Range Extensions

Core experiments in Range Extensions

1. RCE1: Inter-component decorrelation methods

1. RCE1 summary and general discussion

(Discussed Sat. 27 July p.m. Track A (GJS).)

All testing for this CE is for 4:4:4 content.

Experiment 2 and 7 were withdrawn by the proponent and there was no cross check result for experiment 6. A short description of the experiments is given in the following.

• 
  Experiment 1: LM Chroma (LMC): TU-based parameter derivation
  
• 
  Experiment 3: In-loop residual prediction (ILP): TU-based signalling
  
• 
  Experiment 4: LM Chroma with alternative reference sample set (Provided implementation uses even instead of odd positions from the above samples as reference in 4:2:2 sub-sampled content for parameter derivation)
  
• 
  Experiment 5: ILP: LMC-like variants, is derived from the left and above neighbours, is calculated using luma reconstructed and chroma unquantized residuals, is transmitted in the bitstream (encoder decision)
  
• 
  Experiment 6: Combination of LMC (Experiment 1) and ILP (Experiment 5)
  

Some observations on the results were reported as:

• 
  Experiment 1: Similar results for 4:4:4 and 4:2:2 YCbCr sequences relative to the previous meeting cycle is observed. However, the performance on screen content is constantly higher than for natural content. A degeneration of the improvement is observed for inter-predicted GOP structures.
  
• 
  Experiment 3: The results are mainly the same as reported by the proponent for RGB content. There are mostly no gain or loss for 4:4:4 YCbCr sequences. In inter-predicted GOP structures, the performance for the first component measured in both colour spaces, i.e., RGB and YCbCr, is higher than in the intra-only configuration.
  
• 
  Experiment 4: The results for 4:4:4 content is exactly the same as in experiment 1. A negligible loss can be observed for 4:2:2 sub-sampled content.
  
• 
  Experiment 5: The results show an improvement for mainly 4:4:4 YCbCr sequences while the performance for RGB content is dropped relative to the scheme in experiment 3.
  
• 
  Experiment 6: Combination of both schemes lead to small improvements for YCbCr relative to experiment 1 and small improvements for RGB content relative to experiment 5. Still the performance for inter-predicted configurations is lower than the performance of the scheme in experiment 3. The combination results in higher performance for screen content.
  

After repeating the test with the QP offset set to 6, the following were observed:

• 
  Experiment 1: The performance for YC_bC_r is improved relative to experiment 1 for RGB content and the bit allocation between the components are similar to that in experiment 3.
  
• 
  Experiment 3: Similar results can be observed relative to the original experiment 3.
  

• 
  Backward-driven: The LM-based techniques require a parameter derivation at both decoder and encoder. The complexity is increased consequently at both encoder and decoder.
  
• 
  Forward-driven: The appropriate mode is transmitted in the bit stream. Encoder complexity is increased but decoder complexity is mostly maintained.
  

Overall conclusions provided in summary report:

• 
  LM-based (Experiment 1, 4, 5):
  
  • 
    Somewhat more complexity than forward-driven schemes.
    
  • 
    Achieve coding improvement for YC_bC_r sequences (max. 2% and about 1% for inter-predicted GOP structures).
    
• 
  Forward-driven (Experiment 3):
  
  • 
    Higher coding improvement in the context of colour space transformation.
    
  • 
    Especially for screen content RGB.
    
• 
  ILP and LMC:
  
  • 
    ILP results in higher coding improvement for inter-predicted GOP structures relative to LMC in the context of colour space transformations.
    
  • 
    LMC results in coding improvement for YC_bC_r sequences while ILP doesn’t show any effects.
    
• 
  Combined techniques:
  
  • 
    Combining LM-based ILP and LMC results in best performance for RGB screen content.
    
  • 
    The improvement for YC_bC_r sequences is maintained and the performance of ILP on RGB content can be achieved.
    
• 
  QpOffset for chroma:
  
  • 
    A QpOffset for chroma results in higher YC_bC_r performance for all schemes
    
  • 
    For the anchor itself, only a bit allocation effect is observed
    

• 
  ILP shows no gain/loss for YCbCr sequences.
  
• 
  Similar results for LMC relative to previous meeting cycles – small modification for 4:2:2 only.
  
• 
  LM-based approaches achieve gain for YCbCr sequences () but less performance for RGB.
  
• 
  ILP can be applied for inter.
  
• 
  Additional bit depth of ILP unnecessary.
  

• 
  It was asked about the interaction with other techniques when coding screen content.
  
• 
  For RGB, it was commented that external conversion to YUV is an alternative.
  
• 
  There was some questioning of whether PSNR is measured in the appropriate space – whether PSNR should be measured in RGB domain or in YUV domain?
  
• 
  Should deblocking be adjusted to account for the QP offset effect? That hadn't been explored.
  
• 
  It was suggested to consider using both of the first two components to predict the third. However, another participant commented that the B component is usually noisy, and this usually doesn't help.
  

• 
  For YCbCr natural content, there is gain for LM approaches (but this has substantial complexity for both encoder and decoder).
  
• 
  LM chroma gain for YCbCr is about 2% for intra, 1% for RA, 0.2% for LD.
  
• 
  LM is only for intra, so its benefit is primarily for the AI case. ILP is not just for all-intra.
  
• 
  For RGB content, the non-LM approaches are better (this one requires mode selection in the encoder, but is not so difficult in the decoder). However, has been agreed that RGB is not so high priority in our current work, unless we change our mind about that, this diminishes the potential interest in the ILP scheme.
  
• 
  YCbCr has a bit allocation effect. External YCbCr conversion has a similar effect as ILP; any additional observed gain is primarily from the chroma QP offset effect.
  
• 
  There are two closely-related non-RCE contributions: N0223 and N0266. One allows negative slope values for LM chroma, and shows gain for YCbCr.
  

2. RCE1 primary contributions

3. RCE1 cross checks

2. 
   
   Directory: sc29 -> open -> 29view
   29view -> International organisation for standardisation organisation internationale de normalisation
   29view -> International organisation for standardisation organisation internationale de normalisation
   
   
   
   Download 8.47 Mb.
   
   Share with your friends: